Skip to content
OpenAdvisories
Medium · 6.2 CVE-2024-8939 EUVD-2024-2887GHSA-wc36-9694-f9rfPYSEC-2026-2025

Vllm: denials of service in vllm json web api

Published Sep 17, 2024 · Updated Nov 20, 2025 · Assigned by redhat

Description

A vulnerability was found in the ilab model serve component, where improper handling of the best_of parameter in the vllm JSON web API can lead to a Denial of Service (DoS). The API used for LLM-based sentence or chat completion accepts a best_of parameter to return the best completion from several options. When this parameter is set to a large value, the API does not handle timeouts or resource exhaustion properly, allowing an attacker to cause a DoS by consuming excessive system resources. This leads to the API becoming unresponsive, preventing legitimate users from accessing the service.

Affected products

VendorProductAffectedFixed
— vllm < 0.5.0.post1 0.5.0.post1
Red Hat Red Hat Enterprise Linux AI (RHEL AI) — —

Affected packages

EcosystemPackageAffectedFixedRecord
PyPI vllm <= 0.5.0.post1 — GHSA-wc36-9694-f9rf

References