Skip to content
OpenAdvisories
Medium · 6.5 CVE-2026-44223 EUVD-2026-29800GHSA-83vm-p52w-f9pwPYSEC-2026-145

vLLM: extract_hidden_states speculative decoding crashes server on any request with penalty parameters

Published May 12, 2026 · Updated Jun 22, 2026 · Assigned by GitHub_M

Description

vLLM is an inference and serving engine for large language models (LLMs). From 0.18.0 to before 0.20.0, the extract_hidden_states speculative decoding proposer in vLLM returns a tensor with an incorrect shape after the first decode step, causing a RuntimeError that crashes the EngineCore process. The crash is triggered when any request in the batch uses sampling penalty parameters (repetition_penalty, frequency_penalty, or presence_penalty). A single request with a penalty parameter (e.g., "repetition_penalty": 1.1) is sufficient to crash the server. This vulnerability is fixed in 0.20.0.

Affected products

VendorProductAffectedFixed
vllm-project vllm >= 0.18.0, < 0.20.0 —

Affected packages

EcosystemPackageAffectedFixedRecord
PyPI vllm >= 0.18.0, < 0.20.0 0.20.0 GHSA-83vm-p52w-f9pw

Advisories 1

References