Description
LightLLM through 1.2.0 contains a remote code execution vulnerability in the KV-transfer worker when started with --pd_trans_mode nccl, which exposes an unauthenticated RPyC control channel that deserializes attacker-supplied data. Attackers can send malicious pickled objects to the exposed RPyC ThreadedServer to execute arbitrary code with the privileges of the LightLLM service account.
Affected products
| Vendor | Product | Affected | Fixed |
|---|---|---|---|
| ModelTC | LightLLM | ≤ 1.2.0 | — |
References
- GitHub Issue #1590 issue-tracking
- https://github.com/ModelTC/lightllm/blob/v1.2.0/lightllm/server/router/model_infer/mode_backend/pd/nccl_kv_transporter.py#L437-L461 technical-description
- https://github.com/ModelTC/lightllm/blob/v1.2.0/lightllm/server/router/model_infer/mode_backend/pd/nccl_kv_transporter.py#L411-L415 technical-description
- https://github.com/ModelTC/lightllm/blob/v1.2.0/lightllm/server/router/model_infer/mode_backend/pd/nccl_kv_transporter.py#L247-L249 technical-description
- https://github.com/ModelTC/lightllm/blob/v1.2.0/lightllm/server/router/model_infer/mode_backend/pd/kv_transporter.py#L20-L36 technical-description
- https://github.com/ModelTC/lightllm product
- VulnCheck Advisory: LightLLM through 1.2.0 Unauthenticated Remote Code Execution via NCCL PD RPyC Control Channel third-party-advisory