Skip to content

fix(serve): emit OPTION_SPECULATIVE_CONFIG so vLLM enables speculative decoding - #6143

Closed
ZealSV wants to merge 1 commit into
aws:masterfrom
ZealSV:fix/spec-decoding-vllm-config
Closed

fix(serve): emit OPTION_SPECULATIVE_CONFIG so vLLM enables speculative decoding#6143
ZealSV wants to merge 1 commit into
aws:masterfrom
ZealSV:fix/spec-decoding-vllm-config

Commits

Commits on Jul 31, 2026