Skip to content

fix(llama): keep the vLLM KV cache in scanned Llama decoder layers - #6002

Closed
chiajunglien wants to merge 1 commit into
mainfrom
emma/fix-llama31-vllm-decode-greedy
Closed

chiajunglien wants to merge 1 commit into
mainfrom
emma/fix-llama31-vllm-decode-greedy

Commits

  1. Commits on Nov 5, 2026