Skip to content

fix(llama): keep the vLLM KV cache in scanned Llama decoder layers - #6002

Closed
chiajunglien wants to merge 1 commit into
mainfrom
emma/fix-llama31-vllm-decode-greedy
Closed

chiajunglien wants to merge 1 commit into
mainfrom
emma/fix-llama31-vllm-decode-greedy

fix(llama): keep the vLLM KV cache in scanned Llama decoder layers

8241589
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Nov 5, 2026 in 8s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ 8241589 Author: @chiajunglien <em*****en​@cienet.com>, <em****en​@google.com>

(Only the first commit for a unique contributor is listed.)