Skip to content

[#19527][fix] Account for beam width when sizing CUDA graph warmup KV requests - #19568

Open
LiRunGuo wants to merge 2 commits into
NVIDIA:mainfrom
LiRunGuo:fix/beam-search-cuda-graph-warmup-kv-sizing
Open

[#19527][fix] Account for beam width when sizing CUDA graph warmup KV requests#19568
LiRunGuo wants to merge 2 commits into
NVIDIA:mainfrom
LiRunGuo:fix/beam-search-cuda-graph-warmup-kv-sizing

[#19527][fix] Skip beam-search warmup batches below one token; extend…

9949eb1
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 5, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO