Repository navigation

fix(qwen3.5): capture logprobs on the prefill draw when the think block is prefilled - #780

Open

manueldomke wants to merge 6 commits into

manueldomke:decider-integration

Open

fix(qwen3.5): capture logprobs on the prefill draw when the think block is prefilled#780
manueldomke wants to merge 6 commits into
ROCm:mainfrom
manueldomke:decider-integration

Commits on Oct 20, 2026
- fix: don't count a discarded sample as generated text
  manueldomke
  committed
  2e7e47c
Commits on Oct 21, 2026
- feat(server): report logprobs when the request asks for them
  manueldomke
  committed
  969a1b6
- fix(qwen3.5): stop at max_tokens instead of one token past it
  
  manueldomke
  and
  claude
  committed
  a326a31
- perf(qwen3.5): prefill the empty think block for single-turn models
  
  manueldomke
  and
  claude
  committed
  2e3171a
- fix: prefill again when a request matches the whole history
  
  manueldomke
  and
  claude
  committed
  109ed15
- fix(qwen3.5): capture logprobs on the prefill draw when the think block is prefilled
  
  manueldomke
  and
  claude
  committed
  1d22326