Skip to content

qwen CUDA: --prompt-precision int8, prompt matmuls on int8 activations (cold prefill 20-27% shorter) - #1176

Closed
BobClawblaw wants to merge 26 commits into
ashhart:mainfrom
BobClawblaw:q35-prompt-int8
Closed

BobClawblaw wants to merge 26 commits into
ashhart:mainfrom
BobClawblaw:q35-prompt-int8

qwen CUDA: --prompt-precision int8, prompt matmuls on int8 activation…

18d9345
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
zig-windows
succeeded Oct 22, 2026 in 9m 43s