Skip to content

feat(engine): overlap decode steps with asynchronous token handoff - #524

Open
qinyiqun wants to merge 2 commits into
InfiniTensor:mainfrom
qinyiqun:decode
Open

feat(engine): overlap decode steps with asynchronous token handoff#524
qinyiqun wants to merge 2 commits into
InfiniTensor:mainfrom
qinyiqun:decode

feat(engine): overlap decode with asynchronous token handoff

ddb2663
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
ruff
succeeded Aug 5, 2026 in 8s