Skip to content

feat(engine): overlap decode steps with asynchronous token handoff - #524

Open
qinyiqun wants to merge 2 commits into
InfiniTensor:mainfrom
qinyiqun:decode
Open

feat(engine): overlap decode steps with asynchronous token handoff#524
qinyiqun wants to merge 2 commits into
InfiniTensor:mainfrom
qinyiqun:decode

Commits

Commits on Jul 11, 2026

Commits on Aug 5, 2026