Skip to content

Let splash attention exceed 524,288 tokens when packing is off - #4929

Open
WandLZhang wants to merge 2 commits into
AI-Hypercomputer:mainfrom
WandLZhang:splash-unpacked-smem
Open

Let splash attention exceed 524,288 tokens when packing is off#4929
WandLZhang wants to merge 2 commits into
AI-Hypercomputer:mainfrom
WandLZhang:splash-unpacked-smem

Drop the segment ids before the early returns

83f18aa
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Aug 18, 2026 in 8s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

83f18aa Author: @WandLZhang <wil******ng​@google.com>

(Only the first commit for a unique contributor is listed.)