Add HCA Static Compilation for Splash Attention [Deepseek v4] - #4924

Draft

octatrifan wants to merge 50 commits into

mainfrom

octatrifan-dsv4-hca-static

Commits on Jul 17, 2026

Support dynamic Tokamax Flash Attention for DeepSeek-V4 HCA and CSA layers
octatrifan
committed
cf4d118
Remove deepseek4-small config and registration
octatrifan
committed
b108e56
Add unit tests for CompressedAttention (DeepSeek-V4) compilation and execution
octatrifan
committed
0399b7d

Commits on Jul 18, 2026

Enable Flash Attention support for DeepSeek-V4 (MLA) and add HCA/CSA unit tests
octatrifan
committed
c48a8f8

Commits on Jul 20, 2026

Commits on Jul 24, 2026

Support non-multiple-of-128 sequence lengths in DeepSeek-V4 HCA/CSA Flash Attention
octatrifan
committed
3d70121

Commits on Jul 25, 2026

Revert experimental rotary_embedding.head_dim check in favor of stock PR 4488 config.head_dim
octatrifan
committed
a3ccb02

Commits on Jul 26, 2026

Commits on Jul 27, 2026

Commits on Jul 28, 2026

Commits on Jul 29, 2026

Commits on Aug 3, 2026

Implement static Splash Attention compilation path for DeepSeek-V4 HCA
octatrifan
committed
6a5b05b

Commits on Aug 5, 2026

Fix TopKMoE router parity test tie-breaking on TPU and add TPU numerical tolerance docstring note
octatrifan
committed
3883766

Commits on Aug 8, 2026

Merge origin/main into octatrifan-dsv4-flash-attention and resolve conflicts
octatrifan
committed
73a50ab

Commits on Aug 10, 2026

Commits on Aug 11, 2026

Commits on Aug 12, 2026

Commits on Aug 14, 2026

Commits on Aug 17, 2026