Repository navigation
perf(qgemm): add checked Omega work ordering - #258
Closed
drakestapleton wants to merge 5 commits into
Closed
drakestapleton wants to merge 5 commits into
drakestapleton wants to merge 5 commits into
Conversation
5 of 6 tasks
aien-spark
added a commit
that referenced
this pull request
Nov 2, 2026
#259 #260) native-x86-host on this head hit its 40 min timeout (cancelled, not failed); the same code at 9ade9f5 (diff since: evidence JSON + .crumb only) passed it in 34 min, and main e6598c7 passes it. All 10 other checks green on the merge with main. Independent review APPROVE-WITH-NOTES (see PR comment).
Collaborator
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The combined 128-row/group4 setting preserved every output-score bit and next-token choice in all six frozen 27B reading cases. The repeated 5,017-token read took 18.817 seconds with the 64-row/group0 comparison and 14.348 seconds with the selected combination. The 128-row/group5 alternative took 15.379 seconds. These are shared-machine diagnostics, not quiet-machine qualification; production defaults remain unchanged.
Omega owns the bounded launch grid and complete coordinate-remapping instruction plan. The existing emitter interprets those primitive instructions. This restores the work-order mechanism examined in historical Omega 86211a399 without changing arithmetic or the 45-cycle matrix wait. Runtime API 0.10.0 adds an experimental setter. Stacked on #257; its cache-budget correction is included.
Validation: the initial work-order source passed all 78 host targets and the API version gate, 137 independent plan cases, five Omega source mutants, matrix simulation, and default-code byte identity. After merging the cache correction, targeted cache admission, matrix simulation, Omega fault tests and API version checks passed again. The complete combined host rerun passed all 78 targets and the API version gate; see om/prefill-shape/order-combined-full-host-validation.json. Full-model scores match for the tested 64-row group0/3/4/5 and 128-row group0/4/5 settings.
Source/binary identities and complete comparisons are in om/prefill-shape/order-combined-validation.json and order-validation.json. Per-model serving integration, full serving qualification and five quiet alternating pairs remain. Coordinated Ribbon evidence is in aien-sovereign-core-mv#898. No deployment or performance qualification is claimed.
Apache-2.0 WITH LLVM-exception notices retained; no new production dependency.