Skip to content

perf(gdn): submit scoped prefill through Omega-checked batches - #261

Draft
drakestapleton wants to merge 4 commits into
perf/q38-attention-mirrorfrom
perf/q38-gdn-batch
Draft

drakestapleton wants to merge 4 commits into
perf/q38-attention-mirrorfrom
perf/q38-gdn-batch

Conversation

@drakestapleton

@drakestapleton drakestapleton commented Nov 1, 2026 •

Copy link
Copy Markdown
Contributor

This candidate submits the existing GDN preparation, scan and output operations as one ordered command list, reusing current staging and one list per object. Omega owns admission, recording order, completion checks and timestamp validation. Kernel arithmetic, output poison checks and recurrent-state layouts remain unchanged. The explicit scoped entry uses mode 0 for ordinary behavior and mode 1 for batching; other modes refuse. API version advances to 0.14.0.

The complete 85-target host suite passes on production commit 09dbc67. The later test-only timing-selector correction e74b047 passes the full dispatch target, including its four caller/option combinations and a reverted-source mutation. Production transport and Omega policy are unchanged between those revisions. The full suite was not repeated at the test-only revision.

Physical checks pass in timed and optional-untimed arms, 54 checks each, covering the independent GDN reference, carried state and next decode. The BF16 state arm passes eight checks. All six complete-model score vectors and selected tokens match in ordinary, untimed-batch and timed-batch arms. A second checker compares all 18 vectors with frozen reference files and rejects a flipped score bit; deliberately nonfinite model output is also refused before a passing row. The follow-up receipt pins source, binaries, commands and original logs.

Speed remains unqualified. These shared-machine screens show mixed short-input timings and little long-input improvement. The additional balanced comparison was cancelled before starting when Drake requested wrapping up and publishing the best verified result. This candidate is excluded from the selected Ribbon result in Core #899. This is production Omega/native behavior selected by an external measuring wrapper; Core GDN integration and server behavior are NOT_RUN. No default or deployed service changes.

Earlier targeted proof remains in the host receipt: 1,440 admission cases, 34,560 transitions, 12,005 timestamp cases, eight malformed-length refusals, 11 Omega source mutants, eight transport mutants, API/portability/semantic-version checks and negative controls. The selector receipt preserves its reproduced failure and correction.

Stacked on #260 and its dependencies; related to aien-dev/aien-sovereign-core-mv#710. C changes maintain existing transport; new policy is Omega lowered through the unchanged pinned Bridge. Python and fake C transport are external verification instruments. No new production dependency. Crumb and whitespace checks pass; Apache-2.0 WITH LLVM-exception notices retained. Independent review requested before merge; draft while integration and performance decisions remain open.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants