Repository navigation
perf(gdn): submit scoped prefill through Omega-checked batches - #261
Draft
drakestapleton wants to merge 4 commits into
Draft
drakestapleton wants to merge 4 commits into
drakestapleton wants to merge 4 commits into
Conversation
Co-authored-by: Drake Stapleton <[email protected]>
Co-authored-by: Drake Stapleton <[email protected]>
Co-authored-by: Drake Stapleton <[email protected]>
Co-authored-by: Drake Stapleton <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This candidate submits the existing GDN preparation, scan and output operations as one ordered command list, reusing current staging and one list per object. Omega owns admission, recording order, completion checks and timestamp validation. Kernel arithmetic, output poison checks and recurrent-state layouts remain unchanged. The explicit scoped entry uses mode 0 for ordinary behavior and mode 1 for batching; other modes refuse. API version advances to 0.14.0.
The complete 85-target host suite passes on production commit 09dbc67. The later test-only timing-selector correction e74b047 passes the full dispatch target, including its four caller/option combinations and a reverted-source mutation. Production transport and Omega policy are unchanged between those revisions. The full suite was not repeated at the test-only revision.
Physical checks pass in timed and optional-untimed arms, 54 checks each, covering the independent GDN reference, carried state and next decode. The BF16 state arm passes eight checks. All six complete-model score vectors and selected tokens match in ordinary, untimed-batch and timed-batch arms. A second checker compares all 18 vectors with frozen reference files and rejects a flipped score bit; deliberately nonfinite model output is also refused before a passing row. The follow-up receipt pins source, binaries, commands and original logs.
Speed remains unqualified. These shared-machine screens show mixed short-input timings and little long-input improvement. The additional balanced comparison was cancelled before starting when Drake requested wrapping up and publishing the best verified result. This candidate is excluded from the selected Ribbon result in Core #899. This is production Omega/native behavior selected by an external measuring wrapper; Core GDN integration and server behavior are NOT_RUN. No default or deployed service changes.
Earlier targeted proof remains in the host receipt: 1,440 admission cases, 34,560 transitions, 12,005 timestamp cases, eight malformed-length refusals, 11 Omega source mutants, eight transport mutants, API/portability/semantic-version checks and negative controls. The selector receipt preserves its reproduced failure and correction.
Stacked on #260 and its dependencies; related to aien-dev/aien-sovereign-core-mv#710. C changes maintain existing transport; new policy is Omega lowered through the unchanged pinned Bridge. Python and fake C transport are external verification instruments. No new production dependency. Crumb and whitespace checks pass; Apache-2.0 WITH LLVM-exception notices retained. Independent review requested before merge; draft while integration and performance decisions remain open.