Repository navigation
feat(routing): add opt-in bandit route-order recommendations - #49
Conversation
Behind BANDIT_MODE (off, shadow or recommendation; default off), build task/model cells from stored evaluation results and nonce-protected administrator feedback, gate them on sample count, decay and the evaluation noise floor, and propose at most a one-position move in an automatic route's eligible order. Neither mode calls a provider or writes route policy; a proposal is applied only through the reviewed configuration snapshot apply with its revision check. Unknown cost or quality never ranks as favourable.
|
You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard. |
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configuration
You can disable this status message by setting the Use the checkbox below for a quick retry:
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Deploying with
|
| Status | Name | Latest Commit | Updated (UTC) |
|---|---|---|---|
| ❌ Deployment failed View logs |
multillm-proxy | 64037f4 | Oct 09 2026, 01:27 AM |
2037c03
into
integrate/gateway-waves-1-4
Summary
Adds opt-in route-order recommendations behind
BANDIT_MODE:off(the default),shadoworrecommendation. With it off, existing evaluation proposals, the shadow apply route and request dispatch are unchanged, and the two new admin routes return 404.POST /admin/workbench/shadow/proposereturnsbase_revision,eligible_order_before,eligible_order_after, the evidence (sample counts, coverage, quality, measured cost, 95% intervals) and the uncertainty. A proposal moves at most one position, and a fixed seed gives the same result.Details are in
docs/bandit-recommendations.md.Shared registrations
BANDIT_MODEto the Container env keys.app.post('/admin/workbench/shadow/bandit/nonce')andapp.post('/admin/workbench/shadow/bandit/feedback')to the Flask route inventory. Both are administrator-only dashboard routes, protected by CSRF, and dispatch to no provider.Tests
tests/test_bandit_recommendations.pycovers:npm run test:worker: 1,460 passed.npm run test:integration: 7 passed.test:deploy, free routes, client headers and thewrangler deploy --dry-runbundle all pass.CI notes
python/nodejobs: the dependency-audit steps fail on every branch, including main. fix(deps): clear the CI dependency audit advisories #42 fixes that.AdmissionCoordinatorDurable Object migration, whichwrangler versions uploadcannot apply. This is expected untilwrangler deployruns on main.This is part of Wave 5. It is based on
integrate/gateway-waves-1-4, the Wave 4 integration branch. The README line comes with the Wave 5 integration PR.