Skip to content

feat(ai): delegate LLM drafts to adaptive orchestration - #900

Open
seonghobae wants to merge 8 commits into
mainfrom
agent/adaptive-orchestrator-default
Open

feat(ai): delegate LLM drafts to adaptive orchestration#900
seonghobae wants to merge 8 commits into
mainfrom
agent/adaptive-orchestrator-default

Conversation

@seonghobae

@seonghobae seonghobae commented Aug 16, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • explicitly include contextual-orchestrator auto in reverse-engineering and index-design LLM draft requests;
  • preserve pg-erd-cloud authorization, schema semantics, prompt construction, and draft-review boundaries;
  • add a permanent contract test, integration documentation, ADR-0010, and CHANGELOG entry where present.

The branch workflow stages the contract first, proves the red/green transition when needed, runs the complete backend suite, verifies syntax and patch integrity, removes itself, and publishes only the verified source commit.


Open in Devin Review

Summary by CodeRabbit

  • 변경 사항

    • LLM 채팅 요청이 orchestration_mode: "auto"를 사용하도록 업데이트되었습니다.
    • 요청 처리 시 상황에 맞는 모델 선택, 워크플로 깊이, 라우팅 및 검증 방식이 자동으로 결정됩니다.
  • 문서

    • 자동 오케스트레이션 정책과 통합 방식에 대한 안내 및 아키텍처 결정 기록을 추가했습니다.
  • 테스트

    • LLM 요청에 자동 오케스트레이션 모드가 전송되는지 검증하도록 테스트를 보강했습니다.

@coderabbitai

coderabbitai Bot commented Aug 16, 2026

Copy link
Copy Markdown

Review Change Stack

Warning

Review limit reached

@seonghobae, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 20 minutes

Limit details: You’ve used the included review currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

How can I continue?

Wait for the limit to reset, then comment @coderabbitai review or push new commits to the PR.

An organization admin can change what happens after included review limits in Billing.

How do review limits work?

CodeRabbit enforces per-developer PR review limits within each organization.

For paid Pro and Pro+ reviews, CodeRabbit uses a developer's included PR review attempts over the past 7 days to set the current hourly allowance. At typical activity levels, the full plan allowance applies. Higher sustained activity can lower the allowance until earlier attempts leave the 7-day window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 76b1a204-420d-4220-9d13-16ed34788b7d

📥 Commits

Reviewing files that changed from the base of the PR and between b688317 and c0b105c.

⛔ Files ignored due to path filters (1)
  • frontend/package-lock.json is excluded by !**/package-lock.json
📒 Files selected for processing (3)
  • docs/adr/0010-adaptive-contextual-orchestrator-default.md
  • docs/llm-orchestrator-integration.md
  • frontend/package.json
📝 Walkthrough

Walkthrough

LLM 요청에 orchestration_mode: "auto"를 추가했습니다. 테스트는 해당 값을 검증합니다. ADR, 통합 문서, 변경 기록은 contextual-orchestrator 기반 정책을 설명합니다.

Changes

LLM 오케스트레이션 정책

Layer / File(s) Summary
LLM 요청 모드와 테스트
backend/app/spec/llm.py, backend/tests/test_reversing_llm.py
LLM 요청에 orchestration_mode: "auto"를 추가했습니다. 테스트는 전송된 요청에서 해당 값을 확인합니다.
정책 문서와 변경 기록
docs/adr/0010-adaptive-contextual-orchestrator-default.md, docs/llm-orchestrator-integration.md, CHANGELOG.md
contextual-orchestrator의 자동 오케스트레이션 정책과 애플리케이션 책임 범위를 문서화했습니다. 통합 문서와 변경 기록을 갱신했습니다.

Estimated code review effort: 2 (Simple) | ~10 minutes

Merge Risk: 🟡 Moderate · up to b6883

The PR documents a production launch command for adaptive orchestration, but the command omits required admin authentication in split-token serve mode, which could cause deployment or authorization failure; merge should wait for the command to be corrected or explicitly accepted.

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Docstring Coverage ⚠️ Warning Docstring coverage is 0.00% which is insufficient. The required threshold is 80.00%. Docstring coverage is scoped to functions touched by this diff. Analyzed 3 functions across 2 files. (3 skipped: 3 unsupported.) Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (4 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed 제목은 LLM 초안 요청을 adaptive orchestration에 위임하는 주요 변경사항을 정확하고 간결하게 설명합니다.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches 💡 1
📝 Generate docstrings 💡
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch agent/adaptive-orchestrator-default

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@seonghobae

Copy link
Copy Markdown
Collaborator Author

@opencode-agent review

Please review exact current head fec2e30. Re-evaluate this head only; do not transfer predecessor approvals or check evidence.

@opencode-agent

Copy link
Copy Markdown
Contributor

Queued @opencode-agent for PR #900 at head fec2e301bdf93a0847b992307d5f16067476198e. Central exact-name Actions artifacts are the durable dispatch ledger; existing review workflows remain authoritative for the final verdict and failure evidence.

@seonghobae
seonghobae enabled auto-merge August 20, 2026 05:44
@opencode-agent

Copy link
Copy Markdown
Contributor

Queued @opencode-agent for PR #900 at head 87d28b6bbd412055fd4a44a2e472c884fd1b2d60. Central exact-name Actions artifacts are the durable dispatch ledger; existing review workflows remain authoritative for the final verdict and failure evidence.

@opencode-agent
opencode-agent Bot disabled auto-merge August 20, 2026 06:45
@seonghobae
seonghobae enabled auto-merge August 20, 2026 06:57
@opencode-agent

Copy link
Copy Markdown
Contributor

Queued @opencode-agent for PR #900 at head ed12e8d6e2ae75e4591827fe4315d4d7a53b9374. Central exact-name Actions artifacts are the durable dispatch ledger; existing review workflows remain authoritative for the final verdict and failure evidence.

@opencode-agent

Copy link
Copy Markdown
Contributor

Already queued @opencode-agent on this exact request for PR #900 at head ed12e8d6e2ae75e4591827fe4315d4d7a53b9374. Central exact-name Actions artifacts are the durable dispatch ledger; existing review workflows remain authoritative for the final verdict and failure evidence.

2 similar comments
@opencode-agent

Copy link
Copy Markdown
Contributor

Already queued @opencode-agent on this exact request for PR #900 at head ed12e8d6e2ae75e4591827fe4315d4d7a53b9374. Central exact-name Actions artifacts are the durable dispatch ledger; existing review workflows remain authoritative for the final verdict and failure evidence.

@opencode-agent

Copy link
Copy Markdown
Contributor

Already queued @opencode-agent on this exact request for PR #900 at head ed12e8d6e2ae75e4591827fe4315d4d7a53b9374. Central exact-name Actions artifacts are the durable dispatch ledger; existing review workflows remain authoritative for the final verdict and failure evidence.

@seonghobae
seonghobae force-pushed the agent/adaptive-orchestrator-default branch from ed12e8d to d231b7d Compare August 20, 2026 18:39

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Open in Devin Review

@seonghobae

Copy link
Copy Markdown
Collaborator Author

Exact-head review request for b688317.

  • Restored the current branch intended auto orchestration contract: orchestration_mode auto is sent to the OpenAI-compatible gateway; contextual-orchestrator accepts that field and strips it before upstream forwarding.
  • Fixed the integration guide so it no longer claims the change is configuration-only.
  • Backend focused test: 8 passed.
  • Backend full suite: 387 passed.
  • Ruff and CodeGraph sync completed.
  • No approvals, dismissals, admin merge, or bypass commands were used. Please review this exact HEAD and apply the normal required checks/review gate. @opencode-agent

coderabbitai[bot]

This comment was marked as resolved.

@opencode-agent
opencode-agent Bot disabled auto-merge August 20, 2026 21:52
@seonghobae

Copy link
Copy Markdown
Collaborator Author

Current HEAD 검증: c0b105c

  • ADR-0010에 Omidvar와 Sakana Fugu 연구의 adaptive routing, verification, cost-aware orchestration 근거 요약 추가
  • contextual-orchestrator production serve 명령을 CLI 계약에 맞는 auth-token 단일 모드로 수정
  • nanoid high advisory 대응 override 및 lockfile 정합화
  • backend 전체 pytest: 387 passed; LLM focused test: 8 passed; mypy 및 변경 파일 Ruff 통과
  • frontend 전체 28 files / 201 tests, typecheck, build 통과; npm audit high 0
  • CodeGraph sync 및 git diff check 통과
  • 전체 backend Ruff에는 origin/main의 기존 미사용 rel_by_oid 1건이 남아 있으며 PR #772에서 제거 중입니다. 이 PR에서는 변경 범위 밖 코드를 임의로 중복 수정하지 않았습니다.

이 코멘트는 위 exact HEAD의 로컬 검증 증거입니다. GitHub required checks와 독립 승인 후 일반 merge를 진행합니다.

@opencode-agent

Copy link
Copy Markdown
Contributor

Queued @opencode-agent for PR #900 at head c0b105cc0815ba16fd29e7b356b90600fff1f480. Central exact-name Actions artifacts are the durable dispatch ledger; existing review workflows remain authoritative for the final verdict and failure evidence.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant