V0.9.1/evals - #39

Open

gimlichael wants to merge 74 commits into

mainfrom

Commits on Aug 21, 2026

💬 update repository policies and community guidance
aicia-bot
committed
779b9db
🔨 add skill evaluation runner infrastructure
aicia-bot
committed
b616b00
💬 update installation and runner guidance
aicia-bot
committed
9e416d2
🔨 enhance runner isolation assessment and add cline support
aicia-bot
committed
a135399
✨ introduce github copilot eval runner
aicia-bot
committed
dc29f68
🔧 update eval infrastructure for github copilot support
aicia-bot
committed
e29cbfa
📝 document github copilot reference configuration and eval isolation
aicia-bot
committed
fe1070c
🧱 update github copilot runner for stdin prompt delivery
aicia-bot
committed
3077725

Commits on Aug 22, 2026

Commits on Aug 23, 2026

🔨 refine eval infrastructure with result bridging and manifest
aicia-bot
committed
b0f395f
💬 clarify eval completion gate validation
aicia-bot
committed
4f0a341
🔨 update eval package readme generation
aicia-bot
committed
c5516b0

Commits on Aug 24, 2026

👷 add native worker orchestration to eval runner protocol
aicia-bot
committed
24838e2
👷 refine native worker orchestration and terminal evidence validation
aicia-bot
committed
53aec32
♻️ refactor git-visual-commits auto-approval guidance
aicia-bot
committed
f0ce94b
✅ add assertions for git-visual-commits auto-approval
aicia-bot
committed
0d54ec8
📝 clarify auto-approval in agent operation safeguards
aicia-bot
committed
1c3bc2a
♻️ clarify native delegated worker protocol in eval orchestrator guidance
Eval Worker
committed
3da4977
📝 clarify eval orchestration requirements and Codex model defaults
aicia-bot
committed
05dc60c
♻️ implement parallel eval orchestration across runners
aicia-bot
committed
3341cb6
♻️ harden parallel evaluation orchestration
aicia-bot
committed
e07fc28
📝 clarify evaluation orchestration requirements for parallel execution
aicia-bot
committed
88a4811
♻️ harden manifest result validation with sha256 and incompatible checks
Eval Worker
committed
fb261d2

Commits on Aug 25, 2026

🔥 remove cline eval runner support

aicia-bot
authored and
Eval Worker
committed
55a5201
✨ add native worker result handling infrastructure
aicia-bot
committed
b3f8045
✅ update eval runner conformance tests
aicia-bot
committed
676e193
💬 update repository documentation for eval changes
aicia-bot
committed
b3804ac
🔥 remove cline eval runner support from changelog
Eval Worker
committed
cc27e68
💬 clarify orchestrator/runner dispatch mechanism
aicia-bot
committed
1302fa0
🔧 implement eval runner dispatch owner pattern
aicia-bot
committed
e22f3bd
🔧 update skill eval tooling for dispatch owner
aicia-bot
committed
ca3e763
✨ add runner-owned arm execution infrastructure
aicia-bot
committed
9b825a3
✅ add runner-owned arm conformance tests
aicia-bot
committed
03c6eb9
📝 document runner-owned arm execution model
aicia-bot
committed
4aa13eb
📝 clarify phase 1 preflight boundary in evaluation dispatch
aicia-bot
committed
da63695
🧱 implement phase 1 preflight boundary for runner-owned dispatch
aicia-bot
committed
4266c45
✅ add tests for phase 1 runner-owned dispatch preflighting
aicia-bot
committed
c5fe974

Commits on Aug 27, 2026

🔧 enhance eval runner infrastructure and protocol
aicia-bot
committed
fed4607
🔧 enhance skill evaluation tooling
aicia-bot
committed
ff87852
✅ add skill evaluation definitions
aicia-bot
committed
44dc09a
📝 update repository documentation
aicia-bot
committed
b9205d5
✨ add multi-turn same-session support for copilot and opencode
aicia-bot
committed
e774cd6
🔧 enhance evaluation runner infrastructure
aicia-bot
committed
35264c9

Commits on Aug 28, 2026

yolo
gimlichael
committed
a63eecc
🔨 enhance eval runner infrastructure with timeout and concurrency
aicia-bot
committed
c79449d
♻️ improve eval runner timeout handling
aicia-bot
committed
8cbec94
✅ update runner conformance for timeout regression testing
aicia-bot
committed
b9a667c
♻️ improve eval runner timeout handling
aicia-bot
committed
060f08f
🐛 calculate phase 1 eval allowance with serial preflight
aicia-bot
committed
87b9687
Merge branch 'v0.9.1/evals' of https://github.com/codebeltnet/agentic into v0.9.1/evals
gimlichael
committed
cfc5698
🐛 fix eval-runner terminal status preservation and evidence validation
aicia-bot
committed
c0fc505
✅ add eval-runner terminal status regression tests
aicia-bot
committed
df76d4a

Commits on Aug 29, 2026

♻️ implement Phase 1 completion gates for orchestration
aicia-bot
committed
5eb61ef

Commits on Aug 30, 2026

Commits on Aug 31, 2026

♻️ refactor phase1 eval-runner controller with common module
aicia-bot
committed
dadc7c5
✅ enhance eval runner tests for Windows Job Object scenarios
aicia-bot
committed
7146144
🐛 fix iteration-11 bug: resolve writable temp in model-free probes
aicia-bot
committed
e1aee04
📝 update runner handoff guidance
aicia-bot
committed
75ad1e3
🏗️ simplify runner-owned phase 1 execution
aicia-bot
committed
f24a244
✅ update runner-owned phase 1 regression coverage
aicia-bot
committed
8666d0a