Repository navigation
evals: keep the auth-death record in sealed run state #211
Description
From PR #198 round 3. grade() writes verdict.json (grade_boundary.py ~792) before grade_run adds the error record (live.py ~347-350). A kill in that ~11 ms window, or a grade refusal after an auth death, leaves a verdict without error; the report then counts the run as INCONCLUSIVE and live.py grade cannot restore ERROR. Reproduced by the round-3 fix lane. Keep the death record in the sealed controller state so grade() carries it. Also: live.py grade a b c stops at the first refusal (pre-existing), and _authorize_retained would lose error (test-only caller).
Activity
mdsmithaustin commentedon Oct 15, 2026
Fixed by #250. The merged change preserves the sealed error state through verdict publication and retained grading, and processes each requested grading target independently. Validation included native fault scenarios and CLI subprocess checks. Historical replay and environment verification gaps remain tracked separately and are not claimed resolved here.