Repository navigation
fix: clearer output found in a live subscription run - #19
Merged
Merged
Conversation
A live run with Codex on a ChatGPT subscription (one task, k=1, nine model calls, all without an API key) went through run, status, diff, judge, eval and apply. Fixes from reading its output: - Codex and subscriptions report no money, so run and status say "spend not reported" instead of "$0.00 spent", which read as free. - eval and apply call the run's result the final harness, as the docs do, and eval's table is aligned. - init --yes no longer prints stray blank lines. Co-Authored-By: Claude Opus 5.5 <[email protected]>
This was referenced Oct 19, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
I ran harness2 for real on a tiny project, using Codex on a ChatGPT subscription: one task fixing a broken
average(), graded by a unittest check, k=1.init --yes --executor codex --auth login→doctor(all ok) →run --dry-run(estimated 9 calls) →run --detach --max-calls 15→status→diff→judge/report(100%) →eval→apply --dry-run.codexrecorded the environment:OPENAI_API_KEYwas absent from everycodex execand was only present forcodex --version.__pycache__bytecode with their fix. The improver found this in the trajectories, and the final AGENTS.md adds a short rule to checkgit statusand drop generated artifacts before finishing. Notes, diff and apply preview all match.Fixes from reading the output:
runandstatusnow say "spend not reported" instead of "$0.00 spent".evalandapplycall the result "final harness", matching the docs. Theevaltable is aligned.init --yesno longer prints stray blank lines.Test plan
ruff🤖 Generated with Claude Code