Skip to content

fix: re-register 16 dropped evals; review-rigor follow-ups - #203

Merged
cahenesy merged 3 commits into
masterfrom
fix/review-rigor-followups
Oct 15, 2026
Merged

cahenesy merged 3 commits into
masterfrom
fix/review-rigor-followups

Conversation

@cahenesy

Copy link
Copy Markdown
Owner

Follow-ups from the review-rigor build (#200–#202), plus a gate gap found while fixing them. Plugin 3.57.0 → 3.57.1.

The gate gap: 16 evals never ran

scripts/ci-checks.sh runs only tests/implement-gate.test.sh, and the aggregator's eval list lost 16 evals when the coprocess runner was retired (TDD 0063, Aug 2026). Since then, bounded-tdd-scope, md-parser, token-spend-reduction, evaluation-rubric, markers, interactive-draft-persistence and ten others never gated a build. All 16 pass today.

  • They are registered again in REGISTERED_EVALS.
  • A new [registry] check fails the aggregator when any tests/*.test.sh is missing from the list. As a negative control, a probe eval left off the list makes the aggregator exit 1 and name it.
  • CONTRIBUTING.md documents the rule.

Review-rigor follow-ups

  • Plugin-internal citations. The design, build and requirements reviewer prompts cite "(FR-55)" and "(ADR 0005)", which are throughline's own records. In a consumer repo those numbers belong to unrelated requirements. Each prompt now says these citations refer to the plugin's design records, and that the reviewer must never look them up in the repo under review or cite them in a finding.
  • /tdd-author step 7b dispatches the design reviewer by its prompt file ($(tl_plugin_root)/agents/design-reviewer.md), not by agent-type name. This matches the build-reviewer dispatch. The model-roles fresh-worker wording is unchanged.
  • /prd-author self-review told authors to "move it to Open questions". But prd-lint flags TBD/TODO on any new line, Open questions included. The bullet now says to move the item as a plain question, without the token. This is 0073 review N3.
  • tdd-lint.sh resolved its lib directory twice (_TL_LINT_LIB and _TL_LINT_LIB_ABS). Now it resolves it once, and both the ux.sh and verdicts.sh sourcing use it. This is 0074 review N1.

Verification

Each fix was test-first: a test(failing) commit, then the fix.

  • reviewer-contracts 147/0, tdd-grounding 29/0, model-roles 87/0, ux-pipeline 61/0, requirements-review 60/0, prd-lint 42/0, releases-manifest green.
  • scripts/ci-checks.sh exits 0, with all 34 evals registered and run.

🤖 Generated with Claude Code

https://claude.ai/code/session_01NpGG21Y2VGGhTQaFr4oshB

cahenesy and others added 3 commits October 15, 2026 09:49
- implement-gate: every tests/*.test.sh must be registered (16 are not;
  ci-checks runs only this aggregator, so they never gate a build)
- reviewer prompts label plugin-internal FR/ADR citations
- /tdd-author 7b dispatches design-reviewer by prompt file
- /prd-author self-review stops routing TBD tokens into Open questions
- tdd-lint resolves its lib dir once

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01NpGG21Y2VGGhTQaFr4oshB
- implement-gate re-registers the 16 evals dropped with the coprocess runner
  (TDD 0063) and adds a [registry] check so the list stays complete;
  CONTRIBUTING documents the rule
- design/build/requirements reviewer prompts label their FR/ADR citations
  as the plugin's own design records, not the reviewed repo's
- /tdd-author 7b dispatches design-reviewer by prompt file, not agent type
- /prd-author self-review: move an open item to Open questions without the
  TBD/TODO token (prd-lint flags it on any new line)
- tdd-lint resolves its lib dir once (_TL_LINT_LIB_ABS folded in)

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01NpGG21Y2VGGhTQaFr4oshB
@cahenesy
cahenesy merged commit 7e62e7c into master Oct 15, 2026
1 check passed
@cahenesy
cahenesy deleted the fix/review-rigor-followups branch October 15, 2026 13:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant