Repository navigation
docs: correct the load note, CONTRIBUTING's gate, PLAN, the env example, CLI help, and the issue templates - #85
Merged
Merged
Conversation
…le, CLI help, and the issue templates #62: the load summary said every JevBench row "is asked as a one-of-n choice", which is false for an adapter that asks yes/no rows as yes/no questions. It now says each row is asked as the question type it states. The report's "Asked" line read "3 choice asked as failed"; it now reads "3 choice rows failed", and "67 choice rows asked as choice". The example report is regenerated from its command and differs in those two lines and its date. #63: CONTRIBUTING said "All three must pass" above four commands, and named the four test jobs as the whole gate. It now lists the required checks and adds a section on working on the site: the build and its four checks, the golden fixture, regenerating the example report, and the CSP. #64: PLAN listed pushing the tag, going public, the About box and the badge as still to do, said datasets/private/.gitkeep was untracked, and carried a repository description that no longer matched. All three are corrected. #65: .env.example said to copy it to .env, which nothing reads, and listed an Ollama adapter that does not exist. It now says to export the variables, and lists ANTHROPIC_BASE_URL. CONTRIBUTING and the adapter template called generative a home for "any chat model"; it speaks Anthropic's Messages API. #66: the app help ("Choose and configure a decision model") contradicted the README; it now says what the tool measures. --adapter and --semantics list their choices. plumbline adapters marks local_logits when its extra is not installed. The dataset README's command uses uv run python. #67: the adapter template applied the label adapter-config, which does not exist; it applies adapter. A site bug template asks for the page address (inputs included), the browser, and console errors. Fixes #62. Fixes #63. Fixes #64. Fixes #65. Fixes #66. Fixes #67. Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #62. Fixes #63. Fixes #64. Fixes #65. Fixes #66. Fixes #67.
#62: the load note and the "Asked" line.
#63: CONTRIBUTING.
#64: PLAN. It no longer lists pushing the tag, going public, the About box or the badge as still to do. It no longer calls
datasets/private/.gitkeepuntracked, and its repository description matches the live one.#65:
.env.exampleand the generative arm..env.examplesaid to copy it to.env, which nothing reads, and listed an Ollama adapter that doesn't exist. It now says to export the variables, and listsANTHROPIC_BASE_URL.generativea home for "any chat model". It speaks Anthropic's Messages API only, and both now say so.#66: CLI help.
--adapterand--semanticslist their valid values.plumbline adaptersprintslocal_logits (needs the local extra: uv sync --extra local)when the extra is missing.uv run python.#67: issue templates. The adapter template applied
adapter-config, a label that doesn't exist; it now appliesadapter. A new site bug template asks for the page address (including its inputs), the browser, and console errors.Checked
ruff,mypy --strict, and the fullpytestsuite pass.--checks are clean.Separately, as #63 suggests, once this merges I'll make the quickstart, prose, wheel and site checks required in the
mainruleset. They pass on every PR, and CONTRIBUTING now describes them as required.🤖 Generated with Claude Code