Skip to content

Add wellposed - #111

Closed
suraj-phanindra wants to merge 0 commit into
hellogumbo:mainfrom
suraj-phanindra:add-wellposed
Closed

suraj-phanindra wants to merge 0 commit into
hellogumbo:mainfrom
suraj-phanindra:add-wellposed

Conversation

@suraj-phanindra

@suraj-phanindra suraj-phanindra commented Sep 23, 2026 •

Copy link
Copy Markdown
Contributor

wellposed — https://github.com/suraj-phanindra/wellposed · npx wellposed lint request.json

Checks a Jev request before you send it. Two layers: 40 structural rules that run offline with no API key (a Choice with no none-of-the-above option, backticked state paths that do not resolve, criteria in the wrong shape for the primitive, the context limits), then Jev-on-Jev checks for the things structure cannot settle — whether "none of these" is actually reachable, whether two options overlap, whether the question is answerable from the state given.

Where Jev fits: the semantic layer asks Jev about the request itself, and only for what the free layer cannot decide.

It came out of a measurement rather than an idea. Over 40 requests generated from realistic intents, 0 had syntax errors — the API rejects those with exact field paths — but 16 were semantically ill-posed, and 0 of 11 Choice questions carried a none-of-the-above option. A Choice whose options do not cover the input still picks one, and did so at confidence 1.00 on a live call, which is why a confidence threshold cannot catch that class.

Both layers ship their labelled corpora, so the numbers are reproducible: npm run eval (85% recall / 92% precision over 76 items, offline) and npm run eval:semantic (91% / 100% over 70 items, one call per item).

Category agents, alongside JevLint and the other linters. Zero dependencies, Node 18+, MIT. Also listed in Amal-David/awesome-jev.

Only data/projects.json is changed; npm run validate passes at 998 entries.


View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need. Autofix is disabled.

Summary by CodeRabbit

  • New Features
    • Added Wellposed to the project directory under Agents. Its listing describes an offline tool for checking Jev requests before they’re sent.

@coderabbitai

coderabbitai Bot commented Sep 23, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

Navigate logical layers of code changes, visualize relationships, and explore their blast radius.

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Advanced

Run ID: f5f4d493-fece-4227-8315-b55cd36b4e1c

📥 Commits

Reviewing files that changed from the base of the PR and between 1149aac and dfd2ec9.

📒 Files selected for processing (1)
  • data/projects.json

Included review availability: Your plan provides up to 2 included reviews per hour; 1 remains after this review.


📝 Walkthrough

Walkthrough

The projects catalog adds wellposed, a JavaScript project in the agents category. Its entry includes the repository, site URL, description, zero stars, and an added date of 2026-09-23.

Changes

Project catalog

Layer / File(s) Summary
Add the wellposed project entry
data/projects.json
The projects array gains the wellposed entry with its repository, site URL, description, category, language, stars, and added date.

Estimated code review effort: 1 (Trivial) | ~5 minutes

Suggested reviewers: scald

Merge Risk: ⚪ Minimal · up to dfd2e

The new entry uses a registered category and presents no concrete merge-blocking issue in the supplied catalog context.

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly identifies the main change: adding the wellposed project.
Description check ✅ Passed The description identifies the project, explains where it fits, documents the validation result, and confirms that only data/projects.json changed. It omits the template checkbox section and does not …
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create a new PR

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant