test: six-client connection matrix (Phase 1 exit bar) #223

Activity

1. ifahimreza

   added

   enhancementNew feature or requestNew feature or request

   on Sep 26, 2026
2. ifahimreza

   added a commit that references this issue on Oct 4, 2026

   test(clients): the matrix's gated write is opt-in (--write)

   ...

   ce261bb
3. ifahimreza commented on Oct 4, 2026

   

   ifahimreza

   on Oct 4, 2026

   ContributorAuthor

   More actions

   #324 adds scripts/client-matrix.mjs and tests/CLIENTS.md. On Playground the key path passes for Claude Code, Codex, Gemini CLI and Cursor: initialize, initialized, tools/list, prompts/list, a read, and a gated write with --write. Two things are still to do before this exit bar is met:

   • run the sign-in path on an HTTPS site with sign-in on (--token);
   • connect the six real apps once, and fill in the results table in tests/CLIENTS.md.
4. ifahimreza commented on Oct 5, 2026

   

   ifahimreza

   on Oct 5, 2026

   ContributorAuthor

   More actions

   Real-app pass started 2026-10-05 on the 1.5.1 zip from WordPress.org (fresh Playground).

   • Claude Code 2.1.289, key and sign-in: connect, read and the Read only refusal pass. The gated write confirmed without asking, because Claude Code keeps only the first 2,048 characters of the server instructions and the ask-first rule was past that. Filed as Claude Code sees only the first 2,048 characters of Saddle's instructions, so it confirms gated steps without asking #333; fixed in fix: ask before confirming, even in apps that cut the guide (#333) #334 and checked with the real app (it now previews, asks, and acts only after yes).
   • Sign-in by address fails on Playground and Studio with a misleading 'private network' message #335: on Playground/Studio, sign-in from Claude Code stops before consent (no DNS in PHP there). Keys work.
   • Results: draft docs(clients): real-app results, 2026-10-05 (#223) #336 fills the Claude Code rows in tests/CLIENTS.md.
   • Still to run: Claude (web) and ChatGPT need an HTTPS address they can reach; Codex, Cursor and Gemini CLI need a go-ahead for headless runs (Gemini also a Google sign-in).
5. ifahimreza

   added 4 commits that reference this issue on Oct 5, 2026

   fix: ask before confirming, even in apps that cut the guide (#333) (#334

   ...

   a0f8676

   docs(clients): #334 is on main

   ...

   52a1eca

   docs(clients): real-app results, 2026-10-05 (#223) (#336)

   ...

   116180c

   docs(clients): Codex results, Cursor connect, 2026-10-05 (#337)

   ...

   39fb0b9
6. ifahimreza commented on Oct 13, 2026

   

   ifahimreza

   on Oct 13, 2026

   ContributorAuthor

   More actions

   Progress 2026-10-14 (recorded in #366):

   • Claude (web/desktop connector): pass. The claude.ai connector, signed in by address to https://saddle.to (1.5.1): connect, read, and a gated write (preview, nothing changed, confirm, trashed).
   • Script: all six profiles pass on the build with Ask first (feat: Allow, Ask first or Off for each tool (#364) #365).
   • Claude Code 2.1.296 and Codex 0.157.0 pass the new Ask-first flow (Phase 2: Allow, Ask first or Off for each tool, with a recommended set #364): they wait for the owner's OK and refuse a chat "yes".
   • Sign-in by address fails on Playground and Studio with a misleading 'private network' message #335 (misleading message on Playground/Studio) is fixed in fix: say when an app's address can't be looked up (#335) #362.

   Left for this exit bar, each needing the owner's own sign-in:

   1. ChatGPT: Developer mode → add a connector with https://saddle.to/wp-json/saddle/v1/mcp, approve on the consent screen, then read and preview a trash. Plus/Pro accounts can only read through custom apps, so the write row may stay N/A unless the account is Business.
   2. Cursor: ! cursor-agent login, then read and the gated write.
   3. Gemini CLI: npm i -g @google/gemini-cli, sign in with Google, then the same three steps.
7. ifahimreza

   added a commit that references this issue on Oct 13, 2026

   docs: client matrix results for 2026-10-14; 1.5.2 is the live build (#…

   ...

   de4f0d1
8. ifahimreza commented on Oct 14, 2026

   

   ifahimreza

   on Oct 14, 2026

   ContributorAuthor

   More actions

   Phase 1 exit bar met, 2026-10-14. Fahim ran the remaining real-app tests himself (ChatGPT, Cursor, Gemini CLI) and reports them done. Agent-run rows are in tests/CLIENTS.md (#366): the script passes all six, and Claude Code, Codex and Claude (claude.ai connector) pass with the real app.
9. ifahimreza

   closed this as completedon Oct 14, 2026