Keep Open Session verification recipes runnable - #328
Conversation
Seed demo state before services load their catalogs, and update stale accessibility roles and archive setup steps found in the full verification pass. Started by Daily verification skill maintenance in this OS session: https://os.tella.dev/session/os-01a084c0-a532-7684-adba-3a1ecb73e302 Co-authored-by: Daily verification skill maintenance <309495949+open-session-os-tella-dev[bot]@users.noreply.github.com>
🤖 OS review · request changes · quality 4/5 · risk lowSafe once the P2 below is fixed. One recipe currently exercises a different disclosure than it claims. 🟢 Risk low · recovery in minutes 1 inline comment below. Reviewed 🔁 Not merge-ready and no live session owns this branch — add the |
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
| - **Open a direct session link.** Run `verify-opensession browser "$RUN_ID" open --route /session/bks-demo-pr --width 1440 --height 900`. Wait with `verify-opensession browser "$RUN_ID" wait --role heading --name "Fix flaky upload retry test"`. The session title and transcript appear. | ||
| - **Inspect transcript semantics.** Run `verify-opensession browser "$RUN_ID" snapshot`. The tree contains the upload retry prompt and transcript controls. Capture a screenshot after expanding any collapsed tool call through its visible button. | ||
| - **Open a direct session link.** Run `verify-opensession browser "$RUN_ID" open --route /session/bks-demo-pr --width 1440 --height 900`. Wait with `verify-opensession browser "$RUN_ID" wait --role button --name "Show what this turn wrote to upload.ts"`. The workspace and seeded transcript appear. The page title may use the branch name instead of the session title. | ||
| - **Inspect transcript semantics.** Run `verify-opensession browser "$RUN_ID" snapshot`. The tree contains the upload retry prompt and transcript controls. Expand the collapsed tool call with `verify-opensession browser "$RUN_ID" click --role button --name "Show what this turn wrote to upload.ts"`, then capture a screenshot. |
There was a problem hiding this comment.
🟠 P2 — The transcript recipe does not expand a tool call
Show what this turn wrote to upload.ts is the TurnFooter file-diff popover trigger (TurnFooter.tsx:375-390), while collapsed tool calls are separate buttons whose aria-expanded state is owned by ToolCallBlock.tsx:469-474. Running this command successfully opens the turn-level diff but leaves every tool call collapsed, so a broken tool disclosure would still pass this recipe. Either describe and verify the file-diff popover, or use the current snapshot to click the actual tool-call button before capturing proof.
Summary
Verification
bun run checkverify-20260909-retry-060626-2801968Product gap found
Automation creation did not persist in the isolated demo. Both a template flow and a plain scheduled form closed after
Create automation, butGET /api/automationsand the state directory contained no new automation. Existing automation toggle persistence worked. The run also logged repeated ReactMaximum update depth exceedederrors around the failed create flow. Product code is intentionally untouched here.Started by Daily verification skill maintenance in this OS session