Skip to content

feat(jvchat): replay debug ticks with first-tick tool schemas - #230

Open
Tharickv75 wants to merge 3 commits into
devfrom
feat/jvchat-debug-replay-snapshot
Open

Tharickv75 wants to merge 3 commits into
devfrom
feat/jvchat-debug-replay-snapshot

Conversation

@Tharickv75

Copy link
Copy Markdown
Contributor

Summary

  • Record full tool schemas on the first observability tick of each unique tool surface so Debug Interactions can replay the request without storing the same payload on every tick.
  • Extract replay snapshot helpers and unwrap success.data from the interact API so retest uses temperature, max_tokens, and the real result payload.

Test plan

  • Open jvchat Debug Interactions, retest a tick that used tools, and confirm the replay includes tool schemas.
  • Retest a later tick of the same tool surface and confirm it still replays (names + first-tick schemas).
  • Run tests/action/model/test_observability_tool_definitions.py and jvchat/src/lib/debugReplay.test.ts.

Made with Cursor

@Tharickv75
Tharickv75 requested a review from eldonm as a code owner September 17, 2026 16:58
LiteLLM now reports a 1M window; keep proving capabilities come from upstream.

Co-authored-by: Cursor <[email protected]>
@Tharickv75 Tharickv75 self-assigned this Sep 17, 2026
…ndling

Introduced a new function to normalize LiteLLM model IDs by lowercasing the provider prefix. Updated the model assignment in DebugInteractions and buildQueryPayload to utilize this normalization function. Added tests to verify the behavior of the new function.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant