Skip to content

feat(chat): server-chosen model with automatic fallback; no model picker; charge after success - #226

Merged
Kumar2421 merged 1 commit into
mainfrom
feat/assistant-model-policy
Oct 23, 2026
Merged

Kumar2421 merged 1 commit into
mainfrom
feat/assistant-model-policy

Conversation

@Kumar2421

Copy link
Copy Markdown
Owner

Chat no longer lets the client pick provider/model (fields ignored): the SERVER builds an ordered plan = user's preferred BYOK model (Settings) -> platform Groq default -> platform Mistral; falls back on rate_limit/server/timeout/network/model_unavailable/empty reply, NEVER on auth/bad_request/402/400/401/409/422 (policy denials incl. chat_limit stop the turn); max 3 attempts inside a 52s turn budget (first attempt <=55% of remaining; drivers take no AbortSignal so a timed-out attempt is abandoned, not cancelled). Credits: read-only affordability check before, ONE charge after a successful reply, none on failure, BYOK never charged. User never sees the backup model; one structured log line per turn (provider/model/fallback/attempts/ms, no content). Client: ModelPicker, Attach and Mention placeholders removed; Settings LLM Providers copy now says chat uses the preferred model first and falls back to our defaults. DELIBERATE behaviour changes (all in tests): 422 'no candidates' replaces 'No model selected'/501/'not connected' and runs after auth+scope; charge moved after answer; empty reply = failed attempt; observer events extended. 36 service tests; 1936 pass. Not verified live. Known: all-fail error text can name the last provider; other agent modals (CodeFix, CMS) still show 'Select a model' (out of scope).

🤖 Generated with Claude Code

…uccess

Remove the chat model picker and placeholder buttons; client no longer sends providerId/model (ignored if sent). Plan: preferred BYOK -> platform Groq -> platform Mistral; fallback on transient failures/empty reply, never on auth/bad_request/credits/limits; 52s deadline split; observer + log line.

Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
@vercel

vercel Bot commented Oct 23, 2026

Copy link
Copy Markdown

Deployment failed for project okara-alternative with the following error:

Resource is limited - try again in 24 hours (more than 100, code: "api-deployments-free-per-day").

Learn More: https://vercel.com/kumar2421s-projects?upgradeToPro=build-rate-limit

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ⚠️ Failed 2026-10-23T12:08:01.870275Z
We couldn’t complete this review. Comment @codex review to try again.
610eda2 PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, you can upgrade your account or add credits to your account and enable them for code reviews in your settings.

@Kumar2421
Kumar2421 merged commit f783776 into main Oct 23, 2026
2 of 3 checks passed
@Kumar2421
Kumar2421 deleted the feat/assistant-model-policy branch October 23, 2026 12:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant