Skip to content

请求mistral未能正常进行格式转化 #407

Closed

Description

@WslzGmzs

请求
https://api.mistral.ai/v1/chat/completions

原始报文上游一侧,请求和响应都正常流式响应,但是在客户端一侧响应会一直卡住直到结束输出截断的响应

上游一侧
请求

POST https://api.mistral.ai/v1/chat/completions
user-agent: thinkwatch/0.89.1 (windows; x86_64)
content-type: application/json
authorization: Bearer 

{"max_tokens":200000,"messages":[{"content":"一項目ずつ素早く値を選んでください。一項目ずつ、1 から 355 まで(両端を含む)の整数を 292 個選んでください。各位置の値は個別に選んでください。1 から順に数えたり、連続して増加または減少させたりせず、等差数列、周期、同じブロックの繰り返し、その他の規則的なパターンも使わないでください。この課題は現在の言語モデル自身が直接行ってください。Python、コード実行ツール、計算機、検索、API、外部の乱数生成器など、いかなるツールも呼び出したり利用したりしないでください。事前にコードを書いたり実行したりすることも禁止します。同じ値が再び出てもかまいません。出力の途中で前の項目を整理したり書き換えたりしないでください。各整数の区切りが明確であれば、形式は自由です。選んだ最初の値から直接出力を始め、数列の前に個数、範囲、課題の説明を繰り返さないでください。","role":"user"}],"model":"mistral-large-4","stream":true,"stream_options":{"include_usage":true}}

响应(太长了删除了中间部分)

HTTP/2 200
date: Fri, 06 Nov 2026 05:38:23 GMT
content-type: text/event-stream; charset=utf-8
mistral-correlation-id: …
x-kong-request-id: …
x-max-retry-attempts-reached: false
x-ratelimit-limit-req-minute: 50
x-ratelimit-remaining-req-minute: 49
x-ratelimit-limit-tokens-minute: ………
x-ratelimit-remaining-tokens-minute: ………
x-envoy-upstream-service-time: 1024
server: cloudflare
access-control-allow-origin: *
x-kong-upstream-latency: 1025
x-kong-proxy-latency: 10
set-cookie: __cf_… GMT
cf-cache-status: DYNAMIC
strict-transport-security: max-age=15552000; includeSubDomains; preload
x-content-type-options: nosniff
cf-ray: a561c06b19901d26-ORD
alt-svc: h3=":443"; ma=86400

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"role":"assistant","content":""},"finish_reason":null}]}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":""},"finish_reason":null}],"p":"abc"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":", 154,"},"finish_reason":null}],"p":"abcdefghi"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":" 223, "},"finish_reason":null}],"p":"abcdefghijklmnopqrstuv"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":"304, 288"},"finish_reason":null}],"p":"abcdefghijklmnopqrstuvwxy"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":", 56,"},"finish_reason":null}],"p":"abcde…3456"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":" 159, "},"finish_reason":null}],"p":"abcdefghijklmnopqrstu"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":"345, 163"},"finish_reason":null}],"p":"abcdefghijk"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":", 260,"},"finish_reason":null}],"p":"abcdefghijklmnopqrstuvwxyz"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":" 351, "},"finish_reason":null}],"p":"abcde…3456"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":"77, 204"},"finish_reason":null}],"p":"abcdefgh"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":", 130,"},"finish_reason":null}],"p":"abcde…4567"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":" 249, "},"finish_reason":null}],"p":"abcdefghijklmnopqrst"}

data: {"id":"…","object":"chat.completion.chunk","created":1793943502,"model":"mistral-large-4","choices":[{"index":0,"delta":{"content":"83"},"finish_reason":"stop"}],"usage":{"prompt_tokens":304,"total_tokens":7714,"completion_tokens":7410,"prompt_tokens_details":{"cached_tokens":0},"completion_tokens_details":{"reasoning_tokens":6533},"service_tier":"standard"},"p":"abcdefghijklmnopqr"}

data: [DONE]

客户端一侧
请求

POST /v1/messages HTTP/1.1
host: 127.0.0.1:8788
connection: keep-alive
content-length: 1234
sec-ch-ua-platform: "Windows"
sec-ch-ua: "Not-A.Brand";v="24", "Chromium";v="146"
x-api-key: tw-xxx
sec-ch-ua-mobile: ?0
anthropic-version: 2023-06-01
x-title: Cherry Studio
user-agent: 
http-referer: https://cherry-ai.com
content-type: application/json
accept: */*
sec-fetch-site: cross-site
sec-fetch-mode: cors
sec-fetch-dest: empty
accept-encoding: gzip, deflate, br, zstd
accept-language: zh-CN

{"model":"mistral-large-4","max_tokens":200000,"messages":[{"role":"user","content":[{"type":"text","text":"一項目ずつ素早く値を選んでください。一項目ずつ、1 から 355 まで(両端を含む)の整数を 292 個選んでください。各位置の値は個別に選んでください。1 から順に数えたり、連続して増加または減少させたりせず、等差数列、周期、同じブロックの繰り返し、その他の規則的なパターンも使わないでください。この課題は現在の言語モデル自身が直接行ってください。Python、コード実行ツール、計算機、検索、API、外部の乱数生成器など、いかなるツールも呼び出したり利用したりしないでください。事前にコードを書いたり実行したりすることも禁止します。同じ値が再び出てもかまいません。出力の途中で前の項目を整理したり書き換えたりしないでください。各整数の区切りが明確であれば、形式は自由です。選んだ最初の値から直接出力を始め、数列の前に個数、範囲、課題の説明を繰り返さないでください。"}]}],"stream":true}

响应

HTTP/1.1 200 OK
date: Fri, 06 Nov 2026 05:38:23 GMT
content-type: text/event-stream
mistral-correlation-id: …
x-kong-request-id: …
x-max-retry-attempts-reached: false
x-ratelimit-limit-req-minute: 50
x-ratelimit-remaining-req-minute: 49
x-ratelimit-limit-tokens-minute: ………
x-ratelimit-remaining-tokens-minute: ………
x-envoy-upstream-service-time: 1024
server: cloudflare
access-control-allow-origin: *
x-kong-upstream-latency: 1025
x-kong-proxy-latency: 10
set-cookie: __cf_… GMT
cf-cache-status: DYNAMIC
strict-transport-security: max-age=15552000; includeSubDomains; preload
x-content-type-options: nosniff
cf-ray: a561c06b19901d26-ORD
alt-svc: h3=":443"; ma=86400
x-thinkwatch-upstream: Mistral

event: message_start
data: {"message":{"content":[],"id":"msg_18e55e1d00da680c00000003","model":"mistral-large-4","role":"assistant","stop_reason":null,"stop_sequence":null,"type":"message","usage":{"cache_creation_input_tokens":0,"cache_read_input_tokens":0,"input_tokens":0,"output_tokens":0}},"type":"message_start"}

event: content_block_start
data: {"content_block":{"text":"","type":"text"},"index":0,"type":"content_block_start"}

event: content_block_delta
data: {"delta":{"text":", 312,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 8, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"201, 155","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 34,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 289, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"96, 340","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 17,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 263, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"5, 188","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 75,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 331, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"122, 41","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 297,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 14, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"246, 179","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 88,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 305, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"23, 150","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 271,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 63, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"19, 333","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 108,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 239, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"52, 184","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 355,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 91, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"267, 36","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 141,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 313, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"70, 26","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 198,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 117, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"302, 59","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 245,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 12, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"171, 328","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 84,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 219, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"67, 350","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 103,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 31, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"286, 139","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 48,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 173, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"21, 308","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 95,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 254, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"15, 187","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 66,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 321, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"126, 39","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 232,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 112, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"299, 53","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 166,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 9, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"277, 144","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 318,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 81, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"205, 38","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 261,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 129, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"6, 234","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 92,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 349, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"57, 193","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 110,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 285, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"74, 158","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 24,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 316, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"101, 44","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 227,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 69, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"344, 132","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 13,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 274, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"176, 86","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 309,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 51, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"148, 230","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 33,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 352, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"119, 27","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 241,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 98, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"165, 354","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 72,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 206, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"45, 283","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 16,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 137, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"64, 317","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 214,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 90, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"268, 115","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 3,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 247, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"182, 29","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 325,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 107, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"58, 199","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 136,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 332, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"76, 18","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 259,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 124, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"346, 49","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 211,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 87, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"294, 61","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 153,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 342, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"25, 170","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 113,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 303, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"78, 226","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 35,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 191, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"102, 68","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 287,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 11, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"237, 156","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 40,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 324, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"93, 207","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 134,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 300, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"54, 181","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 125,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 341, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"22, 269","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 100,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 160, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"217, 80","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 335,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 146, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"7, 251","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 123,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 339, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"65, 218","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 30,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 296, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"149, 202","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 89,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 262, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"42, 177","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 114,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 326, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"20, 233","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 127,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 348, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"97, 186","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 282,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 55, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"167, 104","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 311,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 73, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"250, 143","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 343,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 28, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"194, 109","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 258,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 62, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"220, 338","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 120,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 85, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"272, 10","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 164,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 295, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"46, 212","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 131,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 306, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"138, 256","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 99,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 175, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"353, 37","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 224,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 147, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"60, 192","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 116,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 290, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"71, 336","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 210,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 43, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"168, 128","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 4,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 266, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"145, 314","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 82,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 238, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"106, 347","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 183,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 32, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"257, 121","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 79,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 301, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"50, 172","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 264,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 1, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"329, 140","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 213,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 334, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"94, 180","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 152,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 275, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"118, 280","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 154,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 223, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"304, 288","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 56,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 159, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"345, 163","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 260,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 351, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"77, 204","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":", 130,","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":" 249, ","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_delta
data: {"delta":{"text":"83","type":"text_delta"},"index":0,"type":"content_block_delta"}

event: content_block_stop
data: {"index":0,"type":"content_block_stop"}

event: message_delta
data: {"delta":{"stop_reason":"end_turn","stop_sequence":null},"type":"message_delta","usage":{"cache_creation_input_tokens":0,"cache_read_input_tokens":0,"input_tokens":304,"output_tokens":7410}}

event: message_stop
data: {"type":"message_stop"}

Activity

  1. fylorn commented on Nov 8, 2026

    @fylorn
    Contributor

    Lite 2026.11.4 (Core 0.89.2) fixes reproduced compatibility issues with Mistral responses: typed array content is preserved during format conversion, and redaction placeholders split across content fragments are restored correctly. Incremental forwarding has also been verified for these cases.

    The supplied excerpt is not enough to establish whether those issues caused the delay and truncation you reported, so this issue will stay open. Please retest with the new version. If it persists, please share a complete upstream and client-side SSE capture with credentials removed, ideally with the arrival times of the first and last chunks, and whether redaction or plugins were enabled.

  2. WslzGmzs commented on Nov 8, 2026

    @WslzGmzs
    Author

    目前单次请求和工具调用都没问题,多次出现如下问题

    上游「Mistral」返回 422:{"detail":[{"type":"extra_forbidden","loc":["body","messages",3,"assistant","reasoning_content"],"msg":"Extra inputs are not permitted","input":"The user has invoked `/init` in `/root/projects/test`. Let me follow the phases.\n\nPhase 0: Check for existing CLAUDE.md at project root. Let me `cat ./CLAUDE.md`.\n\nAlso, I must always respond in Chinese-simplified per the user's global CLAUDE.md.\n\nLet me check for the existing CLAUDE.md first."}]}
    

    这个在上游里可能需要特别支持

    还有流量界面不知道能不能考虑一下这样实现 #412 (comment)

  3. WslzGmzs commented on Nov 10, 2026

    @WslzGmzs
    Author

    这里有相关问题贴子

    https://linux.do/t/topic/3149127

  4. fylorn commented on Nov 10, 2026

    @fylorn
    Contributor

    Thanks for the follow-up. The 422 extra_forbidden example identifies a request-side compatibility problem: the upstream rejects reasoning_content in an assistant message from the conversation history. This is separate from the response-content and streaming fixes described above. Lite 2026.11.7 does not yet fix this rejection.

    Reasoning-history support differs between Chat-compatible APIs. Some require that history during tool use, so removing it for every upstream would introduce regressions; the fix needs to account for the target upstream's support.

    Keeping this issue open. The response-content improvements described in the earlier update are released, but the multi-turn rejection remains unresolved. The traffic-layout follow-up is now available; details are in #412.

  5. fylorn commented on Nov 11, 2026

    @fylorn
    Contributor

    Lite 2026.11.10 includes the fix for the multi-turn 422 extra_forbidden rejection in the follow-up above.

    The gateway adapts automatically to precise upstream validation errors: it retries once with only the rejected unsigned assistant-history field omitted and caches the adjustment only after the upstream accepts it. The cache is scoped to the actual upstream, model and request mode. Signed history and explicit settings are preserved, and no additional configuration is needed.

    Please retest with this version. I am keeping the issue open because the original streaming delay/truncation has not been conclusively reproduced from the excerpt. If that still occurs, please share a complete upstream and client-side SSE capture with credentials removed, chunk arrival times, and whether redaction or plugins were enabled.

  6. WslzGmzs commented on Nov 11, 2026

    @WslzGmzs
    Author

    似乎不支持非流式,使用非流式会报 Rate limit exceeded ,可以做一个上游选项,对于不支持非流式的上游在客户端请求非流式的时候先流式缓存下来再做非流式响应

  7. fylorn commented on Nov 12, 2026

    @fylorn
    Contributor

    Status update: the adaptive upstream response-mode work is tracked in ThinkWatch-Core PR #401. That PR is still a draft and is not included in Lite 2026.11.13 / Core 0.95.0.

    The proposed implementation can try the opposite response mode after eligible upstream rejections and convert a successful response back to the client's requested framing. However, Rate limit exceeded alone does not establish that non-streaming requests are unsupported, so rate-limit errors do not trigger this retry. We still need evidence of the actual upstream behavior to confirm whether the proposed adaptation addresses this report. Keeping this issue open.

  8. fylorn commented on Nov 12, 2026

    @fylorn
    Contributor

    Lite 2026.11.14, bundling Core 0.96.0, is now available with automatic upstream response-mode adaptation. It follows the client’s mode first; after an eligible upstream API rejection, it can try the opposite mode once and convert a successful answer back to the client’s requested protocol and framing. A complete successful trial teaches a scoped preference for 30 minutes.

    Rate limit exceeded does not trigger this retry, because it does not establish that non-streaming is unsupported. This release therefore does not confirm a fix for that specific response. Keeping this issue open pending a retest and sanitized upstream/client captures, including the HTTP status and error body for the non-streaming request.

  9. WslzGmzs commented on Nov 20, 2026

    @WslzGmzs
    Author

    @fylorn 这个问题我已经得到解决,不过不是通过ThinkWatch在网关上解决的,我现在有点担忧为了这个特定的api请求做这么多的兼容性提交会不会影响正常的请求?因为这包括了比较多的无法清晰知晓的后台运行处理,不知道对其它api影响或者缓存问题?


    CD403F676E48360A763A21ACD560E89F
  10. fylorn commented on Nov 20, 2026

    @fylorn
    Contributor

    No, we don’t do that. Our approach relies on adaptive support based on the returned messages. Stability is the top priority for ThinkWatch, so we avoid implementing custom solutions tailored to specific APIs. Unfortunately, this design philosophy means our support for that particular API has never been as robust as it could be—apologies for that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions