Repository navigation
fix(ai): record mid-stream errors on streamed OpenAI, Anthropic and Gemini events - #1094
Conversation
dustinbyrne
left a comment
There was a problem hiding this comment.
The streaming error-handling fix is supported by base/head regressions and native-SDK SSE probes. I found four new errors under the locked mypy check and a stale generated API snapshot; details inline. The source-typing errors need correction before approval.
AI-assisted review.
| groups=groups, | ||
| stop_reason=stop_reason, | ||
| service_tier=service_tier, | ||
| **({"error": error} if error is not None else {}), |
There was a problem hiding this comment.
F1 — [P2] Keep the event constructors compatible with the locked type checker
MINOR · REQUIRED · Introduced static-check regression
Location: posthog/ai/openai/_streaming.py:125, RIGHT. Same issue at posthog/ai/gemini/_shared.py:226, posthog/ai/anthropic/anthropic.py:261 and posthog/ai/anthropic/anthropic_async.py:261.
The repository’s locked type check now reports four new typeddict-item errors, one for each conditional unpack added inside StreamingEventData(...):
**({"error": error} if error is not None else {}),With mypy 1.16.1, matching uv.lock:2267–2268, these conditional dictionaries are checked against the full StreamingEventData context. Each produces a diagnostic that the required event keys are missing, although those keys are present in the outer constructor.
Equivalent base/head verification produced:
| Check | Base bf873523… |
Head ec98ed67… |
|---|---|---|
| Raw mypy | Exit 0; no issues in 303 files | Exit 1; four errors in 304 files |
Actual mypy-baseline filter |
Exit 0 | Exit 4; four new errors |
The baseline is empty, so it does not absorb these errors. The configured CI step runs the same check at .github/workflows/ci.yml:61–78:
mypy --no-site-packages --config-file mypy.ini . | mypy-baseline filterThis affects the shared OpenAI builder and the Gemini/Anthropic builders used by their sync/async wrappers. It is a source-type-check regression, not evidence that runtime events lack required fields or that provider streams fail.
Consider passing error=error directly—the field already accepts None—or conditionally assigning event_data["error"] after constructing the typed event, in all four places. Then rerun the CI-aligned check rather than adding the diagnostics to the baseline.
Verification: CONTRIBUTING.md prescribes this check. Inspected all four constructions and executed the checker and actual baseline filter under equivalent sandboxed environments, with isolated caches. This deterministic static failure needs no behavioral regression sketch. No corrected implementation was applied or tested.
| groups: Optional[Dict[str, Any]] | ||
| stop_reason: Optional[str] | ||
| service_tier: NotRequired[Optional[str]] | ||
| error: NotRequired[Optional[BaseException]] # raised mid-stream, if any |
There was a problem hiding this comment.
F2 — [P2] Refresh the generated public API snapshot
MINOR · OPTIONAL acceptance feedback; outstanding mechanical merge prerequisite · Introduced reference drift
Location: posthog/ai/types.py:146, RIGHT.
Adding the optional StreamingEventData.error member changes the generated API surface, but references/public_api_snapshot.txt still describes the base type.
The snapshot checker passes on base bf873523c700d9940c8ec86b677d2bd4904dfa55 and exits 1 on head ec98ed6794f2a866b0ae40522b05dfff8b878024. Its only generated difference is:
+attribute posthog.ai.types.StreamingEventData.error: NotRequired[Optional[BaseException]]CONTRIBUTING.md:33–43 requires regenerating the reference for API-surface changes, and .github/workflows/ci.yml:80–95 runs the snapshot check.
This is a generated-reference/check failure, not a demonstrated runtime compatibility break: the member is optional and existing constructions remain valid. Consider regenerating and including the reference update, then checking it before merge:
uv run --no-sync make public_api_snapshot
uv run --no-sync make public_api_checkVerification: Executed .github/scripts/check_public_api.py without --write on both revisions under equivalent Python 3.11.13/griffe 2.0.2 environments. The optional member is the sole difference. This is deterministic artifact validation, not a behavioral test. No regeneration was performed.
|
Thanks, fixed in 1a6ef61. The four call sites now pass |
marandaneto
left a comment
There was a problem hiding this comment.
The code looks good; no qualifying findings. Verdict: correct.
sign your commits for next PRs @pcbeingused333 |
…emini events capture_streaming_event hard-coded $ai_http_status=200, and the stream generators only had a finally block. When the provider stream raised after the first chunk (overloaded, connection reset), the event was sent as a success with no $ai_is_error/$ai_error, unlike the non-streaming path. Catch the exception in each sync and async generator, pass it through StreamingEventData, and re-raise unchanged. The event now carries $ai_is_error, $ai_error and the error's status code (0 when it has none). Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
…ate the API snapshot
mypy 1.16 rejected splatting {"error": error} into StreamingEventData(...)
(typeddict-item). The field accepts None and capture_streaming_event reads it
with .get(), so pass error=error. Regenerate the public API snapshot for the new
StreamingEventData.error field.
Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
1a6ef61 to
492f2ca
Compare
* feat(metrics): attach trace exemplars to flushed metric series (#1057) (cherry picked from commit 3cc2d64) * chore: Release v7.69.0 [skip ci] (cherry picked from commit 653ff87) * Update generated references (cherry picked from commit 6f65898) * feat(ai): add per-request context to span processor (#1060) * feat: span processor request context * fix: span processor review feedback * fix: span processor review follow-ups (cherry picked from commit 6916499) * chore: Release v7.70.0 [skip ci] (cherry picked from commit a615eed) * Update generated references (cherry picked from commit a49648e) * fix(prompts): share one request between concurrent fetches of the same prompt (#1059) (cherry picked from commit 10d094e) * chore: Release v7.70.1 [skip ci] (cherry picked from commit ec71a24) * Update generated references (cherry picked from commit fc3c434) * fix(ai): mark cancelled async LLM calls as errors (#1065) * fix(ai): mark cancelled async LLM calls as errors * test: fix Python 3.10 cancellation and FastMCP compatibility (cherry picked from commit fec41f2) * chore: Release v7.70.2 [skip ci] (cherry picked from commit e381808) * Update generated references (cherry picked from commit f33d55d) * chore(deps): bump the ai-providers group with 8 updates (#1054) Bumps the ai-providers group with 8 updates: | Package | From | To | | --- | --- | --- | | [langchain](https://github.com/langchain-ai/langchain) | `1.4.2` | `1.4.3` | | [anthropic](https://github.com/anthropics/anthropic-sdk-python) | `1.8.0` | `1.11.0` | | [langgraph](https://github.com/langchain-ai/langgraph) | `1.2.12` | `1.2.13` | | [langchain-core](https://github.com/langchain-ai/langchain) | `1.6.5` | `1.6.6` | | [langchain-openai](https://github.com/langchain-ai/langchain) | `1.6.6` | `1.6.7` | | [langchain-anthropic](https://github.com/langchain-ai/langchain) | `1.7.4` | `1.7.5` | | [google-genai](https://github.com/googleapis/python-genai) | `2.25.0` | `2.28.0` | | [langchain-text-splitters](https://github.com/langchain-ai/langchain) | `1.1.2` | `1.1.3` | Updates `langchain` from 1.4.2 to 1.4.3 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain==1.4.2...langchain==1.4.3) Updates `anthropic` from 1.8.0 to 1.11.0 - [Release notes](https://github.com/anthropics/anthropic-sdk-python/releases) - [Changelog](https://github.com/anthropics/anthropic-sdk-python/blob/main/CHANGELOG.md) - [Commits](anthropics/anthropic-sdk-python@v1.8.0...v1.11.0) Updates `langgraph` from 1.2.12 to 1.2.13 - [Release notes](https://github.com/langchain-ai/langgraph/releases) - [Commits](langchain-ai/langgraph@1.2.12...1.2.13) Updates `langchain-core` from 1.6.5 to 1.6.6 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-core==1.6.5...langchain-core==1.6.6) Updates `langchain-openai` from 1.6.6 to 1.6.7 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-openai==1.6.6...langchain-openai==1.6.7) Updates `langchain-anthropic` from 1.7.4 to 1.7.5 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-anthropic==1.7.4...langchain-anthropic==1.7.5) Updates `google-genai` from 2.25.0 to 2.28.0 - [Release notes](https://github.com/googleapis/python-genai/releases) - [Changelog](https://github.com/googleapis/python-genai/blob/main/CHANGELOG.md) - [Commits](googleapis/python-genai@v2.25.0...v2.28.0) Updates `langchain-text-splitters` from 1.1.2 to 1.1.3 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-text-splitters==1.1.2...langchain-text-splitters==1.1.3) --- updated-dependencies: - dependency-name: langchain dependency-version: 1.4.3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: anthropic dependency-version: 1.11.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ai-providers - dependency-name: langgraph dependency-version: 1.2.13 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: langchain-core dependency-version: 1.6.6 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: langchain-openai dependency-version: 1.6.7 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: langchain-anthropic dependency-version: 1.7.5 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: google-genai dependency-version: 2.28.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ai-providers - dependency-name: langchain-text-splitters dependency-version: 1.1.3 dependency-type: indirect update-type: version-update:semver-patch dependency-group: ai-providers ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Dustin Byrne <[email protected]> (cherry picked from commit f95e1f4) * chore(deps): bump the github-actions group with 2 updates (#1055) Bumps the github-actions group with 2 updates: [dtolnay/rust-toolchain](https://github.com/dtolnay/rust-toolchain) and [PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml](https://github.com/posthog/posthog-sdk-test-harness). Updates `dtolnay/rust-toolchain` from 7e38f4b43b4db5c8dd498af069a4f6196df1d067 to e2a55d2ffb04f378e9626c28d38b36d230d1e12f - [Release notes](https://github.com/dtolnay/rust-toolchain/releases) - [Commits](dtolnay/rust-toolchain@7e38f4b...e2a55d2) Updates `PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml` from 1.11.0 to 1.13.1 - [Release notes](https://github.com/posthog/posthog-sdk-test-harness/releases) - [Changelog](https://github.com/PostHog/posthog-sdk-test-harness/blob/main/CHANGELOG.md) - [Commits](PostHog/posthog-sdk-test-harness@4593de8...e32f08b) --- updated-dependencies: - dependency-name: dtolnay/rust-toolchain dependency-version: e2a55d2ffb04f378e9626c28d38b36d230d1e12f dependency-type: direct:production dependency-group: github-actions - dependency-name: PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml dependency-version: 1.13.1 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Dustin Byrne <[email protected]> (cherry picked from commit 9b7e632) * chore(deps): bump mcp from 1.28.1 to 1.30.0 (#1068) Bumps [mcp](https://github.com/modelcontextprotocol/python-sdk) from 1.28.1 to 1.30.0. - [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases) - [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md) - [Commits](modelcontextprotocol/python-sdk@v1.28.1...v1.30.0) --- updated-dependencies: - dependency-name: mcp dependency-version: 1.30.0 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit 12e88a2) * docs: clarify reusable flush and terminal shutdown guidance (#1043) * docs: clarify reusable flush and terminal shutdown guidance * docs: preserve published 7.67.0 reference snapshot (cherry picked from commit d0b6f71) * chore: Release v7.71.0 [skip ci] (cherry picked from commit 20a574e) * Update generated references (cherry picked from commit 883eaca) * chore(deps): bump the uv group across 4 directories with 2 updates (#1069) Bumps the uv group with 1 update in the /examples/example-ai-llamaindex directory: [tinytag](https://github.com/tinytag/tinytag). Bumps the uv group with 1 update in the /examples/example-ai-openai-agents directory: [mcp](https://github.com/modelcontextprotocol/python-sdk). Bumps the uv group with 1 update in the /examples/example-ai-pydantic-ai directory: [mcp](https://github.com/modelcontextprotocol/python-sdk). Bumps the uv group with 1 update in the /examples/example-ai-semantic-kernel directory: [mcp](https://github.com/modelcontextprotocol/python-sdk). Updates `tinytag` from 2.2.1 to 2.3.0 - [Release notes](https://github.com/tinytag/tinytag/releases) - [Commits](tinytag/tinytag@2.2.1...2.3.0) Updates `mcp` from 1.28.1 to 1.30.0 - [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases) - [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md) - [Commits](modelcontextprotocol/python-sdk@v1.28.1...v1.30.0) Updates `mcp` from 1.29.1 to 1.30.0 - [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases) - [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md) - [Commits](modelcontextprotocol/python-sdk@v1.28.1...v1.30.0) Updates `mcp` from 2.1.1 to 2.2.0 - [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases) - [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md) - [Commits](modelcontextprotocol/python-sdk@v1.28.1...v1.30.0) --- updated-dependencies: - dependency-name: tinytag dependency-version: 2.3.0 dependency-type: indirect dependency-group: uv - dependency-name: mcp dependency-version: 1.30.0 dependency-type: indirect dependency-group: uv - dependency-name: mcp dependency-version: 1.30.0 dependency-type: indirect dependency-group: uv - dependency-name: mcp dependency-version: 2.2.0 dependency-type: indirect dependency-group: uv ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit b1363dc) * chore(deps-dev): bump claude-agent-sdk from 0.1.50 to 0.2.121 (#1073) Bumps [claude-agent-sdk](https://github.com/anthropics/claude-agent-sdk-python) from 0.1.50 to 0.2.121. - [Release notes](https://github.com/anthropics/claude-agent-sdk-python/releases) - [Changelog](https://github.com/anthropics/claude-agent-sdk-python/blob/main/CHANGELOG.md) - [Commits](anthropics/claude-agent-sdk-python@v0.1.50...v0.2.121) --- updated-dependencies: - dependency-name: claude-agent-sdk dependency-version: 0.2.121 dependency-type: direct:development ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit a89acf8) * feat(mcp): stop sending standalone $identify events (#1067) * feat(mcp): stop sending standalone $identify events The identify callback still sets distinct_id, $set and $groups on every event. The standalone event carried no $anon_distinct_id, so ingestion merged no person, and stateless servers sent one per tool call. Co-Authored-By: Claude Opus 5.5 <[email protected]> * chore(mcp): assert no $identify over the wire and refresh docs Co-Authored-By: Claude Opus 5.5 <[email protected]> --------- Co-authored-by: Claude Opus 5.5 <[email protected]> (cherry picked from commit facd617) * chore: Release v7.72.0 [skip ci] (cherry picked from commit 876b955) * Update generated references (cherry picked from commit b8327de) * chore(deps): bump the github-actions group with 6 updates (#1083) Bumps the github-actions group with 6 updates: | Package | From | To | | --- | --- | --- | | [astral-sh/setup-uv](https://github.com/astral-sh/setup-uv) | `10.2.0` | `10.3.0` | | [github/codeql-action/init](https://github.com/github/codeql-action) | `4.38.2` | `4.38.3` | | [github/codeql-action/analyze](https://github.com/github/codeql-action) | `4.38.2` | `4.38.3` | | [actions/create-github-app-token](https://github.com/actions/create-github-app-token) | `3.2.0` | `3.3.0` | | [dtolnay/rust-toolchain](https://github.com/dtolnay/rust-toolchain) | `e2a55d2ffb04f378e9626c28d38b36d230d1e12f` | `683b588c487a69d01f6c6ddf40f036ff682cc2c8` | | [PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml](https://github.com/posthog/posthog-sdk-test-harness) | `1.13.1` | `1.15.0` | Updates `astral-sh/setup-uv` from 10.2.0 to 10.3.0 - [Release notes](https://github.com/astral-sh/setup-uv/releases) - [Commits](astral-sh/setup-uv@c18668a...1c37ad0) Updates `github/codeql-action/init` from 4.38.2 to 4.38.3 - [Release notes](https://github.com/github/codeql-action/releases) - [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md) - [Commits](github/codeql-action@2892aa5...24c5418) Updates `github/codeql-action/analyze` from 4.38.2 to 4.38.3 - [Release notes](https://github.com/github/codeql-action/releases) - [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md) - [Commits](github/codeql-action@2892aa5...24c5418) Updates `actions/create-github-app-token` from 3.2.0 to 3.3.0 - [Release notes](https://github.com/actions/create-github-app-token/releases) - [Changelog](https://github.com/actions/create-github-app-token/blob/main/CHANGELOG.md) - [Commits](actions/create-github-app-token@bcd2ba4...64ab729) Updates `dtolnay/rust-toolchain` from e2a55d2ffb04f378e9626c28d38b36d230d1e12f to 683b588c487a69d01f6c6ddf40f036ff682cc2c8 - [Release notes](https://github.com/dtolnay/rust-toolchain/releases) - [Commits](dtolnay/rust-toolchain@e2a55d2...683b588) Updates `PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml` from 1.13.1 to 1.15.0 - [Release notes](https://github.com/posthog/posthog-sdk-test-harness/releases) - [Changelog](https://github.com/PostHog/posthog-sdk-test-harness/blob/main/CHANGELOG.md) - [Commits](PostHog/posthog-sdk-test-harness@e32f08b...64ffa6a) --- updated-dependencies: - dependency-name: astral-sh/setup-uv dependency-version: 10.3.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions - dependency-name: github/codeql-action/init dependency-version: 4.38.3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: github-actions - dependency-name: github/codeql-action/analyze dependency-version: 4.38.3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: github-actions - dependency-name: actions/create-github-app-token dependency-version: 3.3.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions - dependency-name: dtolnay/rust-toolchain dependency-version: 683b588c487a69d01f6c6ddf40f036ff682cc2c8 dependency-type: direct:production dependency-group: github-actions - dependency-name: PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml dependency-version: 1.15.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit 3822271) * chore(deps): bump the ai-providers group with 6 updates (#1082) Bumps the ai-providers group with 6 updates: | Package | From | To | | --- | --- | --- | | [langchain](https://github.com/langchain-ai/langchain) | `1.4.3` | `1.4.4` | | [anthropic](https://github.com/anthropics/anthropic-sdk-python) | `1.11.0` | `1.13.0` | | [langgraph](https://github.com/langchain-ai/langgraph) | `1.2.13` | `1.2.14` | | [langchain-core](https://github.com/langchain-ai/langchain) | `1.6.6` | `1.6.9` | | [langchain-openai](https://github.com/langchain-ai/langchain) | `1.6.7` | `1.7.0` | | [google-genai](https://github.com/googleapis/python-genai) | `2.28.0` | `2.29.0` | Updates `langchain` from 1.4.3 to 1.4.4 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain==1.4.3...langchain==1.4.4) Updates `anthropic` from 1.11.0 to 1.13.0 - [Release notes](https://github.com/anthropics/anthropic-sdk-python/releases) - [Changelog](https://github.com/anthropics/anthropic-sdk-python/blob/main/CHANGELOG.md) - [Commits](anthropics/anthropic-sdk-python@v1.11.0...v1.13.0) Updates `langgraph` from 1.2.13 to 1.2.14 - [Release notes](https://github.com/langchain-ai/langgraph/releases) - [Commits](langchain-ai/langgraph@1.2.13...1.2.14) Updates `langchain-core` from 1.6.6 to 1.6.9 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-core==1.6.6...langchain-core==1.6.9) Updates `langchain-openai` from 1.6.7 to 1.7.0 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-openai==1.6.7...langchain-openai==1.7.0) Updates `google-genai` from 2.28.0 to 2.29.0 - [Release notes](https://github.com/googleapis/python-genai/releases) - [Changelog](https://github.com/googleapis/python-genai/blob/main/CHANGELOG.md) - [Commits](googleapis/python-genai@v2.28.0...v2.29.0) --- updated-dependencies: - dependency-name: langchain dependency-version: 1.4.4 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: anthropic dependency-version: 1.13.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ai-providers - dependency-name: langgraph dependency-version: 1.2.14 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: langchain-core dependency-version: 1.6.9 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: langchain-openai dependency-version: 1.7.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ai-providers - dependency-name: google-genai dependency-version: 2.29.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ai-providers ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit 9b70476) * feat(llma): support scorer and experiment tags (#1085) (cherry picked from commit b086f65) * chore: Release v7.73.0 [skip ci] (cherry picked from commit 81931fa) * Update generated references (cherry picked from commit 9e62e0f) * fix(flags): accept rediss:// URLs for flag_fallback_cache_url (#1080) Signed-off-by: Sebastian Turner <[email protected]> (cherry picked from commit 20dabaa) * chore: Release v7.73.1 [skip ci] (cherry picked from commit 223b592) * Update generated references (cherry picked from commit e9e0830) * chore(deps): bump aiohttp from 3.14.3 to 3.14.4 (#1086) --- updated-dependencies: - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit 305dee3) * chore(deps): bump the uv group across 7 directories with 1 update (#1087) --- updated-dependencies: - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit 1b86549) * fix(flags): compare numeric string properties numerically (#1088) (cherry picked from commit 63b5dcc) * chore: Release v7.73.2 [skip ci] (cherry picked from commit cb7580e) * Update generated references (cherry picked from commit 1222ac7) * fix(ai): keep the openai.Stream API on sync OpenAI streams (#1062) Sync chat completions and Responses streams returned a bare generator, so `with`, `close()` and attributes such as `.response` were lost. Wrap them with _StreamWrapper, as #804 did for Anthropic and #645 did for async. Co-authored-by: Dustin Byrne <[email protected]> (cherry picked from commit f70b3cc) * fix(ai): take cumulative Anthropic stream usage from message_delta (#1074) Anthropic's message_delta usage is cumulative. With server tools (web search, web fetch, code execution) its input and cache counts exceed message_start's, but the stream accumulator only recorded message_start's input and cache counts, so streamed generations under-reported input tokens and cache writes. Keep the larger of the two for each count. Co-authored-by: Claude Opus 5.5 <[email protected]> (cherry picked from commit 57d1607) * chore: Release v7.73.3 [skip ci] (cherry picked from commit 24c6722) * Update generated references (cherry picked from commit bf87352) * feat(llma): add datasets to offline evaluations (#1090) * feat(llma): add datasets to offline evaluations * chore(llma): share evaluation request and response helpers * fix(llma): address dataset sdk review feedback (cherry picked from commit b8879a7) * chore: Release v7.74.0 [skip ci] (cherry picked from commit ac7fa99) * Update generated references (cherry picked from commit b14dd9e) * feat(django): add request context to OpenTelemetry spans (#1070) * feat(django): add request context to OpenTelemetry spans Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * fix(tracing): preserve span attributes and active context values Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * chore: use current tracing header settings in span checks Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * fix(tracing): respect disabled context owners Generated-By: PostHog Desktop Task-Id: bfd18848-e498-4352-a58a-b9ba85de4198 (cherry picked from commit 5f01fe9) * fix: enrich Flask, ASGI, and Celery spans with context (#1075) * fix(flask): add request context to active OpenTelemetry spans Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * fix(asgi): enrich active request spans Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * fix(celery): enrich active task spans with job context Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * chore: use current tracing header settings in framework checks Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * fix(celery): preserve caller span identity during eager tasks Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * chore(tests): use enabled clients in span tests Generated-By: PostHog Desktop Task-Id: bfd18848-e498-4352-a58a-b9ba85de4198 (cherry picked from commit 5ddb446) * chore: Release v7.75.0 [skip ci] (cherry picked from commit 908c77b) * Update generated references (cherry picked from commit a5b93ee) * fix(flags): match explicit null properties with string operators (#1092) (cherry picked from commit e9056e3) * chore: Release v7.75.1 [skip ci] (cherry picked from commit 361ca83) * Update generated references (cherry picked from commit 5e296d8) * fix(ai): capture OpenAI chat custom tool calls instead of raising (#1098) A custom tool call has `custom` instead of `function`, so formatting the response raised AttributeError from the wrapped create(), after the provider call had succeeded. Read the name and input from `custom`, matching PostHog/posthog-js#5251. (cherry picked from commit 4697e6f) * chore: Release v7.75.2 [skip ci] (cherry picked from commit e63a898) * Update generated references (cherry picked from commit e9710ec) * fix(ai): record mid-stream errors on streamed OpenAI, Anthropic and Gemini events (#1094) * fix(ai): record mid-stream errors on streamed OpenAI, Anthropic and Gemini events capture_streaming_event hard-coded $ai_http_status=200, and the stream generators only had a finally block. When the provider stream raised after the first chunk (overloaded, connection reset), the event was sent as a success with no $ai_is_error/$ai_error, unlike the non-streaming path. Catch the exception in each sync and async generator, pass it through StreamingEventData, and re-raise unchanged. The event now carries $ai_is_error, $ai_error and the error's status code (0 when it has none). Co-Authored-By: Claude Sonnet 5.5 <[email protected]> * fix(ai): pass the stream error to StreamingEventData directly and update the API snapshot mypy 1.16 rejected splatting {"error": error} into StreamingEventData(...) (typeddict-item). The field accepts None and capture_streaming_event reads it with .get(), so pass error=error. Regenerate the public API snapshot for the new StreamingEventData.error field. Co-Authored-By: Claude Sonnet 5.5 <[email protected]> --------- Co-authored-by: Claude Sonnet 5.5 <[email protected]> (cherry picked from commit dc2a2b4) * fix(ai): keep the refusal of a non-streamed OpenAI chat completion in the captured output (#1095) Co-authored-by: Claude Sonnet 5.5 <[email protected]> (cherry picked from commit 42c8b7b) * fix(ai): record an integer $ai_http_status in the LangChain callback handler (#1096) Co-authored-by: Claude Sonnet 5.5 <[email protected]> (cherry picked from commit a6ddc2e) * chore: Release v7.75.3 [skip ci] (cherry picked from commit dc01266) * Update generated references (cherry picked from commit 9185524) * fix(ai): keep latest cumulative output tokens across message_deltas (#1100) * fix(ai): keep latest cumulative output tokens across message_deltas Server tools such as web search can emit several message_delta events in one Anthropic stream, and each delta's usage is cumulative. The stream accumulator added every delta's output_tokens together, so a stream with two deltas reporting 50 then 110 cumulative tokens captured 160. Keep the latest cumulative value, matching how the input and cache counts are already handled and how the Anthropic SDK accumulates usage. * style(ai): format cumulative token async regression test --------- Co-authored-by: Manoel Aranda Neto <[email protected]> (cherry picked from commit 34ec4f8) * chore: Release v7.75.4 [skip ci] (cherry picked from commit 84664b4) * Update generated references (cherry picked from commit e17a8be) * fix: serialize non-finite floats as null in JSON payloads (#1081) * fix: serialize non-finite floats as null in JSON payloads Added a helper function to replace non-finite floats with None in JSON serialization. * test: cover non-finite float serialization in batch payloads * chore: refresh public API snapshot for DatetimeSerializer.encode (cherry picked from commit 18b39e8) * fix: annotate client timeouts as float (#1106) `timeout` and `feature_flags_request_timeout_seconds` were typed (or inferred) as `int`, so type checkers rejected fractional values even though they go straight to requests/httpx, which accept floats. Fixes #1089 Co-authored-by: Claude Opus 5.5 (1M context) <[email protected]> (cherry picked from commit b3fcec6) * chore: Release v7.75.5 [skip ci] (cherry picked from commit a774223) * Update generated references (cherry picked from commit 8c2d8f6) * fix(flags): retain tracking metadata in local evaluation snapshots (#1041) (cherry picked from commit a95331f) * chore: Release v7.75.6 [skip ci] (cherry picked from commit a5909dc) * Update generated references (cherry picked from commit 4b280fc) * chore(deps): bump uv to 0.13.4 and certifi to 2026.10.19 (#1104) Bump uv to 0.13.4 and certifi to 2026.10.19 Eight eMudhra intermediate CA private keys were broken, so anyone holding them can impersonate TLS servers to clients that still trust emSign ECC Root CA - G3. uv 0.13.4 and certifi 2026.10.19 are the first releases whose bundled CA store drops that root, and the versions pinned here still trust it. See the Python.org notice. https://discuss.python.org/t/information-for-python-users-regarding-emudhra-emsign-ca-certificate-security-incident/109576 Claude-Session: https://claude.ai/code/session_01T4ck1tYoQv3mzBTXH17asD Co-authored-by: Claude <[email protected]> (cherry picked from commit 7651b10) * test: send NaN and Infinity as null on the v1 path, as #1081 does on main #1081 keeps an event whose properties hold a non-finite float and writes the value as null. The v1 before_send test expected that event to be dropped; a capture v1 body test now pins the null on the wire, and the migration guide says so. Co-Authored-By: Claude Opus 5.5 <[email protected]> --------- Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: Sebastian Turner <[email protected]> Co-authored-by: Daniel Visca <[email protected]> Co-authored-by: releaser-posthog-python[bot] <262414804+releaser-posthog-python[bot]@users.noreply.github.com> Co-authored-by: Carlos Marchal <[email protected]> Co-authored-by: Juraj Majerik <[email protected]> Co-authored-by: Manoel Aranda Neto <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Dustin Byrne <[email protected]> Co-authored-by: Georgis Andonis <[email protected]> Co-authored-by: Claude Opus 5.5 <[email protected]> Co-authored-by: Radu Raicea <[email protected]> Co-authored-by: Sebastian Turner <[email protected]> Co-authored-by: mosafariuk <[email protected]> Co-authored-by: alexcastgonz <[email protected]> Co-authored-by: Paul D'Ambra <[email protected]> Co-authored-by: Harsh Kashyap <[email protected]> Co-authored-by: Manoel Aranda Neto <[email protected]> Co-authored-by: Anna Garcia <[email protected]> Co-authored-by: Georges-Antoine Assi <[email protected]>
💡 Motivation and Context
capture_streaming_eventhard-coded$ai_http_status: 200, and every streaming generator (OpenAI chat completions and responses, Anthropic, Gemini; sync and async) only had afinallyblock. If the provider stream raised after the first chunk (overloaded, connection reset), the event was still sent as a success, with no$ai_is_error/$ai_error. Non-streaming calls already record these (call_llm_and_track_usage).Each generator now catches the exception, passes it to the event through a new optional
errorfield onStreamingEventData, and re-raises it unchanged.capture_streaming_eventthen sets$ai_is_error: true,$ai_errorand$ai_http_status(the exception'sstatus_code, or 0 when it has none, as the non-streaming path does). Streams that finish normally, or are closed early by the consumer, are captured as before.💚 How did you test it?
posthog/test/ai/test_stream_midstream_error.py: the shared capture function with and without an error, and a stream that yields one chunk then raises for OpenAI chat (sync, async), OpenAI responses (sync), Anthropic (sync, async) and Gemini (sync, async). 9 of the 10 tests fail on main (the one that passes is the no-error case); all pass with the change.posthog/test/ai: 1081 passed, 15 skipped.ruff format --checkpasses on the touched files.📝 Checklist
If releasing new changes
sampo addto generate a changeset file (added.sampo/changesets/streaming-midstream-error.mdin the same format)🤖 Agent context
Autonomy: Fully autonomous
finallyblock while the non-streaming path already records errors. Agent-authored, needs human review.🤖 Generated with Claude Code