Repository navigation
feat(llma): support scorer and experiment tags - #1085
Conversation
There was a problem hiding this comment.
Your trial has ended. Reactivate Greptile to resume code reviews.
There was a problem hiding this comment.
Not approved — this change needs a human reviewer.
Re-adding the stamphog label gives the same result unless the changed files change.
stamphog won't auto-review this pull request because two gates refused it. The deny-list gate flagged it for touching the public API: it changes Scorer, adds tag parameters and get_tags()/set_tags() methods, and updates references/public_api_snapshot.txt. The tier gate classified it as T2-never, meaning a cross-cutting feature (395 lines across 9 files) that is not eligible for automated review. The size gate passed, so splitting the pull request would not clear the public API or tier refusals.
The author should ask a human reviewer to look at it. The PR description already notes that human review is required, so this is the expected path.
- greptile-apps[bot] reviewed the current head.
Gate mechanics and policy version
| Gate | Result | |
|---|---|---|
| prerequisites | ✓ | all clear |
| deny-list | ✗ | matches: public_api |
| size | ✓ | 147L, 4F substantive, 395L/9F incl. docs/generated/snapshots — within ceiling |
| tier | ✗ | classified as T2-never: T2-never (395L, 9F, cross-cutting, feat) |
| stamphog 2.6.0 | .stamphog/policy.yml @ unknown · reviewed head 484c415 |
posthog-python Compliance ReportDate: 2026-10-19T18:13:50.791749+00:00 ✅ All Tests Passed!121/121 tests passed Capture_V1 Tests✅ 95/95 tests passed View Details
Capture_Ai Tests✅ 5/5 tests passed View Details
Feature_Flags Tests✅ 17/17 tests passed View Details
Feature_Flags_Local_Evaluation Tests✅ 4/4 tests passed View Details
|
* feat(metrics): attach trace exemplars to flushed metric series (#1057) (cherry picked from commit 3cc2d64) * chore: Release v7.69.0 [skip ci] (cherry picked from commit 653ff87) * Update generated references (cherry picked from commit 6f65898) * feat(ai): add per-request context to span processor (#1060) * feat: span processor request context * fix: span processor review feedback * fix: span processor review follow-ups (cherry picked from commit 6916499) * chore: Release v7.70.0 [skip ci] (cherry picked from commit a615eed) * Update generated references (cherry picked from commit a49648e) * fix(prompts): share one request between concurrent fetches of the same prompt (#1059) (cherry picked from commit 10d094e) * chore: Release v7.70.1 [skip ci] (cherry picked from commit ec71a24) * Update generated references (cherry picked from commit fc3c434) * fix(ai): mark cancelled async LLM calls as errors (#1065) * fix(ai): mark cancelled async LLM calls as errors * test: fix Python 3.10 cancellation and FastMCP compatibility (cherry picked from commit fec41f2) * chore: Release v7.70.2 [skip ci] (cherry picked from commit e381808) * Update generated references (cherry picked from commit f33d55d) * chore(deps): bump the ai-providers group with 8 updates (#1054) Bumps the ai-providers group with 8 updates: | Package | From | To | | --- | --- | --- | | [langchain](https://github.com/langchain-ai/langchain) | `1.4.2` | `1.4.3` | | [anthropic](https://github.com/anthropics/anthropic-sdk-python) | `1.8.0` | `1.11.0` | | [langgraph](https://github.com/langchain-ai/langgraph) | `1.2.12` | `1.2.13` | | [langchain-core](https://github.com/langchain-ai/langchain) | `1.6.5` | `1.6.6` | | [langchain-openai](https://github.com/langchain-ai/langchain) | `1.6.6` | `1.6.7` | | [langchain-anthropic](https://github.com/langchain-ai/langchain) | `1.7.4` | `1.7.5` | | [google-genai](https://github.com/googleapis/python-genai) | `2.25.0` | `2.28.0` | | [langchain-text-splitters](https://github.com/langchain-ai/langchain) | `1.1.2` | `1.1.3` | Updates `langchain` from 1.4.2 to 1.4.3 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain==1.4.2...langchain==1.4.3) Updates `anthropic` from 1.8.0 to 1.11.0 - [Release notes](https://github.com/anthropics/anthropic-sdk-python/releases) - [Changelog](https://github.com/anthropics/anthropic-sdk-python/blob/main/CHANGELOG.md) - [Commits](anthropics/anthropic-sdk-python@v1.8.0...v1.11.0) Updates `langgraph` from 1.2.12 to 1.2.13 - [Release notes](https://github.com/langchain-ai/langgraph/releases) - [Commits](langchain-ai/langgraph@1.2.12...1.2.13) Updates `langchain-core` from 1.6.5 to 1.6.6 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-core==1.6.5...langchain-core==1.6.6) Updates `langchain-openai` from 1.6.6 to 1.6.7 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-openai==1.6.6...langchain-openai==1.6.7) Updates `langchain-anthropic` from 1.7.4 to 1.7.5 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-anthropic==1.7.4...langchain-anthropic==1.7.5) Updates `google-genai` from 2.25.0 to 2.28.0 - [Release notes](https://github.com/googleapis/python-genai/releases) - [Changelog](https://github.com/googleapis/python-genai/blob/main/CHANGELOG.md) - [Commits](googleapis/python-genai@v2.25.0...v2.28.0) Updates `langchain-text-splitters` from 1.1.2 to 1.1.3 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-text-splitters==1.1.2...langchain-text-splitters==1.1.3) --- updated-dependencies: - dependency-name: langchain dependency-version: 1.4.3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: anthropic dependency-version: 1.11.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ai-providers - dependency-name: langgraph dependency-version: 1.2.13 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: langchain-core dependency-version: 1.6.6 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: langchain-openai dependency-version: 1.6.7 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: langchain-anthropic dependency-version: 1.7.5 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: google-genai dependency-version: 2.28.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ai-providers - dependency-name: langchain-text-splitters dependency-version: 1.1.3 dependency-type: indirect update-type: version-update:semver-patch dependency-group: ai-providers ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Dustin Byrne <[email protected]> (cherry picked from commit f95e1f4) * chore(deps): bump the github-actions group with 2 updates (#1055) Bumps the github-actions group with 2 updates: [dtolnay/rust-toolchain](https://github.com/dtolnay/rust-toolchain) and [PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml](https://github.com/posthog/posthog-sdk-test-harness). Updates `dtolnay/rust-toolchain` from 7e38f4b43b4db5c8dd498af069a4f6196df1d067 to e2a55d2ffb04f378e9626c28d38b36d230d1e12f - [Release notes](https://github.com/dtolnay/rust-toolchain/releases) - [Commits](dtolnay/rust-toolchain@7e38f4b...e2a55d2) Updates `PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml` from 1.11.0 to 1.13.1 - [Release notes](https://github.com/posthog/posthog-sdk-test-harness/releases) - [Changelog](https://github.com/PostHog/posthog-sdk-test-harness/blob/main/CHANGELOG.md) - [Commits](PostHog/posthog-sdk-test-harness@4593de8...e32f08b) --- updated-dependencies: - dependency-name: dtolnay/rust-toolchain dependency-version: e2a55d2ffb04f378e9626c28d38b36d230d1e12f dependency-type: direct:production dependency-group: github-actions - dependency-name: PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml dependency-version: 1.13.1 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Dustin Byrne <[email protected]> (cherry picked from commit 9b7e632) * chore(deps): bump mcp from 1.28.1 to 1.30.0 (#1068) Bumps [mcp](https://github.com/modelcontextprotocol/python-sdk) from 1.28.1 to 1.30.0. - [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases) - [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md) - [Commits](modelcontextprotocol/python-sdk@v1.28.1...v1.30.0) --- updated-dependencies: - dependency-name: mcp dependency-version: 1.30.0 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit 12e88a2) * docs: clarify reusable flush and terminal shutdown guidance (#1043) * docs: clarify reusable flush and terminal shutdown guidance * docs: preserve published 7.67.0 reference snapshot (cherry picked from commit d0b6f71) * chore: Release v7.71.0 [skip ci] (cherry picked from commit 20a574e) * Update generated references (cherry picked from commit 883eaca) * chore(deps): bump the uv group across 4 directories with 2 updates (#1069) Bumps the uv group with 1 update in the /examples/example-ai-llamaindex directory: [tinytag](https://github.com/tinytag/tinytag). Bumps the uv group with 1 update in the /examples/example-ai-openai-agents directory: [mcp](https://github.com/modelcontextprotocol/python-sdk). Bumps the uv group with 1 update in the /examples/example-ai-pydantic-ai directory: [mcp](https://github.com/modelcontextprotocol/python-sdk). Bumps the uv group with 1 update in the /examples/example-ai-semantic-kernel directory: [mcp](https://github.com/modelcontextprotocol/python-sdk). Updates `tinytag` from 2.2.1 to 2.3.0 - [Release notes](https://github.com/tinytag/tinytag/releases) - [Commits](tinytag/tinytag@2.2.1...2.3.0) Updates `mcp` from 1.28.1 to 1.30.0 - [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases) - [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md) - [Commits](modelcontextprotocol/python-sdk@v1.28.1...v1.30.0) Updates `mcp` from 1.29.1 to 1.30.0 - [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases) - [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md) - [Commits](modelcontextprotocol/python-sdk@v1.28.1...v1.30.0) Updates `mcp` from 2.1.1 to 2.2.0 - [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases) - [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md) - [Commits](modelcontextprotocol/python-sdk@v1.28.1...v1.30.0) --- updated-dependencies: - dependency-name: tinytag dependency-version: 2.3.0 dependency-type: indirect dependency-group: uv - dependency-name: mcp dependency-version: 1.30.0 dependency-type: indirect dependency-group: uv - dependency-name: mcp dependency-version: 1.30.0 dependency-type: indirect dependency-group: uv - dependency-name: mcp dependency-version: 2.2.0 dependency-type: indirect dependency-group: uv ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit b1363dc) * chore(deps-dev): bump claude-agent-sdk from 0.1.50 to 0.2.121 (#1073) Bumps [claude-agent-sdk](https://github.com/anthropics/claude-agent-sdk-python) from 0.1.50 to 0.2.121. - [Release notes](https://github.com/anthropics/claude-agent-sdk-python/releases) - [Changelog](https://github.com/anthropics/claude-agent-sdk-python/blob/main/CHANGELOG.md) - [Commits](anthropics/claude-agent-sdk-python@v0.1.50...v0.2.121) --- updated-dependencies: - dependency-name: claude-agent-sdk dependency-version: 0.2.121 dependency-type: direct:development ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit a89acf8) * feat(mcp): stop sending standalone $identify events (#1067) * feat(mcp): stop sending standalone $identify events The identify callback still sets distinct_id, $set and $groups on every event. The standalone event carried no $anon_distinct_id, so ingestion merged no person, and stateless servers sent one per tool call. Co-Authored-By: Claude Opus 5.5 <[email protected]> * chore(mcp): assert no $identify over the wire and refresh docs Co-Authored-By: Claude Opus 5.5 <[email protected]> --------- Co-authored-by: Claude Opus 5.5 <[email protected]> (cherry picked from commit facd617) * chore: Release v7.72.0 [skip ci] (cherry picked from commit 876b955) * Update generated references (cherry picked from commit b8327de) * chore(deps): bump the github-actions group with 6 updates (#1083) Bumps the github-actions group with 6 updates: | Package | From | To | | --- | --- | --- | | [astral-sh/setup-uv](https://github.com/astral-sh/setup-uv) | `10.2.0` | `10.3.0` | | [github/codeql-action/init](https://github.com/github/codeql-action) | `4.38.2` | `4.38.3` | | [github/codeql-action/analyze](https://github.com/github/codeql-action) | `4.38.2` | `4.38.3` | | [actions/create-github-app-token](https://github.com/actions/create-github-app-token) | `3.2.0` | `3.3.0` | | [dtolnay/rust-toolchain](https://github.com/dtolnay/rust-toolchain) | `e2a55d2ffb04f378e9626c28d38b36d230d1e12f` | `683b588c487a69d01f6c6ddf40f036ff682cc2c8` | | [PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml](https://github.com/posthog/posthog-sdk-test-harness) | `1.13.1` | `1.15.0` | Updates `astral-sh/setup-uv` from 10.2.0 to 10.3.0 - [Release notes](https://github.com/astral-sh/setup-uv/releases) - [Commits](astral-sh/setup-uv@c18668a...1c37ad0) Updates `github/codeql-action/init` from 4.38.2 to 4.38.3 - [Release notes](https://github.com/github/codeql-action/releases) - [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md) - [Commits](github/codeql-action@2892aa5...24c5418) Updates `github/codeql-action/analyze` from 4.38.2 to 4.38.3 - [Release notes](https://github.com/github/codeql-action/releases) - [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md) - [Commits](github/codeql-action@2892aa5...24c5418) Updates `actions/create-github-app-token` from 3.2.0 to 3.3.0 - [Release notes](https://github.com/actions/create-github-app-token/releases) - [Changelog](https://github.com/actions/create-github-app-token/blob/main/CHANGELOG.md) - [Commits](actions/create-github-app-token@bcd2ba4...64ab729) Updates `dtolnay/rust-toolchain` from e2a55d2ffb04f378e9626c28d38b36d230d1e12f to 683b588c487a69d01f6c6ddf40f036ff682cc2c8 - [Release notes](https://github.com/dtolnay/rust-toolchain/releases) - [Commits](dtolnay/rust-toolchain@e2a55d2...683b588) Updates `PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml` from 1.13.1 to 1.15.0 - [Release notes](https://github.com/posthog/posthog-sdk-test-harness/releases) - [Changelog](https://github.com/PostHog/posthog-sdk-test-harness/blob/main/CHANGELOG.md) - [Commits](PostHog/posthog-sdk-test-harness@e32f08b...64ffa6a) --- updated-dependencies: - dependency-name: astral-sh/setup-uv dependency-version: 10.3.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions - dependency-name: github/codeql-action/init dependency-version: 4.38.3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: github-actions - dependency-name: github/codeql-action/analyze dependency-version: 4.38.3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: github-actions - dependency-name: actions/create-github-app-token dependency-version: 3.3.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions - dependency-name: dtolnay/rust-toolchain dependency-version: 683b588c487a69d01f6c6ddf40f036ff682cc2c8 dependency-type: direct:production dependency-group: github-actions - dependency-name: PostHog/posthog-sdk-test-harness/.github/workflows/test-sdk-action.yml dependency-version: 1.15.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: github-actions ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit 3822271) * chore(deps): bump the ai-providers group with 6 updates (#1082) Bumps the ai-providers group with 6 updates: | Package | From | To | | --- | --- | --- | | [langchain](https://github.com/langchain-ai/langchain) | `1.4.3` | `1.4.4` | | [anthropic](https://github.com/anthropics/anthropic-sdk-python) | `1.11.0` | `1.13.0` | | [langgraph](https://github.com/langchain-ai/langgraph) | `1.2.13` | `1.2.14` | | [langchain-core](https://github.com/langchain-ai/langchain) | `1.6.6` | `1.6.9` | | [langchain-openai](https://github.com/langchain-ai/langchain) | `1.6.7` | `1.7.0` | | [google-genai](https://github.com/googleapis/python-genai) | `2.28.0` | `2.29.0` | Updates `langchain` from 1.4.3 to 1.4.4 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain==1.4.3...langchain==1.4.4) Updates `anthropic` from 1.11.0 to 1.13.0 - [Release notes](https://github.com/anthropics/anthropic-sdk-python/releases) - [Changelog](https://github.com/anthropics/anthropic-sdk-python/blob/main/CHANGELOG.md) - [Commits](anthropics/anthropic-sdk-python@v1.11.0...v1.13.0) Updates `langgraph` from 1.2.13 to 1.2.14 - [Release notes](https://github.com/langchain-ai/langgraph/releases) - [Commits](langchain-ai/langgraph@1.2.13...1.2.14) Updates `langchain-core` from 1.6.6 to 1.6.9 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-core==1.6.6...langchain-core==1.6.9) Updates `langchain-openai` from 1.6.7 to 1.7.0 - [Release notes](https://github.com/langchain-ai/langchain/releases) - [Commits](langchain-ai/langchain@langchain-openai==1.6.7...langchain-openai==1.7.0) Updates `google-genai` from 2.28.0 to 2.29.0 - [Release notes](https://github.com/googleapis/python-genai/releases) - [Changelog](https://github.com/googleapis/python-genai/blob/main/CHANGELOG.md) - [Commits](googleapis/python-genai@v2.28.0...v2.29.0) --- updated-dependencies: - dependency-name: langchain dependency-version: 1.4.4 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: anthropic dependency-version: 1.13.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ai-providers - dependency-name: langgraph dependency-version: 1.2.14 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: langchain-core dependency-version: 1.6.9 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: ai-providers - dependency-name: langchain-openai dependency-version: 1.7.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ai-providers - dependency-name: google-genai dependency-version: 2.29.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: ai-providers ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit 9b70476) * feat(llma): support scorer and experiment tags (#1085) (cherry picked from commit b086f65) * chore: Release v7.73.0 [skip ci] (cherry picked from commit 81931fa) * Update generated references (cherry picked from commit 9e62e0f) * fix(flags): accept rediss:// URLs for flag_fallback_cache_url (#1080) Signed-off-by: Sebastian Turner <[email protected]> (cherry picked from commit 20dabaa) * chore: Release v7.73.1 [skip ci] (cherry picked from commit 223b592) * Update generated references (cherry picked from commit e9e0830) * chore(deps): bump aiohttp from 3.14.3 to 3.14.4 (#1086) --- updated-dependencies: - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit 305dee3) * chore(deps): bump the uv group across 7 directories with 1 update (#1087) --- updated-dependencies: - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv - dependency-name: aiohttp dependency-version: 3.14.4 dependency-type: indirect dependency-group: uv ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (cherry picked from commit 1b86549) * fix(flags): compare numeric string properties numerically (#1088) (cherry picked from commit 63b5dcc) * chore: Release v7.73.2 [skip ci] (cherry picked from commit cb7580e) * Update generated references (cherry picked from commit 1222ac7) * fix(ai): keep the openai.Stream API on sync OpenAI streams (#1062) Sync chat completions and Responses streams returned a bare generator, so `with`, `close()` and attributes such as `.response` were lost. Wrap them with _StreamWrapper, as #804 did for Anthropic and #645 did for async. Co-authored-by: Dustin Byrne <[email protected]> (cherry picked from commit f70b3cc) * fix(ai): take cumulative Anthropic stream usage from message_delta (#1074) Anthropic's message_delta usage is cumulative. With server tools (web search, web fetch, code execution) its input and cache counts exceed message_start's, but the stream accumulator only recorded message_start's input and cache counts, so streamed generations under-reported input tokens and cache writes. Keep the larger of the two for each count. Co-authored-by: Claude Opus 5.5 <[email protected]> (cherry picked from commit 57d1607) * chore: Release v7.73.3 [skip ci] (cherry picked from commit 24c6722) * Update generated references (cherry picked from commit bf87352) * feat(llma): add datasets to offline evaluations (#1090) * feat(llma): add datasets to offline evaluations * chore(llma): share evaluation request and response helpers * fix(llma): address dataset sdk review feedback (cherry picked from commit b8879a7) * chore: Release v7.74.0 [skip ci] (cherry picked from commit ac7fa99) * Update generated references (cherry picked from commit b14dd9e) * feat(django): add request context to OpenTelemetry spans (#1070) * feat(django): add request context to OpenTelemetry spans Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * fix(tracing): preserve span attributes and active context values Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * chore: use current tracing header settings in span checks Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * fix(tracing): respect disabled context owners Generated-By: PostHog Desktop Task-Id: bfd18848-e498-4352-a58a-b9ba85de4198 (cherry picked from commit 5f01fe9) * fix: enrich Flask, ASGI, and Celery spans with context (#1075) * fix(flask): add request context to active OpenTelemetry spans Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * fix(asgi): enrich active request spans Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * fix(celery): enrich active task spans with job context Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * chore: use current tracing header settings in framework checks Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * fix(celery): preserve caller span identity during eager tasks Generated-By: PostHog Desktop Task-Id: 5681be44-4986-48db-b140-1bda88f75f96 * chore(tests): use enabled clients in span tests Generated-By: PostHog Desktop Task-Id: bfd18848-e498-4352-a58a-b9ba85de4198 (cherry picked from commit 5ddb446) * chore: Release v7.75.0 [skip ci] (cherry picked from commit 908c77b) * Update generated references (cherry picked from commit a5b93ee) * fix(flags): match explicit null properties with string operators (#1092) (cherry picked from commit e9056e3) * chore: Release v7.75.1 [skip ci] (cherry picked from commit 361ca83) * Update generated references (cherry picked from commit 5e296d8) * fix(ai): capture OpenAI chat custom tool calls instead of raising (#1098) A custom tool call has `custom` instead of `function`, so formatting the response raised AttributeError from the wrapped create(), after the provider call had succeeded. Read the name and input from `custom`, matching PostHog/posthog-js#5251. (cherry picked from commit 4697e6f) * chore: Release v7.75.2 [skip ci] (cherry picked from commit e63a898) * Update generated references (cherry picked from commit e9710ec) * fix(ai): record mid-stream errors on streamed OpenAI, Anthropic and Gemini events (#1094) * fix(ai): record mid-stream errors on streamed OpenAI, Anthropic and Gemini events capture_streaming_event hard-coded $ai_http_status=200, and the stream generators only had a finally block. When the provider stream raised after the first chunk (overloaded, connection reset), the event was sent as a success with no $ai_is_error/$ai_error, unlike the non-streaming path. Catch the exception in each sync and async generator, pass it through StreamingEventData, and re-raise unchanged. The event now carries $ai_is_error, $ai_error and the error's status code (0 when it has none). Co-Authored-By: Claude Sonnet 5.5 <[email protected]> * fix(ai): pass the stream error to StreamingEventData directly and update the API snapshot mypy 1.16 rejected splatting {"error": error} into StreamingEventData(...) (typeddict-item). The field accepts None and capture_streaming_event reads it with .get(), so pass error=error. Regenerate the public API snapshot for the new StreamingEventData.error field. Co-Authored-By: Claude Sonnet 5.5 <[email protected]> --------- Co-authored-by: Claude Sonnet 5.5 <[email protected]> (cherry picked from commit dc2a2b4) * fix(ai): keep the refusal of a non-streamed OpenAI chat completion in the captured output (#1095) Co-authored-by: Claude Sonnet 5.5 <[email protected]> (cherry picked from commit 42c8b7b) * fix(ai): record an integer $ai_http_status in the LangChain callback handler (#1096) Co-authored-by: Claude Sonnet 5.5 <[email protected]> (cherry picked from commit a6ddc2e) * chore: Release v7.75.3 [skip ci] (cherry picked from commit dc01266) * Update generated references (cherry picked from commit 9185524) * fix(ai): keep latest cumulative output tokens across message_deltas (#1100) * fix(ai): keep latest cumulative output tokens across message_deltas Server tools such as web search can emit several message_delta events in one Anthropic stream, and each delta's usage is cumulative. The stream accumulator added every delta's output_tokens together, so a stream with two deltas reporting 50 then 110 cumulative tokens captured 160. Keep the latest cumulative value, matching how the input and cache counts are already handled and how the Anthropic SDK accumulates usage. * style(ai): format cumulative token async regression test --------- Co-authored-by: Manoel Aranda Neto <[email protected]> (cherry picked from commit 34ec4f8) * chore: Release v7.75.4 [skip ci] (cherry picked from commit 84664b4) * Update generated references (cherry picked from commit e17a8be) * fix: serialize non-finite floats as null in JSON payloads (#1081) * fix: serialize non-finite floats as null in JSON payloads Added a helper function to replace non-finite floats with None in JSON serialization. * test: cover non-finite float serialization in batch payloads * chore: refresh public API snapshot for DatetimeSerializer.encode (cherry picked from commit 18b39e8) * fix: annotate client timeouts as float (#1106) `timeout` and `feature_flags_request_timeout_seconds` were typed (or inferred) as `int`, so type checkers rejected fractional values even though they go straight to requests/httpx, which accept floats. Fixes #1089 Co-authored-by: Claude Opus 5.5 (1M context) <[email protected]> (cherry picked from commit b3fcec6) * chore: Release v7.75.5 [skip ci] (cherry picked from commit a774223) * Update generated references (cherry picked from commit 8c2d8f6) * fix(flags): retain tracking metadata in local evaluation snapshots (#1041) (cherry picked from commit a95331f) * chore: Release v7.75.6 [skip ci] (cherry picked from commit a5909dc) * Update generated references (cherry picked from commit 4b280fc) * chore(deps): bump uv to 0.13.4 and certifi to 2026.10.19 (#1104) Bump uv to 0.13.4 and certifi to 2026.10.19 Eight eMudhra intermediate CA private keys were broken, so anyone holding them can impersonate TLS servers to clients that still trust emSign ECC Root CA - G3. uv 0.13.4 and certifi 2026.10.19 are the first releases whose bundled CA store drops that root, and the versions pinned here still trust it. See the Python.org notice. https://discuss.python.org/t/information-for-python-users-regarding-emudhra-emsign-ca-certificate-security-incident/109576 Claude-Session: https://claude.ai/code/session_01T4ck1tYoQv3mzBTXH17asD Co-authored-by: Claude <[email protected]> (cherry picked from commit 7651b10) * test: send NaN and Infinity as null on the v1 path, as #1081 does on main #1081 keeps an event whose properties hold a non-finite float and writes the value as null. The v1 before_send test expected that event to be dropped; a capture v1 body test now pins the null on the wire, and the migration guide says so. Co-Authored-By: Claude Opus 5.5 <[email protected]> --------- Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: Sebastian Turner <[email protected]> Co-authored-by: Daniel Visca <[email protected]> Co-authored-by: releaser-posthog-python[bot] <262414804+releaser-posthog-python[bot]@users.noreply.github.com> Co-authored-by: Carlos Marchal <[email protected]> Co-authored-by: Juraj Majerik <[email protected]> Co-authored-by: Manoel Aranda Neto <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Dustin Byrne <[email protected]> Co-authored-by: Georgis Andonis <[email protected]> Co-authored-by: Claude Opus 5.5 <[email protected]> Co-authored-by: Radu Raicea <[email protected]> Co-authored-by: Sebastian Turner <[email protected]> Co-authored-by: mosafariuk <[email protected]> Co-authored-by: alexcastgonz <[email protected]> Co-authored-by: Paul D'Ambra <[email protected]> Co-authored-by: Harsh Kashyap <[email protected]> Co-authored-by: Manoel Aranda Neto <[email protected]> Co-authored-by: Anna Garcia <[email protected]> Co-authored-by: Georges-Antoine Assi <[email protected]>
💡 Motivation and Context
The app supports tags for scorers and offline experiments, but Python SDK callers cannot manage them. This adds matching synchronous and asynchronous public APIs:
Scorer.tags, andany/alltag filters on scorer lists.get_tags()andset_tags()methods for reading, replacing, and clearing tags, including after completion.Tags remain separate from immutable scorer versions and experiment upload declarations. Usage examples document replacement behavior and personal-key permissions.
💚 How did you test it?
📝 Checklist
🤖 Agent context
Autonomy: Human-driven (agent-assisted). DRI: @Radu-Raicea.
Implemented with Codex using Git, GitHub CLI, pytest, Ruff, and mypy. Local Codex session. The implementation follows the existing app API and preserves compatibility with older scorer responses that omit tags. Requires human review.