Skip to content

chore: run the capture v1 compliance suites from harness 1.25.0 - #1137

Merged
eli-r-ph merged 6 commits into
v1from
eli/v1-harness-capture-v1-sync
Oct 28, 2026
Merged

eli-r-ph merged 6 commits into
v1from
eli/v1-harness-capture-v1-sync

Conversation

@eli-r-ph

@eli-r-ph eli-r-ph commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

💡 Motivation and Context

Harness 1.25.0 (posthog-sdk-test-harness#92) brings the capture_v1 and capture_ai_v1 suites up to date with capture v1: 404, 429 and 502 retries, the SDK's own backoff, duplicates_dropped, the warning result, caller uuids in lowercase, AI routing and lane isolation. It also gates some tests behind new adapter capabilities.

  • Pin the compliance job to harness 1.25.0.

  • Declare event_uuid_override, bounded_retries, disable_geoip and historical_migration, which this adapter already supports. Without them those tests are skipped.

  • Support the newer harness features (posthog-sdk-test-harness#95) and declare them: reported_drops (from on_error), log_capture (the posthog logger), generated_payloads, property_layers (super_properties and before_send) and fail_open.

Harness 1.25.0 is published (posthog-sdk-test-harness #92, #94 and #95).

💚 How did you test it?

Ran every harness suite from the #92 branch locally against this adapter on v1 with these capabilities declared: 235/235 passed, including the new tests. Adapter unit tests pass, with the capability assertion extended.

Both v1 suites from the posthog-sdk-test-harness#95 branch, with these features: 223/223.

📝 Checklist

  • I reviewed the submitted code.
  • I added tests to verify the changes.
  • I updated the docs if needed.
  • No breaking change or entry added to the changelog.

🤖 Agent context

Autonomy: Human-driven (agent-assisted)

Claude Code (Claude Opus 5.5) wrote this change as part of the harness update and ran the compliance suites locally against the adapter.

🤖 Generated with Claude Code

Declare the adapter capabilities harness 1.23.0 uses to gate tests:
event_uuid_override, bounded_retries, disable_geoip and historical_migration.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
@eli-r-ph eli-r-ph self-assigned this Oct 27, 2026
…loads, property_layers and fail_open features

Co-Authored-By: Claude Opus 5.5 <[email protected]>
@eli-r-ph
eli-r-ph marked this pull request as ready for review October 28, 2026 00:51
@eli-r-ph
eli-r-ph requested a review from a team as a code owner October 28, 2026 00:51

@dustinbyrne dustinbyrne left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The adapter additions look sound overall, but published harness 1.23.0 contains an unrelated flags update and its capture contracts are unchanged from 1.13.1. Please select the release containing the intended capture suites before relying on this CI coverage. Two optional adapter edge cases are noted inline. Formatting and full compliance runs against the correct release remain outstanding.

AI-assisted review.

Comment thread .github/workflows/sdk-compliance.yml Resolved
Comment thread sdk_compliance_adapter/adapter.py Resolved
Comment thread sdk_compliance_adapter/adapter.py Resolved
@dustinbyrne
dustinbyrne requested a review from a team October 28, 2026 14:53
@eli-r-ph eli-r-ph changed the title chore: run the capture v1 compliance suites from harness 1.23.0 chore: run the capture v1 compliance suites from harness 1.25.0 Oct 28, 2026

@dustinbyrne dustinbyrne left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The harness release selection, reset ordering and marker-byte sizing fixes are verified. The intended compliance cases now run successfully across all three codecs. One optional adapter diagnostic edge case is noted inline; it does not block acceptance.

AI-assisted review.

Comment thread sdk_compliance_adapter/adapter.py Resolved
eli-r-ph and others added 2 commits October 28, 2026 12:54
Also point adapter docs at harness 1.25.0.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
@eli-r-ph
eli-r-ph merged commit fd1f241 into v1 Oct 28, 2026
65 of 67 checks passed
@eli-r-ph
eli-r-ph deleted the eli/v1-harness-capture-v1-sync branch October 28, 2026 20:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants