Skip to content

feat(event): score CHRONOS occurrence forecasts with a Brier rule - #85

Draft
seonghobae wants to merge 1 commit into
mainfrom
agent/event-chronos-prediction-calibration
Draft

feat(event): score CHRONOS occurrence forecasts with a Brier rule#85
seonghobae wants to merge 1 commit into
mainfrom
agent/event-chronos-prediction-calibration

Conversation

@seonghobae

Copy link
Copy Markdown
Contributor

Summary

#45 remains ready and merge-first, but is review-blocked (CHANGES_REQUESTED from OpenCode on stale SHA 190a08f; exact-head 293b1f5 has live PostgreSQL, line/branch coverage, and strix SUCCESS). #46#51 were converted back to draft so they cannot leapfrog #45.

This increment adds CHRONOS occurrence-prediction calibration in existing event_core from protected main 40adac9. It does not recreate in-flight crates or allocate migration 0008.

  • Predicted occurrences stay hypothetical and cannot be cast to event instances
  • Perfect (1,0,1) forecasts recover Brier 0 against later-observed truth
  • Calibrated probabilities beat an always-occur predictor on mixed later truth
  • Empty or mismatched streams fail closed

Claim boundary

ADR 0016 forecast-calibration slice only. Not TDT detection, schema-slot extraction, temporal-consistency reasoning, ESEM/DSEM fit, GPU kernels, or encrypted mapping persistence.

Test plan

  • RED: prediction_calibration_contract failed with E0432/E0599
  • cargo test -p event_core --offline
  • cargo clippy -p event_core --all-targets --offline -- -D warnings
  • python3 scripts/check_docstrings.py and python3 scripts/validate_documentation.py
  • cargo llvm-cov -p event_core lines 343/343; nightly-2026-08-01 --branch 20/20
  • Exact-head required Checks; independent review

Do not self-approve or merge. Prefer merge #45 when eligible. Keep this PR draft until then.

Keep predicted occurrences hypothetical, refuse instance promotion, and recover known-truth Brier scores without allocating migration 0008.
@coderabbitai

coderabbitai Bot commented Aug 16, 2026

Copy link
Copy Markdown

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 98a960c9-63fc-4fe4-938e-95c9feb7290d

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant