Skip to content

fix(prism): fail-fast Lium orphans after control-plane restart - #130

Merged
echobt merged 1 commit into
mainfrom
fix/prism-lium-orphan-reconcile
Aug 12, 2026
Merged

fix(prism): fail-fast Lium orphans after control-plane restart#130
echobt merged 1 commit into
mainfrom
fix/prism-lium-orphan-reconcile

Conversation

@echobt

@echobt echobt commented Aug 12, 2026

Copy link
Copy Markdown
Contributor

Summary

  • On boot and every ~30s, fail mid-flight provisioning/running rows whose worker is not alive (control_plane_restart / harness_detached); requeue post-measure review stages; best-effort terminate pods when the BYOK vault still has a key.
  • Optional short-TTL encrypted payer vault (PRISM_PAYER_VAULT_DIR + key file) so restarts can still stop miner-billed pods without storing keys in Postgres.
  • GET /v1/submissions/{id}/logs?since= + site-api proxies; list/detail surface orphan copy for the FE.

Test plan

  • cargo test -p prism-orphan -p prism-lium-payer -p prism-final
  • cargo clippy on touched crates (-D warnings)
  • cargo run -p xtask -- loc-cap / external-docs-check / spec-check
  • CI green on this PR
  • After merge: generate deploy/secrets/prism/payer_vault_key on prod/staging hosts, ensure /var/lib/prism/payer-vault exists (AutoModel pin mount unchanged), promote digests + remote-deploy prism-challenge (+ gateway for site routes)
  • Restart simulation: in-flight running row becomes failed promptly (not ~10h stuck)

Mark detached Lium runs promptly, seal BYOK keys for pod cleanup, and expose
live harness logs through challenge + site-api for the miner FE.
@coderabbitai

coderabbitai Bot commented Aug 12, 2026

Copy link
Copy Markdown

Caution

Review failed

An error occurred during the review process. Please try again later.

✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch fix/prism-lium-orphan-reconcile

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@echobt
echobt merged commit c1ad372 into main Aug 12, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant