Skip to content

pcg + pipeline preflight contract - #547

Merged
akhileshh merged 4 commits into
mainfrom
pcgv2-pipeline
Oct 7, 2026
Merged

akhileshh merged 4 commits into
mainfrom
pcgv2-pipeline

Conversation

@akhileshh

Copy link
Copy Markdown
Contributor

No description provided.

akhileshh and others added 4 commits October 7, 2026 13:17
MeshConfig drops chunk_size; setup_mesh_meta derives it at mip and rejects a mip past the watershed.
The root-layer build stamps earliest_ts, which get_earliest_timestamp and derive_initial_ts read.
Ingest takes root IDs from the sharded root counters whatever n_threads is, as edits do.

Co-Authored-By: Claude <[email protected]>
- Entrypoint guards hand main to run_and_exit, which leaves through os._exit so a client's non-daemon thread never stalls the pod.
- The worker harness reads PCG_N_PROCESSES, the name the CAVEpipelines Job sets.
- Once the root layer is built, the ingest worker runs the hierarchy sanity suite, which skips the cross-edge check when no sampled chunk has cross edges; a failure fails the pod without re-opening the chunk.

Co-Authored-By: Claude <[email protected]>
- The pipeline worker passed a Python int, which numpy 1.26 reads as int64, so every id read above layer 2 raised on `int64 | uint64` and no parent chunk meshed.
- A deterministic error now returns fatal instead of transient, so one bug costs a single attempt rather than every retry the index has.

Co-Authored-By: Claude <[email protected]>
@akhileshh
akhileshh merged commit 4fdb9c5 into main Oct 7, 2026
1 check passed
@akhileshh
akhileshh deleted the pcgv2-pipeline branch October 7, 2026 13:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant