Skip to content

Utopia tracker walk: 200 entries a run, not 2,000 - #2803

Merged
gedaiu merged 1 commit into
mainfrom
utopia/tracker-batch-200
Oct 17, 2026
Merged

gedaiu merged 1 commit into
mainfrom
utopia/tracker-batch-200

Conversation

@gedaiu

@gedaiu gedaiu commented Oct 17, 2026

Copy link
Copy Markdown
Collaborator

The first tracker walk on lore, run right after #2802 deployed, pushed nothing. Its first item, pull:1, timed out after 30 seconds: Utopia's database was at its 4-core limit, with connections waiting 2 to 6 seconds. One walk pushes up to 2,000 items, and each is a job that database has to work through, so a first walk of a repo with a long history piles onto an already busy queue.

This PR caps a walk at 200 entries, as #2801 did for commits. A long backlog now arrives in batches of 200, each resuming from tracker_since. A walk runs for every changed issue or pull request and once in the weekly backfill, so a busy repo like lore catches up within a day, and a quiet one over a few Sundays.

Spec FR14.4 and the ADR-052 amendment now say 200.

Generated with Claude Code

@lore-agent

lore-agent Bot commented Oct 17, 2026

Copy link
Copy Markdown
Contributor

Lore is reviewing this PR — 5c6dd924-9785-404d-8a18-2f615ae68cc1.

Submit a review that requests changes to have Lore push a fix for it. Comment @lore review to re-run the review.

@github-actions

Copy link
Copy Markdown

🔍 Lore Spec Impact — advisory

This PR touches 31 statement(s) across 1 spec(s), and 31 of them have validating tests this PR does not change.

Feature Specification: The spec-to-code chain mirrored in Utopia · 31 statement(s)

specs/utopia-graph-mirror/spec.md

The ontology
⚠ the tests that validate it are not touched by this PR

only its test links changed — the statement text itself is unchanged

FR1.1 — The Lore ontology is one turtle file, libs/shared/src/domain/lore-ontology.ttl, read beside the module that n…

validated by libs/shared/src/domain/lore-ontology.test.ts:57

The ontology
⚠ the tests that validate it are not touched by this PR

only its test links changed — the statement text itself is unchanged

FR1.3 — Version 2 declares the text attribute, a string on Section and Statement, and adds Document to the domain of …

validated by libs/shared/src/domain/lore-ontology.test.ts:57

The ontology
⚠ the tests that validate it are not touched by this PR

only its test links changed — the statement text itself is unchanged

FR1.4 — Version 3 declares what a test run says: violated_by from Statement to Test, outcome a string on Test, Test…

validated by libs/shared/src/domain/lore-ontology.test.ts:57

The push
⚠ the tests that validate it are not touched by this PR

only its test links changed — the statement text itself is unchanged

FR3.1 — An item is posted to POST /api/v1/sources/{source}/statements under the source's own key, as external_id, `…

validated by libs/shared/src/outbound/utopia/utopia-client.test.ts:130

The push
⚠ the tests that validate it are not touched by this PR

only its test links changed — the statement text itself is unchanged

FR3.2 — A tombstone is external_id plus deleted: true, answered marked_missing.

validated by libs/shared/src/outbound/utopia/utopia-client.test.ts:130

The push
⚠ the tests that validate it are not touched by this PR

- … any other refusal, throws a `UtopiaPushEr…
+ … any other refusal, throws a `UtopiaError`…

validated by libs/shared/src/outbound/utopia/utopia-client.test.ts:130

The ingest
⚠ the tests that validate it are not touched by this PR

only its test links changed — the statement text itself is unchanged

FR4.1 — The deployment reaches Utopia through UTOPIA_API_URL (utopia.enabled in the lore-api chart, from `enable_ut…

validated by libs/shared/src/outbound/utopia/utopia-client.test.ts:130

The ingest
⚠ the tests that validate it are not touched by this PR

only its test links changed — the statement text itself is unchanged

FR4.3 — After the delta route has projected a specs or adrs delta into the graph, each file is mirrored as a spec o…

validated by apps/lore-api/src/transport/routes/ingest/ingest-delta.test.ts:711

The ingest
⚠ the tests that validate it are not touched by this PR

only its test links changed — the statement text itself is unchanged

FR4.4 — A mirror that fails is logged as [utopia-mirror] <repo> <path>: <message>, counted on `lore_utopia_mirror_fai…

validated by apps/lore-api/src/transport/routes/ingest/ingest-delta.test.ts:711, libs/shared/src/outbound/otel/metrics.test.ts:109

Setup
⚠ the tests that validate it are not touched by this PR

only its test links changed — the statement text itself is unchanged

FR5.1 — POST /api/repos/{owner}/{repo}/utopia/setup (admin scope) takes a person's Utopia session token and a workspa…

validated by libs/shared/src/outbound/utopia/utopia-client.test.ts:130, apps/lore-api/src/transport/routes/repos/utopia-setup.test.ts:187

…and 21 more statement(s).

2 changed statement(s) had no validating test, so no coverage broke. 201 new statement(s) have no test link yet.

Deterministic · graph @ 54e00aa (projected 2026-10-07) · 4 file(s) skipped: changed since the graph last saw them, so their line numbers no longer line up · no tests run by this check

@lore-agent lore-agent Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lore review — Approved

Lowers MAX_TRACKED_PER_RUN from 2,000 to 200 across the tracker walk, unit tests, spec FR14.4, and ADR-052.

Must fix (0) · Consider (0) · Nits (0)

Reviewed by gemini-4-argon

Submit a review that requests changes to have Lore push a fix for it. Comment @lore review to re-run the review.

Posted by floor, visit f9f409dc-1769-4928-925f-b35d7e4d7556.

@gedaiu
gedaiu merged commit 94440ad into main Oct 17, 2026
28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant