Repository navigation
Sync upstream dev into re-dev (2026-10-19, evening): #1318, #1320, #1264, #1319 and 7 more - #13
Merged
Merged
Conversation
…aiting (deeplethe#1304) * The inference scheduler queues a base again only when it has no job waiting Signed-off-by: Quintin Botes <[email protected]> * The inference scheduling test runs in a binary of its own, since it queues every due base in the database Signed-off-by: Quintin Botes <[email protected]> --------- Signed-off-by: Quintin Botes <[email protected]> Co-authored-by: WaylandYang <[email protected]>
…on it (deeplethe#1305) * Raising a model's concurrency limit admits the tasks already waiting on it Signed-off-by: Quintin Botes <[email protected]> * A changed model limit applies when it is saved, and raising one only adds permits Signed-off-by: Quintin Botes <[email protected]> --------- Signed-off-by: Quintin Botes <[email protected]> Co-authored-by: WaylandYang <[email protected]>
Signed-off-by: Bogdan Szabo <[email protected]> Co-authored-by: Claude Opus 5.5 <[email protected]> Co-authored-by: WaylandYang <[email protected]>
Signed-off-by: Bogdan Szabo <[email protected]> Co-authored-by: Claude Opus 5.5 <[email protected]> Co-authored-by: WaylandYang <[email protected]>
…deeplethe#1318) Signed-off-by: Bogdan Szabo <[email protected]> Co-authored-by: Claude Opus 5.5 <[email protected]> Co-authored-by: WaylandYang <[email protected]>
deeplethe#1320) Signed-off-by: Bogdan Szabo <[email protected]> Co-authored-by: Claude Opus 5.5 <[email protected]> Co-authored-by: WaylandYang <[email protected]>
…the#1299) Signed-off-by: Aschenbath <[email protected]> Co-authored-by: Aschenbath <[email protected]> Co-authored-by: WaylandYang <[email protected]>
…ethe#1323) Signed-off-by: Aschenbath <[email protected]> Co-authored-by: Aschenbath <[email protected]> Co-authored-by: WaylandYang <[email protected]>
… to the token ceiling (deeplethe#1306) * A reply that keeps repeating itself comes back cut instead of running to the token ceiling Signed-off-by: Quintin Botes <[email protected]> * Only a whole-row loop is cut, and the cut is reported as repetition rather than the token ceiling Signed-off-by: Quintin Botes <[email protected]> --------- Signed-off-by: Quintin Botes <[email protected]> Co-authored-by: WaylandYang <[email protected]>
Brings deeplethe#1318, deeplethe#1320, deeplethe#1264, deeplethe#1319, deeplethe#1299, deeplethe#1323, deeplethe#1304, deeplethe#1305 and deeplethe#1306. Schema version 106: upstream's 0115 joins the fork's 9000-9002. Co-Authored-By: Claude Opus 5.5 <[email protected]> Signed-off-by: Bogdan Szabo <[email protected]>
…behind the extraction backlog (deeplethe#1324) Signed-off-by: Quintin Botes <[email protected]> Co-authored-by: WaylandYang <[email protected]>
… the files that changed since the last sync (deeplethe#1325) Signed-off-by: Quintin Botes <[email protected]> Co-authored-by: WaylandYang <[email protected]>
Brings in deeplethe#1324 (intake jobs are claimed before model work) and deeplethe#1325 (a base can follow a GitHub repository's markdown files). CURRENT_SCHEMA_VERSION is recounted to 107 for upstream's 0116. Co-Authored-By: Claude Opus 5.5 <[email protected]> Signed-off-by: Bogdan Szabo <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Brings
re-devup to upstreamdevatd62e880b: 11 commits, deeplethe#1318 (name facts are found through a predicate index), deeplethe#1320 (containment matches%and_literally), deeplethe#1264 (a token reads the graph overview and neighbourhood), deeplethe#1319 (ADR 0071), deeplethe#1299 (Markdown name variants resolve on the same paths), deeplethe#1323, deeplethe#1304, deeplethe#1305, deeplethe#1306, deeplethe#1324 (intake jobs are claimed before model work) and deeplethe#1325 (a base can follow a GitHub repository's markdown files). Thedevmirror was fast-forwarded to upstream first. deeplethe#1324 and deeplethe#1325 came in as a second merge on this branch, on top of the first one atfa6cd6cc.Conflicts. Upstream's text where only upstream changed it, ours where a fork-only change sits on top, and both where each side added a line.
name_vectors.rsandname_vectors_plan_tests.rsmerged clean and are now identical to upstream's. Both migrations stay: upstream's0115and our9001are the sameCREATE INDEX IF NOT EXISTS facts_live_predicate_idx, so whichever runs second does nothing.resolution.rs: ours for containment recall, which is Containment matches a name's % and _ literally instead of as wildcards deeplethe/utopia#1320 (our Containment matches a name's % and _ literally instead of as wildcards (#1320, ahead of upstream) #11) with Containment recall reads indexes instead of scanning the base #12's trigram rewrite on top (CONTAINMENT_SQL,contained_names,SET LOCAL jit = off), plus ourRecall::Fullguard from the pushed-name path. Markdown markers around a name no longer keep it from meeting the same name written plainly deeplethe/utopia#1299's Markdown folding came in around it:nameis now the folded&str, so our calls passnamerather than&name. Containment matches a name's % and _ literally instead of as wildcards deeplethe/utopia#1320'slike_escapedand its two tests are in place and pass.a_similar_name_is_proposed_not_merged.rs: ours, which keeps Containment recall reads indexes instead of scanning the base #12'smr_holmes_is_paired_with_sherlock_holmes_through_its_alias_holmes. Markdown markers around a name no longer keep it from meeting the same name written plainly deeplethe/utopia#1299's change tothe_same_literal_name_is_not_proposed_twicemerged clean.external_id(A client reads a document back by the external_id it pushed it under deeplethe/utopia#1280) and chunk search. This covers theauth.rscomment, ADR 0014 decision 7 andaccess-and-audit.md. ADR 0014's revisions keep our 2026-10-16 line, which already counts every graph read. Upstream's line, which adds the overview and neighbourhood on 2026-10-19, is left out.graph_routes.rswas already identical, andtoken_read_tests.rstakes upstream's six paths.CURRENT_SCHEMA_VERSION, set to the recount (107). Neither PR touches a file the fork changed apart frommodels.rsandutopia-server/src/main.rs, which merged clean.Behaviour to know about.
**Name**,__Name__and backticked paths insideresolve_by_nameandnames::record, so a pushed name (resolve_pushed_name,Recall::Spelling) is folded too. A client that pushes**Pump 1**now getsPump 1.statementssource ({"names": "identity"}). Here every pushed name already resolves that way (RC-002,c80af41e,b7584090). If 0071 lands as written, the two will need reconciling.job_priority(kind)(migration0116): sync, document intake and embedding kinds come before anything that calls the chat model. Our fork-onlyembed_namesjob is not on that list, so it is claimed at priority 1, behind the extraction backlog, even though it only calls the embedding model. Pushed names do not need it (they resolve by name alone), but channel-2 recall for non-pushed documents waits for the backlog to drain. Adding it to the list would take a fork migration (9003) that runsCREATE OR REPLACE FUNCTION job_priorityand rebuildsjobs_priority_claim_idx. That is a separate decision for Bogdan.github_reposource kind that pulls a repository's markdown files, one document per path, refetching only files whose blob SHA changed. It does not interact with the fork's push sources: the read-back byexternal_id(A client reads a document back by the external_id it pushed it under deeplethe/utopia#1280) stays limited toapiandstatements, so agithub_repodocument is not readable that way. It is an alternative to mirroring docs through a write token'sapisource (A write token creates an api source as well as a statements source deeplethe/utopia#1274).embed_names: Finding a base's name facts without vectors reads only its name facts deeplethe/utopia#1318 is now upstream, but ourembed_namesjob (0c56fd13), which upstream declined, stays onre-dev. Whether to drop it is a separate decision for Bogdan.Schema version 107. Upstream added
0115and0116, and we carry9000,9001and9002, so there are 107 migration files. Upstreamdevis at 104.Checked on the merge against a fresh database: the migrations ran twice and the second run succeeded.
cargo fmt --all -- --checkandcargo clippy --workspace --all-targets -- -D warningsare clean.UTOPIA_TEST_REQUIRE_DB=1 cargo test --workspaceis green: 1671 passed, 0 failed, 6 ignored (server 706 passed and 2 ignored, the store integration suite 329, store unit tests 91 with 1 ignored). deeplethe#1325 changed web files, so the web checks ran too:pnpm install --frozen-lockfile, the style guard andtsc --noEmitare clean, andvitest runpasses 307 tests in 44 files.🤖 Generated with Claude Code