Skip to content

update indexing benchmarks, make sure the stats are consistent - #138

Merged
zxqfd555 merged 32 commits into
mainfrom
bench/consistent-results-2026-10-12
Oct 16, 2026
Merged

update indexing benchmarks, make sure the stats are consistent#138
zxqfd555 merged 32 commits into
mainfrom
bench/consistent-results-2026-10-12

Conversation

@zxqfd555

@zxqfd555 zxqfd555 commented Oct 16, 2026

Copy link
Copy Markdown
Collaborator

Scope

  • Small change that can be reviewed in one short sitting
  • Substantial change approved by a maintainer (link below)

Related issues and approval

Problem and resulting behavior

Approach and review guidance

Verification

Checklist

  • I have read CONTRIBUTING.md.
  • For substantial work, I linked maintainer approval and explained the approach.
  • I followed the project's code style and reported relevant verification results.
  • I updated tests and documentation where needed, or explained why no updates are needed.
  • I described any breaking changes and migration steps, if applicable.

zxqfd555 added 30 commits October 15, 2026 22:35
@zxqfd555
Record reproducible indexing benchmark measurements and render public…
bf49edd 
…ation from results
@zxqfd555
Save complete 100 MiB benchmark run and explain changed chunk count
22c22aa
@zxqfd555
Preserve historical benchmark references and flag inconsistent archiv…
8e7a54b 
…e pairs
@zxqfd555
Document historical units and mismatched small-run CSVs
7e23467
@zxqfd555
Save 1 GiB target results and measure local embedder memory separately
851bffa
@zxqfd555
Keep memory attribution labels readable and document embedder diagnostic
78a027f
@zxqfd555
Record Qdrant image and include shared model mappings in embedder att…
38ca0f0 
…ribution
@zxqfd555
Record the actual Qdrant image per measured size
821a4de
@zxqfd555
Save complete 3 GiB target run and validate memory attribution totals
fc31df4
@zxqfd555
Clarify nominal corpus targets and shared per-worker embedding memory
49205b9
@zxqfd555
Include parser and splitter allocations in remote-embedder baseline
3df7cf5
@zxqfd555
Retain shared libraries already needed by parser in remote baseline e…
6f023b1 
…stimate
@zxqfd555
Label calibrated shared-library attribution as an estimate
0180ba5
@zxqfd555
Allow reviewing the measured 10 GB breakdown before the full series c…
9582644 
…ompletes
@zxqfd555
Save and validate complete 10 GiB target benchmark results
26371a4
@zxqfd555
Save 30 GB rerun and calibrated embedding memory breakdown
bbaebdd
@zxqfd555
Restore full 50 GB corpus continuation and reject undersized runs
cfd38f4
@zxqfd555
Document full corpus sources and preserve preparation metadata
a91017c
@zxqfd555
Record reconstruction of the published 50 GB corpus boundary
2d2d192
@zxqfd555
Use GiB and validated data for all individual memory plots
2c35e4a
@zxqfd555
Align published memory precision and clarify approximate chunk counts
bb922be
@zxqfd555
Reject premature benchmark completion and preserve failed 50 GB samples
4374ab3
@zxqfd555
Verify complete output for 3, 10 and 30 GB before publication
507784b
@zxqfd555
Persist independent status for detached benchmark driver
189021c
@zxqfd555
Publish complete 50 GB measurement and consistent six-size benchmark …
305dd04 
…report
@zxqfd555
Audit every benchmark sample and record publication consistency
0d48cd9
@zxqfd555
Keep raw benchmark logs outside Git
ffa4248
@zxqfd555
Remove trailing whitespace from archived benchmark report
582c355
@zxqfd555
Keep only final benchmark runs and publication artifacts
b1e9748
@zxqfd555
Exclude historical and intermediate benchmark archives
52dde2a
@zxqfd555
zxqfd555 merged commit e2a7a09 into main Oct 16, 2026
6 checks passed
@zxqfd555
zxqfd555 deleted the bench/consistent-results-2026-10-12 branch October 16, 2026 10:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@zxqfd555