Skip to content

experiments: the chip counters cover the run, and the export is JSON #41

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
A13xB0 merged 1 commit into from
Oct 14, 2026
Merged

experiments: the chip counters cover the run, and the export is JSON #41

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 6 additions & 2 deletions pages/experiments.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,8 +29,12 @@ against the same network, with the results tabulated side by side.
instead of with the mesh. `experiment.senders` takes the node names.
6. **Start it, and watch the log.** Each run boots every node's firmware,
settles, sends, and tears down.
7. **Export.** `experiment.export` writes an HTML report with every arm, every
run and the deltas between them.
7. **Export.** `experiment.export` writes the whole experiment to a JSON file:
the definition, every run's raw numbers and the means per arm. Each run
carries `chip`, what every node's radio counted over the run, measured from
the same point as the delivery totals, so the boot and the advert settle are
in neither. Two arms that deliver identically can still differ in what their
firmware read from the chip, and this is where that shows.

![The Bench view: the sweep definition, past runs, the experiment log and per-node timelines](images/view-bench.png)

Expand Down
2 changes: 1 addition & 1 deletion pages/reference-control.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3655,7 +3655,7 @@ Write the whole experiment to a file, its definition beside every cell's raw num
|---|---|---|---|
| `path` | string | optional, primary | where to write it; empty writes meshbench-experiment.json in the system temporary directory, and a path that cannot be written is refused |

**Answers** `path`, `bytes`. JSON, holding the arms, seeds, senders and timings alongside `results`, which is every cell including the per-second histogram, the at-risk shares and `chip`, each node's radio counters at the end of the cell, and `summary`, which is the means. It will write an empty one before anything has run.
**Answers** `path`, `bytes`. JSON, holding the arms, seeds, senders and timings alongside `results`, which is every cell including the per-second histogram, the at-risk shares and `chip`, what each node's radio counted over the cell and how it was set at the end, and `summary`, which is the means. It will write an empty one before anything has run.

**Example** - keep the sweep, wherever the machine puts temporary files

Expand Down