Skip to content

bench.sh: detect failed runs and fail accordingly - #246

Merged
jvoisin merged 6 commits into
daanx:masterfrom
derSteFfi:detect_errors_in_runs
Nov 2, 2026
Merged

jvoisin merged 6 commits into
daanx:masterfrom
derSteFfi:detect_errors_in_runs

Conversation

@derSteFfi

@derSteFfi derSteFfi commented Sep 30, 2025 •

Copy link
Copy Markdown
Contributor

because redis has to be detected in a more complicated way, rework the output and remove superflouos sleeps while at it.
Fixes #245

@derSteFfi

Copy link
Copy Markdown
Contributor Author

I've rebased the MR onto master, cleaned up commits and added a more resilient way to catch errors in redis. Also, added -T as a CLI option to set a per $testx$alloc timeout option.

@jvoisin

jvoisin commented Nov 1, 2026

Copy link
Copy Markdown
Collaborator

The CI is failing hard

@derSteFfi

Copy link
Copy Markdown
Contributor Author

I assure its just errors that are there but now are visible. For example, current master has this error in ubuntu/gs/mi: log. CI still reports a success even though no gs instance on ubuntu is currently run with a preloaded allocator. This MR tries to catch all those errors to have a todo list to fix. The actual gs problem is fixed in #279 nonetheless. To find all remaining issues, this MR correctly reports them so the CI is not false-green.

because redis has to be detected in a more complicated way, rework the output and remove superfluous sleeps while at it.
the server startup wait is bounded (with a hard timeout on redis-cli), and the
server is always torn down by pid: when it dies or hangs under the preloaded
allocator the run is marked failed instead of hanging the whole benchmark.
@derSteFfi
derSteFfi force-pushed the detect_errors_in_runs branch from 5a9e60a to 51d42fb Compare November 2, 2026 09:47
@derSteFfi

Copy link
Copy Markdown
Contributor Author

rebased again.

Comment thread bench.sh Resolved
@jvoisin
jvoisin merged commit c65a688 into daanx:master Nov 2, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bench.sh: fail on allocator missing or command exiting with non-zero status

2 participants