Fix production 5xx: cut per-request CPU under the Workers Free plan limit - #32

Merged

ydankner merged 23 commits into

mainfrom

claude/load-test-phase-bc-results

Aug 12, 2026

Commits on Aug 7, 2026

Run Phase B and C, and fix the rig bugs the gate caught

ydankner
and
claude
committed
41d13df

Commits on Aug 8, 2026

Stop the Cloudflare config gate from no-opping on Python 3.10

ydankner
and
claude
committed
99dfd39
Measure user-visible failures, and withdraw the latency conclusion

ydankner
and
claude
committed
7954cbd
Identify the failures as a connection pinned to a wedged isolate

ydankner
and
claude
committed
1e46147
Attribute requests to isolates, and explain the latency swing

ydankner
and
claude
committed
071da3d
Record the capacity ceiling: 40 concurrent users took production down

ydankner
and
claude
committed
e2184f7
Find the root cause: serialising a large body in Python

ydankner
and
claude
committed
d03dfe2
Retract the payload root cause: it was measured on dirty state

ydankner
and
claude
committed
c088b74
Measure isolate survival across a deploy instead of assuming it

ydankner
and
claude
committed
7db61c6
Isolate the cause: concurrent response bytes within one isolate

ydankner
and
claude
committed
732159e
Bound the per-period catalog fetches that were hanging the backend

ydankner
and
claude
committed
9ea1d9a
Correct two errors in the concurrency finding

ydankner
and
claude
committed
2ce8c5f
Add a handoff summary and commit the payload probe

ydankner
and
claude
committed
78dd652
Scrub the superseded GIL/service-binding theory from the repo

ydankner
and
claude
committed
51dcc14
Add single-isolate instruments for the Worker CPU investigation

ydankner
and
claude
committed
da13df0
Encode JSON response bodies before returning them

ydankner
and
claude
committed
718c05f
Identify the rule: a per-isolate CPU overage allowance on the Free plan

ydankner
and
claude
committed
236ae0a
Measure which endpoints accrue CPU debt, and find the dominant one

ydankner
and
claude
committed
f3f911a
Cache the encoded catalog response per isolate

ydankner
and
claude
committed
b56400c
Cache catalog searches too, bounded by bytes

ydankner
and
claude
committed
68fc883
Measure the per-user endpoints the catalog cache cannot help

ydankner
and
claude
committed
d683721

Commits on Aug 9, 2026

Correct the per-user endpoint costs: the earlier figures were cold starts

ydankner
and
claude
committed
a784fb8
Answer the original question: 20 concurrent users, 400/400 requests

ydankner
and
claude
committed
7c8c114