-
Notifications
You must be signed in to change notification settings - Fork 0
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
Add an adapter config for a second Jev-compatible endpoint
adapterAdapter transports and vendor configurationAdapter transports and vendor configurationdocsDocumentation, README, or methodology proseDocumentation, README, or methodology prosegood first issueGood for newcomersGood for newcomersStatus: Open.#11 In TMHSDigital/plumbline;Finding: vendor ties mean the reported choice can differ from argmax, so adapters must read the choice
adapterAdapter transports and vendor configurationAdapter transports and vendor configurationmethodologyHow a number is computed and what it does or does not meanHow a number is computed and what it does or does not meanopen questionA measured finding with something still unresolved. Not a defect.A measured finding with something still unresolved. Not a defect.Status: Open.#10 In TMHSDigital/plumbline;Finding: vendor probabilities arrive on a 2-decimal grid, bounding achievable ECE resolution
adapterAdapter transports and vendor configurationAdapter transports and vendor configurationmethodologyHow a number is computed and what it does or does not meanHow a number is computed and what it does or does not meanopen questionA measured finding with something still unresolved. Not a defect.A measured finding with something still unresolved. Not a defect.Status: Open.#9 In TMHSDigital/plumbline;Finding: adapters reporting no distribution recalibrate materially worse, even on simple miscalibration
adapterAdapter transports and vendor configurationAdapter transports and vendor configurationmethodologyHow a number is computed and what it does or does not meanHow a number is computed and what it does or does not meanopen questionA measured finding with something still unresolved. Not a defect.A measured finding with something still unresolved. Not a defect.Status: Open.#8 In TMHSDigital/plumbline;Batching as a measurement dimension, not just an optimisation
enhancementNew capability or a measurement the tool cannot make yetNew capability or a measurement the tool cannot make yetmethodologyHow a number is computed and what it does or does not meanHow a number is computed and what it does or does not meanv0.2Planned for the v0.2 releasePlanned for the v0.2 releaseStatus: Open.Run the local arm for real: local_logits and generative have never left the test suite
adapterAdapter transports and vendor configurationAdapter transports and vendor configurationenhancementNew capability or a measurement the tool cannot make yetNew capability or a measurement the tool cannot make yetmethodologyHow a number is computed and what it does or does not meanHow a number is computed and what it does or does not meanv0.2Planned for the v0.2 releasePlanned for the v0.2 releaseStatus: Open.