Issues

• javascript-ci: evaluators-on-scenarios example fails on every run, and the examples gate hides why

  bugdependabot-scoutfailing-cijavascriptP1 - high
  langwatch/scenario#1010 · Filter by author langwatch-agent opened on Oct 1, 2026

• voice: option for the agent under test to speak first on connect (greeting-led calls)

  langwatch/scenario#995 · Filter by author drewdrewthis opened on Sep 14, 2026

• voice: callee (agent under test) audio messages carry no transcript in the run message stream

  langwatch/scenario#994 · Filter by author drewdrewthis opened on Sep 14, 2026

• voice: voice.adapter.disconnect span lands on a detached trace id, not the scenario's trace

  langwatch/scenario#993 · Filter by author drewdrewthis opened on Sep 13, 2026

• voice/twilio a-leg: callee greets before the simulator's first line; greeting is consumed as the callee's turn-1 reply

  langwatch/scenario#992 · Filter by author drewdrewthis opened on Sep 13, 2026
  1

• voice: Python Twilio adapter needs the same inbound speech gate as JS (#990)

  langwatch/scenario#991 · Filter by author drewdrewthis opened on Sep 13, 2026

• voice: TypeScript/Python parity matrix and gaps (adapters, telemetry, testing surface)

  enhancementjavascript
  langwatch/scenario#986 · Filter by author drewdrewthis opened on Sep 9, 2026

• python: pytest.ini sets a global 60s timeout that pyproject.toml says does not exist

  bug
  langwatch/scenario#985 · Filter by author drewdrewthis opened on Sep 9, 2026

• voice/twilio: a-leg place_call should fail fast on busy / no-answer / failed instead of waiting the full stream-connect timeout

  enhancement
  langwatch/scenario#984 · Filter by author drewdrewthis opened on Sep 9, 2026

• voice/twilio: inbound webhook returns HTTP 403 to real Twilio requests through the trycloudflare tunnel (Twilio 11200 → call busy)

  bug
  langwatch/scenario#983 · Filter by author drewdrewthis opened on Sep 9, 2026

• Judge ends the run at the first turn when a criterion has not been reached yet

  langwatch/scenario#980 · Filter by author rogeriochaves opened on Sep 7, 2026

• Idea: coverage-bin tracking layer for scenario test runs

  langwatch/scenario#970 · Filter by author Lurpan opened on Sep 5, 2026

• OrcaRouter provider support for Scenario

  langwatch/scenario#965 · Filter by author dulcestentaciones2920-debug opened on Sep 4, 2026

• Print the judge verdict and unmet criteria on scenario failure

  langwatch/scenario#963 · Filter by author rogeriochaves opened on Sep 1, 2026
  1

• fix(js): retry one empty user simulator completion

  langwatch/scenario#955 · Filter by author Elioooon opened on Aug 31, 2026

• javascript/v1.4.0 was tagged and released but never published to npm: prepublishOnly typecheck fails while CI is green

  hound-followup
  langwatch/scenario#948 · Filter by author langwatch-agent opened on Aug 27, 2026

• @langwatch/scenario pins ai@^6 as a hard dependency, blocking AI SDK v7 downstream

  dependenciesjavascript
  langwatch/scenario#946 · Filter by author langwatch-agent opened on Aug 26, 2026

• Portable export: to_openeval() helper for ScenarioResult (EvalPort format)

  langwatch/scenario#939 · Filter by author adhabnr-ux opened on Aug 23, 2026

• Max-turns stop reports "0 of N criteria met" without consulting the judge

  needs-plan
  langwatch/scenario#934 · Filter by author sergioestebance opened on Aug 20, 2026
  

• typecheck and the dts build fail on main: TS2688 Cannot find type definition file for 'yauzl'

  langwatch/scenario#931 · Filter by author langwatch-agent opened on Aug 20, 2026

• pnpm typecheck fails on main in javascript/ and docs/ with TS2688 for 'yauzl'

  langwatch/scenario#930 · Filter by author langwatch-agent opened on Aug 20, 2026

• bug(py): @scenario.cache() ignores keyword arguments in cache keys

  langwatch/scenario#926 · Filter by author xiaoyugangg opened on Aug 19, 2026

• docs: minTurns changelog entry overstates the guarantee

  langwatch/scenario#912 · Filter by author sergioestebance opened on Aug 17, 2026

• chore(ci): external contributions stall silently on fork PRs (three compounding CI process gaps)

  Task

  langwatch/scenario#898 · Filter by author rogeriochaves opened on Aug 12, 2026

• feat(voice): Python voice provider state is a module global, not per-run (ADR-002/003 follow-up)

  Task

  langwatch/scenario#896 · Filter by author rogeriochaves opened on Aug 12, 2026