Post-stop-sequence bench (2026-04-30T20-15-11Z): quote 29S 21H 16U strict-rate 44% grounded 50 6.0s pointer 14S 44H 8U strict-rate 21% grounded 58 4.8s JSON 37S 23H 6U strict-rate 56% grounded 60 4.5s JSON mode delta vs prior post-pointer-ID bench: STRICT: 31 → 37 (+6) UNGROUNDED: 10 → 6 (-4) strict-rate: 47% → 56% (+9pp) apollo runaway: 3/3 → 2/3 (one sample recovered) latency: 5.5s → 4.5s (runaway cases were dragging avg) Day's net for JSON mode (morning baseline → late-evening): STRICT: 26 → 37 (+11) errors: 19 → 0 (-19) grounded: 38 → 60 (+22) strict-rate: 39% → 56% (+17pp) Each step was a named-failure → fix → re-bench cycle: retry → trim-and-verify → pointer-IDs → stop-sequence. |
||
|---|---|---|
| .. | ||
| diagrams | ||
| mesh-deploy.md | ||
| mesh.md | ||
| qa-modes-bench-2026-04-30.md | ||