engineering/arborist
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

ticket(#000006): move into tickets/ subdir + 134-cycle rolling amend

Browse source 
The ticket file was at docs/ticket-000006-... at top-level; the
tickets/ subdir convention landed before #6 was opened. Move into
docs/tickets/ to match every other ticket.

Amend with the 62-entry post-ticket delta. bench/emergent_log.jsonl
now holds 134 cycles total. Distribution stable vs original 72:
106 UNGROUNDED (79.1%), 22 HYBRID (16.4%), 6 STRICT (4.5%). Ten
new grounded cases all carry appropriate violation labels — zero
EVIDENCE-WARRANTED false-positives across all 134 cycles. Original
tuning candidates: Tomas-deflection resolved by a1dd330,
xxviii-STRICT kept as designed, metaphor sidecar calibration
deferred (still rare).

Reframe ticket as a rolling research log. Emergent stress-testing
is an ongoing thread, not a one-shot defect-fix; future
bench-emergent re-runs append new ## Amend sections here, and any
code-level tunings open their own tickets linking back.

TICKETS.md row reflects the rolling-research framing. Stale
"## Next ID" footer scrubbed from the ticket body (TICKETS.md is
canonical for the next-id counter).
This commit is contained in:
russell@unturf.com 2026-05-02 14:42:42 -04:00
parent e5ffa6c6fd
commit 4a7c4aff50
No known key found for this signature in database
3 changed files with 148 additions and 8 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/TICKETS.md
View file

@ -58,7 +58,7 @@ Newest first. Update on every open/close.
| ID | Title | Status | Opened | Directive |
|----------|------------------------------------------------|-----------------------|------------|-----------|
| #000007 | Query-layer hyphen folding | closed · 2026-05-02 | 2026-05-02 | — |
| #000006 | Bench-emergent findings (first 72 cycles) | open · awaiting tuning| 2026-05-02 | — |
| #000006 | Bench-emergent findings (rolling research log) | open · rolling | 2026-05-02 | — |
| #000005 | Label ladder migration (POINTER-LINKED → …) | closed · 2026-05-02 | 2026-05-01 | D7 |
| #000004 | Directive coverage in bench summary | closed · `acd1f9c` | 2026-05-01 | D8 |
| #000003 | Anchor-class warrant generalization (Module H+)| closed · 2026-05-02 | 2026-05-01 | D6 |

88
docs/ticket-000006-bench-emergent-findings.md → docs/tickets/ticket-000006-bench-emergent-findings.md
View file

@ -1,7 +1,8 @@
# Ticket #000006 — Bench-emergent findings (first 72 cycles)
**Status:** open · awaiting tuning passes
**Status:** open · rolling research log (verifier-ladder healthy at 134 cycles; emergent gems still being mined)
**Opened:** 2026-05-02
**Last amend:** 2026-05-02
**Scope:** catalog the failure & success shapes the random-word
triangulation harness surfaced; queue up tunings the curated bench
can't suggest because it doesn't see these question shapes.
@ -167,13 +168,86 @@ EVIDENCE-WARRANTED false-positives. Every grounded run was either
honestly STRICT or honestly demoted. The verifier ladder catches
what it's supposed to.
## Next ID
## Amend — 2026-05-02 (delta + close)
`000007`
Re-aggregated `bench/emergent_log.jsonl` after the parallel-agent
work landed (`a1dd330` deflection-tightening, `8fec3a5` metaphor
sidecar, `b87966c` metaphor cue derivation) and after Ticket
#000007 (query-layer hyphen fold). Log now holds 134 cycles —
the original 72 plus 62 post-ticket cycles.
**Combined 134-cycle distribution:**
| audit_mode | count | % | vs original 72 |
|---|---|---|---|
| UNGROUNDED | 106 | 79.1% | +4.1pp |
| HYBRID | 22 | 16.4% | -2.6pp |
| STRICT | 6 | 4.5% | -1.5pp |
| **grounded total** | **28** | **20.9%** | -4.1pp |
Distribution is stable. Verifier-ladder discipline holds: the 10
post-ticket grounded cases (2 STRICT + 8 HYBRID) all carry
appropriate violation labels. No EVIDENCE-WARRANTED false-positives.
**Post-ticket grounded breakdown:**
| triplet | mode | violations |
|---|---|---|
| `reprehending/Jonesboro/Claus` | STRICT | — (honest grounding, Santa Claus mythology) |
| `steer/reply/correcter` | STRICT | — (honest grounding) |
| `chiller/tromps/naughtiest` | HYBRID | DEFLECTION_DETECTED |
| `teazle/ensconced/Jannie` | HYBRID | DEFLECTION_DETECTED |
| `sowers/leakage/earbuds` | HYBRID | CITATION_MISMATCH + TOO_MANY_EVIDENCE_IDS |
| `Pigmy/aortas/spoiler` | HYBRID | DEFLECTION_DETECTED |
| `colonnade/snacked/acutest` | HYBRID | DEFLECTION_DETECTED + TITLE_MISMATCH |
| `posturing/diminutions/ligatures` | HYBRID | CITATION_MISMATCH |
| `trace/Markham/crawfishes` | HYBRID | DEFLECTION_DETECTED + WARRANT_MISSING |
| `underfeed/stoppered/biorhythm` | HYBRID | CITATION_MISMATCH + TITLE_MISMATCH + WARRANT_MISSING |
**Delta violation kinds:** CITATION_MISMATCH 53, TOO_MANY_EVIDENCE_IDS
18, DEFLECTION_DETECTED 5, TITLE_MISMATCH 5, WARRANT_MISSING 3,
UNKNOWN_EVIDENCE_ID 1, MANUAL_QUOTE_VIOLATION 1. WARRANT_MISSING
is new vs the original snapshot — confirms the warrant-strengthening
work is catching inferential-claim cases the ladder previously
admitted.
**Tuning candidate resolution:**
1. **Tomas-pulls-transceivers (deflection sidecar miss)** —
**resolved**. Commit `a1dd330` ("qa: tighten TITLE_MISMATCH +
DEFLECTION demotes from emergent-log review") landed at 17:33
UTC 2026-05-02, ~20 minutes BEFORE this ticket was opened. The
deflection check on the Tomas log entry now reports
`DEFLECTION_DETECTED` correctly. Ticket text was authored from
a stale snapshot. Post-ticket delta confirms the check fires
on every applicable shape (4 of 5 deflection-shaped HYBRID
cases). No code change needed.
2. **`xxviii` STRICT acceptance** — **kept as designed**. No new
evidence to filter Roman-numeral / archaic-word triplets at
word-pick time. Graceful ignoring is a feature, not a bug.
3. **`metaphor_deflection` sidecar calibration** — **deferred**.
Fired 0× across the 43 post-ticket cycles. Sample too small
for calibration; revisit when corpus-stress accumulates more
samples. The sidecar shipped (`8fec3a5`, `b87966c`) and stays
live; no calibration knob to turn yet.
****Headline finding (unchanged):** zero EVIDENCE-WARRANTED
false-positives across all 134 cycles. The four-rung ladder
catches what it's supposed to.
**Ticket stays open** — emergent stress-testing is ongoing
research, not a one-shot defect. The amend section is the rolling
delta log: append a new `## Amend — YYYY-MM-DD` section after each
substantive bench-emergent re-run with the new distribution +
findings. Code-level tunings that emerge from this research open
their own tickets and link back here.
## Status
Open. Tunings deferred until the parallel-agent work completes
their first pass on the metaphor sidecar + warrant strengthening.
Re-run `make bench-emergent EMERGENT_N=50` after their commits
land and amend this ticket with the delta.
Open · rolling research log. Three original tuning candidates:
(1) Tomas-pulls-transceivers — resolved by `a1dd330` (deflection
sidecar tightened); (2) `xxviii` STRICT acceptance — kept as
designed; (3) metaphor sidecar calibration — deferred until
sample size grows. Re-amend as findings accumulate.