russell@unturf.com
fa8d93c8ef
§12.6 in #000008 captures the 2026-05-03T12-38-53Z reminder-only
A/B (apply_caps=False, reminder=True) on the same 9-question
broad subset:
Mode | Strict-rate | Mean ratio | UNGROUNDED
----------+----------------+-------------------+-----------
quote | 0.56 → 0.52 | 0.900 → 0.845 | 0 → 0
pointer | 0.00 → 0.00 | 0.473 → 0.643 | 9 → 6
JSON | 0.19 → 0.22 | 0.524 → 0.735 | 7 → 1
Pointer-mode violation deltas:
FORMAT_COLLAPSED 2 → 0 (-100%)
NO_EVIDENCE_POINTER 9 → 6 ( -33%)
TITLE_MISMATCH 10 → 15 ( +50%) ← side effect
TOO_MANY_CLAIMS 7 → 8 ( +14%)
§10.8 gate verdict: MET. Both FORMAT_COLLAPSED and NO_EVIDENCE_
POINTER cleared the 5pp floor (−7pp absolute / −11pp absolute
respectively). Strongest signals are mean-ratio improvements
(+17pp pointer, +21pp JSON) — grounded rows ground BETTER under
reminder. JSON-mode UNGROUNDED dropped 7 → 1, a 22pp redistribution
from "didn't ground" to "partially grounded".
Caveat: TITLE_MISMATCH increased (+50%). Reminder may pressure
Hermes to cite *something* rather than say "no evidence", picking
up wrong-source citations as a side effect.
Recommendation: §10.8 gate met but hold default flip until §12.7
(cap-only) and §12.8 (cap+reminder) cells run, per §10.8 "if A+B
together outperform either alone by ≥5pp: land Option D".
Cross-references:
- TICKETS.md index: #000008 status flipped to "open · phases 0–4
landed; bench A/B in progress".
- #000006 rolling log: cross-reference to #000008's bench cycles
+ the d24291b classifier-defect fix surfaced from the
distribution scan.
71 lines
3.5 KiB
Markdown
71 lines
3.5 KiB
Markdown
# Aborist tickets — index
|
||
|
||
Aborist uses a flat `ticket-NNNNNN-<slug>.md` convention for actionable
|
||
proposals: defects with a known root cause, design proposals awaiting
|
||
go/no-go, or scoped enhancements queued for future implementation.
|
||
|
||
## Convention
|
||
|
||
- **Filename:** `docs/tickets/ticket-NNNNNN-<slug>.md`. The ID is a six-digit
|
||
zero-padded integer; the slug is hyphen-lowercase and short enough
|
||
to stay readable on a 100-column terminal.
|
||
- **Numbering:** monotonic, never reused. Pick the next free integer
|
||
greater than every existing ticket. The current next ID is on the
|
||
`Next ID` line below; bump it when you open a ticket and commit
|
||
the bump in the same commit as the new ticket file.
|
||
- **Header:** every ticket starts with
|
||
```
|
||
# Ticket #NNNNNN — <short title>
|
||
|
||
**Status:** open · awaiting go/no-go (or "in progress", "closed")
|
||
**Opened:** YYYY-MM-DD
|
||
**Scope:** <one-liner — what this ticket is for>
|
||
**Audience:** <who reads this>
|
||
**Hard constraint:** <invariants this ticket commits to NOT break>
|
||
```
|
||
- **Body:** problem statement, design choices with trade-offs,
|
||
recommendation, implementation sketch, scope boundaries, status.
|
||
See `ticket-000001-retrieval-keywords-audit-gap.md` for a worked
|
||
template.
|
||
- **Closure:** when a ticket lands, flip Status to `closed · landed in
|
||
commit <sha>` and leave the file in place. Do not delete tickets;
|
||
they are the design log.
|
||
|
||
## Distinction from other docs
|
||
|
||
`docs/` also contains architecture references and bench journey notes
|
||
that are NOT tickets — they describe state of the world rather than
|
||
proposing change. Examples that stay un-numbered:
|
||
|
||
- `cti-architecture.md` (architecture reference)
|
||
- `mesh.md`, `mesh-deploy.md` (architecture + ops reference)
|
||
- `qa-modes-bench-2026-04-30.md` (point-in-time bench journal)
|
||
- `verifier-semantic-gap-design.md`,
|
||
`self-reference-design.md` (older design docs that
|
||
pre-date the ticket convention; leave as-is unless retroactively
|
||
promoting one to a ticket adds value)
|
||
- `concept-relations-design.md` (architecture reference for the
|
||
per-shard `concept_relations` synonym/rivalry layer + the 1.6%
|
||
storage-tax rationale; landed 2026-05-01)
|
||
|
||
If a doc proposes change AND awaits a decision AND has scoped
|
||
implementation cost, it's a ticket. Otherwise it's reference.
|
||
|
||
## Index
|
||
|
||
Newest first. Update on every open/close.
|
||
|
||
| ID | Title | Status | Opened | Directive |
|
||
|----------|------------------------------------------------|-----------------------|------------|-----------|
|
||
| #000008 | Broad-quantifier preflight guard | open · phases 0–4 landed; bench A/B in progress | 2026-05-02 | — |
|
||
| #000007 | Query-layer hyphen folding | closed · 2026-05-02 | 2026-05-02 | — |
|
||
| #000006 | Bench-emergent findings (rolling research log) | open · rolling | 2026-05-02 | — |
|
||
| #000005 | Label ladder migration (POINTER-LINKED → …) | closed · 2026-05-02 | 2026-05-01 | D7 |
|
||
| #000004 | Directive coverage in bench summary | closed · `acd1f9c` | 2026-05-01 | D8 |
|
||
| #000003 | Anchor-class warrant generalization (Module H+)| closed · 2026-05-02 | 2026-05-01 | D6 |
|
||
| #000002 | Reference-Frame Polarity Contract (Module L) | closed · 2026-05-02 | 2026-05-01 | D3 |
|
||
| #000001 | Retrieval-keywords audit gap | closed · 2026-05-02 | 2026-05-01 | D4 |
|
||
|
||
## Next ID
|
||
|
||
`000009`
|