fan-out: ForkScore CLI · authorship warrant ladder · 5F Phase 1c
Three streams in one commit since they're independent and each is small. #000012 Phase 1b — ForkScore CLI surface ======================================== `arborist v8 score` already existed; this adds `--out` for JSON- artifact emission so CI / downstream graders / mesh peers can ingest without parsing stdout. New Makefile targets: - `make bench-fork-baseline` — pins current bench-suite output as the ForkScore parent (one-shot per iteration). - `make bench-fork-score` — runs bench-suite again, scores child vs pinned parent, writes bench/results/fork_score_report.json. Exit 1 on REJECT so CI can gate. `FORK_PARENT` / `FORK_CHILD` / `FORK_REPORT` env-vars override default paths. New regression test pins the --out contract: stdout and file are byte-identical artifacts; --out auto-creates parent directories. #000026 Phase 3 — authorship warrant ladder ============================================ Sidecar classifier in `arborist/qa/warrant_authorship.py`. Six tiers strongest-to-weakest: AUTHOR_PACKAGE_METADATA → AUTHOR_REPOSITORY_OWNER → AUTHOR_PAGE_BYLINE → AUTHOR_PRIMARY_PAGE_TITLE → AUTHOR_COPYRIGHT_FOOTER → AUTHOR_SECONDARY_SOURCE. Plus NO_AUTHORSHIP_SIGNAL when the question doesn't smell like authorship (sidecar stays quiet). Detector regexes for each tier: - Tier 1: `author = "X"` simple form + TOML inline-table `authors = [{ name = "X" }]` form (PEP 621). - Tier 2: github.com / gitlab.com / codeberg.org / bitbucket.org URL pattern. - Tier 3: "By NAME" / "Author: NAME" prose + <meta name="author">. Inline-flag regex keeps the prefix case-insensitive while the capitalized-name capture stays case-sensitive. - Tier 4: cited evidence is the entity's own primary page (host tokens overlap title + answer; third-party indexers like wikipedia.org explicitly excluded). - Tier 5: `© NAME` / `Copyright YYYY NAME` (the current `virt-back` warrant). - Tier 6: fall-through when authorship-shaped question hits cited evidence with no direct markers. Sidecar discipline: never enters proof path; never raises; returns dict with `tier`, `tier_rank` (1=strongest, 99=quiet), `signals`, `candidate_names`, `note`. 20 tests cover each tier + noise filtering + sidecar contract + tier-ordering (strongest wins when multiple fire). Wiring into `arborist inspect` sidecar output + audit-line render-tail is queued as a follow-up — sidecar itself ready. #000025 5F Phase 1c — fixture catalog expansion ================================================ Synthetic side of all five 5F sub-batteries expanded 10 → 30: function — varied claim_count, pointer_set, threshold cases falsification — 13 violation tags (WARRANT_MISSING, TITLE_MISMATCH, FORMAT_COLLAPSED, NO_EVIDENCE_POINTER, BARE_NAME_CLAIM, LAZY_ANCHOR_DEMOTED, etc.) + 7 fail cases feedback-loop — 10 chain templates × 2 cycles finetuning — 20 capability transitions across all 5S/5T/5F/5R sub-batteries + canonical math/logic formulate — 12 lattice shapes × 2 (with deliberate fail cases) 150/150 fixtures pass through `bench-5f-*` runners. test_session_integration.py total updated 462 → 562. Pinned test_5f_*_runs counts updated 10 → 30 across all assertions. Tests ===== Full suite: 1388 passed, 36 skipped (was 1367; +21 — 20 warrant tests + 1 ForkScore --out test).
This commit is contained in:
parent
62d9c7a440
commit
60b5748ff9
14 changed files with 981 additions and 24 deletions
|
|
@ -65,8 +65,8 @@ Newest first. Update on every open/close.
|
|||
| #000029 | Claim-pack source (axiom/theorem JSON bundles) | closed · landed 2026-05-09 | 2026-05-09 | — |
|
||||
| #000028 | Multi-modality witness for canonical shapes | closed · landed 2026-05-09 (STRICT-WITNESSED reachable post-#000027) | 2026-05-08 | — |
|
||||
| #000027 | Canonical projections persist to providence_cache | closed · landed 2026-05-09 | 2026-05-08 | — |
|
||||
| #000026 | Real-shard workload baseline + search latency | in progress · Phase 1 + 2 landed 2026-05-08 | 2026-05-08 | — |
|
||||
| #000025 | 5F battery (Function · Finetuning · Falsification · Formulate · Feedback Loop) | in progress · Phase 1a landed 2026-05-08 | 2026-05-07 | — |
|
||||
| #000026 | Real-shard workload baseline + search latency | in progress · Phase 1 + 2 + 3 landed 2026-05-09 | 2026-05-08 | — |
|
||||
| #000025 | 5F battery (Function · Finetuning · Falsification · Formulate · Feedback Loop) | in progress · Phase 1a + 1b.2 + 1c landed 2026-05-09 | 2026-05-07 | — |
|
||||
| #000024 | 5T Phase 1b + Dav1DPrometheus vocabulary alignment | closed · landed 2026-05-08 | 2026-05-07 | — |
|
||||
| #000023 | 5S Phase 1b: Syllogism · Synthesis · Semiotics | closed · landed 2026-05-08 | 2026-05-07 | — |
|
||||
| #000022 | Adapter LossReport (PRD I9 analogue) | closed · landed 2026-05-07 | 2026-05-07 | — |
|
||||
|
|
@ -79,7 +79,7 @@ Newest first. Update on every open/close.
|
|||
| #000015 | π* domain library + cross-domain composition | closed · landed 2026-05-07 | 2026-05-07 | — |
|
||||
| #000014 | SelfModel: schema, falsification, integration | closed · landed 2026-05-07 | 2026-05-07 | — |
|
||||
| #000013 | Spatial-temporal substrate (Merkle-AGI v7-W) | open · awaiting go/no-go | 2026-05-07 | — |
|
||||
| #000012 | Selection & consensus protocol (Merkle-AGI v8) | in progress · Phase 1a (ForkScore) landed 2026-05-08 | 2026-05-07 | — |
|
||||
| #000012 | Selection & consensus protocol (Merkle-AGI v8) | in progress · Phase 1a + 1b (ForkScore CLI) landed 2026-05-09 | 2026-05-07 | — |
|
||||
| #000011 | SOFT_PREFLIGHT_HINT model-assisted sidecar | closed · landed 2026-05-04 (zero-shot full impl) | 2026-05-04 | D1 (preserves) |
|
||||
| #000010 | Meta-Cognition Preflight Guard (M0 / MCTL) | closed · landed 2026-05-03 (Phases 1–4); DAG binding shipped via #000009 | 2026-05-03 | D1, D3 |
|
||||
| #000009 | Preflight run-DAG node binding (#000008+#000010) | closed · re-landed 2026-05-04 (§8 corrections: reject-path DAG, nested CTI clauses) | 2026-05-03 | D3, D4 |
|
||||
|
|
|
|||
|
|
@ -1,6 +1,6 @@
|
|||
# Ticket #000026 — Real-shard workload baseline + search latency
|
||||
|
||||
**Status:** in progress · Phase 1 + 2 landed 2026-05-08
|
||||
**Status:** in progress · Phase 1 + 2 + 3 landed 2026-05-09
|
||||
**Opened:** 2026-05-08
|
||||
**Scope:** establish a reproducible baseline for arborist's behavior
|
||||
on real shards (~38 GB Wikipedia + crawl). Capture latency, capital
|
||||
|
|
@ -308,3 +308,39 @@ per the design choices section.
|
|||
|
||||
Phase 1 landed in commit `ec92ebc`.
|
||||
Phase 2 landed in commit `8b1de20`.
|
||||
|
||||
**Phase 3 landed 2026-05-09.** Authorship warrant ladder as a
|
||||
sidecar classifier in `arborist/qa/warrant_authorship.py`:
|
||||
|
||||
```
|
||||
Tier 1 AUTHOR_PACKAGE_METADATA (pyproject.toml authors,
|
||||
package.json author, etc.)
|
||||
Tier 2 AUTHOR_REPOSITORY_OWNER (github.com/<owner>/...)
|
||||
Tier 3 AUTHOR_PAGE_BYLINE (By NAME / Author: NAME /
|
||||
<meta name=author>)
|
||||
Tier 4 AUTHOR_PRIMARY_PAGE_TITLE (cited evidence is the
|
||||
entity's own primary page)
|
||||
Tier 5 AUTHOR_COPYRIGHT_FOOTER (© NAME / Copyright YYYY NAME
|
||||
— the current `virt-back`
|
||||
warrant)
|
||||
Tier 6 AUTHOR_SECONDARY_SOURCE (third-party claim)
|
||||
NO_AUTHORSHIP_SIGNAL (question doesn't smell like
|
||||
an authorship inquiry —
|
||||
sidecar stays quiet)
|
||||
```
|
||||
|
||||
Sidecar discipline: never enters proof path; never raises;
|
||||
returns dict with `tier`, `tier_rank` (1=strongest, 99=quiet),
|
||||
`signals` (every detector that fired), `candidate_names`,
|
||||
`note`. Hint regex gates on "who wrote/created/authored/maintains/
|
||||
owns/manages X" + "author/creator/maintainer/owner of Y" patterns
|
||||
so non-authorship queries don't get false-tier-6 noise.
|
||||
|
||||
20 tests covering each tier (positive + boundary) + sidecar
|
||||
contract (never raises on garbage input) + tier-ordering
|
||||
(strongest signal wins when multiple fire). Authorship-warrant
|
||||
ladder is now available; wiring it into the `arborist inspect`
|
||||
sidecar output and the audit-line render-tail is a follow-up
|
||||
(small, non-load-bearing).
|
||||
|
||||
Authorship warrant ladder landed in commit `<filled on commit>`.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue