aborist/arborist

modified:   .gitlab-ci.yml
	modified:   bench/qa_questions.txt
	modified:   bench/qa_sweep.py
	modified:   bench/run.sh
	modified:   docs/TICKETS.md
	modified:   docs/_source/README.md
	modified:   docs/_source/_ext/makefile_targets.py
	modified:   docs/_source/api/cli.rst
	modified:   docs/_source/api/distill.rst
	modified:   docs/_source/api/mesh.rst
	modified:   docs/_source/api/qa.rst
	modified:   docs/_source/api/retrieval.rst
	modified:   docs/_source/api/storage.rst
	modified:   docs/_source/api/substrate.rst
	modified:   docs/_source/concepts.rst
	modified:   docs/_source/conf.py
	modified:   docs/_source/cookbook.rst
	modified:   docs/_source/index.rst
	modified:   docs/_source/license.rst
	modified:   docs/_source/quickstart.rst
	modified:   docs/bench-maxing.md
	modified:   docs/benchmarks.md
	modified:   docs/cti-architecture.md
	modified:   docs/diagrams/aborist-modules.dot
	modified:   docs/diagrams/aborist-modules.svg
	modified:   docs/diagrams/mesh-data-flow.dot
	modified:   docs/diagrams/mesh-epoch-lifecycle.dot
	modified:   docs/diagrams/mesh-epoch-lifecycle.svg
	modified:   docs/diagrams/mesh-group-decisions.dot
	modified:   docs/diagrams/mesh-group-decisions.svg
	modified:   docs/diagrams/mesh-identity-stack.dot
	modified:   docs/diagrams/mesh-secret-envelope.dot
	modified:   docs/mesh.md
	modified:   docs/qa-modes-bench.md
	modified:   docs/seven-point-program.md
	modified:   docs/tickets/ticket-000001-retrieval-keywords-audit-gap.md
	modified:   docs/tickets/ticket-000002-reference-frame-polarity-contract.md
	modified:   docs/tickets/ticket-000003-anchor-class-warrant.md
	modified:   docs/tickets/ticket-000005-label-ladder-migration.md
	modified:   docs/tickets/ticket-000006-bench-emergent-findings.md
	modified:   docs/tickets/ticket-000007-query-layer-hyphen-fold.md
	modified:   docs/tickets/ticket-000008-broad-quantifier-preflight-guard.md
	modified:   docs/tickets/ticket-000009-quantifier-preflight-dag-binding.md
	modified:   docs/tickets/ticket-000010-metacognition-preflight-guard.md
	modified:   docs/tickets/ticket-000011-soft-preflight-hint-sidecar.md
	modified:   scripts/backfill_concepts.py
	modified:   scripts/bench_emergent.py
	modified:   tests/crawler/test_async_web_fetcher.py
	modified:   tests/crawler/test_bridge.py
	modified:   tests/crawler/test_web_fetch.py
	modified:   tests/test_bench_qa_sweep.py
	modified:   tests/test_burn.py
	modified:   tests/test_burn_doc.py
	modified:   tests/test_claim_lattice.py
	modified:   tests/test_cli_render.py
	modified:   tests/test_compress.py
	modified:   tests/test_concepts.py
	modified:   tests/test_dag.py
	modified:   tests/test_directives.py
	modified:   tests/test_distill.py
	modified:   tests/test_distill_recursive.py
	modified:   tests/test_evict.py
	modified:   tests/test_frame.py
	modified:   tests/test_grok_source.py
	modified:   tests/test_html_source.py
	modified:   tests/test_ingest.py
	modified:   tests/test_inspect.py
	modified:   tests/test_journal.py
	modified:   tests/test_keys.py
	modified:   tests/test_llm_context_base.py
	modified:   tests/test_merkle.py
	modified:   tests/test_mesh.py
	modified:   tests/test_mesh_aead.py
	modified:   tests/test_mesh_chain.py
	modified:   tests/test_mesh_cli.py
	modified:   tests/test_mesh_cli_pull.py
	modified:   tests/test_mesh_wire.py
	modified:   tests/test_mesh_wire_e2e.py
	modified:   tests/test_metacognition.py
	modified:   tests/test_migration_audit_mode.py
	modified:   tests/test_providence_source.py
	modified:   tests/test_qa.py
	modified:   tests/test_qa_quality_live.py
	modified:   tests/test_quantifier_caps.py
	modified:   tests/test_quantifier_classifier.py
	modified:   tests/test_quantifier_phase4.py
	modified:   tests/test_quantifier_reminder.py
	modified:   tests/test_query.py
	modified:   tests/test_reclassify.py
	modified:   tests/test_repair.py
	modified:   tests/test_resume.py
	modified:   tests/test_snapshot.py
	modified:   tests/test_soft_preflight.py
	modified:   tests/test_tfidf.py
	modified:   tests/test_vcs_source.py
	modified:   tests/test_verify.py
	modified:   tests/test_verify_json.py
	modified:   tests/test_versioned_ingest.py
	modified:   tests/test_warrant.py
	modified:   tests/test_wikipedia_old.py
	modified:   tests/test_wikipedia_xml.py
	modified:   tests/test_wikitext.py
This commit is contained in:
russell@unturf.com 2026-05-07 09:31:49 -04:00
parent 2c9d00ac95
commit 8d6961fcc1
No known key found for this signature in database
102 changed files with 716 additions and 716 deletions

View file

@ -25,7 +25,7 @@ not a model self-grade.
- **Status**: ✓ enforced.
- **Code anchors**:
`aborist/qa/verify.py:verify_quotes`,
`arborist/qa/verify.py:verify_quotes`,
`verify_claim_lattice`, `verify_claim_lattice_json` — pure functions
with no chat-client parameter.
- **Pinning tests**: `tests/test_verify*.py`,
@ -43,9 +43,9 @@ never types the quote string itself.
- **Status**: ✓ enforced for lattice modes.
- **Code anchors**:
`aborist/qa/parse_claims.py:parse_pointer_claims`,
`aborist/qa/verify.py:CLAIM_LATTICE_JSON_SCHEMA`,
`aborist/qa/runner.py` (system prompts).
`arborist/qa/parse_claims.py:parse_pointer_claims`,
`arborist/qa/verify.py:CLAIM_LATTICE_JSON_SCHEMA`,
`arborist/qa/runner.py` (system prompts).
- **Pinning tests**: `tests/test_claim_lattice.py`,
`tests/test_verify_json.py`.
- **Bench signal**: rows with `answer_mode ∈
@ -66,9 +66,9 @@ frame and discarding the others.
quantifier classifier + #000010 metacognition QuestionState)
landed 2026-05-03. Answer-side multi-frame compilation still
pending.
- **Code anchors**: `aborist/qa/quantifier.py:classify_question_quantifier`
(#000008), `aborist/qa/metacognition.py:preflight_question`
(#000010), `aborist/qa/dag.py:preflight_node_hash` /
- **Code anchors**: `arborist/qa/quantifier.py:classify_question_quantifier`
(#000008), `arborist/qa/metacognition.py:preflight_question`
(#000010), `arborist/qa/dag.py:preflight_node_hash` /
`build_preflight_node_payload` (#000009 — five nested CTI
clauses bind into the run-DAG `preflight` stage). Future:
runtime-side polarity contract emission for multi-frame answers.
@ -96,17 +96,17 @@ the **preflight contract** governing the run (#000009 — guard /
cap / reminder / reject decisions hash-bound).
- **Status**: ¾ — `evidence_map_root` lives in the run-DAG
(`aborist/qa/dag.py`); `retrieval_plan_hash` landed via #000001.
(`arborist/qa/dag.py`); `retrieval_plan_hash` landed via #000001.
Preflight stage (#000009) added the upstream control commitment:
classifier output + answer/prompt/evidence contracts +
`governance_policy_hash` / `model_profile_hash` references all
fold into a single `preflight` Merkle leaf. Quote mode now 7→8
stages; pointer-mode CTI 9→10 stages; reject-broad path emits a
3-stage minimal DAG (`question → preflight → final_label`).
- **Code anchors**: `aborist/qa/dag.py:build_run_dag` (legacy +
- **Code anchors**: `arborist/qa/dag.py:build_run_dag` (legacy +
preflight-extended shapes), `build_reject_run_dag` (3-stage),
`preflight_node_hash` / `build_preflight_node_payload` (5-clause
payload), `aborist/qa/evidence.py:evidence_map_root`.
payload), `arborist/qa/evidence.py:evidence_map_root`.
- **Pinning tests**: `tests/test_dag.py` (24 tests including
preflight stage + reject path), `tests/test_evidence.py`.
- **Open ticket**: [#000001 Retrieval-keywords audit gap](ticket-000001-retrieval-keywords-audit-gap.md)
@ -125,14 +125,14 @@ citation coverage, pointer-count cap, lexical anchor warrant).
No NLI, no embeddings, no model self-grading.
- **Status**: ✓ enforced.
- **Code anchors**: `aborist/qa/verify.py:verify_claim_lattice` —
- **Code anchors**: `arborist/qa/verify.py:verify_claim_lattice` —
seven hard checks documented inline.
- **Pinning tests**: `tests/test_claim_lattice.py` (per-rule
coverage), `tests/test_verify_json.py`,
`tests/test_verify.py`.
- **Bench signal**: every row carries `verifier_method ∈ {quote,
span, entity, paraphrase, claim_lattice, none}` (CHECK constraint
in `aborist/store.py`).
in `arborist/store.py`).
### D6 — General anchor-class warrant before semantic NLI
@ -147,8 +147,8 @@ exists in the proof path.
- **Status**: ½ — relation-shape only. Entity-list / why-cause /
when-date shapes pass through unchecked.
- **Code anchors**:
`aborist/qa/verify.py:_extract_anchor_candidates`,
`aborist/qa/verify.py:_question_is_relation_shape`.
`arborist/qa/verify.py:_extract_anchor_candidates`,
`arborist/qa/verify.py:_question_is_relation_shape`.
- **Pinning tests**: `tests/test_claim_lattice.py` covers
relation-shape; entity-list / cause / date shapes have no warrant
test today.
@ -175,7 +175,7 @@ stays `STRICT`/`HYBRID`/`UNGROUNDED` so v9.8 cache_key invariants
hold.
- **Status**: ✓ enforced for lattice modes.
- **Code anchors**: `aborist/cli.py:_render_audit_label`.
- **Code anchors**: `arborist/cli.py:_render_audit_label`.
- **Pinning tests**: `tests/test_cli_render.py`
`test_render_label_strict_in_claim_lattice_becomes_evidence_linked`
and siblings.
@ -253,7 +253,7 @@ passed at the original snapshot.
Three additional tickets landed extending D1, D3, and D4:
- **#000008** (closed `4f2b5a6`, 2026-05-03) — Broad-quantifier
preflight guard. New modules `aborist/qa/quantifier.py`,
preflight guard. New modules `arborist/qa/quantifier.py`,
`model_profiles.py`, `quantifier_reminder.py`. Seven new
policy fields fold into `governance_policy_hash`; six-level
disable hierarchy. Defaults flipped (after n=5 verification):
@ -261,7 +261,7 @@ Three additional tickets landed extending D1, D3, and D4:
opt-in with JSON-only allowlist.
- **#000010** (closed, 2026-05-03) — Meta-Cognition Preflight
Guard. New module `aborist/qa/metacognition.py` with
Guard. New module `arborist/qa/metacognition.py` with
`QuestionState` dataclass + four pure detectors (temporal,
contradiction, false-premise-lite, out-of-corpus). Six new
policy fields, all default-on except