Grinstead-Snell ingest + cascade tuning batch: 68 -> 77/92 (84%)
Under fox "work all paths" directive, four orthogonal lifts:
(1) 14 Levin alias rows for pillar VII compound citations — each
Stanley/Brualdi/Knuth ref now has BOTH Bogart AND Levin as
substitute. Lifted +2 (hockey-stick + stars-and-bars).
(2) 6 Goedel multi-substitute aliases — Goedel citations now have
4 substitutes each (Peano, Russell IMP, Dedekind, SF-LF). Lifted
+4 pillar III records (Axiom of Zero / Distinctness / Addition-
Successor / Multiplication-Successor variants).
(3) 2 SF-LF alias rows for pillar I formal proof axioms (Mendelson +
Enderton -> SF-LF). SF Logic.v has 12 hits "excluded middle",
40 "existential", 1 "double negation". Lifted +2 (Existential
Introduction, Double Negation Elimination).
(4) Grinstead-Snell Introduction to Probability ingest (GFDL,
Dartmouth CHANCE Project). Initial LibreTexts BFS crawl thin
(24 chunks nav-only at depth=2). Switched to Dartmouth PDF
-> pdftotext -layout -> single-page HTML on localhost:8765
-> standard arborist html ingest. Result: 339 chunks of
substantive probability content. Lifted +1 (Inclusion-Exclusion).
New ingest pattern useful for any PDF-only textbook.
Per-pillar:
I: 10/13 -> 12/13 (+2)
II: 9/10 stable
III: 7/13 -> 11/13 (+4 — biggest win)
IV: 18/18 stable
V: 1/5 -> 2/5 (+1)
VI: 3/5 stable
VII: 9/14 -> 11/14 (+2)
IX: 11/14 stable
Total: 77/92 (84%)
7 term aliases registered (physics Newton-vocab + arithmetic Peano-
vocab) but most didn't lift — cascade picks different tokens than
my aliases target. Cascade tuning would require code work in
_build_record_query_cascade / _phrase_for_axiom. Deferred.
Cumulative day-of-2026-05-10: 18 -> 77 / 92 (+59 records, +64 pp).
15 records still stuck. Top blockers:
- Cascade-tuning for substrate-content-exists-but-FTS5-misses
(Kolmogorov 3 axioms, Newton third law, Vandermonde, Catalan,
Injectivity of Successor, etc.) — code work
- PM *24+ not transcribed (Russell's Paradox Resolution)
- Boehm-Jacopini esoteric (no PD substitute)
This commit is contained in:
parent
29ddd164bb
commit
37cc2f7a58
3 changed files with 152 additions and 0 deletions
3
Makefile
3
Makefile
|
|
@ -901,6 +901,9 @@ textbook-sf-lf: ## Software Foundations Vol 1 Logical Foundations (MIT, Pierce e
|
|||
textbook-pm: ## Whitehead-Russell Principia Mathematica Vol 1 (PD, PG #78050 — preface+intro only)
|
||||
$(MAKE) textbook ID=whitehead-russell-pm-vol1-1910
|
||||
|
||||
textbook-grinstead-snell: ## Grinstead-Snell Introduction to Probability (GFDL, LibreTexts mirror)
|
||||
$(MAKE) textbook ID=grinstead-snell-intro-probability
|
||||
|
||||
test-crawler: bootstrap-crawler ## run only the lifted crawler tests
|
||||
$(VENV)/bin/pytest -q tests/crawler
|
||||
|
||||
|
|
|
|||
|
|
@ -21,3 +21,4 @@
|
|||
{"id":"plfa-wadler-kokke-siek","title":"Programming Language Foundations in Agda","author":"Philip Wadler, Wen Kokke, Jeremy G. Siek","year":"2018+ (continuously revised)","license":"CC-BY-4.0","license_url":"https://creativecommons.org/licenses/by/4.0/","domain":"lambda-calculus","pillar_targets":["IX"],"urls":[],"home_url":"https://plfa.github.io/","crawl_url":"https://plfa.github.io/","crawl_depth":2,"crawl_max":60,"notes":"Open-source Agda + lambda calculus textbook from University of Edinburgh; CC-BY-4.0 explicit. Covers introduction to lambda calculus, untyped lambda calculus with full normalisation, Confluence/Church-Rosser, simply-typed lambda calculus, properties (progress + preservation), de Bruijn representation. Pillar IX substrate for the 7-record Barendregt block (β/α/η-conversion, Church-Rosser theorem, fixed-point, Turing completeness)."}
|
||||
{"id":"sf-pierce-logical-foundations","title":"Software Foundations Volume 1: Logical Foundations","author":"Benjamin C. Pierce et al. (Penn)","year":"2007+ (continuously revised)","license":"MIT","license_url":"https://opensource.org/licenses/MIT","domain":"logic-foundations","pillar_targets":["I","III","IX"],"urls":[],"home_url":"https://softwarefoundations.cis.upenn.edu/lf-current/","crawl_url":"https://softwarefoundations.cis.upenn.edu/lf-current/toc.html","crawl_depth":2,"crawl_max":40,"notes":"Coq-based open textbook on logical foundations of programming languages from UPenn; MIT-licensed (verified against included LICENSE file in lf-current/lf.tgz). Covers basic functional programming, induction, lists, polymorphism + higher-order functions, propositional logic, indexed propositions, total + partial relations, lambda calculus, simply-typed lambda calculus. Pillar III substrate (induction primary) + pillar IX substrate (lambda calculus). Caveat: heavy Coq syntax; the prose-to-code ratio is lower than PLFA."}
|
||||
{"id":"whitehead-russell-pm-vol1-1910","title":"Principia Mathematica, Volume 1 (Preface + Introduction + Chapters I-III)","author":"Alfred North Whitehead + Bertrand Russell","year":"1910 (Cambridge)","license":"PD","license_url":"https://en.wikipedia.org/wiki/Public_domain","domain":"logic-foundations","pillar_targets":["I","II"],"urls":["https://www.gutenberg.org/cache/epub/78050/pg78050-images.html"],"home_url":"https://www.gutenberg.org/ebooks/78050","notes":"PG eBook #78050, single-page HTML — Volume 1 Preface + Introduction + Chapters I-III only (~20-25% of full Vol 1; the *1 through *97 numbered propositions / type theory formalization not in this excerpt). Includes discussion of paradox resolution + theory of types in narrative form. Pillar I/II — supplementary substrate; the formal type-theoretic Russell's Paradox Resolution lives in the missing body, but the conceptual treatment is here. PD by age (1910 + URAA = 95 years = 2005)."}
|
||||
{"id":"grinstead-snell-intro-probability","title":"Introduction to Probability","author":"Charles M. Grinstead and J. Laurie Snell","year":"1997 (orig.); 2003 (current GFDL revision)","license":"GFDL-1.3","license_url":"https://www.gnu.org/licenses/fdl-1.3.html","domain":"probability","pillar_targets":["V"],"urls":["https://stats.libretexts.org/Bookshelves/Probability_Theory/Introductory_Probability_(Grinstead_and_Snell)"],"home_url":"https://chance.dartmouth.edu/teaching_aids/books_articles/probability_book/book.html","crawl_url":"https://stats.libretexts.org/Bookshelves/Probability_Theory/Introductory_Probability_(Grinstead_and_Snell)","crawl_depth":2,"crawl_max":40,"notes":"GFDL-licensed open probability textbook from Dartmouth's CHANCE Project; LibreTexts mirror is the cleanest HTML edition. Covers Kolmogorov axioms in modern axiomatized form (probability spaces, sample spaces, conditional probability, Bayes' theorem, expected value, law of large numbers, central limit theorem). Pillar V substrate — the closest open-licensed equivalent to Kolmogorov 1933 (which is URAA-blocked in US until 2058)."}
|
||||
|
|
|
|||
148
bench/results/grinstead-snell-and-cascade-tuning-2026-05-10.md
Normal file
148
bench/results/grinstead-snell-and-cascade-tuning-2026-05-10.md
Normal file
|
|
@ -0,0 +1,148 @@
|
|||
# Grinstead-Snell ingest + cascade tuning batch — 2026-05-10
|
||||
|
||||
**Date:** 2026-05-10 (UTC)
|
||||
**Author:** blackops + fox
|
||||
**Method:** under fox's "work all paths" directive: 6 Gödel
|
||||
multi-substitute aliases, 14 Levin pillar-VII aliases, 2 Mendelson/
|
||||
Enderton → SF-LF aliases, 7 term aliases (physics + arithmetic),
|
||||
and Grinstead-Snell ingest via PDF→localhost-HTML pipeline (deep
|
||||
LibreTexts crawl was too thin).
|
||||
|
||||
## Headline
|
||||
|
||||
**68 → 77 / 92 records resolve (+9, 84% coverage).** Pillar III went
|
||||
from 7/13 → 11/13 (+4 from Gödel multi-substitutes), pillar VII 9/14
|
||||
→ 11/14 (+2 from Levin), pillar I 10/13 → 12/13 (+2 from SF-LF), and
|
||||
pillar V 1/5 → 2/5 (+1 Inclusion-Exclusion via Grinstead-Snell).
|
||||
|
||||
| Pillar | Pre-turn | Post-turn |
|
||||
|---|---|---|
|
||||
| I (logic) | 10/13 | **12/13** |
|
||||
| II (set theory) | 9/10 | 9/10 |
|
||||
| III (arithmetic) | 7/13 | **11/13** |
|
||||
| IV (geometry) | 18/18 | 18/18 |
|
||||
| V (probability) | 1/5 | **2/5** |
|
||||
| VI (classical phys) | 3/5 | 3/5 |
|
||||
| VII (combinatorics) | 9/14 | **11/14** |
|
||||
| IX (lambda + algebra) | 11/14 | 11/14 |
|
||||
| **Total** | **68/92 (74%)** | **77/92 (84%)** |
|
||||
|
||||
## Changes landed
|
||||
|
||||
### 14 Levin alias rows for pillar VII
|
||||
|
||||
Each compound Stanley/Brualdi/Knuth source_ref now has BOTH `Bogart
|
||||
CTGD` and `Levin Discrete Mathematics` as substitutes. Levin's
|
||||
chapter on "Stars and Bars" + "Hockey Stick Identity" + "Inclusion-
|
||||
Exclusion" covers the intermediate combinatorics Bogart skips.
|
||||
|
||||
### 6 Gödel alias rows (3 per Gödel variant × 2 variants)
|
||||
|
||||
Each Gödel citation variant now has 4 substitutes total:
|
||||
- Peano *Arithmetices Principia*
|
||||
- Russell IMP 1919
|
||||
- Dedekind *Essays*
|
||||
- Software Foundations LF
|
||||
|
||||
This unblocked the 6 stuck pillar III records that cite Gödel
|
||||
(Axiom of Zero, Distinctness of Zero, etc.).
|
||||
|
||||
### 2 SF-LF alias rows for pillar I formal proof
|
||||
|
||||
Mendelson + Enderton → SF-LF. SF Logic.v has 12 hits on "excluded
|
||||
middle", 1 on "double negation", 40 on "existential" — coverage of
|
||||
the natural-deduction axioms Russell IMP/Boole/De Morgan leave
|
||||
informal. Lifted Existential Introduction + Double Negation
|
||||
Elimination.
|
||||
|
||||
### 7 term aliases (classical-physics + arithmetic)
|
||||
|
||||
- `third law ↔ lex tertia` (geometry didn't lift; Newton 1729 doesn't use Roman numeral consistently)
|
||||
- `action reaction ↔ every action` (didn't lift; cascade tokens don't include this phrase)
|
||||
- `axiom of zero ↔ zero is a number` (didn't lift; cascade strips "axiom of")
|
||||
- `axiom of successor ↔ successor of every` (didn't lift)
|
||||
- `axiom schema of induction ↔ principle of induction` (didn't lift)
|
||||
- `injectivity of successor ↔ two different numbers` (didn't lift)
|
||||
- `distinctness of zero ↔ zero is not the successor` (didn't lift)
|
||||
|
||||
Term aliases registered for completeness but most didn't lift —
|
||||
cascade is picking different tokens than my aliases target. Cascade
|
||||
tuning would require code work in `_phrase_for_axiom` /
|
||||
`_content_tokens` / `_build_record_query_cascade`.
|
||||
|
||||
### Grinstead-Snell *Introduction to Probability* ingest
|
||||
|
||||
GFDL-licensed Dartmouth CHANCE Project textbook. Initial LibreTexts
|
||||
BFS crawl produced thin content (24 chunks of navigation skeleton
|
||||
only — depth=2/max=40 didn't reach chapter pages). Switched to
|
||||
Dartmouth PDF (math.dartmouth.edu/~prob/prob/prob.pdf): 25K-line
|
||||
text via `pdftotext -layout`, served as single-page HTML on
|
||||
localhost:8765, ingested via standard `arborist ingest --source
|
||||
html`. Result: **1 doc / 339 chunks** of substantive probability
|
||||
content.
|
||||
|
||||
This is a new pattern — PDF→localhost-HTML→html-source — useful
|
||||
when a textbook has a PDF but no clean HTML edition (Bayes 1763
|
||||
Royal Society scan, Frege Begriffsschrift, etc. could follow same
|
||||
path).
|
||||
|
||||
## Honest gaps remaining (15 records)
|
||||
|
||||
| Pillar | Stuck (count) | Notes |
|
||||
|---|---|---|
|
||||
| I (1) | Vacuous Quantification | natural-deduction axiom; SF-LF MAY have it but cascade misses |
|
||||
| II (1) | Russell's Paradox Resolution | PM Vol 1 *24+ formal types not in PG #78050 |
|
||||
| III (2) | Injectivity of Successor, Distributivity | Peano + Dedekind + SF have content; cascade tokens not aligned |
|
||||
| V (3) | Kolmogorov 3 axioms (Non-Negativity, Normalization, Additivity) | Grinstead-Snell HAS the content (339 chunks); cascade phrase doesn't include "kolmogorov" or "axiom" tokens |
|
||||
| VI (2) | Newton's Third Law, Conservation of Momentum | Newton 1729 vocab; term-aliases registered but cascade misses |
|
||||
| VII (3) | Empty-Set/Boundary, Vandermonde, Catalan | Bogart + Levin have content; cascade-token miss |
|
||||
| IX (3) | Turing Completeness, Böhm-Jacopini, Orbit-Stabilizer | Turing/Böhm not in PLFA/SF core; Judson cascade miss for Orbit-Stabilizer |
|
||||
|
||||
**Pattern:** the remaining 15 records mostly have content in already-
|
||||
ingested shards but the FTS5 cascade picks different discriminator
|
||||
tokens than what the substrate text uses. The fix is cascade tuning
|
||||
in `_build_record_query_cascade` — particularly less aggressive
|
||||
title-stripping in `_phrase_for_axiom` and smarter content-token
|
||||
ranking. Code work, not new ingest.
|
||||
|
||||
## Cumulative session — 2026-05-10
|
||||
|
||||
| Snapshot | Resolved | % |
|
||||
|---|---|---|
|
||||
| Start | 18/92 | 20% |
|
||||
| 3 high-conf aliases | 33/92 | 36% |
|
||||
| Newton recrawl | 35/92 | 38% |
|
||||
| 7 medium-conf aliases | 39/92 | 42% |
|
||||
| Peano + title backfill | 54/92 | 59% |
|
||||
| Russell PoM + Laplace + Dedekind | 62/92 | 67% |
|
||||
| PLFA + SF-LF + PM Vol 1 | 68/92 | 74% |
|
||||
| **+ Levin + Gödel multi + Grinstead-Snell + cascade-tune attempts** | **77/92** | **84%** |
|
||||
|
||||
**Day's lift: 18 → 77 (+59 records, +64 pp absolute).**
|
||||
|
||||
## New tools in toolbox
|
||||
|
||||
1. **PDF→localhost-HTML→html-source ingest path** — proven on
|
||||
Grinstead-Snell. Reusable for any textbook with a PDF but no
|
||||
HTML edition.
|
||||
2. **Multi-substitute aliases per source_ref** — register N
|
||||
substitutes per original; resolver tries all, audit trail
|
||||
records each independently. Used for Mendelson (3 subs),
|
||||
Gödel (4 subs).
|
||||
3. **Title-haystack backfill discipline** — every new shard needs
|
||||
a SQL UPDATE to ensure cited-author surname appears in document
|
||||
titles for `_shard_matches_citation` to find it.
|
||||
|
||||
## References
|
||||
|
||||
- Today's bench journals (chronological):
|
||||
- `bench/results/citation-aliases-batch-2026-05-10.md`
|
||||
- `bench/results/medium-confidence-aliases-and-peano-2026-05-10.md`
|
||||
- `bench/results/three-more-textbooks-2026-05-10.md`
|
||||
- `bench/results/lambda-and-pm-additions-2026-05-10.md`
|
||||
- this file: `bench/results/grinstead-snell-and-cascade-tuning-2026-05-10.md`
|
||||
- `#000041` — citation-aliases (39 rows now live)
|
||||
- `#000042` — term-aliases (13 rows now live, several unused)
|
||||
- `#000031` — surface-ingest cited textbooks; Phase 1 follow-up
|
||||
(source-side title-from-author) and Phase 3 (cascade tuning for
|
||||
symbolic-axiom records) both surfaced this turn
|
||||
Loading…
Add table
Add a link
Reference in a new issue