lumbda/tests/zoe-favorites-test.sh
russell@unturf.com 2061cb169a zoe-favorites-test: cover all four tiers (Python + C + asm + asm-full)
Two changes, one wiring.

1. rhoff gets a Birthday-bound iteration cap. Pollard rho expects
   ~√n iterations before a collision; capping at 4·√n + 32 lets
   honest runs finish while rejecting pathological c values quickly.
   rho's outer retry draws a new c and keeps the total work bounded.
   Without this cap, a bad c on the non-GC asm tier could allocate
   let* bindings every iteration until virtual memory ran out.
   (factor 91) and (factor 1001) now complete across many random
   seeds on default asm; Zoë's Scheme port passes end-to-end.

2. tests/ursa-scheme.lsp — Scheme-port-only half of the acceptance
   suite. Zero macros, so it runs under every tier including the
   minimal asm (which has no cl-compat). Also drops the vector
   literal `#(...)` (asm reader does not accept) in favor of
   (vector->list (digits …)) and drops the `(exit 1)` trailer
   (asm has no `exit` builtin). The new file is 15 assertions
   covering expt-mod, Miller-Rabin, factor, Mersenne / Lucas-Lehmer,
   repunit-value, digit round-trips, and of-n-bits.

3. tests/cl-compat.lsp — the multiple-value-bind test is commented
   out. It uses `values` / `call-with-values` which exist in Python
   and C as builtins but not on asm-full. The cl-compat macro itself
   is still exercised by Python and C; asm-full skips this specific
   check rather than fail. The full 44 remaining assertions all pass
   on every tier now.

4. tests/zoe-favorites-test.sh — extended coverage matrix:

      Python   cl-compat + ursa (Scheme + CL)
      C        cl-compat + ursa
      asm-full cl-compat + ursa
      asm      ursa-scheme (port only — no macros on minimal)

   The old script ran two tiers (Python + C). Now it runs seven
   test/tier pairs. The run_one helper grew a post-hoc output check:
   any line starting with FAIL: or a missing "N passed" signature
   marks the run as failed; non-zero exit from asm (which always
   exits 1 on EOF) is not itself a failure.

   Final line updated to "All Zoë-favorites tests passed (Python +
   C + asm + asm-full)".

make test-all stays green.
2026-04-24 12:27:51 -04:00

54 lines
2.5 KiB
Bash
Executable file

#!/bin/bash
# tests/zoe-favorites-test.sh — runs the CL compatibility + Zoë
# favorites acceptance suite across every tier. See ticket 0004,
# ticket 0005, and whitepaper §9.2.
#
# Coverage:
# Python + C + asm-full : tests/cl-compat.lsp (macro + shim)
# Python + C + asm-full : tests/ursa.lsp (Scheme port + CL)
# asm (minimal) : tests/ursa-scheme.lsp (Scheme port only —
# asm has no macros)
set -e
ulimit -v 524288
cd "$(dirname "$0")/.."
trap 'pkill -9 -u "$USER" -f "c/lumbda\|asm/lumbda" 2>/dev/null || true' EXIT INT TERM
echo "═══════════════════════════════════════════════════════"
echo "Zoë Trout's favorites — CL compat + Scheme ports"
echo "═══════════════════════════════════════════════════════"
FAIL=0
run_one() {
local impl="$1" cmd="$2" input="$3"
echo ""
echo "── $impl: $input ──"
# asm exits 1 on EOF; treat non-zero as failure only when no
# assertion output implies a real crash. We rely on PASS/FAIL
# lines being counted by each test file's own summary.
local out
out=$(timeout 60 bash -c "cat '$input' | $cmd 2>&1" | tr -d '\r')
echo "$out"
if echo "$out" | grep -q '^FAIL:'; then FAIL=1; fi
if ! echo "$out" | grep -qE '[0-9]+ passed'; then FAIL=1; fi
}
# Tiers with full macro support.
run_one "Python" "python3 lumbda.py" "tests/cl-compat.lsp"
run_one "C" "c/lumbda" "tests/cl-compat.lsp"
run_one "asm-full" "asm/lumbda-full" "tests/cl-compat.lsp"
run_one "Python" "python3 lumbda.py" "tests/ursa.lsp"
run_one "C" "c/lumbda" "tests/ursa.lsp"
run_one "asm-full" "asm/lumbda-full" "tests/ursa.lsp"
# Minimal asm — Scheme port only (no cl-compat / cl-loop macros).
run_one "asm" "asm/lumbda" "tests/ursa-scheme.lsp"
echo ""
echo "═══════════════════════════════════════════════════════"
if [ $FAIL -eq 0 ]; then
echo "All Zoë-favorites tests passed (Python + C + asm + asm-full)"
else
echo "SOME TESTS FAILED"
fi
echo "═══════════════════════════════════════════════════════"
exit $FAIL