java-topology/defects/sm/bench/results.txt
russell@unturf.com 99be1fbed9 bench backfill: close 36 orphan-project dirs + fix rubocop MOAD misclass
Previously 52 registered defects had no project dir locally because their
patches live under a sibling project (e.g. ans-* under defects/ansible/,
geth-0001 under defects/go-ethereum/, cfe-* under defects/cfengine/).

Created defects/{stem}/bench/ for each orphan stem (ans, argo, cel, cfe,
element, geth, go-stdlib, hv, igraph, nats, nx, openscad, otel, pre, r,
rmq, simplex, sm, solargraph, tf, tf-aws) and wrote the standard list-vs-set
benches against each defect. Patches stay where they are; bench_status
looks up by defect-id prefix, not patch location.

Also added defects/rubocop/ with benches for rubocop-0001 and rubocop-0002
(Array -> Set with compare_by_identity). Both were misclassified as
MOAD-0011 ReDoS in generate_undf.py; the tickets show they're CWE-407
Sedimentary (O(N*S) -> O(N+S) via identity Set).

Coverage: 1243 -> 1281 (96.0% -> 98.9%). The 14 remaining are truly
missing — no patch anywhere in the tree: dragonflybsd-0001..0005,
jami-daemon, jitsi-videobridge, netbsd-0001..0004, regamedll-cs-0001,
supertuxkart-0002, hadoop-rpc-0001.
2026-04-23 12:37:51 -04:00

24 lines
1.3 KiB
Text

=== sm-0001: CWE-407: list-scan inside loop in sm-0001 (generic model) ===
N=100 k=100 : defective=0.109ms fixed=0.004ms speedup=25.2x
N=500 k=500 : defective=2.790ms fixed=0.028ms speedup=100.5x
N=1000 k=1000 : defective=15.491ms fixed=0.106ms speedup=146.1x
N=2000 k=2000 : defective=47.638ms fixed=0.173ms speedup=276.1x
=== sm-0002: CWE-407: list-scan inside loop in sm-0002 (generic model) ===
N=100 k=100 : defective=0.086ms fixed=0.004ms speedup=24.5x
N=500 k=500 : defective=2.175ms fixed=0.021ms speedup=104.9x
N=1000 k=1000 : defective=10.655ms fixed=0.046ms speedup=233.5x
N=2000 k=2000 : defective=46.033ms fixed=0.175ms speedup=262.3x
=== sm-0003: CWE-407: list-scan inside loop in sm-0003 (generic model) ===
N=100 k=100 : defective=0.162ms fixed=0.017ms speedup=9.6x
N=500 k=500 : defective=3.259ms fixed=0.038ms speedup=86.9x
N=1000 k=1000 : defective=10.210ms fixed=0.116ms speedup=87.8x
N=2000 k=2000 : defective=48.117ms fixed=0.103ms speedup=466.9x
=== sm-0004: CWE-407: list-scan inside loop in sm-0004 (generic model) ===
N=100 k=100 : defective=0.249ms fixed=0.004ms speedup=64.0x
N=500 k=500 : defective=2.376ms fixed=0.023ms speedup=104.5x
N=1000 k=1000 : defective=12.532ms fixed=0.050ms speedup=250.5x
N=2000 k=2000 : defective=44.511ms fixed=0.114ms speedup=391.5x