java-topology/defects/cfe/bench/results.txt
russell@unturf.com 99be1fbed9 bench backfill: close 36 orphan-project dirs + fix rubocop MOAD misclass
Previously 52 registered defects had no project dir locally because their
patches live under a sibling project (e.g. ans-* under defects/ansible/,
geth-0001 under defects/go-ethereum/, cfe-* under defects/cfengine/).

Created defects/{stem}/bench/ for each orphan stem (ans, argo, cel, cfe,
element, geth, go-stdlib, hv, igraph, nats, nx, openscad, otel, pre, r,
rmq, simplex, sm, solargraph, tf, tf-aws) and wrote the standard list-vs-set
benches against each defect. Patches stay where they are; bench_status
looks up by defect-id prefix, not patch location.

Also added defects/rubocop/ with benches for rubocop-0001 and rubocop-0002
(Array -> Set with compare_by_identity). Both were misclassified as
MOAD-0011 ReDoS in generate_undf.py; the tickets show they're CWE-407
Sedimentary (O(N*S) -> O(N+S) via identity Set).

Coverage: 1243 -> 1281 (96.0% -> 98.9%). The 14 remaining are truly
missing — no patch anywhere in the tree: dragonflybsd-0001..0005,
jami-daemon, jitsi-videobridge, netbsd-0001..0004, regamedll-cs-0001,
supertuxkart-0002, hadoop-rpc-0001.
2026-04-23 12:37:51 -04:00

18 lines
1 KiB
Text

=== cfe-0001: CWE-407: list-scan inside loop in cfe-0001 (generic model) ===
N=100 k=100 : defective=0.084ms fixed=0.003ms speedup=24.4x
N=500 k=500 : defective=2.319ms fixed=0.021ms speedup=111.0x
N=1000 k=1000 : defective=9.082ms fixed=0.046ms speedup=198.9x
N=2000 k=2000 : defective=43.871ms fixed=0.097ms speedup=450.4x
=== cfe-0002: CWE-407: list-scan inside loop in cfe-0002 (generic model) ===
N=100 k=100 : defective=0.085ms fixed=0.003ms speedup=25.0x
N=500 k=500 : defective=2.338ms fixed=0.021ms speedup=113.4x
N=1000 k=1000 : defective=9.300ms fixed=0.046ms speedup=202.4x
N=2000 k=2000 : defective=41.926ms fixed=0.097ms speedup=430.5x
=== cfe-0003: CWE-407: list-scan inside loop in cfe-0003 (generic model) ===
N=100 k=100 : defective=0.085ms fixed=0.004ms speedup=24.0x
N=500 k=500 : defective=2.117ms fixed=0.020ms speedup=104.5x
N=1000 k=1000 : defective=10.777ms fixed=0.093ms speedup=115.3x
N=2000 k=2000 : defective=43.851ms fixed=0.101ms speedup=432.5x