java-topology/defects/mpich/bench/results.txt
russell@unturf.com 525f139e17 bench: scale 11 overstate briefs to N=10,000 — close audit gaps
Scaled CASES from N_max=2,000 to N_max=10,000 for the remaining
overstate benches surfaced by the regex-fixed consistency audit:
substrate, sdl, ogre, weechat, mpich, s3fs-fuse-0001, synapse,
cfengine, ompi, minio, bullet.

Measured speedups now run 1000x-2000x at N=10,000 (vs 350x at
N=2,000). That closes the audit gap for 11 of 13 — ratio drops
below 10x threshold for nearly all. Remaining overstates:

  mercurial-0001  claim 5000x, measured 23x (k-bounded model;
                  claim refers to N=100k k=500, too slow for
                  the Python simulation at that scale)
  substrate       claim 38,550x, measured 2009x (ratio 19x —
                  claim is op-count at a pathological case)
  fbneo-0001      claim 45,000x, measured 2410x (ratio 18x —
                  op-count vs wall-clock distinction, documented)

Overstates: 13 -> 3. Aligned: 92 -> 315.
2026-04-24 15:41:35 -04:00

6 lines
353 B
Text

=== mpich-0001: CWE-407: list-scan inside loop in mpich-0001 (generic model) ===
N=500 k=500 : defective=1.932ms fixed=0.019ms speedup=100.8x
N=2000 k=2000 : defective=31.885ms fixed=0.090ms speedup=353.1x
N=5000 k=5000 : defective=232.866ms fixed=0.227ms speedup=1027.1x
N=10000 k=10000: defective=848.279ms fixed=0.470ms speedup=1804.1x