russell@unturf.com
525f139e17
Scaled CASES from N_max=2,000 to N_max=10,000 for the remaining
overstate benches surfaced by the regex-fixed consistency audit:
substrate, sdl, ogre, weechat, mpich, s3fs-fuse-0001, synapse,
cfengine, ompi, minio, bullet.
Measured speedups now run 1000x-2000x at N=10,000 (vs 350x at
N=2,000). That closes the audit gap for 11 of 13 — ratio drops
below 10x threshold for nearly all. Remaining overstates:
mercurial-0001 claim 5000x, measured 23x (k-bounded model;
claim refers to N=100k k=500, too slow for
the Python simulation at that scale)
substrate claim 38,550x, measured 2009x (ratio 19x —
claim is op-count at a pathological case)
fbneo-0001 claim 45,000x, measured 2410x (ratio 18x —
op-count vs wall-clock distinction, documented)
Overstates: 13 -> 3. Aligned: 92 -> 315.
18 lines
1 KiB
Text
18 lines
1 KiB
Text
=== ogre-0001: CWE-407: list-scan inside loop in ogre-0001 (generic model) ===
|
|
N=500 k=500 : defective=3.389ms fixed=0.033ms speedup=103.5x
|
|
N=2000 k=2000 : defective=41.823ms fixed=0.090ms speedup=467.2x
|
|
N=5000 k=5000 : defective=215.277ms fixed=0.224ms speedup=959.0x
|
|
N=10000 k=10000: defective=852.753ms fixed=0.488ms speedup=1748.5x
|
|
|
|
=== ogre-0002: CWE-407: list-scan inside loop in ogre-0002 (generic model) ===
|
|
N=500 k=500 : defective=2.030ms fixed=0.020ms speedup=102.8x
|
|
N=2000 k=2000 : defective=34.070ms fixed=0.093ms speedup=367.8x
|
|
N=5000 k=5000 : defective=206.364ms fixed=0.242ms speedup=853.2x
|
|
N=10000 k=10000: defective=868.075ms fixed=0.462ms speedup=1878.8x
|
|
|
|
=== ogre-0003: CWE-407: list-scan inside loop in ogre-0003 (generic model) ===
|
|
N=500 k=500 : defective=2.034ms fixed=0.019ms speedup=105.6x
|
|
N=2000 k=2000 : defective=33.050ms fixed=0.087ms speedup=379.9x
|
|
N=5000 k=5000 : defective=205.210ms fixed=0.226ms speedup=909.9x
|
|
N=10000 k=10000: defective=846.315ms fixed=0.469ms speedup=1804.5x
|
|
|