russell@unturf.com
525f139e17
Scaled CASES from N_max=2,000 to N_max=10,000 for the remaining
overstate benches surfaced by the regex-fixed consistency audit:
substrate, sdl, ogre, weechat, mpich, s3fs-fuse-0001, synapse,
cfengine, ompi, minio, bullet.
Measured speedups now run 1000x-2000x at N=10,000 (vs 350x at
N=2,000). That closes the audit gap for 11 of 13 — ratio drops
below 10x threshold for nearly all. Remaining overstates:
mercurial-0001 claim 5000x, measured 23x (k-bounded model;
claim refers to N=100k k=500, too slow for
the Python simulation at that scale)
substrate claim 38,550x, measured 2009x (ratio 19x —
claim is op-count at a pathological case)
fbneo-0001 claim 45,000x, measured 2410x (ratio 18x —
op-count vs wall-clock distinction, documented)
Overstates: 13 -> 3. Aligned: 92 -> 315.
24 lines
1.4 KiB
Text
24 lines
1.4 KiB
Text
=== weechat-0001-0001: CWE-407: list-scan inside loop in weechat-0001-0001 (generic model) ===
|
|
N=500 k=500 : defective=3.583ms fixed=0.033ms speedup=107.7x
|
|
N=2000 k=2000 : defective=39.332ms fixed=0.089ms speedup=442.3x
|
|
N=5000 k=5000 : defective=212.270ms fixed=0.230ms speedup=924.5x
|
|
N=10000 k=10000: defective=902.310ms fixed=0.466ms speedup=1937.4x
|
|
|
|
=== weechat-0001: CWE-407: list-scan inside loop in weechat-0001 (generic model) ===
|
|
N=500 k=500 : defective=1.944ms fixed=0.033ms speedup=59.2x
|
|
N=2000 k=2000 : defective=38.291ms fixed=0.088ms speedup=436.3x
|
|
N=5000 k=5000 : defective=214.745ms fixed=0.234ms speedup=918.7x
|
|
N=10000 k=10000: defective=865.578ms fixed=0.483ms speedup=1792.3x
|
|
|
|
=== weechat-0002: CWE-407: list-scan inside loop in weechat-0002 (generic model) ===
|
|
N=500 k=500 : defective=2.055ms fixed=0.020ms speedup=102.9x
|
|
N=2000 k=2000 : defective=36.203ms fixed=0.088ms speedup=411.6x
|
|
N=5000 k=5000 : defective=231.254ms fixed=0.233ms speedup=993.3x
|
|
N=10000 k=10000: defective=892.420ms fixed=0.463ms speedup=1926.7x
|
|
|
|
=== weechat-0003: weechat-0003 — irc_channel_search O(C) linked-list scan — no hash index ===
|
|
N=500 k=500 : defective=1.939ms fixed=0.019ms speedup=101.6x
|
|
N=2000 k=2000 : defective=31.771ms fixed=0.089ms speedup=355.5x
|
|
N=5000 k=5000 : defective=208.652ms fixed=0.227ms speedup=920.2x
|
|
N=10000 k=10000: defective=855.578ms fixed=0.457ms speedup=1871.0x
|
|
|