mirror of
https://github.com/ddidderr/wuffs.git
synced 2026-11-17 16:32:11 +01:00
A future commit could set each benchmark's iteration count (call it N) dynamically, but for now, the iteration counts are hard-coded. The rough guiding principle is those N iterations should take more or less one second, on my modern desktop CPU. Prior to this commit, the adler benchmarks ran for the same N as the zlib benchmarks. Each zlib decode involves exactly one adler checksum computation, so both having the same N makes it very easy to calculate a rough estimate of what fraction of zlib decoding is spent in adler code. But in having the same N, the adler benchmarks run for a tiny fraction of a second (and would run for an even tinier fraction if we further optimize the adler code, e.g. with SIMD). This commit raises that N for the adler benchmarks (but not for the zlib benchmarks), which should hopefully make the adler numbers a little more reliable. It will make that very easy calculation slightly less easy, but it'd still be trivial. The benchmark numbers do change. I'm not entirely sure why, but keep in mind that this commit only changes the benchmark harness code, not the actual std/flate code running in that harness. name old speed new speed delta puffs_adler32_10k/clang 2.45GB/s ± 0% 2.40GB/s ± 1% -2.00% (p=0.008 n=5+5) puffs_adler32_100k/clang 2.44GB/s ± 0% 2.40GB/s ± 1% -1.67% (p=0.008 n=5+5) puffs_flate_decode_1k/clang 133MB/s ± 0% 131MB/s ± 1% -1.37% (p=0.008 n=5+5) puffs_flate_decode_10k/clang 174MB/s ± 0% 171MB/s ± 1% -1.66% (p=0.008 n=5+5) puffs_flate_decode_100k/clang 205MB/s ± 0% 202MB/s ± 0% -1.28% (p=0.016 n=5+4) puffs_zlib_decode_10k/clang 162MB/s ± 0% 159MB/s ± 1% -1.94% (p=0.008 n=5+5) puffs_zlib_decode_100k/clang 188MB/s ± 0% 185MB/s ± 1% -1.60% (p=0.008 n=5+5) puffs_adler32_10k/gcc 3.25GB/s ± 0% 3.26GB/s ± 0% +0.25% (p=0.016 n=4+5) puffs_adler32_100k/gcc 3.25GB/s ± 0% 3.27GB/s ± 0% +0.39% (p=0.008 n=5+5) puffs_flate_decode_1k/gcc 132MB/s ± 0% 132MB/s ± 0% ~ (p=0.151 n=5+5) puffs_flate_decode_10k/gcc 170MB/s ± 0% 170MB/s ± 0% ~ (p=0.738 n=5+5) puffs_flate_decode_100k/gcc 207MB/s ± 0% 207MB/s ± 0% ~ (p=0.841 n=5+5) puffs_zlib_decode_10k/gcc 161MB/s ± 1% 162MB/s ± 0% ~ (p=0.841 n=5+5) puffs_zlib_decode_100k/gcc 194MB/s ± 0% 194MB/s ± 0% ~ (p=0.841 n=5+5)