Files
wuffs/test/c
Nigel Tao cf61ca11c3 Run the adler benchmarks for longer.
A future commit could set each benchmark's iteration count (call it N)
dynamically, but for now, the iteration counts are hard-coded. The rough
guiding principle is those N iterations should take more or less one
second, on my modern desktop CPU.

Prior to this commit, the adler benchmarks ran for the same N as the
zlib benchmarks. Each zlib decode involves exactly one adler checksum
computation, so both having the same N makes it very easy to calculate a
rough estimate of what fraction of zlib decoding is spent in adler code.
But in having the same N, the adler benchmarks run for a tiny fraction
of a second (and would run for an even tinier fraction if we further
optimize the adler code, e.g. with SIMD).

This commit raises that N for the adler benchmarks (but not for the zlib
benchmarks), which should hopefully make the adler numbers a little more
reliable. It will make that very easy calculation slightly less easy,
but it'd still be trivial.

The benchmark numbers do change. I'm not entirely sure why, but keep in
mind that this commit only changes the benchmark harness code, not the
actual std/flate code running in that harness.

name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 0%  2.40GB/s ± 1%  -2.00%  (p=0.008 n=5+5)
puffs_adler32_100k/clang       2.44GB/s ± 0%  2.40GB/s ± 1%  -1.67%  (p=0.008 n=5+5)
puffs_flate_decode_1k/clang     133MB/s ± 0%   131MB/s ± 1%  -1.37%  (p=0.008 n=5+5)
puffs_flate_decode_10k/clang    174MB/s ± 0%   171MB/s ± 1%  -1.66%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang   205MB/s ± 0%   202MB/s ± 0%  -1.28%  (p=0.016 n=5+4)
puffs_zlib_decode_10k/clang     162MB/s ± 0%   159MB/s ± 1%  -1.94%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang    188MB/s ± 0%   185MB/s ± 1%  -1.60%  (p=0.008 n=5+5)

puffs_adler32_10k/gcc          3.25GB/s ± 0%  3.26GB/s ± 0%  +0.25%  (p=0.016 n=4+5)
puffs_adler32_100k/gcc         3.25GB/s ± 0%  3.27GB/s ± 0%  +0.39%  (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc       132MB/s ± 0%   132MB/s ± 0%    ~     (p=0.151 n=5+5)
puffs_flate_decode_10k/gcc      170MB/s ± 0%   170MB/s ± 0%    ~     (p=0.738 n=5+5)
puffs_flate_decode_100k/gcc     207MB/s ± 0%   207MB/s ± 0%    ~     (p=0.841 n=5+5)
puffs_zlib_decode_10k/gcc       161MB/s ± 1%   162MB/s ± 0%    ~     (p=0.841 n=5+5)
puffs_zlib_decode_100k/gcc      194MB/s ± 0%   194MB/s ± 0%    ~     (p=0.841 n=5+5)
2017-11-05 07:16:04 +11:00
..
2017-11-05 07:16:04 +11:00