Commit Graph
25 Commits
Author SHA1 Message Date
Nigel Tao e0f87fb2a7 Add a -reps=N flag to "puffs bench". 2017-07-30 08:27:52 +10:00
Nigel Tao c463f4956f Add script/print-bits.go. 2017-07-17 17:28:19 +10:00
Nigel Tao 1e39d0302a Have "puffs bench" show the compiler version. 2017-07-16 23:47:04 +10:00
Nigel Tao 4b4473cc91 Flush "puffs bench"'s stdout. 2017-07-16 23:27:36 +10:00
Nigel Tao 85610b5df2 Add a throughput_counter concept.
Example benchstat summary of "puffs bench -mimic" output below, with
some blank lines added for clarity.

For example, gzip and zlib both add a checksum (crc32 and adler32
respectively) to raw flate. The headline mimic_{gzip,zlib}_decode_100k
numbers are 386µs and 347µs per op. Subtracting 73.2µs and 34.3µs for
the checksum times from the headline times give the same number: 313µs.

This 313µs differs from 358µs for raw flate (mimic_flate_decode_100k)
because zlib takes two different code paths for wrapped vs raw flate. In
the zlib source code, this is inflate.c vs infback.c respectively.

----
name                             time/op

mimic_adler32_10k/clang            3.74µs ± 1%
mimic_adler32_100k/clang           34.3µs ± 1%
mimic_crc32_10k/clang              8.10µs ± 1%
mimic_crc32_100k/clang             73.2µs ± 0%

mimic_flate_decode_1k/clang        4.31µs ± 1%
mimic_flate_decode_10k/clang       42.1µs ± 1%
mimic_flate_decode_100k/clang       358µs ± 1%
mimic_gzip_decode_10k/clang        49.8µs ± 1%
mimic_gzip_decode_100k/clang        386µs ± 0%
mimic_zlib_decode_10k/clang        45.3µs ± 0%
mimic_zlib_decode_100k/clang        347µs ± 1%

mimic_adler32_10k/gcc              3.72µs ± 1%
mimic_adler32_100k/gcc             34.3µs ± 2%
mimic_crc32_10k/gcc                8.06µs ± 0%
mimic_crc32_100k/gcc               73.1µs ± 0%

mimic_flate_decode_1k/gcc          4.26µs ± 0%
mimic_flate_decode_10k/gcc         42.0µs ± 0%
mimic_flate_decode_100k/gcc         356µs ± 0%
mimic_gzip_decode_10k/gcc          50.4µs ± 4%
mimic_gzip_decode_100k/gcc          390µs ± 2%
mimic_zlib_decode_10k/gcc          45.6µs ± 1%
mimic_zlib_decode_100k/gcc          348µs ± 1%

puffs_gif_lzw_decode_20k/clang      151µs ± 0%
puffs_gif_lzw_decode_100k/clang     566µs ± 0%
puffs_gif_decode_1k/clang          2.74µs ± 1%
puffs_gif_decode_10k/clang         73.8µs ± 0%
puffs_gif_decode_100k/clang        1.13ms ± 0%
puffs_gif_decode_1000k/clang       7.99ms ± 0%

mimic_gif_decode_1k/clang          6.44µs ± 0%
mimic_gif_decode_10k/clang          107µs ± 0%
mimic_gif_decode_100k/clang        1.38ms ± 0%
mimic_gif_decode_1000k/clang       9.79ms ± 0%

puffs_gif_lzw_decode_20k/gcc        127µs ± 0%
puffs_gif_lzw_decode_100k/gcc       501µs ± 0%
puffs_gif_decode_1k/gcc            2.45µs ± 1%
puffs_gif_decode_10k/gcc           65.1µs ± 0%
puffs_gif_decode_100k/gcc          1.01ms ± 0%
puffs_gif_decode_1000k/gcc         7.16ms ± 1%

mimic_gif_decode_1k/gcc            6.66µs ± 2%
mimic_gif_decode_10k/gcc            108µs ± 1%
mimic_gif_decode_100k/gcc          1.39ms ± 0%
mimic_gif_decode_1000k/gcc         9.93ms ± 1%

name                             speed

mimic_adler32_10k/clang          2.96GB/s ± 1%
mimic_adler32_100k/clang         2.91GB/s ± 1%
mimic_crc32_10k/clang            1.37GB/s ± 1%
mimic_crc32_100k/clang           1.37GB/s ± 0%

mimic_flate_decode_1k/clang       219MB/s ± 1%
mimic_flate_decode_10k/clang      263MB/s ± 1%
mimic_flate_decode_100k/clang     280MB/s ± 1%
mimic_gzip_decode_10k/clang       222MB/s ± 1%
mimic_gzip_decode_100k/clang      259MB/s ± 0%
mimic_zlib_decode_10k/clang       244MB/s ± 0%
mimic_zlib_decode_100k/clang      288MB/s ± 1%

mimic_adler32_10k/gcc            2.97GB/s ± 1%
mimic_adler32_100k/gcc           2.92GB/s ± 2%
mimic_crc32_10k/gcc              1.37GB/s ± 0%
mimic_crc32_100k/gcc             1.37GB/s ± 0%

mimic_flate_decode_1k/gcc         221MB/s ± 0%
mimic_flate_decode_10k/gcc        264MB/s ± 0%
mimic_flate_decode_100k/gcc       281MB/s ± 0%
mimic_gzip_decode_10k/gcc         219MB/s ± 4%
mimic_gzip_decode_100k/gcc        256MB/s ± 2%
mimic_zlib_decode_10k/gcc         243MB/s ± 1%
mimic_zlib_decode_100k/gcc        287MB/s ± 1%

puffs_gif_lzw_decode_20k/clang    128MB/s ± 0%
puffs_gif_lzw_decode_100k/clang   177MB/s ± 0%
puffs_gif_decode_1k/clang         373MB/s ± 1%
puffs_gif_decode_10k/clang        137MB/s ± 0%
puffs_gif_decode_100k/clang       122MB/s ± 0%
puffs_gif_decode_1000k/clang      125MB/s ± 0%

mimic_gif_decode_1k/clang         159MB/s ± 0%
mimic_gif_decode_10k/clang       94.2MB/s ± 0%
mimic_gif_decode_100k/clang       100MB/s ± 0%
mimic_gif_decode_1000k/clang      102MB/s ± 0%

puffs_gif_lzw_decode_20k/gcc      151MB/s ± 0%
puffs_gif_lzw_decode_100k/gcc     200MB/s ± 0%
puffs_gif_decode_1k/gcc           418MB/s ± 1%
puffs_gif_decode_10k/gcc          155MB/s ± 0%
puffs_gif_decode_100k/gcc         137MB/s ± 0%
puffs_gif_decode_1000k/gcc        140MB/s ± 1%

mimic_gif_decode_1k/gcc           154MB/s ± 2%
mimic_gif_decode_10k/gcc         93.0MB/s ± 1%
mimic_gif_decode_100k/gcc        98.9MB/s ± 0%
mimic_gif_decode_1000k/gcc        101MB/s ± 1%
----
2017-07-14 13:09:45 +10:00
Nigel Tao 8be6dc3394 Add adler32 and crc32 benchmarks. 2017-07-14 13:01:08 +10:00
Nigel Tao 0561297826 Increase soem testlib buffer sizes. 2017-07-07 12:08:56 +10:00
Nigel Tao 0b9f9162a5 Add std/flate tests. 2017-07-07 12:06:54 +10:00
Nigel Tao ed6c642f98 Strip the "bench_" from "Benchmarkbench_etc". 2017-07-02 11:49:34 +10:00
Nigel Tao 11f4cfeb49 Fix C for loop initializer style nit. 2017-06-30 11:46:04 +10:00
Nigel Tao 0cba6885fa Spell the "-b" flag fully, as "-bench". 2017-06-30 08:50:12 +10:00
Nigel Tao 84b3e6e5c2 Make benchmark suffixes "/gcc" not "_gcc". 2017-06-30 08:35:14 +10:00
Nigel Tao 9e59fd1202 Add instructions to install benchstat. 2017-06-30 08:33:06 +10:00
Nigel Tao 0203d2f148 Compile with gcc without -std=c99. 2017-06-29 16:27:04 +10:00
Nigel Tao 480c509214 Add benchmarks. 2017-06-29 14:13:23 +10:00
Nigel Tao 0088c7e257 Have read_u8 honor the limit. 2017-06-23 10:01:31 +10:00
Nigel Tao d16a25806f Decode a GIF's Global Color Table. 2017-06-18 11:11:10 +10:00
Nigel Tao b3c12e05cf Add a buf1.closed field. 2017-06-15 11:50:48 +10:00
Nigel Tao e5736cadf6 Set a default test_funcname. 2017-06-11 12:04:46 +10:00
Nigel Tao f403d0faa8 Generate C code for "in.dst.write?(etc)". 2017-06-10 17:28:35 +10:00
Nigel Tao 88e2d4cf59 Refactor testlib's funcname handling. 2017-06-10 15:34:13 +10:00
Nigel Tao 45cecca79a Rename buf1's cap to len. 2017-06-06 17:29:50 +10:00
Nigel Tao f9de8950e4 Add read_file to testlib.c. 2017-06-03 18:33:22 +10:00
Nigel Tao 71a3ad6563 Tweak the test output. 2017-05-27 09:18:59 +10:00
Nigel Tao 9724466233 Add a basic test framework. 2017-05-26 17:14:48 +10:00