Commit Graph
3551 Commits
Author SHA1 Message Date
Nigel Tao d4ab9caa33 Add table to reverse the bits in a byte. 2017-07-26 09:05:45 +10:00
Nigel Tao 69a3b5804f Remove the unnecessary huffman_decoder struct. 2017-07-26 09:04:14 +10:00
Nigel Tao 7a955406f7 Add instructions on how to generate a hex dump. 2017-07-22 18:00:24 +10:00
Nigel Tao 59320a07d0 Rename "go generate"d files to be data.go. 2017-07-22 17:57:41 +10:00
Nigel Tao e772352036 Decode the lcode and dcode code lengths. 2017-07-22 16:45:54 +10:00
Nigel Tao 9933c971a2 Factor out a evalConstValueBinaryOp function. 2017-07-22 13:55:39 +10:00
Nigel Tao dec234779e Generate lang/check/reason.go. 2017-07-22 12:49:00 +10:00
Nigel Tao 61b771a418 Refactor the bounds checker's list of reasons. 2017-07-22 10:24:48 +10:00
Nigel Tao 389d9bc8bf Remove the placeholder code limit count. 2017-07-22 10:14:50 +10:00
Nigel Tao fd07fa1f27 Decode flate's clcode symbols. 2017-07-21 17:47:58 +10:00
Nigel Tao 74400247f2 Refactor std/flate's decoder.decode_dynamic. 2017-07-21 16:16:09 +10:00
Nigel Tao f7fb991619 Implement init_huffman. 2017-07-21 15:55:49 +10:00
Nigel Tao 02cd837d9d Add a huffman_decoder.consts field. 2017-07-21 11:48:15 +10:00
Nigel Tao 34198f3de5 Start the init_huffman implementation. 2017-07-21 11:00:56 +10:00
Nigel Tao 65c4efbe8b Add a placeholder huffman_decoder struct. 2017-07-21 10:14:59 +10:00
Nigel Tao 4b7a350a68 Rename the code_length_code_lengths field. 2017-07-21 10:09:44 +10:00
Nigel Tao fc74e7e83a Add brief description of the .zip file format. 2017-07-21 10:07:02 +10:00
Nigel Tao 62811d440d Fix topological sort. 2017-07-20 16:01:41 +10:00
Nigel Tao adadb0fd5a Add a worked example of the flate file format. 2017-07-20 15:36:59 +10:00
Nigel Tao 5a1903fdfb Add TODO to describe more keywords. 2017-07-17 17:31:47 +10:00
Nigel Tao c463f4956f Add script/print-bits.go. 2017-07-17 17:28:19 +10:00
Nigel Tao 547351cfec Add testdata/romeo.txt.{flate,zlib}. 2017-07-17 16:53:45 +10:00
Nigel Tao 1e39d0302a Have "puffs bench" show the compiler version. 2017-07-16 23:47:04 +10:00
Nigel Tao 4b4473cc91 Flush "puffs bench"'s stdout. 2017-07-16 23:27:36 +10:00
Nigel Tao 50e091f976 Fix some std/flate visibilities: s/pub/pri/. 2017-07-16 19:28:45 +10:00
Nigel Tao fe7e6ed10e Handle suspending inside a skip32 call. 2017-07-16 19:28:09 +10:00
Nigel Tao fa18eec3e9 Fix returning limited vs short read. 2017-07-16 19:26:58 +10:00
Nigel Tao bd6d2ea3a1 Handle decoding a GIF in many short reads. 2017-07-16 19:25:49 +10:00
Nigel Tao a0c772f617 Improve the check for LIMITED_READ vs SHORT_READ. 2017-07-16 19:24:16 +10:00
Nigel Tao 5eb9bce5f7 Add limited read/write status codes. 2017-07-16 15:51:45 +10:00
Nigel Tao 8c795fb2dc Refactor puffs-gen-c's use of PKGPREFIX. 2017-07-16 15:31:06 +10:00
Nigel Tao 21bb96d756 Refactor short read status code calculations. 2017-07-16 15:21:27 +10:00
Nigel Tao e1fa0e8a34 Don't save local vars if we're not suspending. 2017-07-16 15:04:03 +10:00
Nigel Tao fc2a295354 Save derived vars (I/O pointers) even on error. 2017-07-16 15:01:23 +10:00
Nigel Tao 7b3628d78f Be more consistent with pub/pri error handling. 2017-07-16 14:57:46 +10:00
Nigel Tao 70f2559d4e Refactor puffs-gen-c's use of pkgPrefix. 2017-07-16 13:04:35 +10:00
Nigel Tao 20f37a6dab Decode flate code length code lengths. 2017-07-16 12:51:44 +10:00
Nigel Tao b78807d60a Add the "const" keyword. 2017-07-16 12:02:12 +10:00
Nigel Tao 04a41987f0 Add some undescores to generated C error names. 2017-07-14 16:40:59 +10:00
Nigel Tao 7b7dca4767 Start a flate decoder.decode_dynamic method. 2017-07-14 16:36:51 +10:00
Nigel Tao 85610b5df2 Add a throughput_counter concept.
Example benchstat summary of "puffs bench -mimic" output below, with
some blank lines added for clarity.

For example, gzip and zlib both add a checksum (crc32 and adler32
respectively) to raw flate. The headline mimic_{gzip,zlib}_decode_100k
numbers are 386µs and 347µs per op. Subtracting 73.2µs and 34.3µs for
the checksum times from the headline times give the same number: 313µs.

This 313µs differs from 358µs for raw flate (mimic_flate_decode_100k)
because zlib takes two different code paths for wrapped vs raw flate. In
the zlib source code, this is inflate.c vs infback.c respectively.

----
name                             time/op

mimic_adler32_10k/clang            3.74µs ± 1%
mimic_adler32_100k/clang           34.3µs ± 1%
mimic_crc32_10k/clang              8.10µs ± 1%
mimic_crc32_100k/clang             73.2µs ± 0%

mimic_flate_decode_1k/clang        4.31µs ± 1%
mimic_flate_decode_10k/clang       42.1µs ± 1%
mimic_flate_decode_100k/clang       358µs ± 1%
mimic_gzip_decode_10k/clang        49.8µs ± 1%
mimic_gzip_decode_100k/clang        386µs ± 0%
mimic_zlib_decode_10k/clang        45.3µs ± 0%
mimic_zlib_decode_100k/clang        347µs ± 1%

mimic_adler32_10k/gcc              3.72µs ± 1%
mimic_adler32_100k/gcc             34.3µs ± 2%
mimic_crc32_10k/gcc                8.06µs ± 0%
mimic_crc32_100k/gcc               73.1µs ± 0%

mimic_flate_decode_1k/gcc          4.26µs ± 0%
mimic_flate_decode_10k/gcc         42.0µs ± 0%
mimic_flate_decode_100k/gcc         356µs ± 0%
mimic_gzip_decode_10k/gcc          50.4µs ± 4%
mimic_gzip_decode_100k/gcc          390µs ± 2%
mimic_zlib_decode_10k/gcc          45.6µs ± 1%
mimic_zlib_decode_100k/gcc          348µs ± 1%

puffs_gif_lzw_decode_20k/clang      151µs ± 0%
puffs_gif_lzw_decode_100k/clang     566µs ± 0%
puffs_gif_decode_1k/clang          2.74µs ± 1%
puffs_gif_decode_10k/clang         73.8µs ± 0%
puffs_gif_decode_100k/clang        1.13ms ± 0%
puffs_gif_decode_1000k/clang       7.99ms ± 0%

mimic_gif_decode_1k/clang          6.44µs ± 0%
mimic_gif_decode_10k/clang          107µs ± 0%
mimic_gif_decode_100k/clang        1.38ms ± 0%
mimic_gif_decode_1000k/clang       9.79ms ± 0%

puffs_gif_lzw_decode_20k/gcc        127µs ± 0%
puffs_gif_lzw_decode_100k/gcc       501µs ± 0%
puffs_gif_decode_1k/gcc            2.45µs ± 1%
puffs_gif_decode_10k/gcc           65.1µs ± 0%
puffs_gif_decode_100k/gcc          1.01ms ± 0%
puffs_gif_decode_1000k/gcc         7.16ms ± 1%

mimic_gif_decode_1k/gcc            6.66µs ± 2%
mimic_gif_decode_10k/gcc            108µs ± 1%
mimic_gif_decode_100k/gcc          1.39ms ± 0%
mimic_gif_decode_1000k/gcc         9.93ms ± 1%

name                             speed

mimic_adler32_10k/clang          2.96GB/s ± 1%
mimic_adler32_100k/clang         2.91GB/s ± 1%
mimic_crc32_10k/clang            1.37GB/s ± 1%
mimic_crc32_100k/clang           1.37GB/s ± 0%

mimic_flate_decode_1k/clang       219MB/s ± 1%
mimic_flate_decode_10k/clang      263MB/s ± 1%
mimic_flate_decode_100k/clang     280MB/s ± 1%
mimic_gzip_decode_10k/clang       222MB/s ± 1%
mimic_gzip_decode_100k/clang      259MB/s ± 0%
mimic_zlib_decode_10k/clang       244MB/s ± 0%
mimic_zlib_decode_100k/clang      288MB/s ± 1%

mimic_adler32_10k/gcc            2.97GB/s ± 1%
mimic_adler32_100k/gcc           2.92GB/s ± 2%
mimic_crc32_10k/gcc              1.37GB/s ± 0%
mimic_crc32_100k/gcc             1.37GB/s ± 0%

mimic_flate_decode_1k/gcc         221MB/s ± 0%
mimic_flate_decode_10k/gcc        264MB/s ± 0%
mimic_flate_decode_100k/gcc       281MB/s ± 0%
mimic_gzip_decode_10k/gcc         219MB/s ± 4%
mimic_gzip_decode_100k/gcc        256MB/s ± 2%
mimic_zlib_decode_10k/gcc         243MB/s ± 1%
mimic_zlib_decode_100k/gcc        287MB/s ± 1%

puffs_gif_lzw_decode_20k/clang    128MB/s ± 0%
puffs_gif_lzw_decode_100k/clang   177MB/s ± 0%
puffs_gif_decode_1k/clang         373MB/s ± 1%
puffs_gif_decode_10k/clang        137MB/s ± 0%
puffs_gif_decode_100k/clang       122MB/s ± 0%
puffs_gif_decode_1000k/clang      125MB/s ± 0%

mimic_gif_decode_1k/clang         159MB/s ± 0%
mimic_gif_decode_10k/clang       94.2MB/s ± 0%
mimic_gif_decode_100k/clang       100MB/s ± 0%
mimic_gif_decode_1000k/clang      102MB/s ± 0%

puffs_gif_lzw_decode_20k/gcc      151MB/s ± 0%
puffs_gif_lzw_decode_100k/gcc     200MB/s ± 0%
puffs_gif_decode_1k/gcc           418MB/s ± 1%
puffs_gif_decode_10k/gcc          155MB/s ± 0%
puffs_gif_decode_100k/gcc         137MB/s ± 0%
puffs_gif_decode_1000k/gcc        140MB/s ± 1%

mimic_gif_decode_1k/gcc           154MB/s ± 2%
mimic_gif_decode_10k/gcc         93.0MB/s ± 1%
mimic_gif_decode_100k/gcc        98.9MB/s ± 0%
mimic_gif_decode_1000k/gcc        101MB/s ± 1%
----
2017-07-14 13:09:45 +10:00
Nigel Tao 8be6dc3394 Add adler32 and crc32 benchmarks. 2017-07-14 13:01:08 +10:00
Nigel Tao 03572374dd Add zlib (not just raw flate) benchmark. 2017-07-14 12:00:00 +10:00
Nigel Tao 6c8414099a Add gzip (not just raw flate) benchmark. 2017-07-14 10:53:33 +10:00
Nigel Tao 368bd5e4f7 Add a read_u32le method. 2017-07-13 16:20:59 +10:00
Nigel Tao 7e9b3aab67 Add a high_bits method. 2017-07-13 13:23:01 +10:00
Nigel Tao 73a4f2b263 Remove the unnecessary PUFFS_LOW_BITS macro. 2017-07-13 11:46:26 +10:00
Nigel Tao 4302619eba Add "PUFFS" to "ERROR_BAD_PUFFS_VERSION". 2017-07-13 11:34:36 +10:00
Nigel Tao a3302ff1e5 Fix suspending copy_from32. 2017-07-13 11:30:16 +10:00
Nigel Tao e7873b5ca4 Use "coroutine suspension point" consistently. 2017-07-13 10:46:05 +10:00