Commit Graph
3337 Commits
Author SHA1 Message Date
Nigel Tao 8d03a67e6e Re-do image decoders' call sequence state machine 2022-05-28 15:06:56 +10:00
Nigel Tao a2e3a5a272 Update doc/std/compression-decoders.md for bzcat 2022-05-28 14:23:25 +10:00
Nigel Tao f700e00df8 Update doc/std/compression-decoders.md for bzip2 2022-05-28 10:11:34 +10:00
Nigel Tao a56dbb3e3b Tweak script/print-average-pixel.cc output 2022-05-26 14:28:30 +10:00
Nigel Tao 0f98004914 Add script/print-average-pixel.cc 2022-05-25 16:59:13 +10:00
Nigel Tao f55274aaa7 Fix -Werror=conversion in decode_bzip2.wuffs 2022-05-24 13:58:48 +10:00
Nigel Tao 3e93ffe175 Type check const's array length and elem count 2022-05-24 13:56:24 +10:00
Nigel Tao e6793fc501 Have std/bzip2 support QUIRK_IGNORE_CHECKSUM 2022-05-24 12:31:43 +10:00
Nigel Tao 09102fb1e8 Tweak std/bzip2 decoder.flush_fast applicability 2022-05-24 12:25:47 +10:00
Nigel Tao 6a3e43f495 Tweak std/bzip2 flush_* basic blocks
name                             old speed      new speed      delta

wuffs_bzip2_decode_10k/clang11   65.2MB/s ± 0%  65.2MB/s ± 0%    ~     (p=0.056 n=5+5)
wuffs_bzip2_decode_100k/clang11  52.4MB/s ± 0%  51.5MB/s ± 0%  -1.67%  (p=0.016 n=5+4)

wuffs_bzip2_decode_10k/gcc10     60.6MB/s ± 0%  61.7MB/s ± 0%  +1.81%  (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/gcc10    49.2MB/s ± 0%  49.6MB/s ± 0%  +0.86%  (p=0.008 n=5+5)
2022-05-24 12:01:30 +10:00
Nigel Tao bed155bd6f Optimize std/bzip2 flush_repeat_count checks
name                             old speed      new speed      delta

wuffs_bzip2_decode_10k/clang11   60.5MB/s ± 0%  65.2MB/s ± 0%   +7.85%  (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/clang11  45.7MB/s ± 1%  52.4MB/s ± 0%  +14.68%  (p=0.008 n=5+5)

wuffs_bzip2_decode_10k/gcc10     58.5MB/s ± 0%  60.6MB/s ± 0%   +3.67%  (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/gcc10    46.3MB/s ± 0%  49.2MB/s ± 0%   +6.31%  (p=0.008 n=5+5)
2022-05-24 11:56:23 +10:00
Nigel Tao 66f194f7e0 Introduce std/bzip2 decoder.flush_fast method
Compared to the recent commit 623290ef "Cache std/bzip2 Huffman tree
lookup":

name                             old speed      new speed      delta

wuffs_bzip2_decode_10k/clang11   60.5MB/s ± 0%  60.5MB/s ± 0%    ~     (p=1.000 n=5+5)
wuffs_bzip2_decode_100k/clang11  46.7MB/s ± 1%  45.7MB/s ± 1%  -2.05%  (p=0.008 n=5+5)

wuffs_bzip2_decode_10k/gcc10     58.7MB/s ± 0%  58.5MB/s ± 0%    ~     (p=0.222 n=5+5)
wuffs_bzip2_decode_100k/gcc10    46.9MB/s ± 0%  46.3MB/s ± 0%  -1.46%  (p=0.008 n=5+5)
2022-05-24 11:50:48 +10:00
Nigel Tao 29eec43287 Factor out std/bzip2/decode_flush_slow.wuffs 2022-05-24 11:27:09 +10:00
Nigel Tao ae1e075401 Rename std/bzip2 decode_block_* functions 2022-05-24 11:24:57 +10:00
Nigel Tao fc0c5e465b Rename std/bzip2/decode_block_*.wuffs 2022-05-24 11:24:15 +10:00
Nigel Tao 99b8c1cb9e Add std/bzip2 comment re QUIRK_IGNORE_CHECKSUM 2022-05-23 16:21:51 +10:00
Nigel Tao 623290ef87 Cache std/bzip2 Huffman tree lookup
name                             old speed      new speed      delta

wuffs_bzip2_decode_10k/clang11   46.5MB/s ± 0%  60.5MB/s ± 0%  +30.16%  (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/clang11  39.4MB/s ± 1%  46.7MB/s ± 1%  +18.43%  (p=0.008 n=5+5)

wuffs_bzip2_decode_10k/gcc10     43.8MB/s ± 0%  58.7MB/s ± 0%  +34.07%  (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/gcc10    35.9MB/s ± 0%  46.9MB/s ± 0%  +30.92%  (p=0.008 n=5+5)
2022-05-23 15:51:51 +10:00
Nigel Tao fdad12d59f Have std/bzip2 read 4 (not 1) bytes per inner loop
name                             old speed      new speed      delta

wuffs_bzip2_decode_10k/clang11   42.9MB/s ± 0%  46.5MB/s ± 0%   +8.38%  (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/clang11  36.9MB/s ± 0%  39.4MB/s ± 1%   +6.75%  (p=0.008 n=5+5)

wuffs_bzip2_decode_10k/gcc10     36.5MB/s ± 0%  43.8MB/s ± 0%  +19.73%  (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/gcc10    30.8MB/s ± 0%  35.9MB/s ± 0%  +16.37%  (p=0.008 n=5+5)
2022-05-23 15:22:31 +10:00
Nigel Tao 94a2c704d4 Factor out std/bzip2/decode_block_slow.wuffs 2022-05-23 13:54:50 +10:00
Nigel Tao 27e9b81588 Optimize bzip2 invert_bwt letter counting
name                             old speed      new speed      delta

wuffs_bzip2_decode_10k/clang11   42.2MB/s ± 0%  42.9MB/s ± 0%  +1.63%  (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/clang11  36.2MB/s ± 1%  36.9MB/s ± 0%  +2.07%  (p=0.008 n=5+5)

wuffs_bzip2_decode_10k/gcc10     35.3MB/s ± 0%  36.5MB/s ± 0%  +3.62%  (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/gcc10    29.5MB/s ± 0%  30.8MB/s ± 0%  +4.59%  (p=0.008 n=5+5)
2022-05-23 13:36:55 +10:00
Nigel Tao be047533e1 Add bounds check to wuffs_base__make_slice_uNN_ij 2022-05-23 11:07:31 +10:00
Nigel Tao fff55bee66 Add std/bzip2 mimic tests and benches 2022-05-19 15:35:13 +10:00
Nigel Tao cda8b1950a Add fuzz/c/std/bzip2_fuzzer.c 2022-05-18 00:15:40 +10:00
Nigel Tao 53c0dd20ed Add use "program < input", not "program input" 2022-05-18 00:11:37 +10:00
Nigel Tao 2422997ee5 Tweak std/bzip2's "inverse of T" description 2022-05-17 00:10:46 +10:00
Nigel Tao 84ef91dda8 Tweak cgen for an_array[i .. j] 2022-05-17 00:00:25 +10:00
Nigel Tao f1350825cc Fix cgen for an_array[i .. j] 2022-05-16 23:39:44 +10:00
Nigel Tao 68b76a8a56 Implement std/bzip2 2022-05-16 23:35:32 +10:00
Nigel Tao 787ff21cc7 Let magic_number_guess_fourcc sniff compression 2022-05-13 11:01:28 +10:00
Nigel Tao fc635d76f7 Add std/bzip2/README.md note about bzip 1 2022-05-13 10:37:36 +10:00
Nigel Tao ce8d08598d Add std/bzip2 package
This is just a placeholder decoder implementation.
2022-05-12 23:52:12 +10:00
Nigel Tao 4c56f5bdb2 Fix png.DECODER_WORKBUF_LEN_MAX_INCL_WORST_CASE 2022-05-12 22:30:28 +10:00
Nigel Tao b5f12153db Add std/bzip2/README.md 2022-05-12 22:15:31 +10:00
Nigel Tao d6cece7e32 Add more test/data bzip2 files 2022-05-12 10:15:36 +10:00
Nigel Tao 9c6db2673d Add .clang-format 2022-05-10 11:40:08 +10:00
Nigel Tao e0afb3dad3 Add test/data/romeo.txt.zst 2022-05-10 11:36:27 +10:00
Nigel Tao e9cb3c8b34 Use hd consistently, not xxd, in docs 2022-04-30 13:20:08 +10:00
Nigel Tao 7eaf488bae Fix gifplayer for still images with 0 loop count 2022-04-06 17:45:58 +10:00
Nigel Tao 03fd43cfcc Add "#png: unsupported CgBI extension" status 2022-03-21 14:12:25 +11:00
Nigel Tao a55e0a02a2 Fix test/c/std/json.c -Wunused-but-set-variable 2022-02-08 22:08:14 +11:00
Nigel Tao 23c9de18c6 Update doc/std/image-decoders.md Metadata for v0.3
Fixes #60
2022-02-06 21:38:41 +11:00
Nigel Tao 9719073707 Fix test/c/testlib 'const char *' vs 'char *'
Prior to this commit, `g++ test/c/std/png.c` failed with:
test/c/std/../testlib/testlib.c:107:14: error: invalid conversion from ‘const char*’ to ‘char*’ [-fpermissive]
...
test/c/std/../testlib/testlib.c:741:5: note: in expansion of macro ‘RETURN_FAIL’
  741 |     RETURN_FAIL("hex_dump: NULL argument");

Likewise, clang++ also failed with:
test/c/std/../testlib/testlib.c:741:5: error: cannot initialize return object of type 'char *' with an rvalue of type 'const char *'
    RETURN_FAIL("hex_dump: NULL argument");

Also run "clang-format-9 -style=Chromium"
2022-02-06 14:31:28 +11:00
Nigel Tao 94736e2eae Add "API Listing" sections to doc/std 2022-02-06 13:38:21 +11:00
Nigel Tao e4d237df89 Add std/tga to doc/std
Updates #67
2022-02-06 13:30:46 +11:00
Nigel Tao dd9679b56e Remove some redundant assignments after yields 2022-01-25 21:33:19 +11:00
Nigel Tao 7b51266642 Remove redundant json decode_comment "while true" 2022-01-25 21:26:27 +11:00
Nigel Tao 5a93c63f0a Tweak json.decoder.decode_comment 2022-01-25 21:24:54 +11:00
Nigel Tao 656c0bdf92 Remove some redundant assignments after yields 2022-01-25 20:37:50 +11:00
Nigel Tao b374b2b34f Tweak json decode_trailer whitespace_length var 2022-01-25 20:36:10 +11:00
Nigel Tao ad46513ded Remove some redundant assignments after yields 2022-01-25 20:25:46 +11:00