Commit Graph
1138 Commits
Author SHA1 Message Date
Nigel Tao 8ff5693d9d std/xz: prepare to decode concatenated streams 2024-02-26 21:48:31 +11:00
Nigel Tao 47ed32b6ce std/xz: clarify bad versus unsupported filter 2024-02-21 21:59:11 +11:00
Nigel Tao 22fd87efc6 std/xz: reset LZMA decoder after first block
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=66816
2024-02-21 21:55:53 +11:00
Nigel Tao 5ec31fc291 std/xz: verify index blocks' comp/uncomp sizes 2024-02-16 16:03:49 +11:00
Nigel Tao c0264e4496 std/xz: verify index and footer 2024-02-15 21:46:14 +11:00
Nigel Tao 06599b8e9b std/xz: tighten VLI (variable length int) decode 2024-02-15 19:19:46 +11:00
Nigel Tao 6017c37232 std/lzma: stash LZMA state across multiple chunks 2024-02-14 20:32:07 +11:00
Nigel Tao 749e3559f2 std/xz: implement apply_filter_0b_riscv 2024-02-13 21:11:06 +11:00
Nigel Tao 782e78a689 std/xz: support BCJ start option 2024-02-12 21:01:27 +11:00
Nigel Tao 6f4db1b138 std/xz: implement apply_filter_06_ia64 2024-02-12 20:15:45 +11:00
Nigel Tao 30133ad4b2 std/xz: implement apply_filter_05_powerpc 2024-02-11 19:10:55 +11:00
Nigel Tao d2a63a7e34 std/xz: implement apply_filter_04_x86 2024-02-11 13:04:29 +11:00
Nigel Tao 76a17ce742 std/xz: implement apply_filter_0a_arm64 2024-02-11 11:42:40 +11:00
Nigel Tao 8b3e598572 std/xz: implement apply_filter_08_armthumb 2024-02-11 11:11:47 +11:00
Nigel Tao 03bb04d80c std/xz: implement apply_filter_09_sparc 2024-02-11 10:54:44 +11:00
Nigel Tao af6c7b56af std/xz: implement apply_filter_07_arm 2024-02-10 21:46:36 +11:00
Nigel Tao 9ef114be43 std/xz: prepare to add BCJ filters 2024-02-09 22:15:09 +11:00
Nigel Tao 98dae3c1c0 std/xz: refactor apply_non_final_filters 2024-02-09 20:18:56 +11:00
Nigel Tao d2ecc20141 std/xz: use io_forget_history 2024-02-09 15:06:11 +11:00
Nigel Tao 6482ba3923 std/xz: refactor anticipating io_forget_history 2024-02-09 14:59:55 +11:00
Nigel Tao c21cc95713 std/lzma: use args.workbuf for io_buffer history 2024-02-08 21:38:30 +11:00
Nigel Tao 29e49cded4 std/lzma: add sizeof(probs_etc) comment 2024-01-14 12:57:03 +11:00
Nigel Tao 76cb4bd757 std/xz: remove placeholder field 2024-01-08 23:55:49 +11:00
Nigel Tao 13115e4e1d std/xz: fix QUIRK_IGNORE_CHECKSUM skipping bytes 2024-01-07 19:52:11 +11:00
Nigel Tao d4ececf1d4 std/xz: add delta filter 2024-01-07 09:14:11 +11:00
Nigel Tao 1e5cf45090 std/lzma: fix uncompressed prior decoded length 2023-12-27 23:40:10 +11:00
Nigel Tao 992fd9622a base: rename bitvec256.get to bitvec256.get_u64 2023-12-27 17:05:54 +11:00
Nigel Tao 9f42d1fbb8 std/gif: have decode_header call read_u48le_as_u64 2023-12-27 17:03:33 +11:00
Nigel Tao c77989d162 std: rename "var c" to "var c8" 2023-12-27 17:01:01 +11:00
Nigel Tao 77fa011072 std: rename foo_got variables to foo_have 2023-12-27 16:47:52 +11:00
Nigel Tao 2afec50f62 std/lzma: track prior decoded length 2023-12-26 23:48:47 +11:00
Nigel Tao cf927b20bf std/xz: verify block {un,}compressed size 2023-12-26 17:04:16 +11:00
Nigel Tao 79af52bb24 std/xz: add SHA-256 checksum support 2023-12-26 17:04:16 +11:00
Nigel Tao a440f6dd5b std/lzma: support LZMA2 uncompressed chunks 2023-12-26 17:04:14 +11:00
Nigel Tao ce0cee444d std/xz: add new package 2023-12-25 13:24:24 +11:00
Nigel Tao 41a83f2e29 std/lzma: add LZMA2 support 2023-12-24 22:33:42 +11:00
Nigel Tao eed1af7bee base: rename history_retain_length
It was renamed to dst_history_retain_length.

It also was removed from image_decoders and token_decoders. It only
applies to io_transformers, as retaining history applies to the
destination (not source) IO buffer.

Also adjust example/bzcat and example/zcat to apply the history retain
length to the dst (not src) buffer.
2023-12-17 12:26:08 +11:00
Nigel Tao d40b7fbd7e std/png: remove unused "inconsistent frame bounds"
Updates #138
2023-12-15 10:25:39 +11:00
Nigel Tao 57f01ec3f6 std/lzma: add new package 2023-12-12 23:41:26 +11:00
Nigel Tao 8de7f559e0 base: io_writer.limited_etc_fast now needs len>=1 2023-11-25 10:50:02 +11:00
Nigel Tao dc269f3f54 std/bzip2: fix get_quirk(QUIRK_IGNORE_CHECKSUM) 2023-11-19 19:25:39 +11:00
Nigel Tao 82ea1985b4 base: add optional_u63 type 2023-11-19 12:02:24 +11:00
Nigel Tao 190f249031 jpeg: tweak horizontal-rule comment 2023-11-04 11:20:17 +11:00
Nigel Tao 920ac3e5c5 std/crc64: use slicing-by-M algorithm
name                           old speed     new speed      delta

wuffs_crc64_ecma_10k/clang11   485MB/s ± 0%  1774MB/s ± 0%  +265.68%  (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/clang11  485MB/s ± 0%  1777MB/s ± 0%  +266.41%  (p=0.008 n=5+5)

wuffs_crc64_ecma_10k/gcc10     478MB/s ± 0%  1858MB/s ± 0%  +288.52%  (p=0.016 n=4+5)
wuffs_crc64_ecma_100k/gcc10    480MB/s ± 1%  1857MB/s ± 0%  +287.21%  (p=0.008 n=5+5)
2023-10-15 00:08:56 +11:00
Nigel Tao b2ab3ba008 std/crc64: add new package 2023-10-14 23:56:41 +11:00
Nigel Tao 50abf5eb6a std/sha256: add new package 2023-10-14 18:14:36 +11:00
Patrick Georgi f563f32f82 Add SPDX identifier to license headers
SPDX is an ISO standard for describing licenses in a computer readable
format, which is useful when applying license compliance tools and the
like to source code.

In addition to ensuring that the Wuffs C distribution is properly
annotated to the benefit of projects using Wuffs and SPDX-supporting
tools, add it everywhere else where there's a license in this repo for
consistency, too.
2023-10-06 20:52:36 +02:00
Nigel Tao 5336b511e0 std/xxhash32: add SIMD comment 2023-10-06 14:19:48 +11:00
Nigel Tao be2eb64a51 Roll back 'std/xxhash32: add hasher.up_x86_sse42'
See the previous commit for the rationale.
2023-10-06 14:04:56 +11:00
Nigel Tao b9b28dbe8b std/xxhash32: add hasher.up_x86_sse42
This commit will soon be followed by a rollback, but it is committed
anyway so that we can refer to these numbers in the git log.

name                         old speed      new speed      delta

wuffs_xxhash32_10k/clang11   7.81GB/s ± 0%  4.46GB/s ± 1%  -42.86%  (p=0.008 n=5+5)
wuffs_xxhash32_100k/clang11  7.96GB/s ± 0%  4.67GB/s ± 1%  -41.34%  (p=0.008 n=5+5)

wuffs_xxhash32_10k/gcc10     7.83GB/s ± 0%  4.48GB/s ± 2%  -42.81%  (p=0.008 n=5+5)
wuffs_xxhash32_100k/gcc10    7.95GB/s ± 0%  4.69GB/s ± 2%  -41.04%  (p=0.008 n=5+5)

mimic_xxhash32_10k           7.70GB/s ± 1%  7.73GB/s ± 1%     ~     (p=0.421 n=5+5)
mimic_xxhash32_100k          7.79GB/s ± 0%  7.84GB/s ± 1%     ~     (p=0.730 n=4+5)
2023-10-06 13:59:31 +11:00