Commit Graph
3724 Commits
Author SHA1 Message Date
Nigel Tao 3bad76cd2c base: fix -Wtautological-type-limit-compare
Fixes #144
2024-03-28 16:38:45 +11:00
Nigel Tao f1a9d34494 pixconv: fix -Werror=conversion 2024-03-27 22:10:13 +11:00
Nigel Tao da40cdf29f base: re-format ETC__PIXEL_FORMAT__ETC defines 2024-03-27 21:16:32 +11:00
Nigel Tao b4cd9b8d3c std/png: decode PNG color type 4 to YA_NONPREMUL
Fixes #143
2024-03-27 21:06:09 +11:00
Nigel Tao bdfbdf407e pixconv: add PIXEL_FORMAT__YA_NONPREMUL support
Binary size, before:
115152 gen/lib/c/clang-dynamic/wuffs-base-pixconv.lo
115152 gen/lib/c/clang-static/wuffs-base-pixconv.o
162280 gen/lib/c/gcc-dynamic/wuffs-base-pixconv.lo
165352 gen/lib/c/gcc-static/wuffs-base-pixconv.o

After:
123464 gen/lib/c/clang-dynamic/wuffs-base-pixconv.lo
123464 gen/lib/c/clang-static/wuffs-base-pixconv.o
180768 gen/lib/c/gcc-dynamic/wuffs-base-pixconv.lo
180880 gen/lib/c/gcc-static/wuffs-base-pixconv.o

Updates #143
2024-03-27 19:07:03 +11:00
Nigel Tao 0c9b700df0 base: fix PIXEL_FORMAT__YA_{NON,}PREMUL values
These pixel formats have two channels (gray, alpha), not one.

Updates #143
2024-03-27 16:53:19 +11:00
Nigel Tao a6676851e3 pixconv: sse42-optimize swizzling RGB to RGBA
PNG (as a source pixel format) is RGB or RGBA order. Wuffs' std/png
benchmarks, like the other image formats, decode to BGRA order. *If*
those benchmarks are altered to target RGBA instead, we get:

name                                                       old speed     new speed     delta

wuffs_png_decode_image_40k_24bpp/clang14                   279MB/s ± 0%  293MB/s ± 0%  +5.11%  (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/clang14                 289MB/s ± 0%  303MB/s ± 0%  +4.89%  (p=0.008 n=5+5)

wuffs_png_decode_image_40k_24bpp/gcc12                     311MB/s ± 0%  332MB/s ± 0%  +6.84%  (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/gcc12                   325MB/s ± 0%  339MB/s ± 0%  +4.49%  (p=0.008 n=5+5)

When starting from 3-channel RGB, ending with RGBA is now as fast as
ending with BGRA.

Updates #141
2024-03-26 10:07:58 +11:00
Nigel Tao 44bb271c21 root: update BUILD.md for bzcat name change 2024-03-06 17:45:22 +11:00
Nigel Tao b922c28a8e std/lzma: tweak Literal After Non-Literal code 2024-03-04 09:33:08 +11:00
Nigel Tao 13c72db350 std/lzma: add QUIRK_ALLOW_NON_ZERO_INITIAL_BYTE 2024-03-01 21:11:28 +11:00
Nigel Tao 27407b5332 test/3pdata: add xzsuite/lzip-testsuite/*.lz 2024-03-01 21:03:56 +11:00
Nigel Tao a9739a8921 std/lzip: actually implement the format 2024-03-01 20:55:24 +11:00
Nigel Tao 793ab36569 std/lzip: add new package 2024-03-01 09:52:54 +11:00
Nigel Tao 1c0b07f1aa std/lzma: accept optional End of Stream code 2024-02-29 22:01:04 +11:00
Nigel Tao 22b4ff4842 std/xz: decode concatenated streams 2024-02-26 23:02:40 +11:00
Nigel Tao 5b62289c63 test/data: add *.two-concatenated-streams.xz
lo128.dat and hi128.dat were constructed manually, then the
256.bytes.two-concatenated-streams.xz file was constructed by:

xz --keep lo128.dat
xz --keep hi128.dat
cat lo128.dat.xz hi128.dat.xz > 256.bytes.two-concatenated-streams.xz
2024-02-26 22:11:51 +11:00
Nigel Tao 8ff5693d9d std/xz: prepare to decode concatenated streams 2024-02-26 21:48:31 +11:00
Nigel Tao f06858f395 example/convert-to-nia: tweak write max len 2024-02-23 22:42:45 +11:00
Nigel Tao 47ed32b6ce std/xz: clarify bad versus unsupported filter 2024-02-21 21:59:11 +11:00
Nigel Tao 22fd87efc6 std/xz: reset LZMA decoder after first block
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=66816
2024-02-21 21:55:53 +11:00
Nigel Tao 5ec31fc291 std/xz: verify index blocks' comp/uncomp sizes 2024-02-16 16:03:49 +11:00
Nigel Tao c0264e4496 std/xz: verify index and footer 2024-02-15 21:46:14 +11:00
Nigel Tao 06599b8e9b std/xz: tighten VLI (variable length int) decode 2024-02-15 19:19:46 +11:00
Nigel Tao 4e20ba6876 example: add output-crc32-digest flag 2024-02-15 13:40:09 +11:00
Nigel Tao 6017c37232 std/lzma: stash LZMA state across multiple chunks 2024-02-14 20:32:07 +11:00
Nigel Tao 6c71bb229b test/data: add enwik5.block-size-32k.xz
It was created with a vanilla xz binary:
  xz --keep --block-size=32k --stdout enwik5 > enwik5.block-size-32k.xz
2024-02-14 15:49:54 +11:00
Nigel Tao 2f7fbd0f34 test/data: add enwik5.lzma2-chunk-max-1-13.xz
It was created wih a custom xz binary (built from the source at
https://github.com/tukaani-project/xz), with this command:
  xz --compress --keep --stdout enwik5 > enwik5.lzma2-chunk-max-1-13.xz
after applying this patch to xz's src/liblzma/lzma/lzma2_encoder.h:

-#define LZMA2_CHUNK_MAX (UINT32_C(1) << 16)
+#define LZMA2_CHUNK_MAX (UINT32_C(1) << 13)

The resultant enwik5.lzma2-chunk-max-1-13.xz file has multiple LZMA2
chunks, unlike the existing enwik5.xz (created with the normal chunk
limit). Wuffs' std/xz currently does not decode this new file properly.
2024-02-13 22:17:35 +11:00
Nigel Tao 749e3559f2 std/xz: implement apply_filter_0b_riscv 2024-02-13 21:11:06 +11:00
Nigel Tao 94e32e8e56 test/3pdata: add xzsuite/*-riscv-*.xz 2024-02-13 20:22:02 +11:00
Nigel Tao 782e78a689 std/xz: support BCJ start option 2024-02-12 21:01:27 +11:00
Nigel Tao 6f4db1b138 std/xz: implement apply_filter_06_ia64 2024-02-12 20:15:45 +11:00
Nigel Tao 30133ad4b2 std/xz: implement apply_filter_05_powerpc 2024-02-11 19:10:55 +11:00
Nigel Tao d2a63a7e34 std/xz: implement apply_filter_04_x86 2024-02-11 13:04:29 +11:00
Nigel Tao 76a17ce742 std/xz: implement apply_filter_0a_arm64 2024-02-11 11:42:40 +11:00
Nigel Tao 8b3e598572 std/xz: implement apply_filter_08_armthumb 2024-02-11 11:11:47 +11:00
Nigel Tao 03bb04d80c std/xz: implement apply_filter_09_sparc 2024-02-11 10:54:44 +11:00
Nigel Tao af6c7b56af std/xz: implement apply_filter_07_arm 2024-02-10 21:46:36 +11:00
Nigel Tao 764169165a script: reduce os.Write perms, s/0666/0644/ 2024-02-09 22:16:10 +11:00
Nigel Tao 9ef114be43 std/xz: prepare to add BCJ filters 2024-02-09 22:15:09 +11:00
Nigel Tao 98dae3c1c0 std/xz: refactor apply_non_final_filters 2024-02-09 20:18:56 +11:00
Nigel Tao 2b4e8ce6a2 example/mzcat: support zlib 2024-02-09 16:07:43 +11:00
Nigel Tao e8ec21976c fuzz: shrink xz WORK_BUFFER_ARRAY_SIZE 2024-02-09 16:02:54 +11:00
Nigel Tao 569a91892e check: drop facts before/after an IOManip 2024-02-09 15:31:50 +11:00
Nigel Tao e5dc87e4d3 cgen: have writeStatementIOManip use switches 2024-02-09 15:21:37 +11:00
Nigel Tao be1b1b564c cgen: reformat "uint8_t *o_etc" 2024-02-09 15:09:50 +11:00
Nigel Tao d2ecc20141 std/xz: use io_forget_history 2024-02-09 15:06:11 +11:00
Nigel Tao 9fb3859488 lang: more anticipating io_forget_history 2024-02-09 15:03:44 +11:00
Nigel Tao 6482ba3923 std/xz: refactor anticipating io_forget_history 2024-02-09 14:59:55 +11:00
Nigel Tao e8af2d0635 lang: refactor anticipating io_forget_history 2024-02-09 14:55:35 +11:00
Nigel Tao c21cc95713 std/lzma: use args.workbuf for io_buffer history 2024-02-08 21:38:30 +11:00