Commit Graph
3738 Commits
Author SHA1 Message Date
Nigel Tao 00a01abc4e base: avoid some (ptr + len) when ptr is NULL
Updates #135
2024-04-05 15:52:40 +11:00
Nigel Tao d7f6b81d31 base: have empty_foo() functions use NULL ptr
This largely reverts commit f81deb6b6e.

Updates #135
2024-04-05 15:29:51 +11:00
Nigel Tao 2142aa65fc cgen: fix iterate's "ptr + len" when ptr is NULL
Updates #135
2024-04-05 13:47:25 +11:00
Nigel Tao 8ed5d1327b example/gifplayer: tweak try_allocate workbuf len 2024-04-05 13:33:15 +11:00
Nigel Tao a9a6d8ac55 base: make malloc_slice_u8(etc, 0) return empty
Updates #135
2024-04-05 13:30:18 +11:00
Nigel Tao f32bfe95c6 std/crc64: optimize for x86+SSE4.2
name                           old speed      new speed      delta

wuffs_crc64_ecma_10k/clang14   1.78GB/s ± 0%  5.79GB/s ± 0%  +225.48%  (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/clang14  1.78GB/s ± 0%  6.09GB/s ± 0%  +241.67%  (p=0.008 n=5+5)

wuffs_crc64_ecma_10k/gcc12     2.05GB/s ± 1%  5.79GB/s ± 1%  +182.80%  (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/gcc12    2.01GB/s ± 0%  6.09GB/s ± 0%  +202.64%  (p=0.008 n=5+5)

wuffs_xz_decode_100k/clang14   57.9MB/s ± 1%  60.2MB/s ± 0%    +4.11%  (p=0.008 n=5+5)

wuffs_xz_decode_100k/gcc12     57.0MB/s ± 0%  57.8MB/s ± 1%    +1.39%  (p=0.008 n=5+5)

$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m8.122s
After:  user 0m8.115s
2024-04-02 00:17:43 +11:00
Nigel Tao 5c693c9de8 release: wuffs gen -version=0.4.0-alpha.3 v0.4.0-alpha.3 2024-03-31 20:44:03 +11:00
Nigel Tao 1596343889 example/mzcat: embiggen static array buffers
$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m8.392s
After:  user 0m8.122s
2024-03-31 18:39:57 +11:00
Nigel Tao b6b0f84187 std/lzma: use 8-byte-copy if applicable
name                            old speed      new speed      delta
wuffs_lzma_decode_100k/clang14  56.2MB/s ± 0%  60.7MB/s ± 0%  +7.96%  (p=0.008 n=5+5)
wuffs_lzma_decode_100k/gcc12    56.4MB/s ± 1%  61.7MB/s ± 1%  +9.44%  (p=0.008 n=5+5)

$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m8.396s
After:  user 0m8.392s
2024-03-31 16:02:06 +11:00
Nigel Tao 7077c20cb6 std/lzma: simplify decode-a-literal
name                            old speed      new speed      delta
wuffs_lzma_decode_100k/clang14  54.8MB/s ± 1%  56.2MB/s ± 0%  +2.61%  (p=0.008 n=5+5)
wuffs_lzma_decode_100k/gcc12    56.8MB/s ± 0%  56.4MB/s ± 1%  -0.75%  (p=0.008 n=5+5)

$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m8.409s
After:  user 0m8.396s
2024-03-31 14:59:58 +11:00
Nigel Tao 9958d6c520 std/lzma: add decoder.decode_bitstream_fast
name                            old speed      new speed      delta
wuffs_lzma_decode_100k/clang14  52.7MB/s ± 0%  54.8MB/s ± 1%   +4.00%  (p=0.008 n=5+5)
wuffs_lzma_decode_100k/gcc12    50.3MB/s ± 1%  56.8MB/s ± 0%  +12.93%  (p=0.008 n=5+5)

$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m9.725s
After:  user 0m8.409s
2024-03-30 21:24:59 +11:00
Nigel Tao f5bb519320 base: add ETC__DST_PIXEL_FORMAT__ENABLE_ALLOWLIST
Binary size, before:
412128 gen/bin/example-convert-to-nia
 50680 gen/bin/example-gifplayer
449680 gen/bin/example-imageviewer
439000 gen/bin/example-sdl-imageviewer
151848 gen/bin/example-toy-aux-image

After:
302232 gen/bin/example-convert-to-nia
 46144 gen/bin/example-gifplayer
352112 gen/bin/example-imageviewer
329168 gen/bin/example-sdl-imageviewer
138656 gen/bin/example-toy-aux-image

For further data points, if you hard-code define'ing
WUFFS_CONFIG__DST_PIXEL_FORMAT__ENABLE_ALLOWLIST and
WUFFS_CONFIG__DST_PIXEL_FORMAT__ALLOW_BGRA_PREMUL:

Binary size, before:
121368 gen/lib/c/clang-dynamic/wuffs-base-pixconv.lo
121368 gen/lib/c/clang-static/wuffs-base-pixconv.o
181088 gen/lib/c/gcc-dynamic/wuffs-base-pixconv.lo
181136 gen/lib/c/gcc-static/wuffs-base-pixconv.o

After:
 54784 gen/lib/c/clang-dynamic/wuffs-base-pixconv.lo
 54784 gen/lib/c/clang-static/wuffs-base-pixconv.o
 72144 gen/lib/c/gcc-dynamic/wuffs-base-pixconv.lo
 72272 gen/lib/c/gcc-static/wuffs-base-pixconv.o
2024-03-29 22:19:47 +11:00
Nigel Tao b2c7c69227 base: add WUFFS_BASE__FORCE_INLINE 2024-03-29 15:49:41 +11:00
Nigel Tao 24151f8132 doc: update changelog for std/png YA_NONPREMUL 2024-03-28 16:43:06 +11:00
Nigel Tao 3bad76cd2c base: fix -Wtautological-type-limit-compare
Fixes #144
2024-03-28 16:38:45 +11:00
Nigel Tao f1a9d34494 pixconv: fix -Werror=conversion 2024-03-27 22:10:13 +11:00
Nigel Tao da40cdf29f base: re-format ETC__PIXEL_FORMAT__ETC defines 2024-03-27 21:16:32 +11:00
Nigel Tao b4cd9b8d3c std/png: decode PNG color type 4 to YA_NONPREMUL
Fixes #143
2024-03-27 21:06:09 +11:00
Nigel Tao bdfbdf407e pixconv: add PIXEL_FORMAT__YA_NONPREMUL support
Binary size, before:
115152 gen/lib/c/clang-dynamic/wuffs-base-pixconv.lo
115152 gen/lib/c/clang-static/wuffs-base-pixconv.o
162280 gen/lib/c/gcc-dynamic/wuffs-base-pixconv.lo
165352 gen/lib/c/gcc-static/wuffs-base-pixconv.o

After:
123464 gen/lib/c/clang-dynamic/wuffs-base-pixconv.lo
123464 gen/lib/c/clang-static/wuffs-base-pixconv.o
180768 gen/lib/c/gcc-dynamic/wuffs-base-pixconv.lo
180880 gen/lib/c/gcc-static/wuffs-base-pixconv.o

Updates #143
2024-03-27 19:07:03 +11:00
Nigel Tao 0c9b700df0 base: fix PIXEL_FORMAT__YA_{NON,}PREMUL values
These pixel formats have two channels (gray, alpha), not one.

Updates #143
2024-03-27 16:53:19 +11:00
Nigel Tao a6676851e3 pixconv: sse42-optimize swizzling RGB to RGBA
PNG (as a source pixel format) is RGB or RGBA order. Wuffs' std/png
benchmarks, like the other image formats, decode to BGRA order. *If*
those benchmarks are altered to target RGBA instead, we get:

name                                                       old speed     new speed     delta

wuffs_png_decode_image_40k_24bpp/clang14                   279MB/s ± 0%  293MB/s ± 0%  +5.11%  (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/clang14                 289MB/s ± 0%  303MB/s ± 0%  +4.89%  (p=0.008 n=5+5)

wuffs_png_decode_image_40k_24bpp/gcc12                     311MB/s ± 0%  332MB/s ± 0%  +6.84%  (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/gcc12                   325MB/s ± 0%  339MB/s ± 0%  +4.49%  (p=0.008 n=5+5)

When starting from 3-channel RGB, ending with RGBA is now as fast as
ending with BGRA.

Updates #141
2024-03-26 10:07:58 +11:00
Nigel Tao 44bb271c21 root: update BUILD.md for bzcat name change 2024-03-06 17:45:22 +11:00
Nigel Tao b922c28a8e std/lzma: tweak Literal After Non-Literal code 2024-03-04 09:33:08 +11:00
Nigel Tao 13c72db350 std/lzma: add QUIRK_ALLOW_NON_ZERO_INITIAL_BYTE 2024-03-01 21:11:28 +11:00
Nigel Tao 27407b5332 test/3pdata: add xzsuite/lzip-testsuite/*.lz 2024-03-01 21:03:56 +11:00
Nigel Tao a9739a8921 std/lzip: actually implement the format 2024-03-01 20:55:24 +11:00
Nigel Tao 793ab36569 std/lzip: add new package 2024-03-01 09:52:54 +11:00
Nigel Tao 1c0b07f1aa std/lzma: accept optional End of Stream code 2024-02-29 22:01:04 +11:00
Nigel Tao 22b4ff4842 std/xz: decode concatenated streams 2024-02-26 23:02:40 +11:00
Nigel Tao 5b62289c63 test/data: add *.two-concatenated-streams.xz
lo128.dat and hi128.dat were constructed manually, then the
256.bytes.two-concatenated-streams.xz file was constructed by:

xz --keep lo128.dat
xz --keep hi128.dat
cat lo128.dat.xz hi128.dat.xz > 256.bytes.two-concatenated-streams.xz
2024-02-26 22:11:51 +11:00
Nigel Tao 8ff5693d9d std/xz: prepare to decode concatenated streams 2024-02-26 21:48:31 +11:00
Nigel Tao f06858f395 example/convert-to-nia: tweak write max len 2024-02-23 22:42:45 +11:00
Nigel Tao 47ed32b6ce std/xz: clarify bad versus unsupported filter 2024-02-21 21:59:11 +11:00
Nigel Tao 22fd87efc6 std/xz: reset LZMA decoder after first block
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=66816
2024-02-21 21:55:53 +11:00
Nigel Tao 5ec31fc291 std/xz: verify index blocks' comp/uncomp sizes 2024-02-16 16:03:49 +11:00
Nigel Tao c0264e4496 std/xz: verify index and footer 2024-02-15 21:46:14 +11:00
Nigel Tao 06599b8e9b std/xz: tighten VLI (variable length int) decode 2024-02-15 19:19:46 +11:00
Nigel Tao 4e20ba6876 example: add output-crc32-digest flag 2024-02-15 13:40:09 +11:00
Nigel Tao 6017c37232 std/lzma: stash LZMA state across multiple chunks 2024-02-14 20:32:07 +11:00
Nigel Tao 6c71bb229b test/data: add enwik5.block-size-32k.xz
It was created with a vanilla xz binary:
  xz --keep --block-size=32k --stdout enwik5 > enwik5.block-size-32k.xz
2024-02-14 15:49:54 +11:00
Nigel Tao 2f7fbd0f34 test/data: add enwik5.lzma2-chunk-max-1-13.xz
It was created wih a custom xz binary (built from the source at
https://github.com/tukaani-project/xz), with this command:
  xz --compress --keep --stdout enwik5 > enwik5.lzma2-chunk-max-1-13.xz
after applying this patch to xz's src/liblzma/lzma/lzma2_encoder.h:

-#define LZMA2_CHUNK_MAX (UINT32_C(1) << 16)
+#define LZMA2_CHUNK_MAX (UINT32_C(1) << 13)

The resultant enwik5.lzma2-chunk-max-1-13.xz file has multiple LZMA2
chunks, unlike the existing enwik5.xz (created with the normal chunk
limit). Wuffs' std/xz currently does not decode this new file properly.
2024-02-13 22:17:35 +11:00
Nigel Tao 749e3559f2 std/xz: implement apply_filter_0b_riscv 2024-02-13 21:11:06 +11:00
Nigel Tao 94e32e8e56 test/3pdata: add xzsuite/*-riscv-*.xz 2024-02-13 20:22:02 +11:00
Nigel Tao 782e78a689 std/xz: support BCJ start option 2024-02-12 21:01:27 +11:00
Nigel Tao 6f4db1b138 std/xz: implement apply_filter_06_ia64 2024-02-12 20:15:45 +11:00
Nigel Tao 30133ad4b2 std/xz: implement apply_filter_05_powerpc 2024-02-11 19:10:55 +11:00
Nigel Tao d2a63a7e34 std/xz: implement apply_filter_04_x86 2024-02-11 13:04:29 +11:00
Nigel Tao 76a17ce742 std/xz: implement apply_filter_0a_arm64 2024-02-11 11:42:40 +11:00
Nigel Tao 8b3e598572 std/xz: implement apply_filter_08_armthumb 2024-02-11 11:11:47 +11:00
Nigel Tao 03bb04d80c std/xz: implement apply_filter_09_sparc 2024-02-11 10:54:44 +11:00