Commit Graph
803 Commits
Author SHA1 Message Date
Nigel Tao d0603f3b94 test/3pdata: add webpsuite 2024-07-09 21:43:24 +10:00
Nigel Tao affa1e02d4 base: add WUFFS_PRIVATE_IMPL__CPU_ARCH__X86_64_V2
Updates #148
2024-07-09 09:17:09 +10:00
Nigel Tao 37a3c3ce9b base: rename WUFFS_BASE__CPU_ARCH__ETC
See
https://github.com/google/wuffs/issues/148#issuecomment-2130535812

Updates #148
2024-07-08 18:14:59 +10:00
Nigel Tao 6c8a43390b test: add webp mimic tests and benches 2024-07-08 15:54:40 +10:00
Nigel Tao 5654506497 base: allow swizzling WebP Lossless to gray 2024-07-08 12:35:40 +10:00
Nigel Tao 00e6e71672 std/webp: implement VP8 Lossless 2024-07-07 22:13:50 +10:00
Nigel Tao 09f4500e19 std/webp: add new package (and vp8 placeholder) 2024-05-10 13:52:07 +10:00
Nigel Tao 16705a1816 test: fix lzip "wuffs mimic cflags" copy/pasto 2024-05-09 15:15:04 +10:00
Nigel Tao e541e0cf79 std/crc64: re-write x86_sse42 implementation
name                           old speed      new speed       delta

wuffs_crc64_ecma_10k/clang14   5.84GB/s ± 0%  23.43GB/s ± 0%  +301.23%  (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/clang14  6.18GB/s ± 0%  30.23GB/s ± 1%  +389.45%  (p=0.008 n=5+5)

wuffs_crc64_ecma_10k/gcc12     5.87GB/s ± 1%  24.02GB/s ± 0%  +309.21%  (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/gcc12    6.21GB/s ± 0%  30.68GB/s ± 0%  +394.22%  (p=0.008 n=5+5)

$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m7.604s
After:  user 0m7.432s
2024-04-22 14:05:16 +10:00
Nigel Tao e1f803324b test: use s/100/300/ digits of pi for crcNN tests 2024-04-22 09:13:22 +10:00
Nigel Tao fdd08200e3 test/3pdata: add note re XZ backdoor test files
This mirrors the nigeltao/xz-tests-files repo's
https://github.com/nigeltao/xz-tests-files/commit/d163360fd24b54562de56f012b2b05cc183736df
2024-04-05 17:33:18 +11:00
Nigel Tao bdfbdf407e pixconv: add PIXEL_FORMAT__YA_NONPREMUL support
Binary size, before:
115152 gen/lib/c/clang-dynamic/wuffs-base-pixconv.lo
115152 gen/lib/c/clang-static/wuffs-base-pixconv.o
162280 gen/lib/c/gcc-dynamic/wuffs-base-pixconv.lo
165352 gen/lib/c/gcc-static/wuffs-base-pixconv.o

After:
123464 gen/lib/c/clang-dynamic/wuffs-base-pixconv.lo
123464 gen/lib/c/clang-static/wuffs-base-pixconv.o
180768 gen/lib/c/gcc-dynamic/wuffs-base-pixconv.lo
180880 gen/lib/c/gcc-static/wuffs-base-pixconv.o

Updates #143
2024-03-27 19:07:03 +11:00
Nigel Tao 13c72db350 std/lzma: add QUIRK_ALLOW_NON_ZERO_INITIAL_BYTE 2024-03-01 21:11:28 +11:00
Nigel Tao 27407b5332 test/3pdata: add xzsuite/lzip-testsuite/*.lz 2024-03-01 21:03:56 +11:00
Nigel Tao a9739a8921 std/lzip: actually implement the format 2024-03-01 20:55:24 +11:00
Nigel Tao 793ab36569 std/lzip: add new package 2024-03-01 09:52:54 +11:00
Nigel Tao 1c0b07f1aa std/lzma: accept optional End of Stream code 2024-02-29 22:01:04 +11:00
Nigel Tao 22b4ff4842 std/xz: decode concatenated streams 2024-02-26 23:02:40 +11:00
Nigel Tao 5b62289c63 test/data: add *.two-concatenated-streams.xz
lo128.dat and hi128.dat were constructed manually, then the
256.bytes.two-concatenated-streams.xz file was constructed by:

xz --keep lo128.dat
xz --keep hi128.dat
cat lo128.dat.xz hi128.dat.xz > 256.bytes.two-concatenated-streams.xz
2024-02-26 22:11:51 +11:00
Nigel Tao 5ec31fc291 std/xz: verify index blocks' comp/uncomp sizes 2024-02-16 16:03:49 +11:00
Nigel Tao c0264e4496 std/xz: verify index and footer 2024-02-15 21:46:14 +11:00
Nigel Tao 06599b8e9b std/xz: tighten VLI (variable length int) decode 2024-02-15 19:19:46 +11:00
Nigel Tao 6017c37232 std/lzma: stash LZMA state across multiple chunks 2024-02-14 20:32:07 +11:00
Nigel Tao 6c71bb229b test/data: add enwik5.block-size-32k.xz
It was created with a vanilla xz binary:
  xz --keep --block-size=32k --stdout enwik5 > enwik5.block-size-32k.xz
2024-02-14 15:49:54 +11:00
Nigel Tao 2f7fbd0f34 test/data: add enwik5.lzma2-chunk-max-1-13.xz
It was created wih a custom xz binary (built from the source at
https://github.com/tukaani-project/xz), with this command:
  xz --compress --keep --stdout enwik5 > enwik5.lzma2-chunk-max-1-13.xz
after applying this patch to xz's src/liblzma/lzma/lzma2_encoder.h:

-#define LZMA2_CHUNK_MAX (UINT32_C(1) << 16)
+#define LZMA2_CHUNK_MAX (UINT32_C(1) << 13)

The resultant enwik5.lzma2-chunk-max-1-13.xz file has multiple LZMA2
chunks, unlike the existing enwik5.xz (created with the normal chunk
limit). Wuffs' std/xz currently does not decode this new file properly.
2024-02-13 22:17:35 +11:00
Nigel Tao 749e3559f2 std/xz: implement apply_filter_0b_riscv 2024-02-13 21:11:06 +11:00
Nigel Tao 94e32e8e56 test/3pdata: add xzsuite/*-riscv-*.xz 2024-02-13 20:22:02 +11:00
Nigel Tao 782e78a689 std/xz: support BCJ start option 2024-02-12 21:01:27 +11:00
Nigel Tao 6f4db1b138 std/xz: implement apply_filter_06_ia64 2024-02-12 20:15:45 +11:00
Nigel Tao 30133ad4b2 std/xz: implement apply_filter_05_powerpc 2024-02-11 19:10:55 +11:00
Nigel Tao d2a63a7e34 std/xz: implement apply_filter_04_x86 2024-02-11 13:04:29 +11:00
Nigel Tao 76a17ce742 std/xz: implement apply_filter_0a_arm64 2024-02-11 11:42:40 +11:00
Nigel Tao 8b3e598572 std/xz: implement apply_filter_08_armthumb 2024-02-11 11:11:47 +11:00
Nigel Tao 03bb04d80c std/xz: implement apply_filter_09_sparc 2024-02-11 10:54:44 +11:00
Nigel Tao af6c7b56af std/xz: implement apply_filter_07_arm 2024-02-10 21:46:36 +11:00
Nigel Tao 9ef114be43 std/xz: prepare to add BCJ filters 2024-02-09 22:15:09 +11:00
Nigel Tao 2b4e8ce6a2 example/mzcat: support zlib 2024-02-09 16:07:43 +11:00
Nigel Tao d2ecc20141 std/xz: use io_forget_history 2024-02-09 15:06:11 +11:00
Nigel Tao c21cc95713 std/lzma: use args.workbuf for io_buffer history 2024-02-08 21:38:30 +11:00
Nigel Tao ab06be047b test/data: add romeo.txt.delta1.xz
It was generated by:
xz -k --delta=dist=1 --lzma2 --stdout romeo.txt > romeo.txt.delta1.xz
2024-01-09 22:40:46 +11:00
Nigel Tao d4ececf1d4 std/xz: add delta filter 2024-01-07 09:14:11 +11:00
Nigel Tao 1e5cf45090 std/lzma: fix uncompressed prior decoded length 2023-12-27 23:40:10 +11:00
Nigel Tao 2afec50f62 std/lzma: track prior decoded length 2023-12-26 23:48:47 +11:00
Nigel Tao 5a7299b5c2 script: have print-*-checksums.sh show exit codes 2023-12-26 22:21:13 +11:00
Nigel Tao cf927b20bf std/xz: verify block {un,}compressed size 2023-12-26 17:04:16 +11:00
Nigel Tao a440f6dd5b std/lzma: support LZMA2 uncompressed chunks 2023-12-26 17:04:14 +11:00
Nigel Tao 13d9d259e8 test/3pdata: add xzsuite 2023-12-26 12:41:01 +11:00
Nigel Tao 33db93f617 script: add print-mzcat-checksums.sh 2023-12-26 10:56:22 +11:00
Nigel Tao ce0cee444d std/xz: add new package 2023-12-25 13:24:24 +11:00
Nigel Tao 41a83f2e29 std/lzma: add LZMA2 support 2023-12-24 22:33:42 +11:00