Nigel Tao
affa1e02d4
base: add WUFFS_PRIVATE_IMPL__CPU_ARCH__X86_64_V2
...
Updates #148
2024-07-09 09:17:09 +10:00
Nigel Tao
37a3c3ce9b
base: rename WUFFS_BASE__CPU_ARCH__ETC
...
See
https://github.com/google/wuffs/issues/148#issuecomment-2130535812
Updates #148
2024-07-08 18:14:59 +10:00
Nigel Tao
6c8a43390b
test: add webp mimic tests and benches
2024-07-08 15:54:40 +10:00
Nigel Tao
5654506497
base: allow swizzling WebP Lossless to gray
2024-07-08 12:35:40 +10:00
Nigel Tao
00e6e71672
std/webp: implement VP8 Lossless
2024-07-07 22:13:50 +10:00
Nigel Tao
09f4500e19
std/webp: add new package (and vp8 placeholder)
2024-05-10 13:52:07 +10:00
Nigel Tao
16705a1816
test: fix lzip "wuffs mimic cflags" copy/pasto
2024-05-09 15:15:04 +10:00
Nigel Tao
e541e0cf79
std/crc64: re-write x86_sse42 implementation
...
name old speed new speed delta
wuffs_crc64_ecma_10k/clang14 5.84GB/s ± 0% 23.43GB/s ± 0% +301.23% (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/clang14 6.18GB/s ± 0% 30.23GB/s ± 1% +389.45% (p=0.008 n=5+5)
wuffs_crc64_ecma_10k/gcc12 5.87GB/s ± 1% 24.02GB/s ± 0% +309.21% (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/gcc12 6.21GB/s ± 0% 30.68GB/s ± 0% +394.22% (p=0.008 n=5+5)
$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m7.604s
After: user 0m7.432s
2024-04-22 14:05:16 +10:00
Nigel Tao
e1f803324b
test: use s/100/300/ digits of pi for crcNN tests
2024-04-22 09:13:22 +10:00
Nigel Tao
bdfbdf407e
pixconv: add PIXEL_FORMAT__YA_NONPREMUL support
...
Binary size, before:
115152 gen/lib/c/clang-dynamic/wuffs-base-pixconv.lo
115152 gen/lib/c/clang-static/wuffs-base-pixconv.o
162280 gen/lib/c/gcc-dynamic/wuffs-base-pixconv.lo
165352 gen/lib/c/gcc-static/wuffs-base-pixconv.o
After:
123464 gen/lib/c/clang-dynamic/wuffs-base-pixconv.lo
123464 gen/lib/c/clang-static/wuffs-base-pixconv.o
180768 gen/lib/c/gcc-dynamic/wuffs-base-pixconv.lo
180880 gen/lib/c/gcc-static/wuffs-base-pixconv.o
Updates #143
2024-03-27 19:07:03 +11:00
Nigel Tao
a9739a8921
std/lzip: actually implement the format
2024-03-01 20:55:24 +11:00
Nigel Tao
793ab36569
std/lzip: add new package
2024-03-01 09:52:54 +11:00
Nigel Tao
d2ecc20141
std/xz: use io_forget_history
2024-02-09 15:06:11 +11:00
Nigel Tao
c21cc95713
std/lzma: use args.workbuf for io_buffer history
2024-02-08 21:38:30 +11:00
Nigel Tao
ab06be047b
test/data: add romeo.txt.delta1.xz
...
It was generated by:
xz -k --delta=dist=1 --lzma2 --stdout romeo.txt > romeo.txt.delta1.xz
2024-01-09 22:40:46 +11:00
Nigel Tao
ce0cee444d
std/xz: add new package
2023-12-25 13:24:24 +11:00
Nigel Tao
41a83f2e29
std/lzma: add LZMA2 support
2023-12-24 22:33:42 +11:00
Nigel Tao
57f01ec3f6
std/lzma: add new package
2023-12-12 23:41:26 +11:00
Nigel Tao
9a68ec70c6
base: use wuffs_private_impl__etc names
2023-11-02 22:30:10 +11:00
Nigel Tao
883ad62c2f
pixconv: use wuffs_private_impl__etc names
2023-10-30 22:29:59 +11:00
Nigel Tao
054c6c964b
strconv: drop base from wuffs_base__private_impl
2023-10-29 21:59:52 +11:00
Nigel Tao
712e42e938
test: fix sha256 mimic call for one-shot func
2023-10-24 20:57:02 +11:00
Nigel Tao
b2ab3ba008
std/crc64: add new package
2023-10-14 23:56:41 +11:00
Nigel Tao
50abf5eb6a
std/sha256: add new package
2023-10-14 18:14:36 +11:00
Patrick Georgi
f563f32f82
Add SPDX identifier to license headers
...
SPDX is an ISO standard for describing licenses in a computer readable
format, which is useful when applying license compliance tools and the
like to source code.
In addition to ensuring that the Wuffs C distribution is properly
annotated to the benefit of projects using Wuffs and SPDX-supporting
tools, add it everywhere else where there's a license in this repo for
consistency, too.
2023-10-06 20:52:36 +02:00
Nigel Tao
1304ee6265
std/xxhash64: add new package
2023-10-06 13:10:47 +11:00
Nigel Tao
74a6ea2fcd
all: relicense from Apache2 to dual Apache2/MIT
...
The LICENSE has changed from a single license (Apache2) to a dual
license (Apache2 or MIT, at your option).
If you've previously used Wuffs under the Apache2 license, you are able
to keep doing so. No further action required by you.
The two files listed below (previous releases) are exceptions, as they
are older snapshots, frozen in time. Their license has not changed:
release/c/wuffs-v0.2.c
release/c/wuffs-v0.3.c
Every name in the AUTHORS file, other than Google Inc., has signed
Google's CLA (Contributor License Agreement).
2023-10-06 10:00:59 +11:00
Nigel Tao
bec02d7c31
std/xxhash32: add new package
2023-10-05 19:08:22 +11:00
Nigel Tao
8e42e01d3c
std/gif: remove the std/lzw dependency
...
name old speed new speed delta
wuffs_gif_decode_1k_bw/clang11 683MB/s ± 0% 682MB/s ± 0% ~ (p=0.690 n=5+5)
wuffs_gif_decode_1k_color_full_init/clang11 168MB/s ± 0% 184MB/s ± 0% +10.01% (p=0.008 n=5+5)
wuffs_gif_decode_1k_color_part_init/clang11 204MB/s ± 0% 230MB/s ± 0% +12.77% (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/clang11 746MB/s ± 0% 819MB/s ± 0% +9.90% (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/clang11 200MB/s ± 0% 218MB/s ± 0% +8.97% (p=0.008 n=5+5)
wuffs_gif_decode_20k/clang11 246MB/s ± 0% 257MB/s ± 0% +4.33% (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/clang11 543MB/s ± 0% 562MB/s ± 0% +3.44% (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/clang11 210MB/s ± 0% 220MB/s ± 0% +4.90% (p=0.008 n=5+5)
wuffs_gif_decode_1000k_full_init/clang11 214MB/s ± 0% 224MB/s ± 0% +4.96% (p=0.008 n=5+5)
wuffs_gif_decode_1000k_part_init/clang11 214MB/s ± 0% 224MB/s ± 0% +4.98% (p=0.008 n=5+5)
wuffs_gif_decode_anim_screencap/clang11 1.24GB/s ± 0% 1.29GB/s ± 0% +3.85% (p=0.008 n=5+5)
wuffs_gif_decode_1k_bw/gcc10 649MB/s ± 0% 588MB/s ± 0% -9.42% (p=0.008 n=5+5)
wuffs_gif_decode_1k_color_full_init/gcc10 167MB/s ± 0% 198MB/s ± 0% +18.57% (p=0.008 n=5+5)
wuffs_gif_decode_1k_color_part_init/gcc10 195MB/s ± 0% 251MB/s ± 0% +28.64% (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/gcc10 753MB/s ± 0% 871MB/s ± 0% +15.64% (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/gcc10 199MB/s ± 0% 233MB/s ± 0% +16.86% (p=0.008 n=5+5)
wuffs_gif_decode_20k/gcc10 258MB/s ± 0% 265MB/s ± 0% +2.93% (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/gcc10 560MB/s ± 0% 561MB/s ± 0% +0.19% (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/gcc10 221MB/s ± 0% 227MB/s ± 0% +2.65% (p=0.008 n=5+5)
wuffs_gif_decode_1000k_full_init/gcc10 227MB/s ± 0% 232MB/s ± 0% +2.29% (p=0.008 n=5+5)
wuffs_gif_decode_1000k_part_init/gcc10 227MB/s ± 0% 232MB/s ± 0% +2.28% (p=0.008 n=5+5)
wuffs_gif_decode_anim_screencap/gcc10 1.29GB/s ± 0% 1.28GB/s ± 0% -0.22% (p=0.008 n=5+5)
2023-10-04 20:19:25 +11:00
Nigel Tao
e2b9566fc5
base: restrict x86_avx2 to 64-bit (not 32-bit) x86
...
32-bit C/C++ compilers don't always compile the AVX intrinsics. Per the
60773 bug below,
> clang++ -m32 etc etc fuzz/c/std/jpeg_fuzzer.c
> undefined reference to `_mm_cvtsi128_si64'
> undefined reference to `_mm256_extract_epi64'
See also the "#ifdef __x86_64__" guards in
https://github.com/gcc-mirror/gcc/blob/4a3895903c29ed85da6fcb886f31ff23d4c6e935/gcc/config/i386/emmintrin.h#L228-L231
https://github.com/llvm/llvm-project/blob/08fab9ebecf72a682279d75489dc2460121cbeed/clang/lib/Headers/emmintrin.h#L3502-L3515
Note that -m32 is not the same as -mx32
> $ touch empty.c
> $ gcc -dM -E empty.c | grep -E '__i386__|__x86_64__'
> #define __x86_64__ 1
> $ gcc -m32 -dM -E empty.c | grep -E '__i386__|__x86_64__'
> #define __i386__ 1
> $ gcc -mx32 -dM -E empty.c | grep -E '__i386__|__x86_64__'
> #define __x86_64__ 1
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=60773
2023-07-23 21:20:35 +10:00
Nigel Tao
2bff962cf1
std/jpeg: add decoder.decode_idct_x86_avx2
...
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 237MB/s ± 0% 370MB/s ± 0% +55.94% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 205MB/s ± 0% 231MB/s ± 0% +12.80% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 379MB/s ± 0% 470MB/s ± 0% +23.92% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 332MB/s ± 0% 418MB/s ± 0% +25.95% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 345MB/s ± 0% 435MB/s ± 0% +25.99% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 483MB/s ± 0% 620MB/s ± 0% +28.53% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 349MB/s ± 0% 441MB/s ± 0% +26.47% (p=0.008 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 231MB/s ± 0% 352MB/s ± 0% +52.78% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 227MB/s ± 0% 296MB/s ± 0% +30.44% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 500MB/s ± 0% 666MB/s ± 0% +33.21% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 417MB/s ± 0% 565MB/s ± 0% +35.32% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 440MB/s ± 0% 608MB/s ± 0% +38.37% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 478MB/s ± 0% 624MB/s ± 0% +30.70% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 445MB/s ± 0% 616MB/s ± 0% +38.42% (p=0.008 n=5+5)
2023-07-18 09:17:08 +10:00
Nigel Tao
0af626b850
std/jpeg: grow quant_tables' elements, s/u8/u16/
2023-07-17 10:27:49 +10:00
Nigel Tao
e5b6f2563e
std/jpeg: prepare decode_idct_x86_avx2.wuffs
2023-07-16 19:54:36 +10:00
Nigel Tao
8954281a4e
pixconv: allow decoding to PIXEL_FORMAT__RGB
...
"wuffs genlib" binary size changes:
77936 clang-static/wuffs-base-pixconv.o # Before = 1.00x
79792 clang-static/wuffs-base-pixconv.o # After = 1.02x
173784 gcc-static/wuffs-base-pixconv.o # Before = 1.00x
177112 gcc-static/wuffs-base-pixconv.o # After = 1.02x
Some of the benchmark numbers move around even though they don't use the
new WUFFS_BASE__PIXEL_FORMAT__RGB code paths. It's possibly just a code
alignment coincidence per https://news.ycombinator.com/item?id=23633583
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 249MB/s ± 0% 251MB/s ± 0% +0.76% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 222MB/s ± 0% 225MB/s ± 0% +1.16% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 405MB/s ± 0% 406MB/s ± 0% ~ (p=1.000 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 357MB/s ± 0% 356MB/s ± 0% -0.24% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 370MB/s ± 0% 372MB/s ± 0% +0.46% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 504MB/s ± 0% 508MB/s ± 0% +0.83% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 375MB/s ± 0% 374MB/s ± 0% ~ (p=0.095 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 258MB/s ± 0% 254MB/s ± 0% -1.68% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 267MB/s ± 0% 240MB/s ± 0% -9.95% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 537MB/s ± 0% 537MB/s ± 0% ~ (p=0.556 n=4+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 458MB/s ± 0% 453MB/s ± 0% -1.18% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 482MB/s ± 0% 478MB/s ± 0% -0.78% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 508MB/s ± 0% 511MB/s ± 0% +0.49% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 489MB/s ± 0% 484MB/s ± 0% -1.11% (p=0.016 n=4+5)
wuffs_png_decode_image_19k_8bpp/clang11 269MB/s ± 0% 275MB/s ± 0% +2.25% (p=0.008 n=5+5)
wuffs_png_decode_image_40k_24bpp/clang11 328MB/s ± 0% 328MB/s ± 0% ~ (p=0.841 n=5+5)
wuffs_png_decode_image_77k_8bpp/clang11 949MB/s ± 0% 962MB/s ± 0% +1.29% (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/clang11 854MB/s ± 0% 859MB/s ± 0% +0.54% (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_verify_checksum/clang11 822MB/s ± 0% 826MB/s ± 0% +0.52% (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/clang11 331MB/s ± 0% 332MB/s ± 0% +0.15% (p=0.008 n=5+5)
wuffs_png_decode_image_19k_8bpp/gcc10 287MB/s ± 0% 277MB/s ± 0% -3.46% (p=0.008 n=5+5)
wuffs_png_decode_image_40k_24bpp/gcc10 341MB/s ± 0% 346MB/s ± 0% +1.34% (p=0.008 n=5+5)
wuffs_png_decode_image_77k_8bpp/gcc10 1.02GB/s ± 0% 1.01GB/s ± 0% -0.41% (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/gcc10 939MB/s ± 0% 916MB/s ± 0% -2.50% (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_verify_checksum/gcc10 895MB/s ± 0% 874MB/s ± 0% -2.41% (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/gcc10 352MB/s ± 0% 350MB/s ± 0% -0.44% (p=0.008 n=5+5)
Updates #131
2023-07-16 11:17:45 +10:00
Nigel Tao
38205517d4
test: fix some errors in "compile C as C++"
2023-06-20 17:25:56 +10:00
Nigel Tao
dfab0d2b3d
mimiclib: allow jpeg decoding via stb_image
2023-06-12 17:24:49 +10:00
Nigel Tao
c0d7d7d046
std/jpeg: remove decode_idct block-selector arg
...
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 210MB/s ± 0% 213MB/s ± 0% +1.54% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 200MB/s ± 0% 197MB/s ± 0% -1.31% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 362MB/s ± 0% 373MB/s ± 0% +3.04% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 307MB/s ± 0% 318MB/s ± 0% +3.82% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 318MB/s ± 0% 331MB/s ± 0% +4.09% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 434MB/s ± 0% 440MB/s ± 0% +1.34% (p=0.016 n=4+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 320MB/s ± 0% 340MB/s ± 0% +6.29% (p=0.008 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 165MB/s ± 0% 172MB/s ± 0% +4.32% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 224MB/s ± 0% 227MB/s ± 0% +1.30% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 454MB/s ± 0% 465MB/s ± 0% +2.40% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 311MB/s ± 0% 324MB/s ± 0% +4.38% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 327MB/s ± 0% 342MB/s ± 0% +4.52% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 384MB/s ± 0% 393MB/s ± 0% +2.34% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 324MB/s ± 0% 345MB/s ± 1% +6.26% (p=0.008 n=5+5)
2023-06-10 14:12:08 +10:00
Nigel Tao
dcb5b0e1c7
test: add 4:4:4 (not just 4:2:0) JPEG test+bench
2023-06-05 22:25:22 +10:00
Nigel Tao
4751ef4de5
test: add std/jpeg mimic tests and benches
2023-06-04 12:44:17 +10:00
Nigel Tao
a41149e73c
std/jpeg: implement triangle-filter upsampling
...
"script/confirm-matches-djpeg.sh test/data/*.jpeg" is now all matches.
2023-05-21 22:05:38 +10:00
Nigel Tao
94df43c530
std/jpeg: prepare for triangle-filter upsampling
2023-05-21 22:04:45 +10:00
Nigel Tao
85b244aa49
std/netpbm: add new package
2023-05-16 16:29:58 +10:00
Nigel Tao
7514dede23
std/jpeg: decode color images, not just gray
...
Updates #42
2023-05-14 23:03:33 +10:00
Nigel Tao
3bd83e3ebb
std/jpeg: apply Inverse DCT
...
Updates #42
2023-05-11 21:29:07 +10:00
Nigel Tao
8cfe304f3c
std/jpeg: implement Inverse DCT
...
Updates #42
2023-05-08 21:51:47 +10:00
Nigel Tao
c914f66a6c
std/jpeg: decode Huffman entropy coded data
...
Updates #42
2023-05-06 09:47:10 +10:00
Nigel Tao
d36277f0c0
std/jpeg: decode DHT (Huffman tables)
...
Updates #42
2023-04-29 11:14:59 +10:00
Nigel Tao
0ccceece0b
std/jpeg: decode SOF, producing the image config
...
Updates #42
2023-04-24 11:14:54 +10:00
Nigel Tao
0bbc4c0083
std/jpeg: add new package
...
This is just a placeholder decoder implementation (and all of the
required plumbing) that produces a 1x1 reddish-purple image. Follow-up
commits will add flesh to the metaphorical bones.
Updates #42
2023-04-21 18:33:00 +10:00
Nigel Tao
d8c23a3a66
std/lzw: change set_literal_width to set_quirk
2023-04-15 09:59:40 +10:00