Nigel Tao
ca50faaa92
test/3pdata: add more commentary about djpeg diffs
2023-09-26 22:09:25 +10:00
Nigel Tao
70c1a78cd8
test/3pdata: add etc-blinksuite.commentary.md
2023-09-24 11:50:55 +10:00
Nigel Tao
186bdc5fe2
Roll back 'decode truncated... on MCU boundaries'
...
See the previous commit for the rationale.
2023-09-16 20:53:15 +10:00
Nigel Tao
a3cecef69a
std/jpeg: decode truncated JPEGs on MCU boundaries
...
This only affects truncated (malformed) JPEGs. It moves Wuffs' std/jpeg
decoder closer to libjpeg-turbo, as seen by the "hash of the decoded
output" for test/data/peacock.default.truncated.jpeg now matching
test/data/peacock.default.truncated.decoded-by-djpeg.png instead of
test/data/peacock.default.truncated.decoded-by-wuffs.png
The decoding of test/data/peacock.progressive.truncated.jpeg is not yet
affected, requiring further investigation, but a future commit could
similarly make that match djpeg.
The two libraries don't use exactly the same algorithm because, for
performance, Wuffs' decoder reads from the bitstream 8 bytes at a time
where libjpeg-turbo reads only 1 byte at a time.
While this change moves Wuffs' output closer to libjpeg-turbo (to
repeat, only for truncated JPEGs; well-formed JPEGs are unaffected), the
benchmarks below show a negative performance impact, and visual
inspection of test/data/peacock.*.truncated.decoded-by-*.png shows that
matching libjpeg-turbo *exactly* on truncated JPEGs doesn't actually
always look better.
On balance, it doesn't seem worth it to keep this change (and spend more
time on that further investigation).
This commit will soon be followed by a rollback, but it is committed
anyway so that we can refer to these numbers in the git log.
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 378MB/s ± 0% 364MB/s ± 0% -3.53% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 325MB/s ± 0% 340MB/s ± 0% +4.62% (p=0.016 n=5+4)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 1.02GB/s ± 0% 0.99GB/s ± 0% -2.64% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 842MB/s ± 0% 815MB/s ± 0% -3.16% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 916MB/s ± 0% 887MB/s ± 0% -3.08% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 1.10GB/s ± 0% 1.07GB/s ± 2% -3.39% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 919MB/s ± 0% 892MB/s ± 0% -2.95% (p=0.008 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 360MB/s ± 0% 348MB/s ± 0% -3.34% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 290MB/s ± 0% 283MB/s ± 0% -2.46% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 925MB/s ± 0% 909MB/s ± 0% -1.70% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 758MB/s ± 0% 732MB/s ± 0% -3.43% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 829MB/s ± 0% 799MB/s ± 0% -3.54% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 981MB/s ± 0% 964MB/s ± 0% -1.72% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 835MB/s ± 0% 811MB/s ± 0% -2.89% (p=0.008 n=5+5)
2023-09-16 20:49:46 +10:00
Nigel Tao
721463be95
test/data: add PNGs of truncated-JPEG decodings
...
"Decoded by wuffs" means as of commit 268b9594 .
"Decoded by djpeg" means as of libjpeg-turbo version 3.0.1.
2023-09-16 14:43:19 +10:00
Nigel Tao
d89ec2d40b
std/jpeg: drain bitstream for truncated input
...
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 367MB/s ± 0% 378MB/s ± 0% +2.91% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 333MB/s ± 0% 325MB/s ± 0% -2.46% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 1.00GB/s ± 0% 1.02GB/s ± 0% +1.37% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 822MB/s ± 0% 842MB/s ± 0% +2.39% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 898MB/s ± 0% 916MB/s ± 0% +1.98% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 1.09GB/s ± 0% 1.10GB/s ± 0% +1.21% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 898MB/s ± 0% 919MB/s ± 0% +2.29% (p=0.008 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 362MB/s ± 0% 360MB/s ± 0% -0.55% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 292MB/s ± 0% 290MB/s ± 0% -0.57% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 934MB/s ± 0% 925MB/s ± 0% -1.03% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 759MB/s ± 0% 758MB/s ± 0% -0.25% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 828MB/s ± 0% 829MB/s ± 0% ~ (p=0.222 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 1.00GB/s ± 0% 0.98GB/s ± 0% -1.44% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 837MB/s ± 0% 835MB/s ± 0% -0.29% (p=0.008 n=5+5)
2023-08-28 19:35:08 +10:00
Nigel Tao
dfe5bcd36e
std/jpeg: decode something for truncated input
2023-08-27 10:15:40 +10:00
Nigel Tao
45350db8ca
test/data: add peacock.*.truncated.jpeg
2023-08-26 10:41:46 +10:00
Nigel Tao
80e847dceb
std/jpeg: stash mcu_blocks during progressive IDCT
2023-08-25 23:03:06 +10:00
Nigel Tao
4417dcea4e
std/jpeg: use default Huffman tables if missing
2023-08-24 16:18:11 +10:00
Nigel Tao
6489915ed3
std/jpeg: decode CMYK and YCbCrK JPEGs
...
Once again, the benchmarks don't exercise the CMYK / YCbCrK code paths
per se, but here are the numbers:
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 376MB/s ± 0% 376MB/s ± 0% ~ (p=0.310 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 341MB/s ± 0% 340MB/s ± 0% -0.42% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 1.01GB/s ± 0% 1.01GB/s ± 0% +0.27% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 836MB/s ± 1% 839MB/s ± 0% +0.37% (p=0.016 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 912MB/s ± 0% 914MB/s ± 0% +0.28% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 1.10GB/s ± 0% 1.11GB/s ± 0% +0.82% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 916MB/s ± 0% 916MB/s ± 0% ~ (p=0.841 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 368MB/s ± 0% 361MB/s ± 0% -1.87% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 279MB/s ± 0% 292MB/s ± 0% +4.68% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 947MB/s ± 1% 930MB/s ± 0% -1.74% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 770MB/s ± 0% 760MB/s ± 0% -1.32% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 838MB/s ± 0% 826MB/s ± 0% -1.36% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 1.00GB/s ± 0% 1.01GB/s ± 0% +1.04% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 847MB/s ± 0% 833MB/s ± 0% -1.67% (p=0.008 n=5+5)
2023-08-21 22:13:39 +10:00
Nigel Tao
72b9c23120
std/jpeg: decode RGB (not just YCbCr) JPEGs
...
The benchmarks don't exercise the RGB code paths per se, but it does
affect the numbers. Especially for gcc, this essentially undoes the
performance impact of the previous (trivial) commit. This is all
presumably another code alignment coincidence per
https://news.ycombinator.com/item?id=23633583
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 376MB/s ± 0% 376MB/s ± 0% ~ (p=1.000 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 338MB/s ± 0% 341MB/s ± 0% +0.98% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 1.01GB/s ± 0% 1.01GB/s ± 0% +0.35% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 841MB/s ± 0% 836MB/s ± 1% -0.65% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 913MB/s ± 0% 912MB/s ± 0% -0.18% (p=0.016 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 1.11GB/s ± 0% 1.10GB/s ± 0% -0.34% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 920MB/s ± 0% 916MB/s ± 0% -0.42% (p=0.008 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 349MB/s ± 0% 368MB/s ± 0% +5.60% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 328MB/s ± 0% 279MB/s ± 0% -14.82% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 925MB/s ± 0% 947MB/s ± 1% +2.33% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 732MB/s ± 0% 770MB/s ± 0% +5.23% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 798MB/s ± 0% 838MB/s ± 0% +4.99% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 962MB/s ± 0% 996MB/s ± 0% +3.54% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 806MB/s ± 0% 847MB/s ± 0% +5.19% (p=0.008 n=5+5)
2023-08-21 16:12:21 +10:00
Nigel Tao
14a8bd0feb
std/jpeg: allow fewer-components sequential scans
...
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 366MB/s ± 0% 369MB/s ± 0% +0.81% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 302MB/s ± 0% 309MB/s ± 0% +2.28% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 1.00GB/s ± 0% 1.00GB/s ± 0% -0.58% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 820MB/s ± 0% 827MB/s ± 0% +0.80% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 895MB/s ± 0% 897MB/s ± 0% +0.24% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 1.11GB/s ± 0% 1.10GB/s ± 0% -0.30% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 897MB/s ± 0% 900MB/s ± 0% +0.30% (p=0.008 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 370MB/s ± 0% 369MB/s ± 0% -0.26% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 309MB/s ± 0% 283MB/s ± 0% -8.35% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 948MB/s ± 0% 945MB/s ± 0% -0.27% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 769MB/s ± 0% 769MB/s ± 0% ~ (p=0.310 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 841MB/s ± 0% 842MB/s ± 0% +0.13% (p=0.016 n=4+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 1.00GB/s ± 0% 1.01GB/s ± 0% +0.75% (p=0.016 n=4+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 846MB/s ± 0% 848MB/s ± 0% +0.22% (p=0.008 n=5+5)
2023-08-19 17:22:47 +10:00
Nigel Tao
2f5f203d1b
test/3pdata: regenerate nia-checksums-of-*.txt
2023-08-19 17:18:11 +10:00
Nigel Tao
41d0c095c8
std/jpeg: implement block smoothing
...
"script/confirm-matches-djpeg.sh test/data/*.jpeg" is now all matches.
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 369MB/s ± 0% 366MB/s ± 0% -0.79% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 335MB/s ± 0% 302MB/s ± 0% -9.93% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 1.01GB/s ± 0% 1.00GB/s ± 0% -1.07% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 829MB/s ± 0% 820MB/s ± 0% -1.03% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 903MB/s ± 0% 895MB/s ± 0% -0.93% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 1.12GB/s ± 0% 1.11GB/s ± 0% -1.28% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 906MB/s ± 0% 897MB/s ± 0% -0.93% (p=0.008 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 350MB/s ± 0% 370MB/s ± 0% +5.54% (p=0.016 n=4+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 334MB/s ± 0% 309MB/s ± 0% -7.46% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 924MB/s ± 0% 948MB/s ± 0% +2.61% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 745MB/s ± 0% 769MB/s ± 0% +3.25% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 813MB/s ± 0% 841MB/s ± 0% +3.41% (p=0.029 n=4+4)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 1.00GB/s ± 0% 1.00GB/s ± 0% +0.25% (p=0.029 n=4+4)
wuffs_jpeg_decode_4002k_24bpp/gcc10 821MB/s ± 0% 846MB/s ± 0% +3.00% (p=0.008 n=5+5)
2023-08-19 17:16:51 +10:00
Nigel Tao
e2b9566fc5
base: restrict x86_avx2 to 64-bit (not 32-bit) x86
...
32-bit C/C++ compilers don't always compile the AVX intrinsics. Per the
60773 bug below,
> clang++ -m32 etc etc fuzz/c/std/jpeg_fuzzer.c
> undefined reference to `_mm_cvtsi128_si64'
> undefined reference to `_mm256_extract_epi64'
See also the "#ifdef __x86_64__" guards in
https://github.com/gcc-mirror/gcc/blob/4a3895903c29ed85da6fcb886f31ff23d4c6e935/gcc/config/i386/emmintrin.h#L228-L231
https://github.com/llvm/llvm-project/blob/08fab9ebecf72a682279d75489dc2460121cbeed/clang/lib/Headers/emmintrin.h#L3502-L3515
Note that -m32 is not the same as -mx32
> $ touch empty.c
> $ gcc -dM -E empty.c | grep -E '__i386__|__x86_64__'
> #define __x86_64__ 1
> $ gcc -m32 -dM -E empty.c | grep -E '__i386__|__x86_64__'
> #define __i386__ 1
> $ gcc -mx32 -dM -E empty.c | grep -E '__i386__|__x86_64__'
> #define __x86_64__ 1
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=60773
2023-07-23 21:20:35 +10:00
Nigel Tao
2bff962cf1
std/jpeg: add decoder.decode_idct_x86_avx2
...
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 237MB/s ± 0% 370MB/s ± 0% +55.94% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 205MB/s ± 0% 231MB/s ± 0% +12.80% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 379MB/s ± 0% 470MB/s ± 0% +23.92% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 332MB/s ± 0% 418MB/s ± 0% +25.95% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 345MB/s ± 0% 435MB/s ± 0% +25.99% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 483MB/s ± 0% 620MB/s ± 0% +28.53% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 349MB/s ± 0% 441MB/s ± 0% +26.47% (p=0.008 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 231MB/s ± 0% 352MB/s ± 0% +52.78% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 227MB/s ± 0% 296MB/s ± 0% +30.44% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 500MB/s ± 0% 666MB/s ± 0% +33.21% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 417MB/s ± 0% 565MB/s ± 0% +35.32% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 440MB/s ± 0% 608MB/s ± 0% +38.37% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 478MB/s ± 0% 624MB/s ± 0% +30.70% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 445MB/s ± 0% 616MB/s ± 0% +38.42% (p=0.008 n=5+5)
2023-07-18 09:17:08 +10:00
Nigel Tao
0af626b850
std/jpeg: grow quant_tables' elements, s/u8/u16/
2023-07-17 10:27:49 +10:00
Nigel Tao
e5b6f2563e
std/jpeg: prepare decode_idct_x86_avx2.wuffs
2023-07-16 19:54:36 +10:00
Nigel Tao
8954281a4e
pixconv: allow decoding to PIXEL_FORMAT__RGB
...
"wuffs genlib" binary size changes:
77936 clang-static/wuffs-base-pixconv.o # Before = 1.00x
79792 clang-static/wuffs-base-pixconv.o # After = 1.02x
173784 gcc-static/wuffs-base-pixconv.o # Before = 1.00x
177112 gcc-static/wuffs-base-pixconv.o # After = 1.02x
Some of the benchmark numbers move around even though they don't use the
new WUFFS_BASE__PIXEL_FORMAT__RGB code paths. It's possibly just a code
alignment coincidence per https://news.ycombinator.com/item?id=23633583
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 249MB/s ± 0% 251MB/s ± 0% +0.76% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 222MB/s ± 0% 225MB/s ± 0% +1.16% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 405MB/s ± 0% 406MB/s ± 0% ~ (p=1.000 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 357MB/s ± 0% 356MB/s ± 0% -0.24% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 370MB/s ± 0% 372MB/s ± 0% +0.46% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 504MB/s ± 0% 508MB/s ± 0% +0.83% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 375MB/s ± 0% 374MB/s ± 0% ~ (p=0.095 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 258MB/s ± 0% 254MB/s ± 0% -1.68% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 267MB/s ± 0% 240MB/s ± 0% -9.95% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 537MB/s ± 0% 537MB/s ± 0% ~ (p=0.556 n=4+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 458MB/s ± 0% 453MB/s ± 0% -1.18% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 482MB/s ± 0% 478MB/s ± 0% -0.78% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 508MB/s ± 0% 511MB/s ± 0% +0.49% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 489MB/s ± 0% 484MB/s ± 0% -1.11% (p=0.016 n=4+5)
wuffs_png_decode_image_19k_8bpp/clang11 269MB/s ± 0% 275MB/s ± 0% +2.25% (p=0.008 n=5+5)
wuffs_png_decode_image_40k_24bpp/clang11 328MB/s ± 0% 328MB/s ± 0% ~ (p=0.841 n=5+5)
wuffs_png_decode_image_77k_8bpp/clang11 949MB/s ± 0% 962MB/s ± 0% +1.29% (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/clang11 854MB/s ± 0% 859MB/s ± 0% +0.54% (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_verify_checksum/clang11 822MB/s ± 0% 826MB/s ± 0% +0.52% (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/clang11 331MB/s ± 0% 332MB/s ± 0% +0.15% (p=0.008 n=5+5)
wuffs_png_decode_image_19k_8bpp/gcc10 287MB/s ± 0% 277MB/s ± 0% -3.46% (p=0.008 n=5+5)
wuffs_png_decode_image_40k_24bpp/gcc10 341MB/s ± 0% 346MB/s ± 0% +1.34% (p=0.008 n=5+5)
wuffs_png_decode_image_77k_8bpp/gcc10 1.02GB/s ± 0% 1.01GB/s ± 0% -0.41% (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/gcc10 939MB/s ± 0% 916MB/s ± 0% -2.50% (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_verify_checksum/gcc10 895MB/s ± 0% 874MB/s ± 0% -2.41% (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/gcc10 352MB/s ± 0% 350MB/s ± 0% -0.44% (p=0.008 n=5+5)
Updates #131
2023-07-16 11:17:45 +10:00
Nigel Tao
38205517d4
test: fix some errors in "compile C as C++"
2023-06-20 17:25:56 +10:00
Nigel Tao
2ca61b521f
test/data: add ridiculously-fast.png
2023-06-17 19:50:47 +10:00
Nigel Tao
dfab0d2b3d
mimiclib: allow jpeg decoding via stb_image
2023-06-12 17:24:49 +10:00
Nigel Tao
c0d7d7d046
std/jpeg: remove decode_idct block-selector arg
...
name old speed new speed delta
wuffs_jpeg_decode_19k_8bpp/clang11 210MB/s ± 0% 213MB/s ± 0% +1.54% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang11 200MB/s ± 0% 197MB/s ± 0% -1.31% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang11 362MB/s ± 0% 373MB/s ± 0% +3.04% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang11 307MB/s ± 0% 318MB/s ± 0% +3.82% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/clang11 318MB/s ± 0% 331MB/s ± 0% +4.09% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang11 434MB/s ± 0% 440MB/s ± 0% +1.34% (p=0.016 n=4+5)
wuffs_jpeg_decode_4002k_24bpp/clang11 320MB/s ± 0% 340MB/s ± 0% +6.29% (p=0.008 n=5+5)
wuffs_jpeg_decode_19k_8bpp/gcc10 165MB/s ± 0% 172MB/s ± 0% +4.32% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc10 224MB/s ± 0% 227MB/s ± 0% +1.30% (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc10 454MB/s ± 0% 465MB/s ± 0% +2.40% (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc10 311MB/s ± 0% 324MB/s ± 0% +4.38% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc10 327MB/s ± 0% 342MB/s ± 0% +4.52% (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc10 384MB/s ± 0% 393MB/s ± 0% +2.34% (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc10 324MB/s ± 0% 345MB/s ± 1% +6.26% (p=0.008 n=5+5)
2023-06-10 14:12:08 +10:00
Nigel Tao
d248ade0e6
test/3pdata: add blinksuite, bmpsuite, golangsuite
2023-06-09 22:10:07 +10:00
Nigel Tao
fe5c1f25b8
test/data: add more peacock.*.jpeg files
2023-06-09 21:29:21 +10:00
Nigel Tao
dcb5b0e1c7
test: add 4:4:4 (not just 4:2:0) JPEG test+bench
2023-06-05 22:25:22 +10:00
Nigel Tao
4751ef4de5
test: add std/jpeg mimic tests and benches
2023-06-04 12:44:17 +10:00
Nigel Tao
27a3197727
script: add truncate-progressive-jpeg.go
...
"script/confirm-matches-djpeg.sh test/data/*.jpeg" shows differences on
"test/data/peacock.progressive.scan00[0-8].jpeg".
2023-06-01 22:32:37 +10:00
Nigel Tao
d7ddc153ba
std/jpeg: decode progressive JPEGs
...
"script/confirm-matches-djpeg.sh test/data/*.jpeg" is now all matches.
2023-06-01 12:16:14 +10:00
Nigel Tao
1cd3604351
std/jpeg: prepare to decode progressive JPEGs
2023-05-30 15:36:50 +10:00
Nigel Tao
0aad753137
test/data: add peacock.*
...
"script/confirm-matches-djpeg.sh test/data/*.jpeg" shows a difference on
"test/data/peacock.progressive.jpeg".
2023-05-22 16:11:12 +10:00
Nigel Tao
a41149e73c
std/jpeg: implement triangle-filter upsampling
...
"script/confirm-matches-djpeg.sh test/data/*.jpeg" is now all matches.
2023-05-21 22:05:38 +10:00
Nigel Tao
94df43c530
std/jpeg: prepare for triangle-filter upsampling
2023-05-21 22:04:45 +10:00
Nigel Tao
85b244aa49
std/netpbm: add new package
2023-05-16 16:29:58 +10:00
Nigel Tao
7514dede23
std/jpeg: decode color images, not just gray
...
Updates #42
2023-05-14 23:03:33 +10:00
Nigel Tao
3bd83e3ebb
std/jpeg: apply Inverse DCT
...
Updates #42
2023-05-11 21:29:07 +10:00
Nigel Tao
8cfe304f3c
std/jpeg: implement Inverse DCT
...
Updates #42
2023-05-08 21:51:47 +10:00
Nigel Tao
c914f66a6c
std/jpeg: decode Huffman entropy coded data
...
Updates #42
2023-05-06 09:47:10 +10:00
Nigel Tao
d36277f0c0
std/jpeg: decode DHT (Huffman tables)
...
Updates #42
2023-04-29 11:14:59 +10:00
Nigel Tao
0ccceece0b
std/jpeg: decode SOF, producing the image config
...
Updates #42
2023-04-24 11:14:54 +10:00
Nigel Tao
0bbc4c0083
std/jpeg: add new package
...
This is just a placeholder decoder implementation (and all of the
required plumbing) that produces a 1x1 reddish-purple image. Follow-up
commits will add flesh to the metaphorical bones.
Updates #42
2023-04-21 18:33:00 +10:00
Nigel Tao
d8c23a3a66
std/lzw: change set_literal_width to set_quirk
2023-04-15 09:59:40 +10:00
Nigel Tao
6e84987d33
std: change set_quirk_enabled to set_quirk
2023-04-14 21:42:15 +10:00
Nigel Tao
176cdf7527
test: fix gcc -Wmaybe-uninitialized false positive
...
When running "gcc -O3 -Wall test/c/std/adler32.c", gcc 12.2.0 (but not
gcc 10.2.1) would warn that adler32's "checksum.private_impl.f_started"
may be used uninitialized. There is no warning without the "-O3".
That warning is a false positive. f_started is always zero-initialized
by wuffs_adler32__hasher__initialize (unless opted in to
WUFFS_INITIALIZE__ALREADY_ZEROED, which the benchmarks do not).
Also update test/c/std/crc32.c so that all of the base.hasher_u32
wuffs_bench_etc functions are consistent, even though gcc on crc32.c
does not produce that same false positive warning.
2023-04-12 13:31:01 +10:00
Nigel Tao
6e8349129c
base: remove deprecated names
2023-04-09 16:12:49 +10:00
Nigel Tao
00d5e35865
floatconv: optimize parse_number_f64 fallback
...
The time taken running script/manual-test-parse-number-f64.cc on the
parse-number-fxx-test-data suite falls from 3.565s to 2.491s (a 1.43x
ratio; the inverse is 0.70 = 100% - 30%).
Fixes #113
2023-04-08 14:56:32 +10:00
Nigel Tao
3474af988b
std/{cbor,json}: add test for empty input
...
Updates #96
2023-02-01 21:43:25 +11:00
Nigel Tao
248bddcfd2
std/*image_decoder*: add "#truncated input"
...
name old speed new speed delta
wuffs_bmp_decode_40k/clang11 4.36GB/s ± 0% 4.48GB/s ± 0% +2.74% (p=0.008 n=5+5)
wuffs_bmp_decode_40k/gcc10 4.49GB/s ± 0% 4.50GB/s ± 0% +0.15% (p=0.008 n=5+5)
wuffs_gif_decode_1k_bw/clang11 723MB/s ± 0% 742MB/s ± 0% +2.64% (p=0.008 n=5+5)
wuffs_gif_decode_1k_color_full_init/clang11 177MB/s ± 0% 177MB/s ± 0% ~ (p=0.841 n=5+5)
wuffs_gif_decode_1k_color_part_init/clang11 216MB/s ± 0% 217MB/s ± 0% +0.66% (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/clang11 793MB/s ± 0% 785MB/s ± 0% -1.04% (p=0.016 n=4+5)
wuffs_gif_decode_10k_indexed/clang11 210MB/s ± 0% 209MB/s ± 0% -0.38% (p=0.008 n=5+5)
wuffs_gif_decode_20k/clang11 254MB/s ± 0% 255MB/s ± 0% +0.37% (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/clang11 568MB/s ± 0% 569MB/s ± 0% +0.14% (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/clang11 221MB/s ± 0% 221MB/s ± 0% ~ (p=0.222 n=5+5)
wuffs_gif_decode_1000k_full_init/clang11 224MB/s ± 0% 224MB/s ± 0% ~ (p=0.690 n=5+5)
wuffs_gif_decode_1000k_part_init/clang11 224MB/s ± 0% 224MB/s ± 0% ~ (p=0.841 n=5+5)
wuffs_gif_decode_anim_screencap/clang11 1.30GB/s ± 0% 1.30GB/s ± 0% ~ (p=0.111 n=5+5)
wuffs_gif_decode_1k_bw/gcc10 638MB/s ± 0% 672MB/s ± 0% +5.23% (p=0.008 n=5+5)
wuffs_gif_decode_1k_color_full_init/gcc10 175MB/s ± 0% 181MB/s ± 0% +3.03% (p=0.008 n=5+5)
wuffs_gif_decode_1k_color_part_init/gcc10 203MB/s ± 0% 209MB/s ± 0% +3.38% (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/gcc10 798MB/s ± 0% 804MB/s ± 0% +0.70% (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/gcc10 210MB/s ± 0% 212MB/s ± 0% +0.84% (p=0.008 n=5+5)
wuffs_gif_decode_20k/gcc10 265MB/s ± 0% 265MB/s ± 0% ~ (p=0.222 n=5+5)
wuffs_gif_decode_100k_artificial/gcc10 576MB/s ± 0% 577MB/s ± 0% ~ (p=0.690 n=5+5)
wuffs_gif_decode_100k_realistic/gcc10 226MB/s ± 0% 227MB/s ± 0% +0.21% (p=0.008 n=5+5)
wuffs_gif_decode_1000k_full_init/gcc10 230MB/s ± 0% 231MB/s ± 0% +0.32% (p=0.008 n=5+5)
wuffs_gif_decode_1000k_part_init/gcc10 230MB/s ± 0% 231MB/s ± 0% +0.43% (p=0.008 n=5+5)
wuffs_gif_decode_anim_screencap/gcc10 1.32GB/s ± 0% 1.32GB/s ± 0% +0.18% (p=0.008 n=5+5)
wuffs_png_decode_image_19k_8bpp/clang11 267MB/s ± 0% 273MB/s ± 0% +2.47% (p=0.008 n=5+5)
wuffs_png_decode_image_40k_24bpp/clang11 326MB/s ± 0% 327MB/s ± 0% +0.51% (p=0.008 n=5+5)
wuffs_png_decode_image_77k_8bpp/clang11 954MB/s ± 0% 969MB/s ± 0% +1.58% (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/clang11 865MB/s ± 0% 864MB/s ± 0% -0.18% (p=0.016 n=5+5)
wuffs_png_decode_image_552k_32bpp_verify_checksum/clang11 832MB/s ± 0% 831MB/s ± 0% -0.11% (p=0.016 n=5+5)
wuffs_png_decode_image_4002k_24bpp/clang11 331MB/s ± 0% 332MB/s ± 0% +0.18% (p=0.016 n=5+5)
wuffs_png_decode_image_19k_8bpp/gcc10 298MB/s ± 0% 292MB/s ± 0% -2.17% (p=0.008 n=5+5)
wuffs_png_decode_image_40k_24bpp/gcc10 352MB/s ± 0% 349MB/s ± 0% -0.75% (p=0.008 n=5+5)
wuffs_png_decode_image_77k_8bpp/gcc10 1.05GB/s ± 0% 1.03GB/s ± 0% -1.56% (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/gcc10 950MB/s ± 0% 949MB/s ± 0% ~ (p=0.310 n=5+5)
wuffs_png_decode_image_552k_32bpp_verify_checksum/gcc10 905MB/s ± 0% 902MB/s ± 0% -0.35% (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/gcc10 360MB/s ± 0% 358MB/s ± 0% -0.40% (p=0.008 n=5+5)
wuffs_tga_decode_19k_8bpp/clang11 7.81GB/s ± 0% 7.90GB/s ± 0% +1.22% (p=0.008 n=5+5)
wuffs_tga_decode_77k_24bpp/clang11 4.34GB/s ± 0% 4.36GB/s ± 0% +0.59% (p=0.008 n=5+5)
wuffs_tga_decode_19k_8bpp/gcc10 7.10GB/s ± 0% 7.13GB/s ± 0% +0.33% (p=0.008 n=5+5)
wuffs_tga_decode_77k_24bpp/gcc10 4.61GB/s ± 0% 4.60GB/s ± 0% -0.35% (p=0.008 n=5+5)
Updates #96
2023-02-01 16:36:56 +11:00
Nigel Tao
f01f0859f0
std/*io_transformer*: add "#truncated input"
...
name old speed new speed delta
wuffs_bzip2_decode_10k/clang11 58.5MB/s ± 0% 59.9MB/s ± 0% +2.50% (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/clang11 45.7MB/s ± 0% 50.5MB/s ± 0% +10.66% (p=0.008 n=5+5)
wuffs_bzip2_decode_10k/gcc10 56.2MB/s ± 0% 61.9MB/s ± 0% +10.01% (p=0.008 n=5+5)
wuffs_bzip2_decode_100k/gcc10 46.5MB/s ± 0% 50.4MB/s ± 0% +8.41% (p=0.016 n=4+5)
wuffs_deflate_decode_1k_full_init/clang11 195MB/s ± 0% 191MB/s ± 0% -1.71% (p=0.008 n=5+5)
wuffs_deflate_decode_1k_part_init/clang11 224MB/s ± 0% 225MB/s ± 0% +0.87% (p=0.008 n=5+5)
wuffs_deflate_decode_10k_full_init/clang11 421MB/s ± 0% 401MB/s ± 0% -4.59% (p=0.008 n=5+5)
wuffs_deflate_decode_10k_part_init/clang11 432MB/s ± 0% 413MB/s ± 0% -4.49% (p=0.008 n=5+5)
wuffs_deflate_decode_100k_just_one_read/clang11 542MB/s ± 0% 518MB/s ± 0% -4.43% (p=0.008 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/clang11 338MB/s ± 0% 325MB/s ± 0% -3.81% (p=0.008 n=5+5)
wuffs_deflate_decode_1k_full_init/gcc10 181MB/s ± 0% 185MB/s ± 0% +1.76% (p=0.008 n=5+5)
wuffs_deflate_decode_1k_part_init/gcc10 209MB/s ± 0% 212MB/s ± 0% +1.79% (p=0.008 n=5+5)
wuffs_deflate_decode_10k_full_init/gcc10 410MB/s ± 0% 407MB/s ± 0% -0.93% (p=0.008 n=5+5)
wuffs_deflate_decode_10k_part_init/gcc10 421MB/s ± 0% 418MB/s ± 0% -0.87% (p=0.008 n=5+5)
wuffs_deflate_decode_100k_just_one_read/gcc10 533MB/s ± 0% 533MB/s ± 0% ~ (p=0.548 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/gcc10 336MB/s ± 0% 334MB/s ± 1% -0.67% (p=0.008 n=5+5)
wuffs_gzip_decode_10k/clang11 401MB/s ± 0% 398MB/s ± 0% -0.77% (p=0.008 n=5+5)
wuffs_gzip_decode_100k/clang11 505MB/s ± 0% 503MB/s ± 0% -0.46% (p=0.008 n=5+5)
wuffs_gzip_decode_10k/gcc10 403MB/s ± 0% 410MB/s ± 0% +1.90% (p=0.008 n=5+5)
wuffs_gzip_decode_100k/gcc10 522MB/s ± 0% 523MB/s ± 0% +0.10% (p=0.032 n=5+5)
wuffs_zlib_decode_10k/clang11 418MB/s ± 0% 417MB/s ± 1% ~ (p=0.310 n=5+5)
wuffs_zlib_decode_100k/clang11 530MB/s ± 0% 529MB/s ± 0% ~ (p=0.421 n=5+5)
wuffs_zlib_decode_10k/gcc10 428MB/s ± 0% 434MB/s ± 0% +1.50% (p=0.008 n=5+5)
wuffs_zlib_decode_100k/gcc10 551MB/s ± 0% 551MB/s ± 0% ~ (p=0.690 n=5+5)
Fixes #96
2023-01-31 23:09:37 +11:00