Commit Graph
1186 Commits
Author SHA1 Message Date
Nigel Tao 8c854ae702 std/thumbhash: implement do_decode_frame 2024-09-06 12:35:53 +10:00
Nigel Tao b8740d8881 std/thumbhash: add new package 2024-09-03 20:07:37 +10:00
Nigel Tao bd42fa7af2 base38: reassign alphabet and numbers
It changes from " 0-9?a-z" to ".0-9a-z~". The default or placeholder
changes from " " to "." so it's now always visible. The wildcard changes
from "?" to "~" so it's now sorted last.
2024-08-26 12:30:20 +10:00
Nigel Tao e12f10eef0 std/jpeg: tweak ignore too-short marker code
name                                             old speed     new speed     delta

wuffs_jpeg_decode_19k_8bpp/clang14               317MB/s ± 0%  325MB/s ± 0%  +2.60%  (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/clang14  322MB/s ± 0%  325MB/s ± 0%  +0.94%  (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/clang14   864MB/s ± 0%  880MB/s ± 0%  +1.84%  (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/clang14              720MB/s ± 0%  730MB/s ± 0%  +1.39%  (p=0.016 n=4+5)
wuffs_jpeg_decode_552k_24bpp_420/clang14         783MB/s ± 0%  794MB/s ± 0%  +1.44%  (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/clang14         884MB/s ± 0%  914MB/s ± 0%  +3.39%  (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/clang14            781MB/s ± 0%  796MB/s ± 0%  +1.90%  (p=0.008 n=5+5)

wuffs_jpeg_decode_19k_8bpp/gcc12                 359MB/s ± 0%  360MB/s ± 0%  +0.12%  (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_progressive/gcc12    311MB/s ± 0%  310MB/s ± 0%  -0.30%  (p=0.008 n=5+5)
wuffs_jpeg_decode_30k_24bpp_sequential/gcc12     909MB/s ± 0%  915MB/s ± 0%  +0.66%  (p=0.008 n=5+5)
wuffs_jpeg_decode_77k_24bpp/gcc12                747MB/s ± 0%  750MB/s ± 0%  +0.34%  (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_420/gcc12           817MB/s ± 0%  819MB/s ± 0%  +0.30%  (p=0.008 n=5+5)
wuffs_jpeg_decode_552k_24bpp_444/gcc12           971MB/s ± 0%  972MB/s ± 0%  +0.11%  (p=0.008 n=5+5)
wuffs_jpeg_decode_4002k_24bpp/gcc12              819MB/s ± 0%  821MB/s ± 0%  +0.21%  (p=0.008 n=5+5)
2024-08-25 23:03:06 +10:00
Nigel Tao 6693250aa9 lang: add io_reader.peek_u8_at 2024-08-25 15:07:29 +10:00
Nigel Tao d4bab677b0 std/jpeg: skip 0xFF filler before restart search 2024-08-25 14:48:17 +10:00
Nigel Tao 6a9347843b std/jpeg: ignore too-short COM or APPn markers 2024-08-25 13:46:16 +10:00
Nigel Tao 819742cfac std/jpeg: add "#short SOS bitstream" 2024-08-24 17:01:28 +10:00
Nigel Tao a824c55c3d std/jpeg: allow DHT markers before SOF 2024-08-24 16:13:31 +10:00
Nigel Tao 60e3b8cb1c test/data: add bricks-color.etc1s.pkm 2024-08-23 22:14:33 +10:00
Nigel Tao 96eda2ec0d std/etc2: support transparency 2024-08-18 15:09:51 +10:00
Nigel Tao 2d80615a08 std/etc2: refactor decoder.from_src_to_buffer 2024-08-18 10:07:58 +10:00
Nigel Tao 7637982814 std/etc2: support ETC2PACKAGE_RGB_NO_MIPMAPS 2024-08-18 09:42:22 +10:00
Nigel Tao 43df015669 std/etc2: add new package 2024-08-17 15:31:29 +10:00
Nigel Tao a07eb7704b std/jpeg: add QUIRK_REJECT_PROGRESSIVE_JPEGS 2024-08-11 10:15:13 +10:00
Nigel Tao bd27cc0d9b std/qoi: use PIXEL_FORMAT__BGRX 2024-08-09 13:48:34 +10:00
Nigel Tao d06700f00b std/qoi: add new package
Fixes #63
2024-08-08 23:49:17 +10:00
Nigel Tao d270839e3f std/jpeg: let use_lower_quality work with CMYK 2024-08-04 23:16:58 +10:00
Nigel Tao c9fff5b207 std/jpeg: add and use WUFFS_BASE__QUIRK_QUALITY 2024-08-04 23:15:58 +10:00
Nigel Tao 42b070e487 std/jpeg: halve maximum scan count from 64 to 32
cjpeg defaults to using 1 (sequential) or 10 (progressive) scans. 32 is
still easily more than what's seen in practice.

The previous commit (f9c384d6 std/jpeg: add "expect multiple scans"
check) makes Wuffs more closely match libjpeg. Without that commit,
though, this commit halves the time taken to decode the oss-fuzz test
case (linked below) from 6 to 3 seconds, in an optimized build. For the
debug-sanitizer fuzzer build, without this commit, that test case times
out after 60 seconds but this commit should halve the time taken.

Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=70340
2024-07-24 22:09:25 +10:00
Nigel Tao f9c384d6b2 std/jpeg: add "expect multiple scans" check
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=70340
2024-07-23 21:53:32 +10:00
Nigel Tao c6aebf819f std/webp: re-implement 8-bit color indexing 2024-07-09 16:50:58 +10:00
Nigel Tao 8fe987e0b2 base: add sign_extend_convert_u8_u32 2024-07-09 16:31:58 +10:00
Nigel Tao f37cfcf554 check: drop more facts when calling coroutines 2024-07-09 14:11:31 +10:00
Nigel Tao 5d4bb4c6e4 std/bmp: remove superfluous "while.goto_suspend" 2024-07-08 17:23:25 +10:00
Nigel Tao aae5997e12 lang: remove endwhile keyword 2024-07-08 17:15:48 +10:00
Nigel Tao 00e6e71672 std/webp: implement VP8 Lossless 2024-07-07 22:13:50 +10:00
Nigel Tao 09f4500e19 std/webp: add new package (and vp8 placeholder) 2024-05-10 13:52:07 +10:00
Nigel Tao 3c1df67681 std/bmp: let decoded pixfmt be transparent
Fixes #147
2024-05-07 10:06:34 +10:00
Nigel Tao c4aa5e60d0 std/xz: enforce BCJ offset alignment 2024-04-29 22:33:51 +10:00
Nigel Tao 92ff96359a std/crc32: re-write x86_sse42 implementation
name                                                       old speed      new speed      delta

wuffs_crc32_ieee_10k/clang14                               13.5GB/s ± 0%  21.9GB/s ± 0%  +62.09%  (p=0.016 n=5+4)
wuffs_crc32_ieee_100k/clang14                              22.4GB/s ± 9%  29.7GB/s ± 0%  +32.76%  (p=0.016 n=5+4)

wuffs_crc32_ieee_10k/gcc12                                 14.2GB/s ± 2%  22.2GB/s ± 0%  +56.92%  (p=0.008 n=5+5)
wuffs_crc32_ieee_100k/gcc12                                21.3GB/s ± 3%  29.6GB/s ± 1%  +39.18%  (p=0.008 n=5+5)

wuffs_gzip_decode_10k/clang14                               366MB/s ± 0%   372MB/s ± 0%   +1.41%  (p=0.008 n=5+5)
wuffs_gzip_decode_100k/clang14                              482MB/s ± 0%   494MB/s ± 0%   +2.57%  (p=0.008 n=5+5)

wuffs_gzip_decode_10k/gcc12                                 398MB/s ± 0%   418MB/s ± 0%   +5.19%  (p=0.008 n=5+5)
wuffs_gzip_decode_100k/gcc12                                510MB/s ± 0%   537MB/s ± 0%   +5.21%  (p=0.008 n=5+5)

wuffs_png_decode_image_19k_8bpp/clang14                     263MB/s ± 0%   264MB/s ± 0%   +0.39%  (p=0.008 n=5+5)
wuffs_png_decode_image_40k_24bpp/clang14                    297MB/s ± 0%   298MB/s ± 0%   +0.16%  (p=0.008 n=5+5)
wuffs_png_decode_image_77k_8bpp/clang14                     932MB/s ± 0%   945MB/s ± 0%   +1.33%  (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/clang14   831MB/s ± 0%   833MB/s ± 0%   +0.25%  (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_verify_checksum/clang14   799MB/s ± 0%   802MB/s ± 0%   +0.37%  (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/clang14                  306MB/s ± 0%   307MB/s ± 0%   +0.56%  (p=0.008 n=5+5)

wuffs_png_decode_image_19k_8bpp/gcc12                       283MB/s ± 0%   270MB/s ± 0%   -4.84%  (p=0.008 n=5+5)
wuffs_png_decode_image_40k_24bpp/gcc12                      330MB/s ± 0%   329MB/s ± 0%   -0.29%  (p=0.016 n=5+4)
wuffs_png_decode_image_77k_8bpp/gcc12                       992MB/s ± 0%   957MB/s ± 0%   -3.56%  (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/gcc12     920MB/s ± 0%   908MB/s ± 0%   -1.30%  (p=0.008 n=5+5)
wuffs_png_decode_image_552k_32bpp_verify_checksum/gcc12     875MB/s ± 0%   867MB/s ± 0%   -0.95%  (p=0.008 n=5+5)
wuffs_png_decode_image_4002k_24bpp/gcc12                    341MB/s ± 0%   342MB/s ± 0%   +0.25%  (p=0.008 n=5+5)
2024-04-23 23:10:30 +10:00
Nigel Tao e541e0cf79 std/crc64: re-write x86_sse42 implementation
name                           old speed      new speed       delta

wuffs_crc64_ecma_10k/clang14   5.84GB/s ± 0%  23.43GB/s ± 0%  +301.23%  (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/clang14  6.18GB/s ± 0%  30.23GB/s ± 1%  +389.45%  (p=0.008 n=5+5)

wuffs_crc64_ecma_10k/gcc12     5.87GB/s ± 1%  24.02GB/s ± 0%  +309.21%  (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/gcc12    6.21GB/s ± 0%  30.68GB/s ± 0%  +394.22%  (p=0.008 n=5+5)

$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m7.604s
After:  user 0m7.432s
2024-04-22 14:05:16 +10:00
Nigel Tao 58d2a80691 std/crc64: fix x86_sse42 k1' magic number 2024-04-21 22:43:34 +10:00
Nigel Tao 77541659f3 std/crc64: tweak x86 to be more like std/crc32 2024-04-21 22:05:36 +10:00
Nigel Tao 9c704c4a6a std/crc32: tweak x86 to be more like std/crc64 2024-04-21 12:46:05 +10:00
Nigel Tao 5bf4c2cb51 std/lzma: link to "XZ/LZMA Worked Example" blog 2024-04-21 10:00:54 +10:00
Nigel Tao da0d51d802 std/png: ignore tRNS chunks for color types 4, 6
Updates #146
2024-04-19 21:31:39 +10:00
Nigel Tao f32bfe95c6 std/crc64: optimize for x86+SSE4.2
name                           old speed      new speed      delta

wuffs_crc64_ecma_10k/clang14   1.78GB/s ± 0%  5.79GB/s ± 0%  +225.48%  (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/clang14  1.78GB/s ± 0%  6.09GB/s ± 0%  +241.67%  (p=0.008 n=5+5)

wuffs_crc64_ecma_10k/gcc12     2.05GB/s ± 1%  5.79GB/s ± 1%  +182.80%  (p=0.008 n=5+5)
wuffs_crc64_ecma_100k/gcc12    2.01GB/s ± 0%  6.09GB/s ± 0%  +202.64%  (p=0.008 n=5+5)

wuffs_xz_decode_100k/clang14   57.9MB/s ± 1%  60.2MB/s ± 0%    +4.11%  (p=0.008 n=5+5)

wuffs_xz_decode_100k/gcc12     57.0MB/s ± 0%  57.8MB/s ± 1%    +1.39%  (p=0.008 n=5+5)

$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m8.122s
After:  user 0m8.115s
2024-04-02 00:17:43 +11:00
Nigel Tao b6b0f84187 std/lzma: use 8-byte-copy if applicable
name                            old speed      new speed      delta
wuffs_lzma_decode_100k/clang14  56.2MB/s ± 0%  60.7MB/s ± 0%  +7.96%  (p=0.008 n=5+5)
wuffs_lzma_decode_100k/gcc12    56.4MB/s ± 1%  61.7MB/s ± 1%  +9.44%  (p=0.008 n=5+5)

$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m8.396s
After:  user 0m8.392s
2024-03-31 16:02:06 +11:00
Nigel Tao 7077c20cb6 std/lzma: simplify decode-a-literal
name                            old speed      new speed      delta
wuffs_lzma_decode_100k/clang14  54.8MB/s ± 1%  56.2MB/s ± 0%  +2.61%  (p=0.008 n=5+5)
wuffs_lzma_decode_100k/gcc12    56.8MB/s ± 0%  56.4MB/s ± 1%  -0.75%  (p=0.008 n=5+5)

$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m8.409s
After:  user 0m8.396s
2024-03-31 14:59:58 +11:00
Nigel Tao 9958d6c520 std/lzma: add decoder.decode_bitstream_fast
name                            old speed      new speed      delta
wuffs_lzma_decode_100k/clang14  52.7MB/s ± 0%  54.8MB/s ± 1%   +4.00%  (p=0.008 n=5+5)
wuffs_lzma_decode_100k/gcc12    50.3MB/s ± 1%  56.8MB/s ± 0%  +12.93%  (p=0.008 n=5+5)

$ time example-mzcat < linux-6.8.2.tar.xz > /dev/null
Before: user 0m9.725s
After:  user 0m8.409s
2024-03-30 21:24:59 +11:00
Nigel Tao b4cd9b8d3c std/png: decode PNG color type 4 to YA_NONPREMUL
Fixes #143
2024-03-27 21:06:09 +11:00
Nigel Tao b922c28a8e std/lzma: tweak Literal After Non-Literal code 2024-03-04 09:33:08 +11:00
Nigel Tao 13c72db350 std/lzma: add QUIRK_ALLOW_NON_ZERO_INITIAL_BYTE 2024-03-01 21:11:28 +11:00
Nigel Tao a9739a8921 std/lzip: actually implement the format 2024-03-01 20:55:24 +11:00
Nigel Tao 793ab36569 std/lzip: add new package 2024-03-01 09:52:54 +11:00
Nigel Tao 1c0b07f1aa std/lzma: accept optional End of Stream code 2024-02-29 22:01:04 +11:00
Nigel Tao 22b4ff4842 std/xz: decode concatenated streams 2024-02-26 23:02:40 +11:00
Nigel Tao 8ff5693d9d std/xz: prepare to decode concatenated streams 2024-02-26 21:48:31 +11:00
Nigel Tao 47ed32b6ce std/xz: clarify bad versus unsupported filter 2024-02-21 21:59:11 +11:00