Commit Graph
7 Commits
Author SHA1 Message Date
Nigel Tao fd8025342e Be able to test and bench the libspng library
That's libspng with an 's', instead of libpng without an 's'.

Wuffs' std/png and std/zlib implementations have not been fully
optimized yet, but as a snapshot, here's how it compares with these
"mimic" libraries, libspng and libpng.

On a mid-range x86_64 laptop:

Wuffs/clang9:
wuffs_png_decode_image_19k_8bpp/clang9                    91.9MB/s ± 0%
wuffs_png_decode_image_40k_24bpp/clang9                    128MB/s ± 0%
wuffs_png_decode_image_77k_8bpp/clang9                     342MB/s ± 0%
wuffs_png_decode_image_552k_32bpp_ignore_checksum/clang9   324MB/s ± 0%
wuffs_png_decode_image_552k_32bpp_verify_checksum/clang9   258MB/s ± 0%
wuffs_png_decode_image_4002k_24bpp/clang9                  127MB/s ± 0%

Wuffs/gcc10:
wuffs_png_decode_image_19k_8bpp/gcc10                     94.3MB/s ± 0%
wuffs_png_decode_image_40k_24bpp/gcc10                     131MB/s ± 0%
wuffs_png_decode_image_77k_8bpp/gcc10                      348MB/s ± 1%
wuffs_png_decode_image_552k_32bpp_ignore_checksum/gcc10    319MB/s ± 0%
wuffs_png_decode_image_552k_32bpp_verify_checksum/gcc10    269MB/s ± 0%
wuffs_png_decode_image_4002k_24bpp/gcc10                   131MB/s ± 0%

libspng/clang9:
mimic_png_decode_image_19k_8bpp/clang9                    59.3MB/s ± 1%
mimic_png_decode_image_40k_24bpp/clang9                   78.4MB/s ± 0%
mimic_png_decode_image_77k_8bpp/clang9                     189MB/s ± 0%
mimic_png_decode_image_552k_32bpp_ignore_checksum/clang9   235MB/s ± 0%
mimic_png_decode_image_552k_32bpp_verify_checksum/clang9   203MB/s ± 0%
mimic_png_decode_image_4002k_24bpp/clang9                  110MB/s ± 0%

libspng/gcc10:
mimic_png_decode_image_19k_8bpp/gcc10                     59.5MB/s ± 0%
mimic_png_decode_image_40k_24bpp/gcc10                    77.6MB/s ± 0%
mimic_png_decode_image_77k_8bpp/gcc10                      188MB/s ± 0%
mimic_png_decode_image_552k_32bpp_ignore_checksum/gcc10    223MB/s ± 0%
mimic_png_decode_image_552k_32bpp_verify_checksum/gcc10    193MB/s ± 0%
mimic_png_decode_image_4002k_24bpp/gcc10                   109MB/s ± 0%

libpng (Debian_Testing_Bullseye /usr/lib/x86_64-linux-gnu/libpng.so):
mimic_png_decode_image_19k_8bpp                           58.3MB/s ± 0%
mimic_png_decode_image_40k_24bpp                          73.1MB/s ± 0%
mimic_png_decode_image_77k_8bpp                            177MB/s ± 0%
mimic_png_decode_image_552k_32bpp_ignore_checksum               skipped
mimic_png_decode_image_552k_32bpp_verify_checksum          146MB/s ± 0%
mimic_png_decode_image_4002k_24bpp                         104MB/s ± 0%
2021-01-22 13:15:42 +11:00
Nigel Tao 170a810486 Add std/png benches for ignore/verify checksums
wuffs_png_decode_image_552k_32bpp_ignore_checksum/clang9   324MB/s ± 0%
wuffs_png_decode_image_552k_32bpp_verify_checksum/clang9   258MB/s ± 0%

wuffs_png_decode_image_552k_32bpp_ignore_checksum/gcc10    319MB/s ± 0%
wuffs_png_decode_image_552k_32bpp_verify_checksum/gcc10    269MB/s ± 0%
2021-01-22 11:34:52 +11:00
Nigel Tao cf4aff9ef0 Have testlib image_decoder helpers take quirks 2021-01-21 22:29:30 +11:00
Nigel Tao aa2d41e0a0 Add a mimiclib scratch buffer 2020-12-29 21:38:52 +11:00
Nigel Tao 10e8ee5e79 Roll back 0c7a8cc0 re do_bench_image_decode
Commit 0c7a8cc029 is "Have
do_bench_image_decode pass a non-NULL dst". Adding a mandatory memcpy to
do_bench_image_decode noticably slowed down the bench numbers. Removing
the memcpy speeds it back up.

wuffs_gif_decode_1k_bw/clang9                278MB/s ± 0%   373MB/s ± 0%  +34.42%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color_full_init/clang9  85.0MB/s ± 0%  91.1MB/s ± 0%   +7.27%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color_part_init/clang9   104MB/s ± 0%   114MB/s ± 0%   +9.51%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/clang9             434MB/s ± 0%   449MB/s ± 0%   +3.59%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/clang9          115MB/s ± 0%   120MB/s ± 0%   +4.63%  (p=0.008 n=5+5)
wuffs_gif_decode_20k/clang9                  140MB/s ± 1%   145MB/s ± 0%   +3.16%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/clang9      301MB/s ± 0%   312MB/s ± 0%   +3.62%  (p=0.016 n=5+4)
wuffs_gif_decode_100k_realistic/clang9       125MB/s ± 0%   127MB/s ± 0%   +1.40%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k_full_init/clang9      128MB/s ± 0%   129MB/s ± 0%   +0.78%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k_part_init/clang9      128MB/s ± 0%   128MB/s ± 1%     ~     (p=0.151 n=5+5)
wuffs_gif_decode_anim_screencap/clang9       586MB/s ± 0%   671MB/s ± 0%  +14.60%  (p=0.016 n=5+4)

wuffs_gif_decode_1k_bw/gcc10                 271MB/s ± 0%   322MB/s ± 0%  +18.81%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color_full_init/gcc10   94.8MB/s ± 0%  99.2MB/s ± 1%   +4.64%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color_part_init/gcc10    116MB/s ± 0%   123MB/s ± 0%   +5.90%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/gcc10              374MB/s ± 0%   382MB/s ± 1%   +2.12%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/gcc10           116MB/s ± 1%   119MB/s ± 0%   +3.09%  (p=0.008 n=5+5)
wuffs_gif_decode_20k/gcc10                   137MB/s ± 0%   139MB/s ± 0%   +1.46%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/gcc10       286MB/s ± 0%   293MB/s ± 0%   +2.49%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/gcc10        118MB/s ± 0%   119MB/s ± 0%   +0.80%  (p=0.016 n=5+4)
wuffs_gif_decode_1000k_full_init/gcc10       121MB/s ± 0%   121MB/s ± 0%   +0.33%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k_part_init/gcc10       121MB/s ± 0%   121MB/s ± 0%   +0.28%  (p=0.016 n=5+5)
wuffs_gif_decode_anim_screencap/gcc10        582MB/s ± 0%   659MB/s ± 0%  +13.25%  (p=0.008 n=5+5)

wuffs_png_decode_19k_8bpp/clang9            88.7MB/s ± 0%  94.2MB/s ± 0%   +6.28%  (p=0.008 n=5+5)
wuffs_png_decode_40k_24bpp/clang9            104MB/s ± 0%   108MB/s ± 0%   +3.96%  (p=0.008 n=5+5)
wuffs_png_decode_77k_8bpp/clang9             335MB/s ± 0%   352MB/s ± 0%   +5.29%  (p=0.008 n=5+5)
wuffs_png_decode_552k_32bpp/clang9           118MB/s ± 0%   119MB/s ± 0%   +0.54%  (p=0.008 n=5+5)
wuffs_png_decode_4002k_24bpp/clang9          109MB/s ± 0%   112MB/s ± 0%   +2.36%  (p=0.008 n=5+5)

wuffs_png_decode_19k_8bpp/gcc10             96.7MB/s ± 0%  98.0MB/s ± 0%   +1.36%  (p=0.029 n=4+4)
wuffs_png_decode_40k_24bpp/gcc10             114MB/s ± 0%   115MB/s ± 0%   +0.79%  (p=0.008 n=5+5)
wuffs_png_decode_77k_8bpp/gcc10              316MB/s ± 0%   320MB/s ± 0%   +1.18%  (p=0.016 n=5+4)
wuffs_png_decode_552k_32bpp/gcc10            149MB/s ± 0%   149MB/s ± 0%   +0.17%  (p=0.016 n=5+4)
wuffs_png_decode_4002k_24bpp/gcc10           116MB/s ± 0%   116MB/s ± 0%   +0.09%  (p=0.032 n=5+5)
2020-12-29 21:29:32 +11:00
Nigel Tao 0c7a8cc029 Have do_bench_image_decode pass a non-NULL dst 2020-12-28 15:54:15 +11:00
Nigel Tao 88616cc969 Add std/png mimic benches
Wuffs' std/png and std/zlib implementations have not been optimized yet,
but even at this early stage, they are roughly on par with their
"mimics": equivalent production-quality C libraries (libpng and zlib).

On a mid-range x86_64 laptop:

wuffs_png_decode_19k_8bpp/clang9     95.8MB/s ± 0%
wuffs_png_decode_40k_24bpp/clang9     100MB/s ± 1%
wuffs_png_decode_77k_8bpp/clang9      359MB/s ± 0%
wuffs_png_decode_552k_32bpp/clang9    119MB/s ± 0%
wuffs_png_decode_4002k_24bpp/clang9   101MB/s ± 0%

wuffs_png_decode_19k_8bpp/gcc10      97.2MB/s ± 0%
wuffs_png_decode_40k_24bpp/gcc10      111MB/s ± 0%
wuffs_png_decode_77k_8bpp/gcc10       316MB/s ± 0%
wuffs_png_decode_552k_32bpp/gcc10     132MB/s ± 0%
wuffs_png_decode_4002k_24bpp/gcc10    116MB/s ± 0%

mimic_png_decode_19k_8bpp            58.1MB/s ± 0%
mimic_png_decode_40k_24bpp           73.3MB/s ± 0%
mimic_png_decode_77k_8bpp             177MB/s ± 0%
mimic_png_decode_552k_32bpp           147MB/s ± 0%
mimic_png_decode_4002k_24bpp          104MB/s ± 0%

wuffs_zlib_decode_10k/clang9   126MB/s ± 0%
wuffs_zlib_decode_100k/clang9  136MB/s ± 0%

wuffs_zlib_decode_10k/gcc10    131MB/s ± 0%
wuffs_zlib_decode_100k/gcc10   159MB/s ± 0%

mimic_zlib_decode_10k          133MB/s ± 0%
mimic_zlib_decode_100k         160MB/s ± 0%
2020-12-28 15:52:46 +11:00