ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,434 Commits 17 Branches 77 Tags
0532fe3e8ac1caf48f11603847ac3176064189d1
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yann Collet 3a3c506b51 Fix #4553 
This is a bug in the streaming implementation of the v0.5 decoder.
The bug has always been there.
It requires an uncommon block configuration, which wasn't tested at the time.

v0.5 is deprecated now,
latest version to produce such format is v0.5.1 from February 2016.
It was superceded in April 2016.
So it's both short lived and very old.

Another PR will remove support of this format,
but it will still be possible to explicitely request this support on demand,
so better fix the issue.
 2025-12-18 15:52:11 -08:00
Yann Collet 6c3e805e50 doc: legacy support is now disabled by default 2025-12-18 13:19:11 -08:00
Yann Collet 073c7fb6ea update dev version number to v1.6.0 
to reflect the relatively big scope change by removing support of legacy formats.
 2025-12-18 13:13:56 -08:00
Yann Collet b79e86291b [cmake] disable legacy support by default 
can still be explicitly enabled
 2025-12-18 13:11:37 -08:00
Yann Collet 38cce02684 Makefile: remove support of legacy formats by default 
can still be changed manually by setting `ZSTD_LEGACY_SUPPORT` to a different value
 2025-12-18 12:59:14 -08:00
Yann Collet 85c5fa09fd changed to freebsd 15 
since the image 16 does not seem to work
 2025-12-18 09:40:47 -08:00
Yann Collet c7c29693c9 [ci] update freebsd image 2025-12-09 08:30:24 +09:00
Yann Collet 7a3c940e7f syncio interface only enabled when compression is enabled 2025-10-26 09:48:45 -07:00
Yann Collet 4c1f86c777 fix minor warning in legacy decoders 
for mingw + clang CI test
 2025-09-23 13:01:38 -07:00
Yann Collet 249e4a07d5 fixed minor unused variable warning 
in certain compilation modes
 2025-09-02 16:36:44 -07:00
Yann Collet 725a152c7b benchmark uses 1 thread by default 2025-09-02 16:29:14 -07:00
Yann Collet c41fc1aa01 only display nbThread Msg in nbThreads > 1 2025-09-02 16:05:35 -07:00
Yann Collet 6551db3459 specify nb of threads used during benchmarking 
used to require `-v` (verbose) modifier
 2025-09-02 15:53:45 -07:00
Yann Collet 1c5d45fc11 fixed -T# documentation in zstd -H 
provide the local value for default nbThreads
which is dynamic and depends on local nb of cores.
 2025-09-02 15:46:51 -07:00
Yann Collet ae64545c6b fixed a potential division by 0 in the cli trace unit 2025-08-19 17:13:15 -07:00
Yann Collet 8bca04ba9f regroup list of OSes for install inside common variable 
within lib/install_oses.mk.

fixes #4445
 2025-07-28 11:33:22 -07:00
Yann Collet 3b23f0c673 added android cmake build 
is expecte to fail, due to #4444
 2025-07-23 15:07:20 -07:00
Yann Collet 0055ce7a02 simplify sequence resolution in zstd_opt 
initially hinted by @pitaj in #4442
 2025-07-18 21:21:47 -07:00
Yann Collet 7325384a68 removed VS2019 runners 
replaced by one vs2025 runner,
which is badly named since it still running MSVC 2022,
but it's a good test that  shows that the matrix is able to handle multiple MSVC versions.
 2025-07-11 10:29:07 -07:00
Yann Collet 2295826266 update tests duration indications 2025-06-21 12:01:07 -07:00
Yann Collet d77a7b6895 added test-largeDictionary to dev-long CI script 2025-06-21 11:34:10 -07:00
Yann Collet e315155cc2 removed duplicate 
this file is already present as `largeDictionary.c`
 2025-06-18 15:07:32 -07:00
Yann Collet 7f907d5c23 fix minor warning in zstreamtest 2025-04-29 09:56:00 -07:00
Yann Collet 2f9627863f update error message 2025-03-28 10:02:37 -07:00
Yann Collet 0bdeb1d204 fix test 2025-03-28 09:18:17 -07:00
Yann Collet 8626da73b6 add error message clarification for inputs as process substitution 2025-03-28 09:18:17 -07:00
Yann Collet a293cdcb85 added CI test 2025-03-28 09:18:17 -07:00
Yann Collet 0bde39a9b3 visual studio fix 2025-03-28 09:18:17 -07:00
Yann Collet 94cfa0b5a0 minor: restore some code comment 2025-03-28 09:18:17 -07:00
Yann Collet 76c2fdc7b7 better naming 
and more narrow scope of local variables
 2025-03-28 09:18:17 -07:00
Yann Collet 7630870b47 second implementation, better structured for improved maintenance 2025-03-28 09:18:17 -07:00
Yann Collet 165e52ce62 first implementation supporting Process Substitution 2025-03-28 09:18:17 -07:00
Yann Collet eb168a0afc add --patch-apply command 
as an equivalent for `-d --patch-from`.
Requested by @sergeevabc in #2173.
 2025-03-25 14:50:39 -07:00
Yann Collet bea1e942f7 [doc] minor clarification for maximum block size 
closes #4339
 2025-03-22 23:52:45 -07:00
Yann Collet 4d53e27144 removed OpenBSD specificity 2025-03-12 09:55:14 -07:00
Yann Collet ddcb41a282 updated documentation 2025-03-11 14:10:35 -07:00
Yann Collet a9b8fef2e8 add support for C11 Annex K qsort_s() 
standard defined re-entrant variant of qsort().
Unfortunately, Annex K is optional.
 2025-03-11 14:10:35 -07:00
Yann Collet dcf675886b re-design qsort() selection in cover 
centralizes auto detection tests,
then distribute the outcome in all the places where it's active.
 2025-03-11 14:10:35 -07:00
Yann Collet c583c2c39e warn when requesting decompression with multiple threads 
restore #2918 fix
 2025-03-10 22:50:00 -07:00
Yann Collet 3c4096c83e fixed ShellCheck warning 2025-03-10 19:11:44 -07:00
Yann Collet 2ff87aefac fix FreeBSD 
use an alias instead of a function

also: added more traces and updated version nb to v1.5.8
 2025-03-10 19:04:41 -07:00
Yann Collet c18374bb16 add test 
checks that ZSTD_NBTHREADS triggers the expected verbose message

Also: checked that the new test script fails on current `dev` branch, and is fixed by this branch
 2025-03-10 13:40:47 -07:00
Yann Collet 56e2ebf5c3 removed useless assert() 2025-03-10 09:54:06 -07:00
Yann Collet d5986f235f fix #4332: setting ZSTD_NBTHREADS=0 via environment variables 2025-03-10 00:12:34 -07:00
Yann Collet 5ae1cb9fa1 added a cli test for new command --jobsize 2025-03-04 15:24:43 -08:00
Yann Collet f5a0e047cb fix typo 2025-03-04 15:12:35 -08:00
Yann Collet 0b40c513fd update fileio to employ jobSize 2025-03-04 14:55:25 -08:00
Yann Collet 0298df50f9 update cli-tests 2025-03-04 14:43:06 -08:00
Yann Collet 9b8b414833 updated playTests.sh to employ the new commands 2025-03-04 13:22:01 -08:00
Yann Collet 19ffcf81b8 changed -B# command into --jobsize 
to reduce confusion with the term "block".

-B# remains supported for existing scripts,
but it's no longer documented, so it's effectively a hidden shortcut.
 2025-03-04 13:17:10 -08:00
Yann Collet fcfb3160dc convert benchmark unit to use the new naming scheme 
chunks instead of blocks
 2025-03-04 13:04:59 -08:00
Yann Collet d5dbdd6ece changed command --blocksize into --split 
to reduce confusion with the concept of "blocks" inside a Zstandard frame.

We are now talking about "independent chunks" being produced by a `split` operation.

updated documentation accordingly.

Note: old commands "-B#` and `--blocksize=#` remain supported,
to maintain compatibility with existing scripts.
 2025-03-04 12:53:23 -08:00
Yann Collet bceb8f2dbc attempt to no longer depend on system library presence for autodetection 
use explicit opt-in and path setting
 2025-03-03 17:20:43 -08:00
Yann Collet 9ec1a7c0ac update zstd build recipe to also support lz4 format 2025-03-03 15:36:38 -08:00
Yann Collet e99be473a6 automatically upload windows artifact on Release Tag creation 2025-02-28 12:04:06 -08:00
Yann Collet bbbb2379ed test win artifact generation on pushing to release 
this will get a chance to check that win artifact generation works correctly
before creating the release tag.
 2025-02-28 09:42:50 -08:00
Yann Collet a6d232dcad avoid double zipping 2025-02-28 09:33:22 -08:00
Yann Collet 88100bc62f proper usage of standard variables 2025-02-27 16:59:40 -08:00
Yann Collet 4e1723a7e4 fixed the script so that it fails when a copy fails 
and also: fix the list of files, as `zdict.h` was incorrectly set.
 2025-02-27 16:18:44 -08:00
Yann Collet 7340657c6f update build_package.bat by using a subrouting 2025-02-27 16:18:44 -08:00
Yann Collet 77e58994d2 updated zlib version to more recent v1.3.1 2025-02-27 16:18:44 -08:00
Yann Collet e94e09dd7b ensure that a copy error results in the task failing clearly 
error code != 0, red status

checked by intentionally inserting an error in another run
 2025-02-27 16:18:44 -08:00
Yann Collet bbf2801ddd try to fix the meson windows build 
apparently could be just a missing include
 2025-02-27 15:45:59 -08:00
Yann Collet db2d205ada fixed -Wconversion for lib/decompress/zstd_decompress_block.c 2025-02-26 10:01:05 -08:00
Yann Collet 2413f17322 fixed -Wconversion for cover.c 2025-02-26 08:33:01 -08:00
Yann Collet 8ffa27d93b fixed -Wconversion for divsufsort.c 2025-02-26 08:12:11 -08:00
Yann Collet e635221f1b fixed -Wconversion for zdict 2025-02-26 08:07:51 -08:00
Yann Collet 30281d889f fix conversion warning 2025-02-26 07:41:34 -08:00
Yann Collet fd5498a179 document ZSTD_USE_C90_QSORT 2025-02-21 12:48:26 -08:00
Yann Collet ebfa660b82 introduce ZSTD_USE_C90_QSORT 2025-02-21 11:36:30 -08:00
Yann Collet 8ff47f3df0 added musl compilation test in CI 2025-02-21 09:57:55 -08:00
Yann Collet 0c3345d6ec [cmake] use target_compile_definitions 
which is considered best practice.
 2025-02-20 16:00:54 -08:00
Yann Collet c2ab0f9c4e check man page update 2025-02-20 13:14:11 -08:00
Yann Collet 4690d66c7e add CI check for zstd_manual before release 
ensures it's properly updated
 2025-02-20 13:00:16 -08:00
Yann Collet 6af3842118 updated man pages and manual 
fixes #4301
 2025-02-19 16:25:00 -08:00
Yann Collet 37077c859b updated benchmark numbers 
using latest version of @inikep's lzbench
 2025-02-18 21:22:02 -08:00
Yann Collet eb6608869f faster clang-msan-testzstd 
this is by far our longest CI test.
Attempt to make it run a bit faster.
 2025-02-18 16:19:18 -08:00
Yann Collet b14d76d888 pinned dependency hash 2025-02-18 14:53:31 -08:00
Yann Collet 5c465fcabe harden github actions script Android NDK Build 2025-02-18 14:50:03 -08:00
Yann Collet c26bde119b update changelog for v1.5.7 2025-02-18 13:59:24 -08:00
Yann Collet 2a58b04752 disabled BTI test 
this test seems impossible on Ubuntu-24
 2025-02-11 13:20:15 -08:00
Yann Collet 85c39b78cf faster aarch64 test execution 2025-02-11 13:11:29 -08:00
Yann Collet 0b8119f0ad minor arm64 test script clarification 2025-02-11 12:58:35 -08:00
Yann Collet b73e06b83e updated FreeBSD VM to 14.2 
14.1 seems no longer supported by gcloud
 2025-02-11 12:52:59 -08:00
Yann Collet 2b7c661ad2 update arm64 test 
for ubuntu-24
 2025-02-11 12:41:38 -08:00
Yann Collet 75bcae1272 removing x32 tests 
this ABI is no longer supported by Ubuntu,
and there is a wider consensus that this ABI is on the way out,
with more and more distributions dropping it,
and lingering questions about support of x32 in the kernel.
 2025-02-11 11:37:18 -08:00
Yann Collet fc1baf3463 move qemu tests to ubuntu24 2025-02-11 09:57:18 -08:00
Yann Collet 815ca8c678 ubuntu 20 is being deprecated 
change ubuntu20 tests to use more modern ubuntu variants
 2025-02-11 09:19:08 -08:00
Yann Collet d2c562b803 update hrlog comment 2025-02-10 10:48:56 -08:00
Yann Collet 67fad95f79 derive hashratelog from hashlog when only hashlog is set 2025-02-10 10:46:37 -08:00
Yann Collet f86024ccd2 reinforce man page warning 
32-bit is unsuitable for --max
 2025-02-09 17:25:35 -08:00
Yann Collet 39d1d82fa8 adjusted mml heuristic 2025-02-09 17:24:12 -08:00
Yann Collet 41b7193757 added --max to test suite 2025-02-09 12:26:36 -08:00
Yann Collet 8ae1330708 add man entry for --max 2025-02-09 11:51:25 -08:00
Yann Collet 630b47a158 added a new --max command 
set parameters to maximum compression
(even more than -22)
 2025-02-09 11:38:44 -08:00
Yann Collet aebffd66ec --ultra automatically triggered with --long and --patch-from 
the purpose of --ultra is to make the user explicitly opt-in
to generate very large window size (> 8 MB).

The agreement to generate very large window size is already implicit
when selecting --long or --patch-from.

Consequently, `--ultra ` is automatically enabled when `--long` or `--patch-from` is set.
 2025-02-08 22:47:05 -08:00
Yann Collet 23e5f80390 Revert "pass dictionary loading method as parameter" 
This reverts commit 821fc567f93a415e9fbe856271ccd452ee7acf07.
 2025-02-05 18:47:26 -08:00
Yann Collet c7cd7dc04b better MT fluidity 
--patch-from no longer blocked on first job dictionary loading
 2025-02-05 18:42:00 -08:00
Yann Collet f11bd19c7f ensure cdict is properly reset to NULL 2025-02-05 18:42:00 -08:00
Yann Collet 7406d2b6eb skips the need to create a temporary cdict for --patch-from 
thus saving a bit of memory and a little bit of cpu time
 2025-02-05 18:42:00 -08:00