ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,293 Commits 17 Branches 77 Tags
2849f3a5d1497a0b84d613f03949315a5b430153
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yann Collet 7325384a68 removed VS2019 runners 
replaced by one vs2025 runner,
which is badly named since it still running MSVC 2022,
but it's a good test that  shows that the matrix is able to handle multiple MSVC versions.
 2025-07-11 10:29:07 -07:00
Yann Collet 2295826266 update tests duration indications 2025-06-21 12:01:07 -07:00
Yann Collet d77a7b6895 added test-largeDictionary to dev-long CI script 2025-06-21 11:34:10 -07:00
Yann Collet e315155cc2 removed duplicate 
this file is already present as `largeDictionary.c`
 2025-06-18 15:07:32 -07:00
Yann Collet 7f907d5c23 fix minor warning in zstreamtest 2025-04-29 09:56:00 -07:00
Yann Collet 2f9627863f update error message 2025-03-28 10:02:37 -07:00
Yann Collet 0bdeb1d204 fix test 2025-03-28 09:18:17 -07:00
Yann Collet 8626da73b6 add error message clarification for inputs as process substitution 2025-03-28 09:18:17 -07:00
Yann Collet a293cdcb85 added CI test 2025-03-28 09:18:17 -07:00
Yann Collet 0bde39a9b3 visual studio fix 2025-03-28 09:18:17 -07:00
Yann Collet 94cfa0b5a0 minor: restore some code comment 2025-03-28 09:18:17 -07:00
Yann Collet 76c2fdc7b7 better naming 
and more narrow scope of local variables
 2025-03-28 09:18:17 -07:00
Yann Collet 7630870b47 second implementation, better structured for improved maintenance 2025-03-28 09:18:17 -07:00
Yann Collet 165e52ce62 first implementation supporting Process Substitution 2025-03-28 09:18:17 -07:00
Yann Collet eb168a0afc add --patch-apply command 
as an equivalent for `-d --patch-from`.
Requested by @sergeevabc in #2173.
 2025-03-25 14:50:39 -07:00
Yann Collet bea1e942f7 [doc] minor clarification for maximum block size 
closes #4339
 2025-03-22 23:52:45 -07:00
Yann Collet 4d53e27144 removed OpenBSD specificity 2025-03-12 09:55:14 -07:00
Yann Collet ddcb41a282 updated documentation 2025-03-11 14:10:35 -07:00
Yann Collet a9b8fef2e8 add support for C11 Annex K qsort_s() 
standard defined re-entrant variant of qsort().
Unfortunately, Annex K is optional.
 2025-03-11 14:10:35 -07:00
Yann Collet dcf675886b re-design qsort() selection in cover 
centralizes auto detection tests,
then distribute the outcome in all the places where it's active.
 2025-03-11 14:10:35 -07:00
Yann Collet c583c2c39e warn when requesting decompression with multiple threads 
restore #2918 fix
 2025-03-10 22:50:00 -07:00
Yann Collet 3c4096c83e fixed ShellCheck warning 2025-03-10 19:11:44 -07:00
Yann Collet 2ff87aefac fix FreeBSD 
use an alias instead of a function

also: added more traces and updated version nb to v1.5.8
 2025-03-10 19:04:41 -07:00
Yann Collet c18374bb16 add test 
checks that ZSTD_NBTHREADS triggers the expected verbose message

Also: checked that the new test script fails on current `dev` branch, and is fixed by this branch
 2025-03-10 13:40:47 -07:00
Yann Collet 56e2ebf5c3 removed useless assert() 2025-03-10 09:54:06 -07:00
Yann Collet d5986f235f fix #4332: setting ZSTD_NBTHREADS=0 via environment variables 2025-03-10 00:12:34 -07:00
Yann Collet 5ae1cb9fa1 added a cli test for new command --jobsize 2025-03-04 15:24:43 -08:00
Yann Collet f5a0e047cb fix typo 2025-03-04 15:12:35 -08:00
Yann Collet 0b40c513fd update fileio to employ jobSize 2025-03-04 14:55:25 -08:00
Yann Collet 0298df50f9 update cli-tests 2025-03-04 14:43:06 -08:00
Yann Collet 9b8b414833 updated playTests.sh to employ the new commands 2025-03-04 13:22:01 -08:00
Yann Collet 19ffcf81b8 changed -B# command into --jobsize 
to reduce confusion with the term "block".

-B# remains supported for existing scripts,
but it's no longer documented, so it's effectively a hidden shortcut.
 2025-03-04 13:17:10 -08:00
Yann Collet fcfb3160dc convert benchmark unit to use the new naming scheme 
chunks instead of blocks
 2025-03-04 13:04:59 -08:00
Yann Collet d5dbdd6ece changed command --blocksize into --split 
to reduce confusion with the concept of "blocks" inside a Zstandard frame.

We are now talking about "independent chunks" being produced by a `split` operation.

updated documentation accordingly.

Note: old commands "-B#` and `--blocksize=#` remain supported,
to maintain compatibility with existing scripts.
 2025-03-04 12:53:23 -08:00
Yann Collet bceb8f2dbc attempt to no longer depend on system library presence for autodetection 
use explicit opt-in and path setting
 2025-03-03 17:20:43 -08:00
Yann Collet 9ec1a7c0ac update zstd build recipe to also support lz4 format 2025-03-03 15:36:38 -08:00
Yann Collet e99be473a6 automatically upload windows artifact on Release Tag creation 2025-02-28 12:04:06 -08:00
Yann Collet bbbb2379ed test win artifact generation on pushing to release 
this will get a chance to check that win artifact generation works correctly
before creating the release tag.
 2025-02-28 09:42:50 -08:00
Yann Collet a6d232dcad avoid double zipping 2025-02-28 09:33:22 -08:00
Yann Collet 88100bc62f proper usage of standard variables 2025-02-27 16:59:40 -08:00
Yann Collet 4e1723a7e4 fixed the script so that it fails when a copy fails 
and also: fix the list of files, as `zdict.h` was incorrectly set.
 2025-02-27 16:18:44 -08:00
Yann Collet 7340657c6f update build_package.bat by using a subrouting 2025-02-27 16:18:44 -08:00
Yann Collet 77e58994d2 updated zlib version to more recent v1.3.1 2025-02-27 16:18:44 -08:00
Yann Collet e94e09dd7b ensure that a copy error results in the task failing clearly 
error code != 0, red status

checked by intentionally inserting an error in another run
 2025-02-27 16:18:44 -08:00
Yann Collet bbf2801ddd try to fix the meson windows build 
apparently could be just a missing include
 2025-02-27 15:45:59 -08:00
Yann Collet db2d205ada fixed -Wconversion for lib/decompress/zstd_decompress_block.c 2025-02-26 10:01:05 -08:00
Yann Collet 2413f17322 fixed -Wconversion for cover.c 2025-02-26 08:33:01 -08:00
Yann Collet 8ffa27d93b fixed -Wconversion for divsufsort.c 2025-02-26 08:12:11 -08:00
Yann Collet e635221f1b fixed -Wconversion for zdict 2025-02-26 08:07:51 -08:00
Yann Collet 30281d889f fix conversion warning 2025-02-26 07:41:34 -08:00
Yann Collet fd5498a179 document ZSTD_USE_C90_QSORT 2025-02-21 12:48:26 -08:00
Yann Collet ebfa660b82 introduce ZSTD_USE_C90_QSORT 2025-02-21 11:36:30 -08:00
Yann Collet 8ff47f3df0 added musl compilation test in CI 2025-02-21 09:57:55 -08:00
Yann Collet 0c3345d6ec [cmake] use target_compile_definitions 
which is considered best practice.
 2025-02-20 16:00:54 -08:00
Yann Collet c2ab0f9c4e check man page update 2025-02-20 13:14:11 -08:00
Yann Collet 4690d66c7e add CI check for zstd_manual before release 
ensures it's properly updated
 2025-02-20 13:00:16 -08:00
Yann Collet 6af3842118 updated man pages and manual 
fixes #4301
 2025-02-19 16:25:00 -08:00
Yann Collet 37077c859b updated benchmark numbers 
using latest version of @inikep's lzbench
 2025-02-18 21:22:02 -08:00
Yann Collet eb6608869f faster clang-msan-testzstd 
this is by far our longest CI test.
Attempt to make it run a bit faster.
 2025-02-18 16:19:18 -08:00
Yann Collet b14d76d888 pinned dependency hash 2025-02-18 14:53:31 -08:00
Yann Collet 5c465fcabe harden github actions script Android NDK Build 2025-02-18 14:50:03 -08:00
Yann Collet c26bde119b update changelog for v1.5.7 2025-02-18 13:59:24 -08:00
Yann Collet 2a58b04752 disabled BTI test 
this test seems impossible on Ubuntu-24
 2025-02-11 13:20:15 -08:00
Yann Collet 85c39b78cf faster aarch64 test execution 2025-02-11 13:11:29 -08:00
Yann Collet 0b8119f0ad minor arm64 test script clarification 2025-02-11 12:58:35 -08:00
Yann Collet b73e06b83e updated FreeBSD VM to 14.2 
14.1 seems no longer supported by gcloud
 2025-02-11 12:52:59 -08:00
Yann Collet 2b7c661ad2 update arm64 test 
for ubuntu-24
 2025-02-11 12:41:38 -08:00
Yann Collet 75bcae1272 removing x32 tests 
this ABI is no longer supported by Ubuntu,
and there is a wider consensus that this ABI is on the way out,
with more and more distributions dropping it,
and lingering questions about support of x32 in the kernel.
 2025-02-11 11:37:18 -08:00
Yann Collet fc1baf3463 move qemu tests to ubuntu24 2025-02-11 09:57:18 -08:00
Yann Collet 815ca8c678 ubuntu 20 is being deprecated 
change ubuntu20 tests to use more modern ubuntu variants
 2025-02-11 09:19:08 -08:00
Yann Collet d2c562b803 update hrlog comment 2025-02-10 10:48:56 -08:00
Yann Collet 67fad95f79 derive hashratelog from hashlog when only hashlog is set 2025-02-10 10:46:37 -08:00
Yann Collet f86024ccd2 reinforce man page warning 
32-bit is unsuitable for --max
 2025-02-09 17:25:35 -08:00
Yann Collet 39d1d82fa8 adjusted mml heuristic 2025-02-09 17:24:12 -08:00
Yann Collet 41b7193757 added --max to test suite 2025-02-09 12:26:36 -08:00
Yann Collet 8ae1330708 add man entry for --max 2025-02-09 11:51:25 -08:00
Yann Collet 630b47a158 added a new --max command 
set parameters to maximum compression
(even more than -22)
 2025-02-09 11:38:44 -08:00
Yann Collet aebffd66ec --ultra automatically triggered with --long and --patch-from 
the purpose of --ultra is to make the user explicitly opt-in
to generate very large window size (> 8 MB).

The agreement to generate very large window size is already implicit
when selecting --long or --patch-from.

Consequently, `--ultra ` is automatically enabled when `--long` or `--patch-from` is set.
 2025-02-08 22:47:05 -08:00
Yann Collet 23e5f80390 Revert "pass dictionary loading method as parameter" 
This reverts commit 821fc567f93a415e9fbe856271ccd452ee7acf07.
 2025-02-05 18:47:26 -08:00
Yann Collet c7cd7dc04b better MT fluidity 
--patch-from no longer blocked on first job dictionary loading
 2025-02-05 18:42:00 -08:00
Yann Collet f11bd19c7f ensure cdict is properly reset to NULL 2025-02-05 18:42:00 -08:00
Yann Collet 7406d2b6eb skips the need to create a temporary cdict for --patch-from 
thus saving a bit of memory and a little bit of cpu time
 2025-02-05 18:42:00 -08:00
Yann Collet 220abe6da8 reduced memory usage 
by avoiding to duplicate in memory
a dictionary that was passed by reference.
 2025-02-05 18:42:00 -08:00
Yann Collet 85a44b233a always free .cdictLocal 2025-02-05 18:41:59 -08:00
Yann Collet e637fc64c5 update type naming convention 2025-02-05 18:41:59 -08:00
Yann Collet 34ba14437a minor boundary change 
improves compression ratio at low levels
 2025-02-05 18:41:59 -08:00
Yann Collet ffa66a6971 fix speed of --patch-from at high compression mode 2025-02-05 18:41:59 -08:00
Yann Collet 2949252923 fix minor conversion warnings 2025-02-05 17:01:19 -08:00
Yann Collet e87d15938c more %zu warnings fixes 2025-02-05 16:48:19 -08:00
Yann Collet 590c22454e fix more %zu warnings 2025-02-05 16:36:54 -08:00
Yann Collet f9c1850aa2 fix minor printf argument limitation on older mingw 
which do not support `%zu` fields
 2025-02-05 16:28:52 -08:00
Yann Collet e117d79e22 fix minor alignment warning 2025-02-05 16:13:58 -08:00
Yann Collet c39424ea87 fix minor alignment warning 
this is a prototype definition error:
`_mm_storeu_si128()` should accept a `void*` pointer,
since it explicitly states that it accepts unaligned addresses
yet requiring a `__m128i*` tells otherwise, and requires the compiler the enforce this alignment.
 2025-02-05 16:11:54 -08:00
Yann Collet 32dff04d32 fix one minor alignment warning 
seems like a prototype interface error:
input parameter should have been `const void*`,
since the documentation is explicit that input doesn't have to be aligned,
but `const __m256i*` makes the compiler enforce it.
 2025-02-05 15:46:44 -08:00
Yann Collet 5883ee6cc2 make visual studio tests error out on warnings 2025-02-05 15:38:39 -08:00
Yann Collet 54e9d46db4 added __clang__ to compiler-specific alignment attribute 
when clang is used within msvc, `__GNUC__` isn't defined,
so testing `__clang__` explicitly is required.
 2025-02-05 13:48:24 -08:00
Yann Collet bcf404c0ab changed C11 keyword to _Alignas 
so that it doesn't depend on #include
 2025-02-05 13:25:14 -08:00
Yann Collet 6e1d02f1f0 adding a Visual + ClangCL + AVX2 compilation test 2025-02-05 13:20:44 -08:00
Yann Collet 60f84f73fe bench: better result alignment 
when displaying ratios > x100
 2025-01-30 21:30:48 -08:00
Yann Collet 82346b92bb minor: generalize BitContainerType 
technically equivalent to `size_t`,
but it's the proper type for underlying register representation.

This makes it possible to control register type, and therefore size, independently from `size_t`,
which can be useful on systems where `size_t` is 32-bit, while the architecture supports 64-bit registers.
 2025-01-19 18:05:57 -08:00