ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,392 Commits 17 Branches 77 Tags
9ae3bf5ee2ea676594b84afc6a3a4edcc22a19bf
Commit Graph
10392 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yann Collet 9ae3bf5ee2 update compression results 
good news: there are only improvements
 2024-02-03 17:52:50 -08:00
Yann Collet e5af24c5fa fixed wrong assert 2024-02-03 17:48:29 -08:00
Yann Collet 8168a451e5 minor optimization, mostly for clarity 2024-02-03 17:26:47 -08:00
Yann Collet d31018e223 finally, a version that generalizes well 
While it's not always strictly a win,
it's a win for files that see a noticeably compression ratio increase,
while it's a very small noise for other files.

Downside is, this patch is less efficient for 32-bit arrays of integer
than the previous patch which was introducing losses for other files,
but it's still a net improvement on this scenario.
 2024-02-03 14:26:18 -08:00
Yann Collet 0166b2ba80 modification: differentiate literal update at pos+1 
helps when litlen==1 is cheaper than litlen==0

works great on pathological arr[u32] examples
but doesn't generalize well on other files.

silesia/x-ray is amoung the most negatively affected ones.
 2024-01-31 11:20:43 -08:00
Yann Collet 4683667785 refactor optimal parser 
store stretches as intermediate solution instead of sequences.
makes it possible to link a solution to a predecessor.
 2024-01-31 02:51:46 -08:00
Yann Collet de10f56be2 improve high compression ratio for file like #3793 
this works great for 32-bit arrays,
notably the synthetic ones, with extreme regularity,
unfortunately, it's not universal,
and in some cases, it's a loss.
Crucially, on average, it's a loss on silesia.
The most negatively impacted file is x-ray.
It deserves an investigation before suggesting it as an evolution.
 2024-01-29 23:25:24 -08:00
Yann ColletandGitHub a7b4dafa03 Merge pull request #3888 from facebook/dependabot/github_actions/microsoft/setup-msbuild-1.3.2 
Bump microsoft/setup-msbuild from 1.3.1 to 1.3.2
 2024-01-29 14:34:53 -08:00
Yann ColletandGitHub 4a74eb8cfb Merge pull request #3887 from facebook/dependabot/github_actions/actions/upload-artifact-4.3.0 
Bump actions/upload-artifact from 4.2.0 to 4.3.0
 2024-01-29 09:49:36 -08:00
dependabot[bot]andGitHub c485b57bc7 Bump microsoft/setup-msbuild from 1.3.1 to 1.3.2 
Bumps [microsoft/setup-msbuild](https://github.com/microsoft/setup-msbuild) from 1.3.1 to 1.3.2.
- [Release notes](https://github.com/microsoft/setup-msbuild/releases)
- [Changelog](https://github.com/microsoft/setup-msbuild/blob/main/building-release.md)
- [Commits](https://github.com/microsoft/setup-msbuild/compare/1ff57057b5cfdc39105cd07a01d78e9b0ea0c14c...031090342aeefe171e49f3820f3b52110c66e402)

---
updated-dependencies:
- dependency-name: microsoft/setup-msbuild
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-29 05:53:45 +00:00
dependabot[bot]andGitHub 163e9b6637 Bump actions/upload-artifact from 4.2.0 to 4.3.0 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 4.2.0 to 4.3.0.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/694cdabd8bdb0f10b2cea11669e1bf5453eed0a6...26f96dfa697d77e81fd5907df203aa23a56210a8)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-29 05:53:39 +00:00
Yann ColletandGitHub 60829445bf Merge pull request #3880 from facebook/dependabot/github_actions/actions/upload-artifact-4.2.0 
Bump actions/upload-artifact from 4.1.0 to 4.2.0
 2024-01-27 21:49:29 -08:00
Yann ColletandGitHub 798034aeae Merge pull request #3883 from facebook/cmake_test 
improve cmake test
 2024-01-27 18:18:15 -08:00
Yann Collet 2fc7248412 fix cmakebuild test 
write it in a way which is more compatible with older versions of cmake (<3.13)

Also:
fix pzstd compilation (notably on macos)
 2024-01-27 17:30:06 -08:00
Yann ColletandGitHub 799b904628 Merge pull request #3884 from facebook/disable_intelcet 
disable Intel CET Compatibility tests
 2024-01-27 17:29:17 -08:00
Yann Collet c7611d6964 disable Intel CET Compatibility tests 
The binary blob that must be downloaded from intel.com is no longer available
 2024-01-27 15:37:29 -08:00
dependabot[bot]andGitHub ee2efb634e Bump actions/upload-artifact from 4.1.0 to 4.2.0 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 4.1.0 to 4.2.0.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/1eb3cb2b3e0f29609092a73eb033bb759a334595...694cdabd8bdb0f10b2cea11669e1bf5453eed0a6)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-22 05:21:32 +00:00
Yann ColletandGitHub 1a860c8737 Merge pull request #3877 from facebook/oldgrep 
minor: playTests.sh more compatible with older versions of grep
 2024-01-21 11:31:58 -08:00
Yann Collet 81f444f4f9 made playTests.sh more compatible with older versions of grep 
replaced `\+` by `*`.
`\+` means `[1-N]`,
while `*` means `[0-N]`,
so it's not strictly equivalent
but `\+` happens to be badly supported on some flavors of grep,
and for the purpose of these tests, `*` is good enough.
 2024-01-16 12:14:35 -08:00
Yann ColletandGitHub 050fec5c37 Merge pull request #3865 from facebook/grep_e 
playTests.sh does no longer needs grep -E
 2024-01-15 12:44:46 -08:00
Yann Collet e6f4b46493 playTests.sh does no longer needs grep -E 
it makes the test script more portable across posix systems
because `grep -E` is not guaranteed
while `grep` is fairly common.
 2024-01-15 11:16:46 -08:00
Yann ColletandGitHub d2ea3fb5ef Merge pull request #3863 from facebook/dependabot/github_actions/github/codeql-action-3.23.0 
Bump github/codeql-action from 2.21.4 to 3.23.0
 2024-01-15 09:44:19 -08:00
Yann ColletandGitHub 572acb9c5d Merge pull request #3864 from facebook/dependabot/github_actions/actions/upload-artifact-4.1.0 
Bump actions/upload-artifact from 4.0.0 to 4.1.0
 2024-01-14 23:44:56 -08:00
dependabot[bot]andGitHub e2fe266279 Bump actions/upload-artifact from 4.0.0 to 4.1.0 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 4.0.0 to 4.1.0.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/c7d193f32edcb7bfad88892161225aeda64e9392...1eb3cb2b3e0f29609092a73eb033bb759a334595)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-15 05:24:46 +00:00
dependabot[bot]andGitHub 3a2e302b2c Bump github/codeql-action from 2.21.4 to 3.23.0 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.21.4 to 3.23.0.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/github/codeql-action/compare/a09933a12a80f87b87005513f0abb1494c27a716...e5f05b81d5b6ff8cfa111c80c22c5fd02a384118)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-15 05:24:41 +00:00
Yann ColletandGitHub dcf784a04b Merge pull request #3760 from jcelerier/patch-1 
[x-compile] Fix cross-compiling for AArch64 with lld
 2024-01-13 11:41:30 -08:00
Yann ColletandGitHub 7971fd16f7 Merge pull request #3817 from elasota/oversized-probs-clarification 
Clarify that probability tables must not contain non-zero probabilities for invalid values
 2024-01-13 11:37:54 -08:00
Yann ColletandGitHub 7f76d37044 Merge pull request #3850 from KapJI/better-errors 
cli: better errors on argument parsing
 2024-01-13 11:37:25 -08:00
Yann ColletandGitHub 17332454e5 Merge pull request #3858 from eli-schwartz/msvc-dev-cmd 
CI: meson: use builtin handling for MSVC
 2024-01-13 11:36:20 -08:00
Eli Schwartz 923cf3dc92 CI: meson: use builtin handling for MSVC 
This avoids downloading -- and periodically bumping the checksum for --
a third-party action that isn't strictly required, and thus helps keep
down dependencies and reduce update churn.
 2024-01-02 01:36:45 -05:00
Yann ColletandGitHub ffde100b68 Merge pull request #3855 from emaste/freebsd-14-ci 
Cirrus-CI: Add FreeBSD 14
 2023-12-30 22:16:42 -08:00
Yann ColletandGitHub a07cae3976 Merge pull request #3847 from michoecho/fix_nullptr_deref_in_createCDict 
Fix a nullptr dereference in ZSTD_createCDict_advanced2()
 2023-12-30 13:23:39 -08:00
Ed Maste a52d897d60 Cirrus-CI: Add FreeBSD 14 2023-12-29 15:44:25 -05:00
Yann ColletandGitHub 903bc264ad Merge pull request #3846 from emaste/c89 
zlibWrapper: convert to C89 / ANSI C
 2023-12-29 12:34:47 -08:00
Elliot GorokhovskyandGitHub c6cabf9441 Make offload API compatible with static CCtx (#3854) 
* Add ZSTD_CCtxParams_registerSequenceProducer() to public API

* add unit test

* add docs to zstd.h

* nits

* Add ZSTDLIB_STATIC_API prefix

* Add asserts
 2023-12-28 14:48:46 -05:00
Yann ColletandGitHub 7cf62bc274 Merge pull request #3849 from facebook/dependabot/github_actions/actions/upload-artifact-4.0.0 
Bump actions/upload-artifact from 3.1.3 to 4.0.0
 2023-12-18 09:49:57 -08:00
Yann ColletandGitHub 377ecefce9 Update windows-artifacts.yml 
and fixed version number in comment
 2023-12-18 09:39:42 -08:00
Ruslan SayfutdinovandRuslan Sayfutdinov 8052cd0131 cli: better errors on arguent parsing 2023-12-18 13:59:33 +00:00
dependabot[bot]andGitHub e515327764 Bump actions/upload-artifact from 3.1.3 to 4.0.0 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 3.1.3 to 4.0.0.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/a8a3f3ad30e3422c9c7b888a15615d19a852ae32...c7d193f32edcb7bfad88892161225aeda64e9392)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-18 05:26:39 +00:00
Michał Chojnowski 9a3b17c4d6 Fix a nullptr dereference in ZSTD_createCDict_advanced2() 
If the relevant allocation returns NULL, ZSTD_createCDict_advanced_internal()
will return NULL. But ZSTD_createCDict_advanced2() doesn't check for
this and attempts to use the returned pointer anyway, which leads to
a segfault.
 2023-12-16 13:02:18 +01:00
Ed Maste 2ce0290e4d zlibWrapper: convert to C89 / ANSI C 
Clang 16 (which is the system compiler in FreeBSD 14.0) no longer allows
K&R function definitions.  Formatting of the changes matches current
zlib.
 2023-12-14 08:45:04 -05:00
Yann ColletandGitHub 86ead9f4a4 Merge pull request #3845 from emaste/dev 
Update FreeBSD CI: drop 12.4 (nearly EOL)
 2023-12-13 23:54:41 -08:00
Ed Maste 20f8df6440 Update FreeBSD CI: drop 12.4 as it is nearly EOL 
12.4 is EOL as of the end of December 2023, and pkg installation will
start failing some time after that so remove those jobs now.
 2023-12-13 19:10:43 -05:00
Elliot GorokhovskyandGitHub 126ec2669c Merge pull request #3839 from embg/offload_refactor 
Move offload API params into ZSTD_CCtx_params
 2023-11-28 20:04:08 -05:00
Elliot Gorokhovsky d151a4880b Move offload API params into ZSTD_CCtx_params 2023-11-27 08:11:01 -08:00
Elliot Gorokhovsky 809c7eb6bf Refactor ZSTD_sequenceProducer_F typedef to ZSTD_sequenceProducer_F* 2023-11-27 06:56:37 -08:00
elasotaandNick Terrell 05059e5a48 Clarify that there must be at least 2 weights, i.e. encoding all weights as 0 is invalid 2023-11-24 16:49:40 -05:00
elasotaandNick Terrell dc84e35138 Clarify that the presence of a value with weight 1 is required 2023-11-24 16:49:40 -05:00
Nick TerrellandNick Terrell 8193250615 Modernize macros to use do { } while (0) 
This PR introduces no functional changes. It attempts to change all
macros currently using `{ }` or some variant of that to to
`do { } while (0)`, and introduces trailing `;` where necessary.
There were no bugs found during this migration.

The bug in Visual Studios warning on this has been fixed since VS2015.
Additionally, we have several instances of `do { } while (0)` which have
been present for several releases, so we don't have to worry about
breaking peoples builds.

Fixes Issue #3830.
 2023-11-21 20:05:17 -05:00
Yann ColletandGitHub 6b3d12fe54 Merge pull request #3820 from facebook/xxh082 
update xxhash library to v0.8.2
 2023-11-21 09:11:40 -08:00