ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,421 Commits 17 Branches 77 Tags
b921f1aad67cfc347ea7f8ef1c0afb6688bad4b6
Commit Graph
10421 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Christoph Grüninger b921f1aad6 Reduce scope of variables 
This improves readability, keeps variables local, and
prevents the unintended use (e.g. typo) later on.
Found by Cppcheck (variableScope)
 2024-02-11 22:00:03 +01:00
Yann ColletandGitHub a3f1b2448c Merge pull request #3902 from facebook/fuzz_debuglevel 
Fix fuzz issue 5131069967892480
 2024-02-09 13:07:46 -08:00
Yann Collet b0e8580dc7 fix fuzz issue 5131069967892480 2024-02-08 16:38:20 -08:00
Yann Collet 695d154cac fuzz: control debuglevel from Makefile 
and make the compilation faster
 2024-02-08 16:23:52 -08:00
Yann ColletandGitHub 54107e263f Merge pull request #3900 from facebook/fix5921623844651008 
fix 5921623844651008
 2024-02-07 12:27:03 -08:00
Sergey AndreenkoandGitHub a844455095 Merge pull request #3899 from sandreenko/dev 
[Zstd] Less verbose log for patch mode.
 2024-02-06 18:01:15 -05:00
Yann Collet 22574d848d fix issue 5921623844651008 
ossfuzz managed to create a scenario which triggers an `assert`.
This fixes it, by giving +1 more space for the backward search pass.
 2024-02-06 13:01:14 -08:00
sergeyandreenko 1f87c88ecf [Zstd] Less verbose log for patch mode. 2024-02-06 12:07:11 -08:00
Yann ColletandGitHub 06b5b37b8d Merge pull request #3895 from facebook/fix_3793 
Improve compression of Arrays of Integers (High compression mode)
 2024-02-05 20:12:24 -08:00
Yann Collet b88c593d8f added or updated code comments 
as suggested by @terrelln,
to make the code of the optimal parser a bit more understandable.
 2024-02-05 18:32:25 -08:00
Yann Collet 887f5b62ae update compression results for regression tests 2024-02-05 01:27:22 -08:00
Yann Collet 6c35fb2e8c fix msan warnings 2024-02-05 01:21:06 -08:00
Yann Collet 641749fc09 fix uasan dictionary_stream_round_trip fuzz test 2024-02-05 00:36:10 -08:00
Yann ColletandGitHub 5a08f58df2 Merge pull request #3897 from facebook/dependabot/github_actions/microsoft/setup-msbuild-2.0.0 
Bump microsoft/setup-msbuild from 1.3.2 to 2.0.0
 2024-02-04 23:49:56 -08:00
Yann ColletandGitHub 0d9fb5dc33 fix msbuild action version number 2024-02-04 22:45:18 -08:00
dependabot[bot]andGitHub 9fed5ef108 Bump microsoft/setup-msbuild from 1.3.2 to 2.0.0 
Bumps [microsoft/setup-msbuild](https://github.com/microsoft/setup-msbuild) from 1.3.2 to 2.0.0.
- [Release notes](https://github.com/microsoft/setup-msbuild/releases)
- [Changelog](https://github.com/microsoft/setup-msbuild/blob/main/building-release.md)
- [Commits](https://github.com/microsoft/setup-msbuild/compare/031090342aeefe171e49f3820f3b52110c66e402...6fb02220983dee41ce7ae257b6f4d8f9bf5ed4ce)

---
updated-dependencies:
- dependency-name: microsoft/setup-msbuild
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-02-05 05:43:28 +00:00
Yann Collet fe2e2ad36d use ZSTD_memcpy() 
which can be redirected in Linux kernel mode
 2024-02-03 19:57:38 -08:00
Yann Collet 0ae21d8c31 removed trace control 2024-02-03 19:32:59 -08:00
Yann Collet 5474edbe60 fixed wrong assert 
by introducing ZSTD_OPT_SIZE
 2024-02-03 19:31:53 -08:00
Yann Collet 9ae3bf5ee2 update compression results 
good news: there are only improvements
 2024-02-03 17:52:50 -08:00
Yann Collet e5af24c5fa fixed wrong assert 2024-02-03 17:48:29 -08:00
Yann Collet 8168a451e5 minor optimization, mostly for clarity 2024-02-03 17:26:47 -08:00
Yann Collet d31018e223 finally, a version that generalizes well 
While it's not always strictly a win,
it's a win for files that see a noticeably compression ratio increase,
while it's a very small noise for other files.

Downside is, this patch is less efficient for 32-bit arrays of integer
than the previous patch which was introducing losses for other files,
but it's still a net improvement on this scenario.
 2024-02-03 14:26:18 -08:00
Felix HandteandGitHub 7afd9db8db Merge pull request #3893 from felixhandte/gh-actions-cet-test-update-dep 
Update Dependency in Intel CET Test; Re-Enable Test
 2024-02-01 14:49:37 -05:00
W. Felix Handte 04a6c8cbe2 Update Dependency in Intel CET Test; Re-Enable Test 
Motivated by #3884.
 2024-02-01 10:24:42 -08:00
Yann ColletandGitHub 79e9459efc Merge pull request #3890 from facebook/lorem 
add a lorem ipsum generator
 2024-02-01 10:15:57 -08:00
Yann Collet 0166b2ba80 modification: differentiate literal update at pos+1 
helps when litlen==1 is cheaper than litlen==0

works great on pathological arr[u32] examples
but doesn't generalize well on other files.

silesia/x-ray is amoung the most negatively affected ones.
 2024-01-31 11:20:43 -08:00
Yann ColletandGitHub 81bfe3655e Merge pull request #3886 from facebook/sparc64 
add sparc64 compilation test
 2024-01-31 10:55:11 -08:00
Yann Collet 4683667785 refactor optimal parser 
store stretches as intermediate solution instead of sequences.
makes it possible to link a solution to a predecessor.
 2024-01-31 02:51:46 -08:00
Yann Collet de10f56be2 improve high compression ratio for file like #3793 
this works great for 32-bit arrays,
notably the synthetic ones, with extreme regularity,
unfortunately, it's not universal,
and in some cases, it's a loss.
Crucially, on average, it's a loss on silesia.
The most negatively impacted file is x-ray.
It deserves an investigation before suggesting it as an evolution.
 2024-01-29 23:25:24 -08:00
Yann Collet fd03971252 blindfix meson recipe 
note: absence of GLOB capability within meson makes its maintenance more painful.
 2024-01-29 15:50:21 -08:00
Yann Collet befcec1788 fix cmake recipe 2024-01-29 15:45:16 -08:00
Yann Collet 3ce4c6e046 fix Visual Studio solutions 
note: we probably don't want to maintain VS2008 solution anymore.
Its successor VS2010 is > 10 years old,
which is more or less the limit after which we can stop supporting old compilers.
 2024-01-29 15:24:42 -08:00
Yann Collet a261375996 fix paramgrill Makefile recipe 2024-01-29 15:18:27 -08:00
Yann Collet d0b7da30e2 add a lorem ipsum generator 
this generator replaces the statistical generator
for the general case when no statistic is requested.

Generated data features a compression level speed / ratio curve
which is more in line with expectation.
 2024-01-29 15:00:32 -08:00
Yann ColletandGitHub a7b4dafa03 Merge pull request #3888 from facebook/dependabot/github_actions/microsoft/setup-msbuild-1.3.2 
Bump microsoft/setup-msbuild from 1.3.1 to 1.3.2
 2024-01-29 14:34:53 -08:00
Yann ColletandGitHub 4a74eb8cfb Merge pull request #3887 from facebook/dependabot/github_actions/actions/upload-artifact-4.3.0 
Bump actions/upload-artifact from 4.2.0 to 4.3.0
 2024-01-29 09:49:36 -08:00
dependabot[bot]andGitHub c485b57bc7 Bump microsoft/setup-msbuild from 1.3.1 to 1.3.2 
Bumps [microsoft/setup-msbuild](https://github.com/microsoft/setup-msbuild) from 1.3.1 to 1.3.2.
- [Release notes](https://github.com/microsoft/setup-msbuild/releases)
- [Changelog](https://github.com/microsoft/setup-msbuild/blob/main/building-release.md)
- [Commits](https://github.com/microsoft/setup-msbuild/compare/1ff57057b5cfdc39105cd07a01d78e9b0ea0c14c...031090342aeefe171e49f3820f3b52110c66e402)

---
updated-dependencies:
- dependency-name: microsoft/setup-msbuild
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-29 05:53:45 +00:00
dependabot[bot]andGitHub 163e9b6637 Bump actions/upload-artifact from 4.2.0 to 4.3.0 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 4.2.0 to 4.3.0.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/694cdabd8bdb0f10b2cea11669e1bf5453eed0a6...26f96dfa697d77e81fd5907df203aa23a56210a8)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-29 05:53:39 +00:00
Yann Collet e1ef81a3ae add sparc64 compilation test 2024-01-28 20:25:04 -08:00
Yann ColletandGitHub 60829445bf Merge pull request #3880 from facebook/dependabot/github_actions/actions/upload-artifact-4.2.0 
Bump actions/upload-artifact from 4.1.0 to 4.2.0
 2024-01-27 21:49:29 -08:00
Yann ColletandGitHub 798034aeae Merge pull request #3883 from facebook/cmake_test 
improve cmake test
 2024-01-27 18:18:15 -08:00
Yann Collet 2fc7248412 fix cmakebuild test 
write it in a way which is more compatible with older versions of cmake (<3.13)

Also:
fix pzstd compilation (notably on macos)
 2024-01-27 17:30:06 -08:00
Yann ColletandGitHub 799b904628 Merge pull request #3884 from facebook/disable_intelcet 
disable Intel CET Compatibility tests
 2024-01-27 17:29:17 -08:00
Yann Collet c7611d6964 disable Intel CET Compatibility tests 
The binary blob that must be downloaded from intel.com is no longer available
 2024-01-27 15:37:29 -08:00
dependabot[bot]andGitHub ee2efb634e Bump actions/upload-artifact from 4.1.0 to 4.2.0 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 4.1.0 to 4.2.0.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/1eb3cb2b3e0f29609092a73eb033bb759a334595...694cdabd8bdb0f10b2cea11669e1bf5453eed0a6)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-22 05:21:32 +00:00
Yann ColletandGitHub 1a860c8737 Merge pull request #3877 from facebook/oldgrep 
minor: playTests.sh more compatible with older versions of grep
 2024-01-21 11:31:58 -08:00
Yann Collet 81f444f4f9 made playTests.sh more compatible with older versions of grep 
replaced `\+` by `*`.
`\+` means `[1-N]`,
while `*` means `[0-N]`,
so it's not strictly equivalent
but `\+` happens to be badly supported on some flavors of grep,
and for the purpose of these tests, `*` is good enough.
 2024-01-16 12:14:35 -08:00
Yann ColletandGitHub 050fec5c37 Merge pull request #3865 from facebook/grep_e 
playTests.sh does no longer needs grep -E
 2024-01-15 12:44:46 -08:00
Yann Collet e6f4b46493 playTests.sh does no longer needs grep -E 
it makes the test script more portable across posix systems
because `grep -E` is not guaranteed
while `grep` is fairly common.
 2024-01-15 11:16:46 -08:00