ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,656 Commits 17 Branches 77 Tags
dev
Commit Graph
10656 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yann ColletandGitHub 3c78b42210 Merge pull request #3913 from facebook/lorem2 
Lorem Ipsum generator update
 2024-02-22 09:41:12 -08:00
Yann ColletandGitHub 4afe31ba7b Merge pull request #3914 from facebook/setup_msys2_v2.22.0 
updated setup-msys2 to v2.22.0
 2024-02-21 09:36:48 -08:00
Yann Collet 0a68be83e7 updated setup-msys2 to v2.22.0 
following a warning in recent test reports

```
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: msys2/setup-msys2@5beef6d11f. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
```
 2024-02-21 00:22:04 -08:00
Yann Collet 7170f51dd2 fix include order 2024-02-20 23:36:04 -08:00
Yann Collet 9e711c9360 fix Visual Studio datagen recipe 2024-02-20 22:59:58 -08:00
Yann Collet e62e15df19 fix clangbuild 
notably -Wconversion and -Wdocumentation
 2024-02-20 22:43:22 -08:00
Yann Collet b34517a440 fix cmake build 2024-02-20 20:20:40 -08:00
Yann Collet 588dfbcc97 fix c89 compatibility by removing snprintf() 
note that this function has been in the code for a long while,
so why does it only start failing CI tests now ?
 2024-02-20 19:24:50 -08:00
Yann Collet c2d3570338 fix meson datagen build 2024-02-20 18:17:28 -08:00
Yann Collet 1e240af30a fix datagen size control 2024-02-20 18:06:56 -08:00
Yann Collet 7a225c0c46 internal benchmark: can select size of generated synthetic sample 2024-02-20 15:47:09 -08:00
Yann Collet 83598aa106 datagen generates lorem ipsum by default 2024-02-20 15:24:25 -08:00
Yann Collet 7003c9905e increase word dictionary 
for higher variety of messages.
Now, level 5 compresses better than level 4 (by a hair).
 2024-02-20 13:27:36 -08:00
Yann Collet 3dbd861b7d runtime weight distribution table 
and made small words a bit more common.
 2024-02-20 12:26:37 -08:00
Yann Collet 5a1bb4a4e0 add question marks 
and (slightly) longer sentences.
 2024-02-20 00:37:21 -08:00
Yann Collet 40874d4aea enriched vocabulary again 
using real latin sentences from Cicero.

Compression ratio lower again, closer to "real" text,

now level 6 is way better than level 4.

level 5 is still lower than level 4,
but at least it's now higher than level 3.
 2024-02-20 00:30:29 -08:00
Yann Collet 1e046ce7fa increase vocabulary size 
makes compression a bit less good,
hence a bit more comparable with real text (though still too easy to compress).
level 6 is now stronger than level 4, by a hair.
However, there is still a ratio dip at level 5.
 2024-02-20 00:12:32 -08:00
Felix HandteandGitHub 889392dac8 Merge pull request #3909 from felixhandte/security-md-notif-list-ad 
Advertise Availability of Security Vulnerability Notifications
 2024-02-13 12:38:18 -05:00
W. Felix Handte e13d099bf8 Advertise Availability of Security Vulnerability Notifications 2024-02-13 11:54:59 -05:00
W. Felix Handte b6805c54d6 Add SECURITY.md File 
This just adds a copy of the Meta default SECURITY.md that we can then modify.
 2024-02-13 11:50:55 -05:00
dependabot[bot]andGitHub 927d079944 Bump actions/upload-artifact from 4.3.0 to 4.3.1 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 4.3.0 to 4.3.1.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/26f96dfa697d77e81fd5907df203aa23a56210a8...5d5d22a31266ced268874388b861e4b58bb5c2f3)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-02-12 05:17:13 +00:00
Christoph Grüninger b921f1aad6 Reduce scope of variables 
This improves readability, keeps variables local, and
prevents the unintended use (e.g. typo) later on.
Found by Cppcheck (variableScope)
 2024-02-11 22:00:03 +01:00
Yann ColletandGitHub a3f1b2448c Merge pull request #3902 from facebook/fuzz_debuglevel 
Fix fuzz issue 5131069967892480
 2024-02-09 13:07:46 -08:00
Yann Collet b0e8580dc7 fix fuzz issue 5131069967892480 2024-02-08 16:38:20 -08:00
Yann Collet 695d154cac fuzz: control debuglevel from Makefile 
and make the compilation faster
 2024-02-08 16:23:52 -08:00
Yann ColletandGitHub 54107e263f Merge pull request #3900 from facebook/fix5921623844651008 
fix 5921623844651008
 2024-02-07 12:27:03 -08:00
Josh KearneyandJosh Kearney 3a64c69eba Convert the CircleCI workflow to a GitHub Actions workflow 2024-02-07 13:32:42 -06:00
Sergey AndreenkoandGitHub a844455095 Merge pull request #3899 from sandreenko/dev 
[Zstd] Less verbose log for patch mode.
 2024-02-06 18:01:15 -05:00
Yann Collet 22574d848d fix issue 5921623844651008 
ossfuzz managed to create a scenario which triggers an `assert`.
This fixes it, by giving +1 more space for the backward search pass.
 2024-02-06 13:01:14 -08:00
sergeyandreenko 1f87c88ecf [Zstd] Less verbose log for patch mode. 2024-02-06 12:07:11 -08:00
Yann ColletandGitHub 06b5b37b8d Merge pull request #3895 from facebook/fix_3793 
Improve compression of Arrays of Integers (High compression mode)
 2024-02-05 20:12:24 -08:00
Yann Collet b88c593d8f added or updated code comments 
as suggested by @terrelln,
to make the code of the optimal parser a bit more understandable.
 2024-02-05 18:32:25 -08:00
Yann Collet 887f5b62ae update compression results for regression tests 2024-02-05 01:27:22 -08:00
Yann Collet 6c35fb2e8c fix msan warnings 2024-02-05 01:21:06 -08:00
Yann Collet 641749fc09 fix uasan dictionary_stream_round_trip fuzz test 2024-02-05 00:36:10 -08:00
Yann ColletandGitHub 5a08f58df2 Merge pull request #3897 from facebook/dependabot/github_actions/microsoft/setup-msbuild-2.0.0 
Bump microsoft/setup-msbuild from 1.3.2 to 2.0.0
 2024-02-04 23:49:56 -08:00
Yann ColletandGitHub 0d9fb5dc33 fix msbuild action version number 2024-02-04 22:45:18 -08:00
dependabot[bot]andGitHub 9fed5ef108 Bump microsoft/setup-msbuild from 1.3.2 to 2.0.0 
Bumps [microsoft/setup-msbuild](https://github.com/microsoft/setup-msbuild) from 1.3.2 to 2.0.0.
- [Release notes](https://github.com/microsoft/setup-msbuild/releases)
- [Changelog](https://github.com/microsoft/setup-msbuild/blob/main/building-release.md)
- [Commits](https://github.com/microsoft/setup-msbuild/compare/031090342aeefe171e49f3820f3b52110c66e402...6fb02220983dee41ce7ae257b6f4d8f9bf5ed4ce)

---
updated-dependencies:
- dependency-name: microsoft/setup-msbuild
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-02-05 05:43:28 +00:00
Yann Collet fe2e2ad36d use ZSTD_memcpy() 
which can be redirected in Linux kernel mode
 2024-02-03 19:57:38 -08:00
Yann Collet 0ae21d8c31 removed trace control 2024-02-03 19:32:59 -08:00
Yann Collet 5474edbe60 fixed wrong assert 
by introducing ZSTD_OPT_SIZE
 2024-02-03 19:31:53 -08:00
Yann Collet 9ae3bf5ee2 update compression results 
good news: there are only improvements
 2024-02-03 17:52:50 -08:00
Yann Collet e5af24c5fa fixed wrong assert 2024-02-03 17:48:29 -08:00
Yann Collet 8168a451e5 minor optimization, mostly for clarity 2024-02-03 17:26:47 -08:00
Yann Collet d31018e223 finally, a version that generalizes well 
While it's not always strictly a win,
it's a win for files that see a noticeably compression ratio increase,
while it's a very small noise for other files.

Downside is, this patch is less efficient for 32-bit arrays of integer
than the previous patch which was introducing losses for other files,
but it's still a net improvement on this scenario.
 2024-02-03 14:26:18 -08:00
Felix HandteandGitHub 7afd9db8db Merge pull request #3893 from felixhandte/gh-actions-cet-test-update-dep 
Update Dependency in Intel CET Test; Re-Enable Test
 2024-02-01 14:49:37 -05:00
W. Felix Handte 04a6c8cbe2 Update Dependency in Intel CET Test; Re-Enable Test 
Motivated by #3884.
 2024-02-01 10:24:42 -08:00
Yann ColletandGitHub 79e9459efc Merge pull request #3890 from facebook/lorem 
add a lorem ipsum generator
 2024-02-01 10:15:57 -08:00
Yann Collet 0166b2ba80 modification: differentiate literal update at pos+1 
helps when litlen==1 is cheaper than litlen==0

works great on pathological arr[u32] examples
but doesn't generalize well on other files.

silesia/x-ray is amoung the most negatively affected ones.
 2024-01-31 11:20:43 -08:00
Yann ColletandGitHub 81bfe3655e Merge pull request #3886 from facebook/sparc64 
add sparc64 compilation test
 2024-01-31 10:55:11 -08:00