ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,453 Commits 17 Branches 77 Tags
f8372191f595f112ba13445205cf46997da67350
Commit Graph
10453 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yann Collet f8372191f5 reduced minimum compressed block size 
with the intention to match the transport layer size,
such as Ethernet and 4G mobile networks.
 2024-02-24 01:59:16 -08:00
Yann Collet f77f634d41 update API documentation 2024-02-24 01:28:17 -08:00
Yann Collet 4b51526412 fix partial block uncompressed 2024-02-24 01:24:58 -08:00
Yann Collet 6719794379 fixed some regressionTests 
but not all
 2024-02-23 18:48:29 -08:00
Yann Collet 0591e7eea1 minor: fix overly cautious conversion warning 2024-02-23 16:05:09 -08:00
Yann Collet 3b40100058 fix long sequences (> 64 KB) 2024-02-23 15:35:12 -08:00
Yann Collet 6b11fc436c fix issue with incompressible sections 2024-02-23 14:53:56 -08:00
Yann Collet cc4530924b speed optimized version of targetCBlockSize 
note that the size of individual compressed blocks will vary more wildly with this modification.
But it seems good enough for a first test, and fix the speed regression issue.
Further refinements can be attempted later.
 2024-02-23 14:03:26 -08:00
Yann Collet 68a232c591 benchmark more can test targetCBlockSize 2024-02-23 13:13:03 -08:00
Yann ColletandGitHub 621a263fb2 Merge pull request #3903 from gruenich/feature/reduce-scope-of-variables 
Reduce scope of variables
 2024-02-22 09:42:02 -08:00
Yann ColletandGitHub ce6cadc860 Merge pull request #3905 from facebook/dependabot/github_actions/actions/upload-artifact-4.3.1 
Bump actions/upload-artifact from 4.3.0 to 4.3.1
 2024-02-22 09:41:26 -08:00
Yann ColletandGitHub 3c78b42210 Merge pull request #3913 from facebook/lorem2 
Lorem Ipsum generator update
 2024-02-22 09:41:12 -08:00
Yann ColletandGitHub 4afe31ba7b Merge pull request #3914 from facebook/setup_msys2_v2.22.0 
updated setup-msys2 to v2.22.0
 2024-02-21 09:36:48 -08:00
Yann Collet 0a68be83e7 updated setup-msys2 to v2.22.0 
following a warning in recent test reports

```
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: msys2/setup-msys2@5beef6d11f. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
```
 2024-02-21 00:22:04 -08:00
Yann Collet 7170f51dd2 fix include order 2024-02-20 23:36:04 -08:00
Yann Collet 9e711c9360 fix Visual Studio datagen recipe 2024-02-20 22:59:58 -08:00
Yann Collet e62e15df19 fix clangbuild 
notably -Wconversion and -Wdocumentation
 2024-02-20 22:43:22 -08:00
Yann Collet b34517a440 fix cmake build 2024-02-20 20:20:40 -08:00
Yann Collet 588dfbcc97 fix c89 compatibility by removing snprintf() 
note that this function has been in the code for a long while,
so why does it only start failing CI tests now ?
 2024-02-20 19:24:50 -08:00
Yann Collet c2d3570338 fix meson datagen build 2024-02-20 18:17:28 -08:00
Yann Collet 1e240af30a fix datagen size control 2024-02-20 18:06:56 -08:00
Yann Collet 7a225c0c46 internal benchmark: can select size of generated synthetic sample 2024-02-20 15:47:09 -08:00
Yann Collet 83598aa106 datagen generates lorem ipsum by default 2024-02-20 15:24:25 -08:00
Yann Collet 7003c9905e increase word dictionary 
for higher variety of messages.
Now, level 5 compresses better than level 4 (by a hair).
 2024-02-20 13:27:36 -08:00
Yann Collet 3dbd861b7d runtime weight distribution table 
and made small words a bit more common.
 2024-02-20 12:26:37 -08:00
Yann Collet 5a1bb4a4e0 add question marks 
and (slightly) longer sentences.
 2024-02-20 00:37:21 -08:00
Yann Collet 40874d4aea enriched vocabulary again 
using real latin sentences from Cicero.

Compression ratio lower again, closer to "real" text,

now level 6 is way better than level 4.

level 5 is still lower than level 4,
but at least it's now higher than level 3.
 2024-02-20 00:30:29 -08:00
Yann Collet 1e046ce7fa increase vocabulary size 
makes compression a bit less good,
hence a bit more comparable with real text (though still too easy to compress).
level 6 is now stronger than level 4, by a hair.
However, there is still a ratio dip at level 5.
 2024-02-20 00:12:32 -08:00
Felix HandteandGitHub 889392dac8 Merge pull request #3909 from felixhandte/security-md-notif-list-ad 
Advertise Availability of Security Vulnerability Notifications
 2024-02-13 12:38:18 -05:00
W. Felix Handte e13d099bf8 Advertise Availability of Security Vulnerability Notifications 2024-02-13 11:54:59 -05:00
W. Felix Handte b6805c54d6 Add SECURITY.md File 
This just adds a copy of the Meta default SECURITY.md that we can then modify.
 2024-02-13 11:50:55 -05:00
dependabot[bot]andGitHub 927d079944 Bump actions/upload-artifact from 4.3.0 to 4.3.1 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 4.3.0 to 4.3.1.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/26f96dfa697d77e81fd5907df203aa23a56210a8...5d5d22a31266ced268874388b861e4b58bb5c2f3)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-02-12 05:17:13 +00:00
Christoph Grüninger b921f1aad6 Reduce scope of variables 
This improves readability, keeps variables local, and
prevents the unintended use (e.g. typo) later on.
Found by Cppcheck (variableScope)
 2024-02-11 22:00:03 +01:00
Yann ColletandGitHub a3f1b2448c Merge pull request #3902 from facebook/fuzz_debuglevel 
Fix fuzz issue 5131069967892480
 2024-02-09 13:07:46 -08:00
Yann Collet b0e8580dc7 fix fuzz issue 5131069967892480 2024-02-08 16:38:20 -08:00
Yann Collet 695d154cac fuzz: control debuglevel from Makefile 
and make the compilation faster
 2024-02-08 16:23:52 -08:00
Yann ColletandGitHub 54107e263f Merge pull request #3900 from facebook/fix5921623844651008 
fix 5921623844651008
 2024-02-07 12:27:03 -08:00
Sergey AndreenkoandGitHub a844455095 Merge pull request #3899 from sandreenko/dev 
[Zstd] Less verbose log for patch mode.
 2024-02-06 18:01:15 -05:00
Yann Collet 22574d848d fix issue 5921623844651008 
ossfuzz managed to create a scenario which triggers an `assert`.
This fixes it, by giving +1 more space for the backward search pass.
 2024-02-06 13:01:14 -08:00
sergeyandreenko 1f87c88ecf [Zstd] Less verbose log for patch mode. 2024-02-06 12:07:11 -08:00
Yann ColletandGitHub 06b5b37b8d Merge pull request #3895 from facebook/fix_3793 
Improve compression of Arrays of Integers (High compression mode)
 2024-02-05 20:12:24 -08:00
Yann Collet b88c593d8f added or updated code comments 
as suggested by @terrelln,
to make the code of the optimal parser a bit more understandable.
 2024-02-05 18:32:25 -08:00
Yann Collet 887f5b62ae update compression results for regression tests 2024-02-05 01:27:22 -08:00
Yann Collet 6c35fb2e8c fix msan warnings 2024-02-05 01:21:06 -08:00
Yann Collet 641749fc09 fix uasan dictionary_stream_round_trip fuzz test 2024-02-05 00:36:10 -08:00
Yann ColletandGitHub 5a08f58df2 Merge pull request #3897 from facebook/dependabot/github_actions/microsoft/setup-msbuild-2.0.0 
Bump microsoft/setup-msbuild from 1.3.2 to 2.0.0
 2024-02-04 23:49:56 -08:00
Yann ColletandGitHub 0d9fb5dc33 fix msbuild action version number 2024-02-04 22:45:18 -08:00
dependabot[bot]andGitHub 9fed5ef108 Bump microsoft/setup-msbuild from 1.3.2 to 2.0.0 
Bumps [microsoft/setup-msbuild](https://github.com/microsoft/setup-msbuild) from 1.3.2 to 2.0.0.
- [Release notes](https://github.com/microsoft/setup-msbuild/releases)
- [Changelog](https://github.com/microsoft/setup-msbuild/blob/main/building-release.md)
- [Commits](https://github.com/microsoft/setup-msbuild/compare/031090342aeefe171e49f3820f3b52110c66e402...6fb02220983dee41ce7ae257b6f4d8f9bf5ed4ce)

---
updated-dependencies:
- dependency-name: microsoft/setup-msbuild
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-02-05 05:43:28 +00:00
Yann Collet fe2e2ad36d use ZSTD_memcpy() 
which can be redirected in Linux kernel mode
 2024-02-03 19:57:38 -08:00
Yann Collet 0ae21d8c31 removed trace control 2024-02-03 19:32:59 -08:00