ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,209 Commits 17 Branches 77 Tags
b7add1dd67f24124f2ebc722effb322fb77ee92b
Commit Graph
10209 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
W. Felix Handte b7add1dd67 Abort if Unsupported Parameters Used 2023-05-04 12:18:58 -04:00
W. Felix Handte f242f5be8f Re-Order Lazy Declarations; Minimize ifndefs 2023-05-04 12:18:58 -04:00
W. Felix Handte 698af84fcf Add CI Test for Excluding Matchfinders 2023-05-04 12:18:58 -04:00
W. Felix Handte bae174960b Add ZSTD_LIB_EXCLUDE_COMPRESSORS_DFAST_AND_UP Build Variable 2023-05-04 12:18:58 -04:00
W. Felix Handte 39b7946b95 Define Macros for Possibly-Present Functions; Use Them Rather than Ifdef Guards 2023-05-04 12:18:58 -04:00
W. Felix Handte b12e8cb3e7 Merge Ultra and Ultra2 Exclusion 
Ultra2 does not exist for dict compression, and so uses ultra. So ultra must
be present if ultra2 is.
 2023-05-04 12:18:58 -04:00
W. Felix Handte 6761e1c949 Tweak Ultra/Opt Guards 2023-05-04 12:18:58 -04:00
W. Felix Handte 16bbd7437c Avoid Ratio Regression Tests When Compressors are Excluded 2023-05-04 12:18:58 -04:00
W. Felix Handte 5a75956001 Adjust Strategy in CParams to Avoid Using Excluded Block Compressors 2023-05-04 12:18:58 -04:00
W. Felix Handte 50cdf84f58 Macro-Exclude Block Compressors from Declaration/Definition 2023-05-04 12:18:58 -04:00
W. Felix Handte 81b86a2024 NULL Out Block Compressor Table Entries When Excluded 
Don't check about excluding `ZSTD_fast`. It's always included so that we know
we can resolve downwards and hit a strategy that's present.
 2023-05-04 12:18:58 -04:00
W. Felix Handte cbf3e26316 Allow ZSTD_selectBlockCompressor() to Return NULL 
Return an error rather than segfaulting.
 2023-05-04 12:18:58 -04:00
Felix HandteandGitHub 7806d80338 Merge pull request #3634 from facebook/dependabot/github_actions/github/codeql-action-2.3.2 
Bump github/codeql-action from 2.3.0 to 2.3.2
 2023-05-01 08:06:07 -07:00
dependabot[bot]andGitHub 2a5076d264 Bump github/codeql-action from 2.3.0 to 2.3.2 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.3.0 to 2.3.2.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/github/codeql-action/compare/b2c19fb9a2a485599ccf4ed5d65527d94bc57226...f3feb00acb00f31a6f60280e6ace9ca31d91c76a)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-05-01 06:04:02 +00:00
Elliot GorokhovskyandGitHub 0525d1cec6 Merge pull request #3629 from facebook/dependabot/github_actions/github/codeql-action-2.3.0 
Bump github/codeql-action from 2.2.11 to 2.3.0
 2023-04-25 22:58:25 -04:00
dependabot[bot]andGitHub be489f78df Bump github/codeql-action from 2.2.11 to 2.3.0 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.2.11 to 2.3.0.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/github/codeql-action/compare/d186a2a36cc67bfa1b860e6170d37fb9634742c7...b2c19fb9a2a485599ccf4ed5d65527d94bc57226)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-04-24 06:03:24 +00:00
Yann ColletandGitHub e256e43274 Merge pull request #3624 from danlark1/patch-4 
Disable unused variable warning in msan configurations
 2023-04-20 10:46:20 -07:00
Daniel KuteninandGitHub 4c25ea329b Disable unused variable warning in msan configurations 2023-04-20 11:14:08 +01:00
Yann ColletandGitHub 189653a9c1 Merge pull request #3614 from mredig/darwin-fat 
add makefile entry to build fat binary on macos
 2023-04-19 15:06:36 -07:00
Yann ColletandGitHub 504c4a1f36 Merge pull request #3620 from facebook/errata_128k 
[doc] add decoder errata paragraph
 2023-04-19 11:31:16 -07:00
Yann Collet 0d6954b4cc added golden file for the new decompressor erratum 2023-04-19 00:24:35 -07:00
Nick TerrellandNick Terrell 61efb2a047 Add ZSTD_d_maxBlockSize parameter 
Reduces memory when blocks are guaranteed to be smaller than allowed by
the format. This is useful for streaming compression in conjunction with
ZSTD_c_maxBlockSize.

This PR saves 2 * (formatMaxBlockSize - paramMaxBlockSize) when streaming.
Once it is rebased on top of PR #3616 it will save
3 * (formatMaxBlockSize - paramMaxBlockSize).
 2023-04-17 22:06:44 -07:00
Yann ColletandGitHub ed313342f1 Merge pull request #3621 from facebook/remove_CIs 
removed travis & appveyor scripts
 2023-04-17 17:54:40 -07:00
Nick TerrellandNick Terrell 0abf2baef9 Reduce streaming decompression memory by 128KB 
The split literals buffer patch increased streaming decompression memory
by 64KB (shrunk lit buffer from 128KB to 64KB, and added 128KB). This
patch removes the added 128KB buffer, because it isn't necessary.

The buffer was there because the literals compression code didn't know
the true `blockSizeMax` of the frame, and always put split literals so
they ended 128KB - 32 from the beginning of the block. Instead, we can
pass down the true `blockSizeMax` and ensure that the split literals
end up at `blockSizeMax - 32` from the beginning of the block. We
already reserve a full `blockSizeMax` bytes in streaming mode, so we
won't be overwriting the extDict window.
 2023-04-17 16:31:02 -07:00
Yann Collet 05434fe9a5 removed travis & appveyor scripts 
we don't employ these CI systems anymore
 2023-04-17 15:50:31 -07:00
Yann Collet a29b6ed251 added decoder errata paragraph 
for compressed blocks of size exactly 128 KB
which used to be disallowed by the spec
but have become allowed in more recent version of the spec.

While this limitation is fixed in decoders v1.5.4+,
implementers should refrain from generating such block with their custom encoder
as they could be misclassified as corrupted by older decoder versions.
 2023-04-17 15:43:27 -07:00
Yann ColletandGitHub 7afe0b3bea Merge pull request #3619 from facebook/dependabot/github_actions/actions/checkout-3.5.2 
Bump actions/checkout from 3.5.0 to 3.5.2
 2023-04-16 23:50:36 -07:00
dependabot[bot]andGitHub 803e65f935 Bump actions/checkout from 3.5.0 to 3.5.2 
Bumps [actions/checkout](https://github.com/actions/checkout) from 3.5.0 to 3.5.2.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/8f4b7f84864484a7bf31766abe9204da3cbe65b3...8e5e7e5ab8b370d6c329ec480221332ada57f0ab)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-04-17 06:02:27 +00:00
Michael Redig 0a794163f4 add makefile entry to build fat binary on macos 2023-04-13 18:43:06 -05:00
Nick TerrellandNick Terrell e72e13ac6c [oss-fuzz] Fix simple_round_trip fuzzer with overlapping decompression 
When `ZSTD_c_maxBlockSize` is set, we weren't computing the
decompression margin correctly, leading to `dstSize_tooSmall` errors.
Fix that computation.

This is just a bug in the fuzzer, not a bug in the library itself.

Credit to OSS-Fuzz
 2023-04-13 10:14:29 -07:00
Felix HandteandGitHub 0f255ff4fa Merge pull request #3606 from facebook/dependabot/github_actions/github/codeql-action-2.2.11 
Bump github/codeql-action from 2.2.9 to 2.2.11
 2023-04-10 08:32:54 -07:00
Yann ColletandGitHub 632baf62e3 Merge pull request #3607 from facebook/dependabot/github_actions/cygwin/cygwin-install-action-4 
Bump cygwin/cygwin-install-action from 3 to 4
 2023-04-10 01:30:20 -07:00
dependabot[bot]andGitHub d9582a0cb8 Bump cygwin/cygwin-install-action from 3 to 4 
Bumps [cygwin/cygwin-install-action](https://github.com/cygwin/cygwin-install-action) from 3 to 4.
- [Release notes](https://github.com/cygwin/cygwin-install-action/releases)
- [Commits](https://github.com/cygwin/cygwin-install-action/compare/f5e0f048310c425e84bc789f493a828c6dc80a25...006ad0b0946ca6d0a3ea2d4437677fa767392401)

---
updated-dependencies:
- dependency-name: cygwin/cygwin-install-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-04-10 06:00:18 +00:00
dependabot[bot]andGitHub dc88f7b8a0 Bump github/codeql-action from 2.2.9 to 2.2.11 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.2.9 to 2.2.11.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/github/codeql-action/compare/04df1262e6247151b5ac09cd2c303ac36ad3f62b...d186a2a36cc67bfa1b860e6170d37fb9634742c7)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-04-10 06:00:15 +00:00
daniellerozenblitandGitHub c28031df8f Add new line + [no-] to mmap-dict help output (#3601) 2023-04-06 13:01:58 -04:00
Yann ColletandGitHub 19105bf710 Merge pull request #3600 from Kim-SSi/dev 
Add win32 to windows-artifacts.yml
 2023-04-05 09:27:11 -07:00
Kim a4fff8e0e8 Change to use strategy.matrix 2023-04-05 20:22:29 +12:00
Kim 520843d8ff Add win32 to windows-artifacts.yml 2023-04-05 18:35:58 +12:00
Yann ColletandGitHub c42ae69eb4 Merge pull request #3587 from facebook/dependabot/github_actions/github/codeql-action-2.2.9 
Bump github/codeql-action from 2.2.8 to 2.2.9
 2023-04-04 16:53:55 -07:00
Yann ColletandGitHub d8197ad88d Merge pull request #3588 from facebook/dependabot/github_actions/ossf/scorecard-action-2.1.3 
Bump ossf/scorecard-action from 2.1.2 to 2.1.3
 2023-04-04 16:53:28 -07:00
Yann ColletandGitHub d4871d5e6e Merge pull request #3593 from facebook/appvbadge 
removed Appveyor Badge
 2023-04-03 18:25:06 -07:00
Yann ColletandGitHub 838f96a955 Merge pull request #3592 from facebook/overRead_magicless 
fix potential over-reads
 2023-04-03 17:46:37 -07:00
Yann Collet 8eef3370a3 removed Appveyor Badge 
as we don't use Appveyor CI anymore.
 2023-04-03 17:40:39 -07:00
Yann Collet e4120c5513 fixing potential over-reads 
detected by @terrelln,
these issue could be triggered in specific scenarios
namely decompression of certain invalid magic-less frames,
or requested properties from certain invalid skippable frames.
 2023-04-03 16:52:32 -07:00
Felix HandteandGitHub 2b71b79f98 Merge pull request #3591 from felixhandte/win-rel-artifact-name 
Rename/Restructure Windows Release Artifact
 2023-04-03 13:46:17 -07:00
W. Felix Handte fcaa422897 Rename/Restructure Windows Release Artifact 
https://github.com/facebook/zstd/releases/tag/v1.5.0 describes the structure
we want to adhere to. This commit tries to accomplish that automatically, so
we can avoid manual fixups on future releases.
 2023-04-03 15:35:57 -04:00
Yann ColletandGitHub 130c2640d0 Merge pull request #3589 from facebook/fix3583 
fix #3583
 2023-04-03 10:58:49 -07:00
Yann Collet 2e29728797 fix #3583 
As reported by @georgmu,
the previous fix is undone by the later initialization.
Switch order, so that initialization is adjusted by special case.
 2023-04-03 09:45:11 -07:00
dependabot[bot]andGitHub da41d1d401 Bump ossf/scorecard-action from 2.1.2 to 2.1.3 
Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action) from 2.1.2 to 2.1.3.
- [Release notes](https://github.com/ossf/scorecard-action/releases)
- [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md)
- [Commits](https://github.com/ossf/scorecard-action/compare/e38b1902ae4f44df626f11ba0734b14fb91f8f86...80e868c13c90f172d68d1f4501dee99e2479f7af)

---
updated-dependencies:
- dependency-name: ossf/scorecard-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-04-03 06:00:58 +00:00
dependabot[bot]andGitHub 68a4a03453 Bump github/codeql-action from 2.2.8 to 2.2.9 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.2.8 to 2.2.9.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/github/codeql-action/compare/67a35a08586135a9573f4327e904ecbf517a882d...04df1262e6247151b5ac09cd2c303ac36ad3f62b)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-04-03 06:00:54 +00:00