ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,663 Commits 17 Branches 77 Tags
3cc227e90e446f1d195f62038ae50d3e9aeadab2
Commit Graph
7663 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Nick Terrell 3cc227e90e [ldm][mt] Fix loadedDictEnd 2020-05-19 15:55:03 -07:00
Nick TerrellandGitHub 0dcd3eec43 Merge pull request #2152 from terrelln/simple-rt-bound 
[fuzz] Expand the allowedExpansion
 2020-05-19 12:56:11 -07:00
Nick Terrell b82bf711fc [fuzz] Expand the allowedExpansion 2020-05-19 11:42:53 -07:00
Yann ColletandGitHub fdc56baa42 fix 22294 (#2151) 2020-05-18 21:05:10 -07:00
Nick TerrellandGitHub 9778f46014 Merge pull request #2150 from terrelln/ldm-dict-reset 
[ldm] Reset loadedDictEnd when the context is reset
 2020-05-18 18:33:01 -07:00
Nick Terrell 7b317b4876 [test] Test that the ldm dictionary gets invalidated on reset 2020-05-18 16:00:28 -07:00
Nick Terrell 87dbd6d4bf [test] Improve LDM forceMaxWindow test 2020-05-18 15:11:18 -07:00
Felix HandteandGitHub 8ca98badc2 Merge pull request #2148 from felixhandte/fix-2144 
Don't Use `[[` in Shell Scripts
 2020-05-18 15:47:17 -04:00
Nick Terrell b2092c6dc4 [ldm] Reset loadedDictEnd when the context is reset 2020-05-18 12:35:44 -07:00
W. Felix Handte d37fcf36eb Don't Use [[ in Shell Scripts 2020-05-18 15:06:56 -04:00
Felix HandteandGitHub e804567d75 Merge pull request #2146 from cwoffenden/combine-script-fixes 
Reduced single file lib size on macOS
 2020-05-18 11:53:28 -04:00
Carl Woffenden 1a8767cbda Minor tidy 2020-05-18 12:33:44 +02:00
Carl Woffenden c6b03fa69c Reduced generated sized on macOS (and other envs where realpath is missing) 
Added Python fallback for when realpath fails.
 2020-05-18 10:12:02 +02:00
Yann Collet 18082ce85a updated CHANGELOG for v1.4.5 2020-05-15 17:19:00 -07:00
Bimba ShresthaandGitHub 255e5e3f56 [fuzz] Adding dictionary_stream_round_trip fuzzer (#2140) 
* Adding dictionary_stream_round_trip

* fixing memory leak
 2020-05-15 13:33:31 -07:00
Yann ColletandGitHub cb74ef3667 Merge pull request #2141 from terrelln/regression 
[test][regression] Update results.csv
 2020-05-14 17:44:58 -07:00
Nick Terrell 608075abb2 [test][regression] Update results.csv 2020-05-14 17:06:39 -07:00
Yann Collet f22b371e31 updated documentation for v1.4.5 
API manual and man pages
 2020-05-14 16:17:03 -07:00
Nick TerrellandGitHub 9ff4991d73 Merge pull request #2138 from terrelln/ldm-fix 
[lib] Fix bug in loading LDM dictionary in MT mode
 2020-05-14 13:32:00 -07:00
Nick Terrell bf0591e1e2 [test] Expose the LDM+MT+dict bug in a unit test 2020-05-14 12:06:55 -07:00
Nick Terrell add7ed2d4a [lib] Fix bug in loading LDM dictionary in MT mode 
Exposed when loading a dictionary < LDM minMatch bytes in MT mode.

Test Plan:
```
CC=clang make -j zstreamtest MOREFLAGS="-O0 -fsanitize=address"
./zstreamtest -vv -i100000000 -t1 --newapi -s7065 -t3925297
```

TODO: Add an explicit test that loads a small dictionary in MT mode
 2020-05-14 11:52:28 -07:00
Bimba ShresthaandGitHub 0208eeccd6 Merge pull request #2135 from bimbashrestha/grep 
Revert to old zstdgrep because of potential license issue
 2020-05-13 16:08:59 -05:00
Bimba Shrestha 12071467d3 reverting docs and test 2020-05-13 15:22:07 -05:00
Bimba Shrestha 9b13077cfb Revert to old zstdgrep 2020-05-13 15:12:14 -05:00
Yann ColletandGitHub ad34d58218 Merge pull request #2134 from terrelln/align-lazy 
[greedy] Fix performance instability
 2020-05-12 20:49:10 -07:00
Nick Terrell 70c80e19e6 [greedy] Fix performance instability 2020-05-12 17:51:16 -07:00
Nick TerrellandGitHub c3e921c639 Merge pull request #2131 from terrelln/raw-dict-fuzzer 
Fix rare scenario with lazy parser, dictionary, and repcodes
 2020-05-12 17:44:31 -07:00
Nick Terrell f800e72a3c [lib] Fix assertion when dictionary is prefix 2020-05-12 14:33:59 -07:00
Yann ColletandGitHub 5dca17db1f Merge pull request #2132 from bimbashrestha/grep-rm-test 
[build] removing -f test (grep usage not supported on mac)
 2020-05-12 13:49:38 -07:00
Yann ColletandGitHub f5f0bb2591 Merge pull request #2125 from Artoria2e5/patch-2 
programs/Makefile: make it actually work with clang
 2020-05-12 13:48:23 -07:00
Bimba Shrestha 0453cfa8f5 removing -f test (grep usage not supported on mac) 2020-05-12 15:18:43 -05:00
Nick Terrell 3c1eba4d99 [lib] Fix lazy repcode validity checks 2020-05-12 12:25:06 -07:00
Yann ColletandGitHub d6225775be Merge pull request #2130 from facebook/initStatic_fix 
Fix for initStatic
 2020-05-12 12:03:22 -07:00
Nick Terrell 4e0515916d [lib] Fix repcode validation in no dict mode 2020-05-12 11:57:15 -07:00
Nick Terrell 6d687a8816 [lib] Fix dictionary + repcodes + optimal parser 2020-05-12 10:36:53 -07:00
Nick Terrell 4b88bd3ee0 [lib][fuzz] Assert sequences are valid in round trip tests 2020-05-11 20:38:49 -07:00
Yann Collet e001715b3d fixed asan test 2020-05-11 20:35:47 -07:00
Yann Collet 20bd246045 blindfix for VS macro redefinition 2020-05-11 19:29:36 -07:00
Yann Collet 76e726e3be updated documentation for ZSTD_estimate*() 
make it clearer that tighter memory estimation
can be provided using advanced functions
on the condition of a defined input size bound.
 2020-05-11 19:21:50 -07:00
Nick Terrell 80d3585e31 [lib] Fix lazy parser with dictionary + repcodes 2020-05-11 19:04:30 -07:00
Nick Terrell 1185dfb8d1 [fuzz] Add raw dictionary content fuzzer 2020-05-11 19:03:33 -07:00
Nick Terrell 301a62fe08 [fuzz] Fix compress bound for dictionary_round_trip 2020-05-11 19:00:52 -07:00
Bimba ShresthaandGitHub e7d2391e9a [doc] measuring performance docs (#2117) 
* performance measuring docs

* spelling

* combining advanced and simple section

* zstd benchmark title change
 2020-05-11 18:55:01 -07:00
Yann ColletandGitHub ed9eb17471 Merge pull request #2124 from facebook/initStatic_tests 
re-inforced tests for initStaticCCtx
 2020-05-11 18:54:22 -07:00
Yann ColletandGitHub f13eb2ec01 Merge pull request #2123 from facebook/zstd_help 
updated `zstd -h`
 2020-05-11 18:54:07 -07:00
Yann Collet 91ad01218e updated initStatic tests 
differentiate small CCtx for small inputs
from full CCtx
from CStream contexts.

Ensure allocation & resize tests are more precise.
 2020-05-11 18:50:10 -07:00
Yann Collet 608f1bfc4c fixed context downsize with initStatic 
When context is created using initStatic,
no resize is possible.

fix : only bump oversizeDuration when !initStatic
 2020-05-11 18:16:38 -07:00
Yann Collet 58227db405 Merge branch 'dev' into initStatic_tests 2020-05-11 16:51:13 -07:00
Yann ColletandGitHub d8b40fe0be Merge pull request #2129 from felixhandte/fix-cctx-size-estimate 
Fix ZSTD_estimateCCtxSize() Under ASAN
 2020-05-11 16:36:46 -07:00
W. Felix Handte c6636afbbb Fix ZSTD_estimateCCtxSize() Under ASAN 
`ZSTD_estimateCCtxSize()` provides estimates for one-shot compression, which
is guaranteed not to buffer inputs or outputs. So it ignores the sizes of the
buffers, assuming they'll be zero. However, the actual workspace allocation
logic always allocates those buffers, and when running under ASAN, the
workspace surrounds every allocation with 256 bytes of redzone. So the 0-sized
buffers end up consuming 512 bytes of space, which is accounted for in the
actual allocation path through the use of `ZSTD_cwksp_alloc_size()` but isn't
in the estimation path, since it ignores the buffers entirely.

This commit fixes this.
 2020-05-11 18:58:19 -04:00