ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,532 Commits 17 Branches 77 Tags
0adfc8dfcef352e098446c59a14950bdf9b2028d
Commit Graph
7532 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Bimba ShresthaandGitHub 075783c1f0 Merge pull request #1980 from bimbashrestha/params 
Adding --show-default-cparams to cli
 2020-02-03 14:43:55 -08:00
Bimba ShresthaandGitHub f1de05f348 Merge pull request #1981 from bimbashrestha/bug-fix 
Benchzstd multiple file decompression enable
 2020-02-03 14:40:26 -08:00
Bimba Shrestha d1389ac3ff Adding assert(NB_STRATEGIES == upperLimit) 2020-02-03 09:52:39 -08:00
Bimba Shrestha 80c26117a9 Line-wrapping 2020-02-03 09:38:16 -08:00
Bimba Shrestha ee8a712af3 Using appliedParams instead of supplied params 2020-01-31 15:49:07 -08:00
Bimba Shrestha f33baa21c6 Removing assert and changing ratio cSize 2020-01-31 11:54:14 -08:00
Bimba Shrestha 19473390d1 Adding (void)ZSTD_strategyMap 2020-01-31 10:54:02 -08:00
Bimba Shrestha 38d010eea0 Adding static assert and using it in cli 2020-01-31 10:47:17 -08:00
Bimba Shrestha 0fa6c90e89 Moving to same category as -v 2020-01-31 10:38:19 -08:00
Bimba Shrestha f4ae6c0b94 Moving documentation and elaborating 2020-01-30 17:54:42 -08:00
Bimba Shrestha 9d9cfa9ef9 Adding assert and using ZSTD_STRATEGY_MAX as ZSTD_NB_STRATEGIES 2020-01-30 17:54:01 -08:00
Bimba Shrestha 6ad2f0d7d6 Adding back one cast and using UTIL_FILESIZE_UNKNOWN to check unknown file size 2020-01-30 17:16:02 -08:00
Bimba Shrestha 6bf05a53ab Documenting in the man file 2020-01-30 17:11:38 -08:00
Bimba Shrestha c203341292 Removing more casts 2020-01-30 17:07:58 -08:00
Bimba Shrestha 2a0771cfdb Removing unnecessary cast 2020-01-30 17:05:33 -08:00
Bimba Shrestha b0ceab4dc0 Moving default cparams back, checking for unknown file size, using getCParams() 2020-01-30 16:52:07 -08:00
Bimba Shrestha b660ef87f8 Convertion nit U32 -> size_t 2020-01-30 14:29:04 -08:00
Bimba Shrestha 71754a26f8 Update comment 2020-01-30 14:14:27 -08:00
Bimba Shrestha 2f10019b92 Adding --show-default-cparams (show cparams before compressing 2020-01-30 14:12:03 -08:00
Nick TerrellandGitHub 6a426ef65e Merge pull request #1977 from terrelln/copyless 
Improve wildcopy performance across the board
 2020-01-29 15:32:19 -08:00
Bimba ShresthaandGitHub 3b10060b71 Merge pull request #1978 from bimbashrestha/quick 
[Typo][fix] make benchmarking typo fix
 2020-01-28 22:11:51 -08:00
Bimba Shrestha 9b049836c9 Typo baseline_build -> baseline_label 2020-01-28 21:39:20 -08:00
Nick Terrell e32e3e8662 Improve wildcopy performance across the board 2020-01-28 20:37:04 -08:00
Bimba ShresthaandYann Collet 8fe562a770 [automated_benchmarking] Make arguments optional and add --dict argument (#1968) 
* Make arugments optional and add --dict argument

* Removing accidental print statement

* Change to more likely scenario for dictionary compression benchmark
 2020-01-28 11:29:43 -08:00
Yann ColletandGitHub 9a71d07aa4 added ability to remove error messages and dictionary support (#1975) 
for the benefit of smaller binary.
 2020-01-27 11:39:29 -08:00
Yann ColletandGitHub 5bcd6448b6 refactor of harness, for clarity (#1974) 
following #1953 (false positive, due to heuristic confusion)
 2020-01-24 20:16:28 -08:00
Yann Collet 5c769e33f8 Merge branch 'dev' of github.com:facebook/zstd into dev 2020-01-24 15:04:02 -08:00
Yann Collet f34eab162f updated CHANGELOG 2020-01-24 14:12:25 -08:00
Nick TerrellandGitHub 7627759b4e Merge pull request #1972 from terrelln/check-cont 
Move ZSTD_checkContinuity() to zstd_decompress_block.c
 2020-01-23 22:02:50 -08:00
Nick TerrellandGitHub e6d3a61db8 Merge pull request #1973 from terrelln/mobile-perf 
Fix performance regression on aarch64 with clang
 2020-01-23 22:02:32 -08:00
Nick Terrell fa6a772f38 Initialize dctx->bType to silence valgrind false positive 2020-01-23 17:54:48 -08:00
Nick Terrell cb2abc3dbe Fix performance regression on aarch64 with clang 2020-01-23 17:31:14 -08:00
Nick Terrell 6e3cd5b024 Move ZSTD_checkContinuity() to zstd_decompress_block.c 2020-01-23 12:27:39 -08:00
Nick TerrellandGitHub 2f31050a3f Merge pull request #1965 from terrelln/android-fix 
Fix timefn on android
 2020-01-22 15:42:50 -08:00
Nick Terrell 7ec87cfb28 Update comment in timefn 2020-01-22 11:17:30 -08:00
Nick Terrell 768adc0774 Fix timefn on android 2020-01-21 18:57:16 -08:00
Felix HandteandGitHub 3a9a079ed1 Merge pull request #1956 from PhoebeHui/dev 
Add vcpkg installation instructions
 2020-01-21 11:54:00 -05:00
PhoebeHui 7738709020 Update comments 2020-01-19 23:51:40 -08:00
Nick TerrellandGitHub db9c8af600 Merge pull request #1957 from terrelln/fix-ultra 
Fix lowLimit underflow in overflow correction
 2020-01-17 18:01:35 -08:00
Nick TerrellandGitHub 76e01f3555 Merge pull request #1958 from terrelln/docs 
Add --single-thread to zstd --help
 2020-01-17 14:46:00 -08:00
Nick Terrell 009f388457 Fix playTests.sh for 32-bit mode 2020-01-17 14:20:44 -08:00
Nick Terrell fa48af545f Add --single-thread to zstd --help 2020-01-17 13:54:49 -08:00
Nick Terrell a11a9271d6 Fix lowLimit underflow in overflow correction 2020-01-17 12:10:18 -08:00
PhoebeHui 3e8222be58 Add vcpkg installation instructions 2020-01-17 03:31:08 -08:00
Nick TerrellandGitHub 957d59c721 Merge pull request #1950 from terrelln/ctest 
[cmake] Add playTests.sh as a test
 2020-01-13 16:16:25 -08:00
Nick Terrell f6d00c059f [util] Fix readLineFromFile on Cygwin 2020-01-13 14:37:22 -08:00
Nick TerrellandNick Terrell 3ed0f65158 [cmake] Add playTests.sh as a test 2020-01-13 14:16:15 -08:00
Nick TerrellandGitHub f27b4b4ec5 Merge pull request #1948 from lazka/cygwin-fix-c99-build 
Fix the c99/cmake build under Cygwin/MSYS2
 2020-01-13 11:35:28 -08:00
Christoph Reiter 9a5d8a6cb4 appveyor: build with CMake under Cygwin 2020-01-11 11:37:22 +01:00
Nick TerrellandGitHub 036b30b555 Fix super block compression and stream raw blocks in decompression (#1947) 
Super blocks must never violate the zstd block bound of input_size + ZSTD_blockHeaderSize. The individual sub-blocks may, but not the super block. If the superblock violates the block bound we are liable to violate ZSTD_compressBound(), which we must not do. Whenever the super block violates the block bound we instead emit an uncompressed block.

This means we increase the latency because of the single uncompressed block. I fix this by enabling streaming an uncompressed block, so the latency of an uncompressed block is 1 byte. This doesn't reduce the latency of the buffer-less API, but I don't think we really care.

* I added a test case that verifies that the decompression has 1 byte latency.
* I rely on existing zstreamtest / fuzzer / libfuzzer regression tests for correctness. During development I had several correctness bugs, and they easily caught them.
* The added assert that the superblock doesn't violate the block bound will help us discover any missed conditions (though I think I got them all).

Credit to OSS-Fuzz.
 2020-01-10 18:02:11 -08:00