ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
6,299 Commits 17 Branches 77 Tags
e1a799e5de563fe6e0739f0694ee8c0079b9fbdd
Commit Graph
35 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Nick TerrellandGitHub 32a98bafdc Merge pull request #1521 from bket/lstat 
Detection of symbolic links on OpenBSD
 2019-02-11 20:38:49 -05:00
Nick TerrellandGitHub a17369c7dc Merge pull request #1518 from bket/non-portable 
'head -c BYTES' is non portable
 2019-02-11 15:43:03 -05:00
Nick TerrellandGitHub 197a5737c8 Merge pull request #1516 from terrelln/dict-doc 
[zdict] Improve documentation
 2019-02-01 19:04:05 -05:00
Nick TerrellandGitHub 5c1148a6a5 Merge pull request #1515 from thatsafunnyname/patch-1 
-Wformat-security not needed with -Wformat=2
 2019-02-01 13:41:27 -05:00
Nick TerrellandGitHub fafa322456 Merge pull request #1511 from lwhsu/cirrus-ci 
Change Cirrus CI's badge to dev branch
 2019-01-30 16:53:13 -05:00
Nick TerrellandGitHub 79463a65e9 Merge pull request #1501 from lwhsu/cirrus-ci 
Add Cirrus-CI config and build status badge for testing on FreeBSD
 2019-01-30 14:15:02 -05:00
Nick TerrellandGitHub 87204a2afd Merge pull request #1467 from terrelln/regression 
[regression] Update results.csv
 2018-12-20 18:14:13 -08:00
Nick TerrellandGitHub 3a4634f2af Merge pull request #1459 from terrelln/destroy 
[zstdcli] Refuse to overwrite input file
 2018-12-18 17:03:54 -08:00
Nick TerrellandGitHub 7f6d11e1e2 Merge pull request #1450 from terrelln/no-progress 
[zstdcli] Add --no-progress flag
 2018-12-14 11:50:59 -08:00
Nick TerrellandGitHub 75fa3f2eb7 Merge pull request #1446 from terrelln/overflow 
[libzstd] Fix infinite loop in decompression
 2018-12-13 16:21:15 -08:00
Nick TerrellandGitHub 54ca4b3c5d Merge pull request #1445 from terrelln/regression 
[regression] add more methods
 2018-12-12 11:16:54 -08:00
Nick TerrellandGitHub c631fdec9f Merge pull request #1434 from terrelln/regression 
[regression] Add dictionary support
 2018-12-03 10:39:12 -08:00
Nick TerrellandGitHub 787532b91a Merge pull request #1418 from ryandesign/cpuid-i386 
Fix i386 build failure "Junk character 13"
 2018-11-16 11:01:46 -08:00
Nick TerrellandGitHub f15f1bfefb Merge pull request #1416 from terrelln/rsync 
- Factor out LDM's hash function for reuse
- Add rsyncable mode to zstdmt and expose it via the advanced API
- Fix `-B`/`--block-size` to actually set the job size
- Add rsyncable tests to `zstreamtest` and `playTests.sh`

Tested by:

```
> cat A.100MB B.100MB C.100MB D.100MB E.100MB | zstd --rsyncable -fo src/file.zst
/*stdin*\            : 48.22%   (524288000 => 252837782 bytes, src/file.zst)
> rsync -rc --stats src devbigvm:/data/users/terrelln/rsync-test
Total bytes sent: 252868779
total size is 252837782  speedup is 1.00
> echo test > test
> cat test A.100MB test B.100MB test C.100MB test D.100MB test E.100MB | zstd --rsyncable -fo src/file.zst
/*stdin*\            : 48.23%   (524288025 => 252838025 bytes, src/unicorn.tar.zst)
> rsync -rc --stats src devbigvm:/data/users/terrelln/rsync-test
Total bytes sent: 4605696
total size is 252838025  speedup is 53.60
```

Close #1155.
 2018-11-14 18:43:12 -08:00
Nick TerrellandGitHub ed39c0e04b Merge pull request #1382 from jonesz/ticket-compiler-rt-fuzzer 
Fix libFuzzer location in makefile.
 2018-10-22 10:48:56 -07:00
Nick TerrellandGitHub e06f91a169 Merge pull request #1343 from terrelln/faster-ci 
[zstreamtest] Reduce memory of newapi tests
 2018-09-27 19:29:02 -07:00
Nick TerrellandGitHub f884e9dd8e Merge pull request #1321 from bket/non-portable 
'head -c BYTES' is non-portable.
 2018-09-17 14:40:27 -07:00
Nick TerrellandGitHub 8f27e8cf3d Merge pull request #1322 from azat-archive/seekable-fixes-pull 
Fixes read write past end of input buffer.
 2018-09-17 11:04:51 -07:00
Nick TerrellandGitHub d492ef4e07 Merge pull request #1306 from jennifermliu/dev 
Change default f of FASTCOVER to 20
 2018-09-04 18:03:36 -07:00
Nick TerrellandGitHub 7a02df8dbe Merge pull request #1302 from jennifermliu/splitpoint 
Always use splitPoint=1.0 for non-optimize cover and fastcover and some minor changes on comments
 2018-09-04 16:59:41 -07:00
Nick TerrellandGitHub 1420129fda Merge pull request #1258 from jennifermliu/fastCover 
Use CDict instead of CCtx in analyzeEntropy
 2018-07-31 14:31:05 -07:00
Nick TerrellandGitHub fc685d6b94 Merge pull request #1257 from jennifermliu/fastCover 
Increment frequency for every dmer occurence within same sample
 2018-07-30 16:03:18 -07:00
Nick TerrellandGitHub 92633789f6 Merge pull request #1254 from jennifermliu/fastCover 
Save segmentFreqs in ctx instead of malloc and memset in SelectSegment
 2018-07-27 18:22:52 -07:00
Nick TerrellandGitHub 3abfbee215 Merge pull request #1250 from jennifermliu/fastCover 
Add Fast Cover Dictionary Builder
 2018-07-27 15:11:57 -07:00
Nick TerrellandGitHub 7974628587 Merge pull request #1252 from GeorgeLu97/bench-quiet-display-fix 
Fixes bug
 2018-07-26 16:12:15 -07:00
Nick TerrellandGitHub 77068a8447 Merge pull request #1246 from jennifermliu/benchmark 
Benchmark dictionary builders
 2018-07-20 18:09:31 -07:00
Nick TerrellandGitHub 2e47865d7d Merge pull request #1245 from terrelln/disable-arm 
Revert "attempt to re-enable arm64 tests"
 2018-07-19 15:32:53 -07:00
Nick TerrellandGitHub 4d1ad5cdb2 Merge pull request #1238 from jennifermliu/random 
Add random dictionary builder
 2018-07-19 13:52:15 -07:00
Nick TerrellandGitHub 45821fac0c Merge pull request #1225 from jennifermliu/dev 
Split samples when building dictionary for COVER
 2018-07-13 13:26:15 -07:00
Nick TerrellandGitHub aa2415402d Merge pull request #1235 from ldv-alt/dev 
tests: use /dev/zero instead of /dev/random on all systems except GNU/Hurd
 2018-07-12 16:56:54 -07:00
Nick TerrellandGitHub b426bcc097 [zstdmt] Fix jobsize bugs (#1205) 
[zstdmt] Fix jobsize bugs

* `ZSTDMT_serialState_reset()` should use `targetSectionSize`, not `jobSize` when sizing the seqstore.
  Add an assert that checks that we sized the seqstore using the right job size.
* `ZSTDMT_compressionJob()` should check if `rawSeqStore.seq == NULL`.
* `ZSTDMT_initCStream_internal()` should not adjust `mtctx->params.jobSize` (clamping to MIN/MAX is okay).
 2018-06-25 15:21:08 -07:00
Nick TerrellandGitHub 06b70179da Work around bug in zstd decoder (#1147) 
Work around bug in zstd decoder

Pull request #1144 exercised a new path in the zstd decoder that proved to
be buggy. Avoid the extremely rare bug by emitting an uncompressed block.
 2018-05-23 18:02:30 -07:00
Nick TerrellandGitHub 3c3f59e68f Enforce pledgeSrcSize whenever known (#1106) 
The test fails before the patch and passes after.

Fixes #1095.
 2018-04-12 16:02:03 -07:00
Nick TerrellandGitHub aa4dbd09a1 Pull job/overlap log logic into common function (#1055) 
Prepares for LDM integration by separating the job size and overlap logic
into helper functions.
 2018-03-19 15:56:36 -07:00
Nick TerrellandGitHub 90d38f6a53 Merge pull request #945 from terrelln/dev 
Fix cdict compressor repcodes
 2017-12-13 14:24:21 -08:00