Sen Huang
6beb3c0159
added decompression support
2019-09-05 17:56:24 -07:00
Sen Huang
7f98b46876
adding support for -O flag: multiple files into one directory for compressions (decompression to come)
2019-09-05 16:03:35 -07:00
and Varun S Nair
9816560649
Fixing assert and DEBUGLOG due to ZSTD_CCtx_params parameter change to const pointer
2019-09-05 15:47:17 +05:30
and Varun S Nair
771645471f
Passing ZSTD_CCtx_params by const pointer
2019-09-05 15:28:30 +05:30
Yann Collet and GitHub
b8327ac4c6
Merge pull request #1770 from cwoffenden/amalgamate-correctness
...
Single file decoder correctness and tidy
2019-09-04 14:51:23 -07:00
Mike Swanson
25878b2de9
[programs] don’t do chmod when coming from stdin or multiple files
...
Fixes #1729
2019-09-02 18:02:32 -07:00
Carl Woffenden
88975e8c25
Minor: documented sizes smaller
2019-09-02 18:15:31 +02:00
Carl Woffenden
8ac29cc825
Correctness and tidy
...
Test compilation performed with warnings. Author and license added. Test for failing grep on ancient OSX versions. Replaced the test image with something less noisy (which compresses better).
2019-09-02 18:02:50 +02:00
Yann Collet and GitHub
b199bb3e0a
Merge pull request #1769 from cybojanek/update_streaming_examples
...
Fix streaming compression/decompression examples
2019-09-01 18:11:54 -07:00
Jan Kasiak
a8219903cf
Fix streaming compression/decompression examples
...
* Handle compression of empty file
* Error in decompression in case of trailing data
2019-09-01 17:22:42 -04:00
Yann Collet and GitHub
c9381c16be
Merge pull request #1761 from terrelln/regression
...
[regression] small improvement from RLE blocks
2019-08-30 10:48:02 -07:00
Bimba Shrestha
5f8b0f6890
Changing api to get sequences across all blocks
2019-08-30 09:18:44 -07:00
Nick Terrell
8ce9c1917e
[regression] small improvement from RLE blocks
2019-08-29 18:05:58 -07:00
Yann Collet and GitHub
5198347382
Merge pull request #1744 from bimbashrestha/dev
...
Generate RLE blocks in the encoder
2019-08-29 15:19:10 -07:00
Bimba Shrestha
623b90f85d
Fixing ci-circle test complaints
2019-08-29 13:09:42 -07:00
mgrice
5d89771529
fix warning: always_inline function might not be inlinable
2019-08-29 12:32:15 -07:00
Bimba Shrestha
ece465644b
Adding api for extracting sequences from seqstore
2019-08-29 12:29:39 -07:00
mgrice
b830599582
Improvements in zstd decode performance
...
Summary: The idea behind wildcopy is that it can be cheaper to copy more bytes (say 8) than it is to copy less (say, 3). This change takes that further by exploiting some properties:
1. it's almost always OK to copy 16 bytes instead of 8, which means fewer copy instructions, and fewer branches
2. A 16 byte chunk size means that ~90% of wildcopy invocations will have a trip count of 1, so branch prediction will be improved.
Speedup on Xeon E5-2680v4 is in the range of 3-5%.
Measured wildcopy length distributions on silesia.tar:
level <=8 <=16 <=24 >24
1 78.05% 11.49% 3.52% 6.94%
3 82.14% 8.99% 2.44% 6.43%
6 85.81% 6.51% 2.92% 4.76%
8 83.02% 7.31% 3.64% 6.03%
10 84.13% 6.67% 3.29% 5.91%
15 77.58% 7.55% 5.21% 9.66%
16 80.07% 7.20% 3.98% 8.75%
Test Plan: benchmark silesia, make check
2019-08-29 12:25:56 -07:00
Yann Collet and GitHub
d944197e79
Merge pull request #1754 from facebook/decTest
...
Tests for single-file decompressor
2019-08-29 12:09:09 -07:00
Bimba Shrestha
c3e3c8bf32
Undoing the last commit (that was an accident)
2019-08-29 12:05:47 -07:00
bimbashrestha
4a1ca5e0a8
Adding method for extracting sequences.
2019-08-29 11:55:12 -07:00
Yann Collet
64102f08da
Merge branch 'dev' into decTest
2019-08-29 09:48:12 -07:00
Yann Collet and GitHub
ccb7c8e903
Merge pull request #1755 from cwoffenden/amalgamate-c99-fixes
...
C99 and older GCC fixes
2019-08-29 09:47:28 -07:00
Carl Woffenden
72e51ac246
C99 and older GCC fixes
2019-08-29 11:16:57 +02:00
Yann Collet
e7ad20c9dc
update test script
2019-08-28 13:46:18 -07:00
Yann Collet
4b3a8fe1c4
fix create_ script for sh
2019-08-28 13:23:48 -07:00
Yann Collet and GitHub
9589e8e4bb
Merge pull request #1749 from facebook/rmadapt
...
removed adaptive-compression
2019-08-28 12:26:29 -07:00
Yann Collet
8af941d2d7
Merge branch 'dev' into decTest
2019-08-28 12:17:29 -07:00
Yann Collet and GitHub
979ddc1271
Merge pull request #1750 from cwoffenden/amalgamate-bash2sh
...
Rewrote the scripts to use sh instead of bash
2019-08-28 12:14:29 -07:00
Carl Woffenden
cdf73e915e
Rewrote the scripts to sh instead of bash
2019-08-28 19:20:42 +02:00
bimbashrestha
e5704bbfdf
Added test for multiple blocks of zeros and fixed nit about comments
2019-08-28 08:32:34 -07:00
Yann Collet
416157df80
try to debug issues on CirrusCI
2019-08-27 16:38:21 -07:00
Yann Collet
cd43f7d965
added single_file_decoder to contrib/ tests
2019-08-27 16:04:12 -07:00
Yann Collet
f61e8a231f
minor script renaming, for clarity
2019-08-27 16:01:39 -07:00
Yann Collet
517aeb89dc
changed contrib project name for clarity
2019-08-27 15:50:47 -07:00
Yann Collet
b12a5b9117
removed associated test
2019-08-27 14:52:16 -07:00
Yann Collet
5ed1b1e11d
removed adaptive-compression
...
the functionality is already integrated into `zstd` through `--adapt` command
2019-08-27 14:47:40 -07:00
Nick Terrell and GitHub
e9c0fc12d2
Merge pull request #1748 from terrelln/cover-deadlock
...
[dictBuilder] Fix deadlock in *COVER error case
2019-08-27 10:17:28 -07:00
Yann Collet and GitHub
a8391cc5a8
Merge pull request #1739 from cwoffenden/amalgamate
...
Tweaks to create a single-file decompressor
2019-08-27 10:05:26 -07:00
Carl Woffenden
51868964ef
Fixed test failure when Emscripten not present
2019-08-27 17:12:57 +02:00
Carl Woffenden
6213b7b3b4
Minor repetition
2019-08-27 16:57:23 +02:00
Carl Woffenden
59052d5fd8
Typo
2019-08-27 16:55:03 +02:00
Carl Woffenden
ec12721538
Added clarification
2019-08-27 15:53:26 +02:00
Carl Woffenden
6712a644fa
Added reasoning
2019-08-27 15:51:14 +02:00
Carl Woffenden
4f2a8b752a
Typo
2019-08-27 15:38:34 +02:00
Carl Woffenden
a57de4ac89
Added test script; tidied and documented
...
The test script combines the sources then builds and runs an example. A futher example is built if the Emscripten compiler is available on the system. Documentation covers building.
2019-08-27 15:36:06 +02:00
Nick Terrell
793c71d6ae
[test][dictBuilder] Add multithreaded tests
2019-08-26 18:32:08 -07:00
Nick Terrell
0932de54bc
[dictBuilder] Fix deadlock in *COVER error case
...
The COVER and FASTCOVER dictionary builders can deadlock when
dictionary construction errors, likely because there are too few
samples, or too few distinct dmers. The deadlock only occurs when
there are errors.
Fixes #1746 .
2019-08-26 18:19:29 -07:00
bimbashrestha
96201d9774
Added bool to cctx and fixed some comment nits
2019-08-26 15:30:41 -07:00
bimbashrestha
991cbc9024
Fixing mixed declaration compiler complaint
2019-08-26 15:00:50 -07:00
Sen Huang