This website requires JavaScript.
273c17b350
Experiment with 64-bit hash and checksum
Stella Lau
2017-07-20 16:50:06 -07:00
483d936b87
reduced competition for completion mutex by separating mutex use based on which values is updated
Paul Cruz
2017-07-23 14:09:16 -07:00
880f08d104
change how completion is measured in compression thread
Paul Cruz
2017-07-23 10:18:54 -07:00
08d9e42ec6
removed useless measurements
Paul Cruz
2017-07-21 18:02:55 -07:00
95bef759b3
switched over to model where reading only waits on compression thread
Paul Cruz
2017-07-21 17:49:39 -07:00
6455ec482c
taking the maximum of the completion level reads in order to determine which one was waiting more
Paul Cruz
2017-07-21 16:05:01 -07:00
05fe8dd47c
updating debug statements
Paul Cruz
2017-07-21 14:06:24 -07:00
db109f8fef
measure multiple completion levels during each wait
Paul Cruz
2017-07-21 13:38:24 -07:00
b72808a49b
changed zstream test time
Yann Collet
2017-07-21 11:45:42 -07:00
ceda7a9a58
minor Makefile refactor
Yann Collet
2017-07-21 11:44:39 -07:00
721c6a8b97
added bounding to compression level change
Paul Cruz
2017-07-21 09:30:24 -07:00
e929d3b787
added priority decision making for adapt compression level
Paul Cruz
2017-07-21 09:26:35 -07:00
9259c7afa4
semi working version that stabilizes
Paul Cruz
2017-07-20 18:45:33 -07:00
38ba7002f2
fixed minor warning on unused variable in shell function
Yann Collet
2017-07-20 18:39:04 -07:00
82e488770c
fixed bug where writeSize could be zero
Paul Cruz
2017-07-20 16:38:02 -07:00
a19916425d
reworked adaptCompressionLevel to only account for completion information
Paul Cruz
2017-07-20 16:19:16 -07:00
a90b16e150
Visual blind fix 2
Yann Collet
2017-07-20 15:57:55 -07:00
4542d7118c
Merge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet
2017-07-20 15:12:21 -07:00
5e6c5203f3
fixed fuzzer test for non OS-X platforms
Yann Collet
2017-07-20 15:11:56 -07:00
57251f52cf
Merge pull request #773 from terrelln/lk-v3
Yann Collet and GitHub
2017-07-20 14:47:26 -07:00
7d3ac0710d
[linux] Update patches for v3
Nick Terrell
2017-07-20 13:33:55 -07:00
7ab758a640
changed how completion is actually sampled
Paul Cruz
2017-07-20 10:53:51 -07:00
b4d460f32c
pool.c : blindfix for Visual warnings
Yann Collet
2017-07-20 01:13:14 -07:00
13a01ffb27
Fix off-by-one in size calculations
Stella Lau
2017-07-19 17:24:09 -07:00
2427a154cb
Minor refactoring
Stella Lau
2017-07-19 16:56:28 -07:00
dcf609f835
make adaptCompressionLevel oscillate less
Paul Cruz
2017-07-19 16:36:33 -07:00
1ca1288689
added --memtest=# command to fuzzer
Yann Collet
2017-07-19 16:01:16 -07:00
2a22c7915e
call ZSTD_compressBegin() once
Paul Cruz
2017-07-19 16:00:54 -07:00
6767abe652
fixing error when file size is multiple of job size (in which case, the srcSize of the last job is 0)
Paul Cruz
2017-07-19 14:54:15 -07:00
030264ca51
Experiment with integrating ZSTD_count with findBestMatch
Stella Lau
2017-07-19 14:14:26 -07:00
3974d2b38a
blind fix for Windows Multithreading module
Yann Collet
2017-07-19 13:33:21 -07:00
42382c1216
added some debug statements, adjusted end condition
Paul Cruz
2017-07-19 13:30:07 -07:00
6945b3c43d
removed previous version of completion for compression
Paul Cruz
2017-07-19 11:51:50 -07:00
5a85c57e30
set up new calculations compression completion progress
Paul Cruz
2017-07-19 11:47:17 -07:00
f1ac518b59
split compression into smaller blocks
Paul Cruz
2017-07-19 11:23:40 -07:00
338951cd48
moved compression adapt to avoid warning
Paul Cruz
2017-07-19 10:23:46 -07:00
4497ecf297
change compression level only right before actually performing compression. When waiting, only update waiting statistics.
Paul Cruz
2017-07-19 10:14:00 -07:00
e11bf55d0b
added mechanism for measuring how much of a job has been created
Paul Cruz
2017-07-19 10:10:47 -07:00
559ea4ff25
split up read process into smaller chunks
Paul Cruz
2017-07-19 09:59:17 -07:00
6119cd2164
added additional print for help menu
Paul Cruz
2017-07-19 09:43:17 -07:00
b71363b967
check pthread_*_init() success condition
Yann Collet
2017-07-19 01:05:40 -07:00
4352e09cb0
Avoid recounting match lengths with ZSTD_count
Stella Lau
2017-07-18 18:35:25 -07:00
1fa223859f
Switch to using ZSTD_count instead of function pointer
Stella Lau
2017-07-18 18:05:10 -07:00
3d7f1afadd
changed createCCtx() to split into initialization and creation
Paul Cruz
2017-07-18 17:32:36 -07:00
2c4e4ddc50
added mutex for stats struct
Paul Cruz
2017-07-18 15:55:58 -07:00
44b0838253
Merge pull request #770 from terrelln/test-mode
Yann Collet and GitHub
2017-07-18 15:40:59 -07:00
ad66faf16a
added progress check for filewriting, put important shared data behind mutex when being read from/written to
Paul Cruz
2017-07-18 15:23:11 -07:00
2aba13b770
Merge pull request #769 from terrelln/real-block-split
Yann Collet and GitHub
2017-07-18 14:58:26 -07:00
d0b27483ae
[zstdcli] Fix -t in streaming mode
Nick Terrell
2017-07-18 14:45:49 -07:00
19258f51c1
Make the meaning of LDM_MEMORY_USAGE consistent across tables
Stella Lau
2017-07-18 14:25:39 -07:00
a34bc30237
setting up basic readme
Paul Cruz
2017-07-18 13:31:02 -07:00
29c36cf051
rename completion variable, split up fwrite operations in order to track progress
Paul Cruz
2017-07-18 13:30:29 -07:00
cc1522351f
[libzstd] Fix bug in Huffman encoding
Nick Terrell
2017-07-18 11:21:19 -07:00
ae47eab2fd
changed test cases to use -s setting on the diffs
Paul Cruz
2017-07-18 12:58:50 -07:00
77d67fb167
Merge pull request #766 from terrelln/real-block-split
Yann Collet and GitHub
2017-07-18 08:26:24 -07:00
14c83b05c7
Merge pull request #765 from terrelln/real-block-split
Yann Collet and GitHub
2017-07-17 19:25:55 -07:00
fc41a87964
Experiment with using a lag when hashing
Stella Lau
2017-07-17 18:13:09 -07:00
5af04c57b0
change parameters for compression level adapt
Paul Cruz
2017-07-17 17:59:50 -07:00
b3c9e02bb6
added signal to other threads whenever error occurs
Paul Cruz
2017-07-17 15:34:58 -07:00
7a28b9e4a3
[libzstd] Pull optimal parser state out of seqStore_t
Nick Terrell
2017-07-17 15:29:11 -07:00
a00e406231
Remove version archive
Stella Lau
2017-07-17 15:17:32 -07:00
15a041adbf
Add function to get valid entries only from table
Stella Lau
2017-07-17 15:16:58 -07:00
3381bf4b84
Merge pull request #764 from terrelln/real-block-split
Yann Collet and GitHub
2017-07-17 14:46:01 -07:00
6be22f1f84
swap buffers instead of copying memory over
Paul Cruz
2017-07-17 14:39:10 -07:00
708238e07e
open file outside of adaptCCtx, pass to the output thread
Paul Cruz
2017-07-17 14:01:13 -07:00
e198230645
[libzstd] Remove ZSTD_CCtx* argument of ZSTD_compressSequences()
Nick Terrell
2017-07-17 12:27:24 -07:00
4bb42b02c1
Add basic chaining table
Stella Lau
2017-07-17 11:53:54 -07:00
634f012420
[libzstd] Refactor ZSTD_compressSequences()
Nick Terrell
2017-07-14 19:11:58 -07:00
044e40db5a
removed freeCCtx() calls from createCCtx() so that it is not called twice during errors
Paul Cruz
2017-07-17 11:19:23 -07:00
50ce4eaeb6
added error detection for pthread initialization, added compression completion measurement, fixed const values
Paul Cruz
2017-07-17 10:12:44 -07:00
ca300ce6e0
Decouple hash table from compression function
Stella Lau
2017-07-14 17:17:00 -07:00
1ab3f06f00
updated tests to use different seeds when executing different tests
Paul Cruz
2017-07-14 16:29:29 -07:00
6e443b4960
Move hash table access for own functions
Stella Lau
2017-07-14 14:27:55 -07:00
2d8e6c6608
Add more statistics
Stella Lau
2017-07-14 12:31:01 -07:00
55f960e8db
Add percentages to offset histogram
Stella Lau
2017-07-14 11:00:20 -07:00
4db7f12ef3
Add offset histogram
Stella Lau
2017-07-14 10:52:03 -07:00
fa3aa04ccd
Merge pull request #761 from paulcruz74/file-rename
Yann Collet and GitHub
2017-07-14 09:09:45 -07:00
3841ee6fb3
Merge pull request #762 from facebook/errorCodes
Yann Collet and GitHub
2017-07-14 09:09:22 -07:00
3b0cff3c33
fixed clang's -Wdocumentation
Yann Collet
2017-07-13 18:58:30 -07:00
2bd6440be0
pinned down error code enum values
Yann Collet
2017-07-13 17:12:16 -07:00
0c8b9436b7
removed goto statements for the most part
Paul Cruz
2017-07-13 16:38:20 -07:00
175a6c6029
[ldm] Minor refactoring
Stella Lau
2017-07-13 16:16:31 -07:00
3502426fd4
Merge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet
2017-07-13 15:49:19 -07:00
6733c0777c
updated NEWS regarding #760
Yann Collet
2017-07-13 15:34:44 -07:00
361c06df75
Add min/max offset to stats
Stella Lau
2017-07-13 15:29:41 -07:00
65a4ce2635
added tests for forced compression level
Paul Cruz
2017-07-13 14:57:24 -07:00
0d9665cef5
added additional tests for performance, allowed force compression level for testing purposes
Paul Cruz
2017-07-13 14:46:54 -07:00
2b3c7e4199
[ldm] Make some functions shared
Stella Lau
2017-07-13 14:39:35 -07:00
9165e97fc6
added some tests for correctness, time, and compression ratio
Paul Cruz
2017-07-13 13:50:23 -07:00
9306feb8fa
[ldm] Switch to using lib/common/mem.h and move typedefs to ldm.h
Stella Lau
2017-07-13 13:44:48 -07:00
830ef4152a
[libzstd] Increase granularity of FSECTable repeat mode
Nick Terrell
2017-07-13 12:45:39 -07:00
50421d9474
[ldm] Remove old main files
Stella Lau
2017-07-13 11:45:00 -07:00
68c4560701
[ldm] Add TODO and comment for segfaulting in compress function
Stella Lau
2017-07-13 10:38:19 -07:00
d985319337
Merge pull request #759 from terrelln/real-block-split
Yann Collet and GitHub
2017-07-13 10:24:19 -07:00
3a60efd3a9
policy change : ZSTDMT automatically caps nbThreads to ZSTDMT_NBTHREADS_MAX (#760 )
Yann Collet
2017-07-13 10:10:13 -07:00
766663f1f1
added altering dictionary size depending on compression level
Paul Cruz
2017-07-13 10:15:27 -07:00
132e6efd76
switched ZSTDMT_compress_advanced() last argument to overlapLog
Yann Collet
2017-07-13 02:22:58 -07:00
4e77f7761d
clarified comment on ZSTD_p_contentSizeFlag
Yann Collet
2017-07-13 02:09:07 -07:00
de0414b736
[libzstd] Pull CTables into sub-structure
Nick Terrell
2017-07-12 19:08:24 -07:00
92bed4a7e0
[ldm] Add CHAR_OFFSET in hash function and extend header size
Stella Lau
2017-07-12 18:47:26 -07:00