 Stella Lau
|
963558a072
|
Fix implicit conversion error
|
2017-09-13 16:01:16 -07:00 |
|
|
Stella Lau
|
40bf0ced7d
|
Add flag to limit max decompressed size in decodeCorpus
|
2017-09-13 15:16:56 -07:00 |
|
|
Stella Lau
|
e89065506e
|
Make decodecorpus generate raw compressed blocks
|
2017-09-12 17:18:45 -07:00 |
|
|
Stella Lau
|
3d8e313f64
|
Reduce ldm hash table size in test
|
2017-09-11 17:21:28 -07:00 |
|
|
Stella Lau
|
eb3327c10a
|
Merge branch 'dev' of https://github.com/facebook/zstd into ldm-mergeDev
|
2017-09-11 15:00:01 -07:00 |
|
|
Stella Lau
|
f902bf9676
|
Merge branch 'ldm-integrate' into ldm-mergeDev
|
2017-09-11 14:55:29 -07:00 |
|
|
Stella Lau
|
0d1b54db61
|
Explicitly cast raw numerals when left-shifting
|
2017-09-11 14:28:18 -07:00 |
|
|
Stella Lau
|
360428c5d9
|
Move ldm functions to their own file
|
2017-09-06 18:09:26 -07:00 |
|
|
Stella Lau
|
2b99d696de
|
Remove debug code
|
2017-09-06 15:57:26 -07:00 |
|
|
Stella Lau
|
eeff55dfa8
|
Merge remote-tracking branch 'upstream/dev' into ldm-mergeDev
|
2017-09-06 15:56:32 -07:00 |
|
|
Stella Lau
|
8c33cfe0bc
|
Add ldm documentation in README
|
2017-09-06 15:21:01 -07:00 |
|
|
Stella Lau
|
9e4060200b
|
Add tests and fix pointer alignment
|
2017-09-06 09:14:05 -07:00 |
|
|
Stella Lau
|
af4068a697
|
Fix function name in tests/fuzz/regression_driver
|
2017-09-05 22:14:41 -07:00 |
|
|
Stella Lau
|
c706de5395
|
Rename and add short ldm parameters in cli
|
2017-09-05 21:11:18 -07:00 |
|
|
Stella Lau
|
98b85426f1
|
Fix setting of nextToUpdate at end of ldm matcher
|
2017-09-05 20:41:37 -07:00 |
|
|
Stella Lau
|
08d33fe1c9
|
Fix parameter handling in copyCCtx with cdict
|
2017-09-05 15:50:20 -07:00 |
|
|
Stella Lau
|
fd0071da29
|
Fix parameter handling with ZSTD_copyCCtx
|
2017-09-05 15:34:17 -07:00 |
|
|
Stella Lau
|
643d28c701
|
Add ldm options to 'man zstd'
|
2017-09-05 11:27:15 -07:00 |
|
|
Stella Lau
|
67d4a6161c
|
Add ldmBucketSizeLog param
|
2017-09-02 21:55:29 -07:00 |
|
|
Stella Lau
|
a1f04d518d
|
Move hashEveryLog to cctxParams and update cli
|
2017-09-01 15:05:47 -07:00 |
|
|
Stella Lau
|
767a0b3be1
|
Move ldm hashLog, bucketLog, and mml to cctxParams
|
2017-09-01 12:24:59 -07:00 |
|
|
Stella Lau
|
17d8e0bdcc
|
Merge remote-tracking branch 'upstream/longRangeMatcher' into ldm-integrate
|
2017-09-01 10:19:38 -07:00 |
|
|
Stella Lau
|
8081becadc
|
Add long distance matching as a CCtxParam
|
2017-09-01 09:18:58 -07:00 |
|
|
Stella Lau
|
6a546efb8c
|
Add long distance matcher
Move last literals section to ZSTD_block_internal
|
2017-08-31 12:53:19 -07:00 |
|
|
Stella Lau
|
90a31bfa16
|
Pass dictMode to ZSTDMT_initCStream; fix nits
- Return error code in estimate{CCtx,CStream}Size functions
|
2017-08-30 16:19:07 -07:00 |
|
|
Stella Lau
|
ee65701720
|
Minor fixes; remove formatting only changes
|
2017-08-29 20:27:35 -07:00 |
|
|
Stella Lau
|
a6e20e1bd7
|
Add test for raw content starting with dict header
|
2017-08-29 18:36:18 -07:00 |
|
|
Stella Lau
|
623e3cd40b
|
Use ZSTD_dm_rawContent in zstdmt_compress
|
2017-08-29 18:04:32 -07:00 |
|
|
Stella Lau
|
82d636b76a
|
Rename applyCCtxParams()
|
2017-08-29 18:03:06 -07:00 |
|
|
Stella Lau
|
4e835720bf
|
Delay creation of ZSTDMT_CCtx
|
2017-08-29 17:58:32 -07:00 |
|
|
Stella Lau
|
c7a18b7c21
|
Localize 'dictMode' from cctx to function param
|
2017-08-29 15:52:24 -07:00 |
|
|
Stella Lau
|
c88fb9267f
|
Replace 'byReference' with enum
|
2017-08-29 11:55:02 -07:00 |
|
|
Stella Lau
|
b5b9275e67
|
Rename estimateCCtxSize_advanced() and estimateCStreamSize_advanced()
|
2017-08-29 10:49:29 -07:00 |
|
|
Stella Lau
|
0e56a84a1e
|
Fix getting cParams from CCtxParams
|
2017-08-28 19:25:17 -07:00 |
|
|
Stella Lau
|
024098a47d
|
Fix parameter retrieval from cdict
|
2017-08-25 17:58:28 -07:00 |
|
|
Stella Lau
|
2adde898c8
|
Fix typo with ZSTDMT_parameter
|
2017-08-25 16:13:40 -07:00 |
|
|
Stella Lau
|
18224608ff
|
Remove ZSTD_setCCtxParameter()
|
2017-08-25 13:58:41 -07:00 |
|
|
Stella Lau
|
0744592d38
|
Add function initializing cctxParams from clevel
|
2017-08-25 13:36:47 -07:00 |
|
|
Stella Lau
|
9911153723
|
Move jobSize and overlapLog in zstdmt to cctxParams
|
2017-08-25 13:14:51 -07:00 |
|
|
Stella Lau
|
de5193422d
|
Distinguish between jobParams and cctxParams in zstdmt
|
2017-08-25 11:36:17 -07:00 |
|
|
Stella Lau
|
eb7bbab36a
|
Remove ZSTD_p_refDictContent and dictContentByRef
|
2017-08-25 11:11:45 -07:00 |
|
|
Stella Lau
|
15fdeb9e41
|
Enforce nbThreads<=1 for estimateCCtxSize
|
2017-08-24 16:28:49 -07:00 |
|
|
Stella Lau
|
2fbf0285b2
|
Fix interaction with ZSTD_setCCtxParameter() and cleanup
|
2017-08-24 11:25:41 -07:00 |
|
|
Stella Lau
|
fd9bf42516
|
Fix forceWindow and dictMode setting for zstdmt jobs
|
2017-08-23 19:16:57 -07:00 |
|
|
Stella Lau
|
bf3108fb50
|
Ensure zstdmt uses 'job version' of cctx parameters
|
2017-08-23 17:03:31 -07:00 |
|
|
Stella Lau
|
1c81f725ff
|
Remove duplicated testing code
|
2017-08-23 15:47:15 -07:00 |
|
|
Stella Lau
|
64ce49426b
|
Fix cstream compression level
|
2017-08-23 12:30:47 -07:00 |
|
|
Stella Lau
|
5bc2c1e982
|
Add prototype support for customMem with cctxParams
|
2017-08-23 12:03:30 -07:00 |
|
|
Stella Lau
|
6f1a21c7e9
|
Remove formatting-only changes
|
2017-08-23 10:24:19 -07:00 |
|
|
Stella Lau
|
11303778d0
|
Add function to make cctxParams from ZSTD_parameters
|
2017-08-22 14:53:13 -07:00 |
|
|
Stella Lau
|
23fc0e41fa
|
Remove 'opaque' naming from internal functions
|
2017-08-22 14:24:47 -07:00 |
|
|
Stella Lau
|
8fd1636776
|
Remove unused functions
|
2017-08-22 13:33:58 -07:00 |
|
|
Stella Lau
|
e50ed1fa3a
|
Fix undefined behavior when srcSize==1
|
2017-08-22 11:55:42 -07:00 |
|
|
Stella Lau
|
60e1bc617c
|
Explicitly create a job cctxParam for multithreading
|
2017-08-21 15:39:37 -07:00 |
|
|
Stella Lau
|
5b956f4753
|
Comment out CCtx_param versions of CDict functions
|
2017-08-21 14:49:16 -07:00 |
|
|
Stella Lau
|
fd8a25786e
|
Check parameters are valid in initCCtxParams
|
2017-08-21 13:23:35 -07:00 |
|
|
Stella Lau
|
1c0dbe81b1
|
Add documentation for CCtx_params
|
2017-08-21 13:18:00 -07:00 |
|
|
Stella Lau
|
939f954285
|
Pass ZSTD_CCtx_params as const ptr when possible
|
2017-08-21 12:57:18 -07:00 |
|
|
Stella Lau
|
73c73bf16a
|
Reduce code duplication in zstreamtest
|
2017-08-21 12:41:19 -07:00 |
|
|
Stella Lau
|
560b34f6d2
|
Return error code when initializing NULL cctxParams
|
2017-08-21 11:52:26 -07:00 |
|
|
Stella Lau
|
25be09c6b4
|
Set some parameters to zero before initializing cdict
|
2017-08-21 11:35:46 -07:00 |
|
|
Stella Lau
|
502031ca10
|
Use cctxParam version of createCDict internally
|
2017-08-21 11:00:44 -07:00 |
|
|
Stella Lau
|
91b30dbe84
|
Remove test parameter
|
2017-08-21 10:09:06 -07:00 |
|
|
Stella Lau
|
f181f33bdf
|
Disable tests and refactor
|
2017-08-21 01:59:08 -07:00 |
|
|
Stella Lau
|
023b24e6d4
|
Add cctx param tests
|
2017-08-20 22:55:07 -07:00 |
|
|
Stella Lau
|
6cee6e07e5
|
Add internal createCDict function
|
2017-08-18 22:48:31 -07:00 |
|
|
Stella Lau
|
d775519296
|
Add cctxParam versions of internal functions
|
2017-08-18 17:37:58 -07:00 |
|
|
Stella Lau
|
63b8c98531
|
Pass cctx parameters to MTCtx
|
2017-08-18 16:17:24 -07:00 |
|
|
Stella Lau
|
399ae013d4
|
Add function to apply cctx params
|
2017-08-18 13:01:55 -07:00 |
|
|
Stella Lau
|
81d89d82a6
|
Move nbThreads to cctx params
|
2017-08-18 12:08:57 -07:00 |
|
|
Stella Lau
|
2300c58a6f
|
Move dictContentByRef to cctx params
|
2017-08-18 12:03:16 -07:00 |
|
|
Stella Lau
|
b6cb2ed8cb
|
Move dictMode to cctxParams
|
2017-08-18 11:43:31 -07:00 |
|
|
Stella Lau
|
97e27affcb
|
Move compression level to cctx params
|
2017-08-18 11:20:08 -07:00 |
|
|
Stella Lau
|
c0221124d5
|
Add function to set opaque parameters
|
2017-08-17 19:30:22 -07:00 |
|
|
Stella Lau
|
4169f49171
|
Add initialization/allocation functions for opaque params
|
2017-08-17 18:45:04 -07:00 |
|
|
Stella Lau
|
ade95b8bed
|
Add opaque interfaces for static initialization
|
2017-08-17 18:13:08 -07:00 |
|
|
Stella Lau
|
699f11b4f7
|
Create opaque parameter structure
|
2017-08-17 17:33:46 -07:00 |
|
|
Stella Lau
|
e1abc2a367
|
Switch the sleep function to UTIL_sleepMilli
|
2017-08-07 11:49:13 -07:00 |
|
|
Stella Lau
|
1e366f9dea
|
Add test for deadlock
|
2017-08-02 11:27:50 -07:00 |
|
|
Stella Lau
|
73ba58955f
|
Signal after finishing job when queueSize=0
|
2017-08-01 20:12:06 -07:00 |
|
|
Stella Lau
|
1d76da1d87
|
Replace marker with queueEmpty variable and update pool.h comment
|
2017-08-01 12:30:16 -07:00 |
|
|
Stella Lau
|
5adceeed01
|
Allow queueSize=0 in pool.c and update poolTests
|
2017-07-31 10:10:16 -07:00 |
|
|
Stella Lau
|
8fae41c412
|
Return error code in verify() and minor code cleanup
|
2017-07-27 17:14:05 -07:00 |
|
|
Stella Lau
|
1294a4a897
|
Fix typo
|
2017-07-27 15:49:46 -07:00 |
|
|
Stella Lau
|
627621839c
|
Add checks in initialization code
|
2017-07-27 15:37:37 -07:00 |
|
|
Stella Lau
|
c105f605e6
|
Update README
|
2017-07-27 11:11:35 -07:00 |
|
|
Stella Lau
|
9eaf3d22d0
|
Allow HASH_ONLY_EVERY_LOG to be configured in ldm.h
|
2017-07-26 16:43:25 -07:00 |
|
|
Stella Lau
|
40759bade9
|
Add README and clean up code
|
2017-07-26 13:24:03 -07:00 |
|
|
Stella Lau
|
e9161637b2
|
Allow parameters to be modified from a separate file
|
2017-07-25 18:13:27 -07:00 |
|
|
Stella Lau
|
629c300118
|
Rename and remove unneeded files
|
2017-07-25 15:17:36 -07:00 |
|
|
Stella Lau
|
0295a27133
|
Experiment with not using a checksum
|
2017-07-24 15:26:44 -07:00 |
|
|
Stella Lau
|
08a6e9a141
|
Minor code cleanup
|
2017-07-24 13:22:00 -07:00 |
|
|
Stella Lau
|
6eefa32911
|
Deduplicate code
|
2017-07-24 12:40:59 -07:00 |
|
|
Stella Lau
|
8ed9220102
|
Experiment with eviction policies and minor code cleanup
|
2017-07-24 12:05:43 -07:00 |
|
|
Stella Lau
|
eb16da647d
|
Minor clean up
|
2017-07-24 10:20:53 -07:00 |
|
|
Stella Lau
|
1a188fe864
|
Fix overflow bug when calculating hash
|
2017-07-24 10:20:53 -07:00 |
|
|
Stella Lau
|
0b8fb1703b
|
Experiment with 64-bit hash insertion policy
|
2017-07-24 10:20:30 -07:00 |
|
|
Stella Lau
|
273c17b350
|
Experiment with 64-bit hash and checksum
|
2017-07-24 10:19:50 -07:00 |
|
|
Stella Lau
|
13a01ffb27
|
Fix off-by-one in size calculations
|
2017-07-19 17:24:09 -07:00 |
|
|
Stella Lau
|
2427a154cb
|
Minor refactoring
|
2017-07-19 16:56:28 -07:00 |
|