 senhuang42
|
6b6cc80196
|
Support .zstd suffix only for decompression
|
2020-09-18 12:49:51 -04:00 |
|
|
senhuang42
|
a71963c7b8
|
nbThreads instead of numThreads
|
2020-09-09 12:40:00 -04:00 |
|
|
senhuang42
|
0a170b20a8
|
Add ZSTD_NUMTHREADS tests to playTests.sh
|
2020-09-08 10:34:50 -04:00 |
|
|
senhuang42
|
243c8dfb41
|
Add include guards for init_numThreads()
|
2020-09-08 09:26:16 -04:00 |
|
|
senhuang42
|
cc29492c5f
|
Update documentation for environment variable
|
2020-09-08 08:42:46 -04:00 |
|
|
senhuang42
|
136a0673f6
|
Add quick documentation for ZSTD_NUMTHREADS in the code
|
2020-09-07 18:19:31 -04:00 |
|
|
senhuang42
|
888c385a49
|
Change param name to ZSTDCLI_NUMTHREADS_DEFAULT
|
2020-09-07 18:11:42 -04:00 |
|
|
senhuang42
|
972e063219
|
Change default num_threads value
|
2020-09-07 18:09:48 -04:00 |
|
|
senhuang42
|
5123496104
|
Adjust function signatures
|
2020-09-07 13:13:05 -04:00 |
|
|
senhuang42
|
28a9dc78c3
|
Always update bytes status in FIO_ctx_t
|
2020-09-03 20:23:30 -04:00 |
|
|
senhuang42
|
60ee0519ca
|
Remove extraneous FIO_ctx_t functions
|
2020-09-03 20:22:56 -04:00 |
|
|
senhuang42
|
48bca10792
|
Address memory leak in CLI from fCtx
|
2020-09-03 10:14:04 -04:00 |
|
|
senhuang42
|
23feaecbe5
|
Fix FIO_removeMultiFilesWarning conflict
|
2020-09-03 09:49:13 -04:00 |
|
|
senhuang42
|
49949f1d51
|
Merge branch 'dev' into multifile_status_update_fio_refactor
|
2020-09-03 09:44:47 -04:00 |
|
|
senhuang42
|
202b2954a2
|
Remove comma-separated decls
|
2020-09-03 09:28:40 -04:00 |
|
|
senhuang42
|
a480b02044
|
Adjust comments and struct to better reflect FIO_ctx_t
|
2020-09-03 09:26:30 -04:00 |
|
|
senhuang42
|
7842f43197
|
Fix 1 file multifile logic, remove unnecessary variable assignments
|
2020-09-03 09:22:07 -04:00 |
|
|
senhuang42
|
dbe5305250
|
Adjusted extra explanation warning to always pop up if applicable
|
2020-09-02 08:44:42 -04:00 |
|
|
senhuang42
|
99039988a5
|
Fixed newline issue and adjusted wording in comment
|
2020-09-01 13:18:30 -04:00 |
|
|
senhuang42
|
3a7d625d6b
|
Cleanup comments, add function to set FIO_ctx_t.nbFilesProcessed
|
2020-09-01 12:54:21 -04:00 |
|
|
senhuang42
|
a03917c751
|
Fix the logic in printing final status updates
|
2020-09-01 12:46:06 -04:00 |
|
|
senhuang42
|
a6414f1247
|
Integrate refactor into status print for multifiles, adjust logic for printing as needed
|
2020-09-01 12:34:43 -04:00 |
|
|
senhuang42
|
565f116a56
|
Change name to ZSTD_NUMTHREADS
|
2020-09-01 09:02:23 -04:00 |
|
|
senhuang42
|
d54566f334
|
First pass at refactoring and creating new FIO_ctx_t */
|
2020-08-28 11:01:04 -04:00 |
|
|
senhuang42
|
01828b27e2
|
Improve documentation, update man
|
2020-08-27 17:57:20 -04:00 |
|
|
senhuang42
|
7e867ad61f
|
Fix potential memory leak
|
2020-08-26 18:52:32 -04:00 |
|
|
senhuang42
|
ef11aadc0c
|
Fix UTIL_requireUserConfirmation() declaration
|
2020-08-26 17:20:37 -04:00 |
|
|
senhuang42
|
7991c55181
|
Move logic into new function FIO_removeMultiFilesWarning, add support for decompression
|
2020-08-26 16:50:20 -04:00 |
|
|
senhuang42
|
3aec385a10
|
Fix merge conflicts
|
2020-08-26 15:43:38 -04:00 |
|
|
senhuang42
|
ead2387a7e
|
Remove extraneous FIO_setNbFiles()
|
2020-08-26 12:05:04 -04:00 |
|
|
senhuang42
|
fed7e7850b
|
Fix bug in user prompt where line was not flushed on negative response
|
2020-08-26 11:57:38 -04:00 |
|
|
senhuang42
|
a73e131f10
|
Adjust playTests.sh refuse overwrite test to include -q
|
2020-08-26 11:40:05 -04:00 |
|
|
senhuang42
|
b6abbc3ce5
|
Fix single file decompression summary, remove escape code dependency, add currFileIdx field to FIO_prefs, general cleanups/bugfixes
|
2020-08-26 11:35:07 -04:00 |
|
|
senhuang42
|
70fa7b37ca
|
Added env var function for threads
|
2020-08-25 18:49:52 -04:00 |
|
|
senhuang42
|
96222cd195
|
Small formatting changes
|
2020-08-25 18:03:08 -04:00 |
|
|
senhuang42
|
47a9ad2ae3
|
Remove decompression status update
|
2020-08-25 17:54:00 -04:00 |
|
|
senhuang42
|
acee48d4c1
|
Small cleanups
|
2020-08-25 17:34:00 -04:00 |
|
|
senhuang42
|
a3401ca7d0
|
Make compatible with displaylevel = 2 and decompression
|
2020-08-25 17:23:47 -04:00 |
|
|
senhuang42
|
da38891a87
|
Add initial live update with displayLevel = 2, add new field to FIO_prefs_t
|
2020-08-25 16:46:47 -04:00 |
|
|
senhuang42
|
7a7cd8861a
|
Add initial functionality to support -q
|
2020-08-25 13:50:44 -04:00 |
|
|
senhuang42
|
aab11ce3db
|
Unified warning prompts into new function UTIL_requireUserConfirmationToProceed()
|
2020-08-25 11:25:49 -04:00 |
|
|
senhuang42
|
dde97de6c4
|
Only ask to proceed if using --rm, otherwise just display warning. -f bypasses it all. More robust tests
|
2020-08-24 20:20:39 -04:00 |
|
|
senhuang42
|
1acf243540
|
Add a warning whenever (de)compressing multiple files into one source, or into stdout
|
2020-08-24 19:10:03 -04:00 |
|
|
senhuang42
|
e1e41addb3
|
Adjust #ifndef logic
|
2020-08-24 17:36:36 -04:00 |
|
|
senhuang42
|
a030560d62
|
Add new DCtx param: validateChecksum and update unit tests
|
2020-08-24 17:28:00 -04:00 |
|
|
senhuang42
|
44c54a3e31
|
Addressing comments: more comments, cleanup, remove extra function, checksum logic
|
2020-08-24 16:14:19 -04:00 |
|
|
senhuang42
|
ffaa0df76d
|
Document change in CLI for --no-check during decompression in --help menu
|
2020-08-24 09:49:12 -04:00 |
|
|
senhuang42
|
e3f5f9658a
|
Added CLI tests for --no-check, fixed ignore checksum logic
|
2020-08-22 16:05:40 -04:00 |
|
|
senhuang42
|
20eb095882
|
Added unit test to fuzzer.c, changed definition param name
|
2020-08-22 13:26:33 -04:00 |
|
|
senhuang42
|
47685ac856
|
Move enum into zstd.h, and fix pesky switch() logic
|
2020-08-21 18:18:53 -04:00 |
|
|
senhuang42
|
1b34b15e6b
|
Adding CLI capability to invoke decompression with no checksum
|
2020-08-21 17:49:30 -04:00 |
|
|
senhuang42
|
08d3567ba8
|
Add function prototype
|
2020-08-21 16:51:43 -04:00 |
|
|
senhuang42
|
6a8dbdcd1f
|
Modify decompression loop to gnore checksums if flag is enabled
|
2020-08-21 16:46:46 -04:00 |
|
|
senhuang42
|
2f39124342
|
Rename to ZSTD_d_forceIgnoreChecksum, add to DCtx, add function to set the advanced param
|
2020-08-21 16:23:39 -04:00 |
|
|
senhuang42
|
b5cddda073
|
Add new definition of ZSTD_d_forceSkipChecksum in experimental section
|
2020-08-21 15:59:03 -04:00 |
|
|
Sen Huang
|
bc3e21578d
|
No margin on RLE test size check
|
2019-11-18 16:39:16 -05:00 |
|
|
Sen Huang
|
db8efbfe7d
|
Updated comment to reflect actual compression behavior
|
2019-11-15 16:11:14 -05:00 |
|
|
Sen Huang
|
75c34684c0
|
Modified existing RLE test to take compressed size into account
|
2019-11-15 12:26:48 -05:00 |
|
|
Sen Huang
|
d9646dcbb5
|
Fixed main compression logic changes
|
2019-11-14 19:39:09 -05:00 |
|
|
Sen Huang
|
c26d32c91c
|
Change superblock #include to be last
|
2019-11-14 13:12:17 -05:00 |
|
|
Sen Huang
|
c85d10d0ea
|
Remove mixed declarations
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
d9c475f3b3
|
Fix static analyze error, use proper bounds for dictEnd
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
d06b90692b
|
Move asserts to loadZstdDictionary()
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
b39149e156
|
Expose ZSTD_reset_compressedBlockState() to shared API
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
6ce335371b
|
Add error forwarding to loadCEntropy(), make check for dictSize >= 8 from bad merge
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
4a61aaf368
|
Remove redundant comment
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
c787b351ea
|
Use ZSTD Error codes, improve explanation of ZSTD_loadCEntropy() and ZSTD_loadDEntropy()
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
04fb42b4f3
|
Integrated refactor into getDictHeaderSize, now passes tests
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
0bcaf6db08
|
First working pass at refactor of loadZstdDictionary()
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
4b141b63e0
|
Revert "Move decompress symbols into zstd_internal.h, remove dependency"
This reverts commit a152b4c67a5266f611db4a2eac4a79003852a795.
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
84404cff6e
|
Move decompress symbols into zstd_internal.h, remove dependency
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
341e0641ed
|
Checks malloc() for failure, returns 0 if so
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
97b7f712f3
|
Change to heap allocation, remove implicit type conversion
|
2019-11-08 13:57:25 -05:00 |
|
|
Sen Huang
|
e1edc554a3
|
Added 2 unit tests: one for sanity, one for correctnesson fixed dict
|
2019-11-08 13:57:25 -05:00 |
|
|
Sen Huang
|
3c36a7f13a
|
Add ZDICT_getHeaderSize()
|
2019-11-08 13:57:08 -05:00 |
|
|
Sen Huang
|
e21a8bbecd
|
Fix FUZZ_rand32() bug
|
2019-11-05 16:43:24 -05:00 |
|
|
Sen Huang
|
13bb7500e8
|
Fix frame argument to compression
|
2019-11-05 16:15:55 -05:00 |
|
|
Sen Huang
|
f2932fb5eb
|
Fix more merge conflicts
|
2019-11-05 15:54:05 -05:00 |
|
|
Sen Huang
|
7ce891870c
|
Fix merge conflicts
|
2019-11-05 15:51:25 -05:00 |
|
|
Sen Huang
|
b9ede1c8c2
|
Make sure contentsize is known
|
2019-10-30 16:03:58 -04:00 |
|
|
Sen Huang
|
c2e1e54f24
|
((x or y) or z) == (x or y or z), remove brackets
|
2019-10-21 19:16:50 -04:00 |
|
|
Sen Huang
|
59c81aa31b
|
Line up comments :)
|
2019-10-21 19:12:15 -04:00 |
|
|
Sen Huang
|
dbda8c318a
|
Trailing comma
|
2019-10-21 19:10:13 -04:00 |
|
|
Sen Huang
|
0c00455ea6
|
Merge branch 'dev' of github.com:senhuang42/zstd into new_path_for_cdict
|
2019-10-21 19:06:51 -04:00 |
|
|
Sen Huang
|
5b2f4ac1a8
|
merge
|
2019-10-21 19:02:52 -04:00 |
|
|
Sen Huang
|
2ab484a5f9
|
Fix bad merge
|
2019-10-21 18:55:17 -04:00 |
|
|
Sen Huang
|
b6c3459d50
|
merge
|
2019-10-21 18:46:17 -04:00 |
|
|
Sen Huang
|
676f89902a
|
Added multiplier, renamed new enum to something more useful
|
2019-10-21 15:36:12 -04:00 |
|
|
Sen Huang
|
1f3a51fb52
|
Updated forceAttachDict param bounds
|
2019-10-21 15:36:12 -04:00 |
|
|
Sen Huang
|
8f69c47643
|
Add enum to decision process
|
2019-10-21 15:36:12 -04:00 |
|
|
Sen Huang
|
e4de8b098a
|
Added support for forcing new CDict behavior and updated enum
|
2019-10-21 15:36:12 -04:00 |
|
|
Sen Huang
|
9294f4826b
|
Changed to int from BYTE
|
2019-10-21 15:36:12 -04:00 |
|
|
Sen Huang
|
f0fccc8847
|
Changed to int from BYTE
|
2019-10-21 15:36:12 -04:00 |
|
|
Sen Huang
|
bb2df8c499
|
Trailing whitespace
|
2019-10-21 15:36:12 -04:00 |
|
|
Sen Huang
|
cf51501d2f
|
Fix test
|
2019-10-21 15:36:12 -04:00 |
|
|
Sen Huang
|
ea3cb6988f
|
Cast to BYTE to appease appveyor
|
2019-10-21 15:36:12 -04:00 |
|
|
Sen Huang
|
a727a85a7e
|
merge conflicts round 2
|
2019-10-21 15:36:12 -04:00 |
|
|
Sen Huang
|
053a35fd64
|
formatting
|
2019-10-21 15:35:33 -04:00 |
|
|
Sen Huang
|
3fa4daaa55
|
Fix error
|
2019-10-21 15:35:33 -04:00 |
|
|
Sen Huang
|
3328348c63
|
Add compressionlevel to cdict
|
2019-10-21 15:32:39 -04:00 |
|