 senhuang42
|
724b94ed18
|
ldm_getNextMatch fixed return values
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
ea92fb3a68
|
Cleanups, add comments and explanations
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
78da2e1808
|
Fixed sifting algorithm
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
6ccd97fc96
|
Fixed end of match boundary update issues
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
28394b64f2
|
Add proper bounds check on adding ldms
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
a2f2b58d04
|
Add a function ldm_voidSequences()
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
9c3c7cd20e
|
Fix function argument to getNextMatch()
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
c8b8572b38
|
Adjustments to no longer segfault on nci
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
f57c7e6bbf
|
Add base adjustment correction
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
5df9b5e05f
|
Add initial getNextMatch() in opt parser
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
f8ce7cabc3
|
Added more debugging
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
84009a076a
|
Add re-copying of ldmSeqStore after processing
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
42395a70c2
|
Add debug statements, flesh out functions
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
dd3dd199bb
|
Get zstd to build with new functions and callsites, fix arguments
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
766c4a8c28
|
Implement part of ldm_maybeAddLdm()
|
2020-10-07 13:56:25 -04:00 |
|
|
senhuang42
|
84777059d2
|
Implement ldm_getNextMatch()
|
2020-10-07 13:56:24 -04:00 |
|
|
senhuang42
|
28c74bf591
|
Implement basic splitSequence and skipSequence functions
|
2020-10-07 13:56:24 -04:00 |
|
|
senhuang42
|
634ab7830d
|
Flesh out required args for ldm_handleLdm()
|
2020-10-07 13:56:24 -04:00 |
|
|
senhuang42
|
db70761032
|
Add callsites to appropriate locations in ..opt_generic()
|
2020-10-07 13:56:24 -04:00 |
|
|
senhuang42
|
aea61e3c91
|
Add ldm helper function declarations into opt parser
|
2020-10-07 13:56:24 -04:00 |
|
|
senhuang42
|
35d9f488f5
|
Modify codepath to use opt parser exclusively if the compression level is high enough
|
2020-10-07 13:56:24 -04:00 |
|
|
senhuang42
|
e1ae398ad5
|
Add rawSeqStore to match state
|
2020-10-07 13:56:24 -04:00 |
|
|
senhuang42
|
ce56810a32
|
Modify error messages on console input/output
|
2020-09-28 12:15:18 -04:00 |
|
|
senhuang42
|
02422db841
|
Fix Stdin typo
|
2020-09-25 11:51:35 -04:00 |
|
|
senhuang42
|
9f7212a48b
|
Update unit tests
|
2020-09-24 16:44:33 -04:00 |
|
|
senhuang42
|
88f4410390
|
Add more useful failure message when stdin is an input
|
2020-09-24 16:29:12 -04:00 |
|
|
senhuang42
|
93d63eaeb8
|
Expand UTIL_requireUserConfirmation to include stdin input check
|
2020-09-24 15:58:06 -04:00 |
|
|
senhuang42
|
432186cbea
|
Add FIO_determineHasStdinInput() function and member to fCtx
|
2020-09-24 15:55:30 -04:00 |
|
|
senhuang42
|
0e8ac6b995
|
Add fCtx to FIO_openDstFile()
|
2020-09-24 15:49:30 -04:00 |
|
|
senhuang42
|
21cd640b93
|
Add unit tests to guard against bad stdin
|
2020-09-22 14:55:41 -04:00 |
|
|
senhuang42
|
7aa3da1cd7
|
Use IS_CONSOLE macro to detect that we're indeed using a console
|
2020-09-22 14:15:52 -04:00 |
|
|
senhuang42
|
8adeb9f1e6
|
Updated to repcode documentation to reflect dict content size
|
2020-09-22 13:24:27 -04:00 |
|
|
senhuang42
|
9dcfe4d7b7
|
Update documentation about repcodes in dictionaries
|
2020-09-22 13:02:26 -04:00 |
|
|
senhuang42
|
07034952df
|
Add -f to .zstd decompression CLI test
|
2020-09-18 13:01:45 -04:00 |
|
|
senhuang42
|
6b6cc80196
|
Support .zstd suffix only for decompression
|
2020-09-18 12:49:51 -04:00 |
|
|
senhuang42
|
29b8f2eb08
|
Fix multifile decompression summary
|
2020-09-16 10:38:13 -04:00 |
|
|
senhuang42
|
1d5c6fda9f
|
Add filename truncations to decompression
|
2020-09-16 10:28:45 -04:00 |
|
|
senhuang42
|
ab0d332563
|
Add display clears
|
2020-09-15 15:53:32 -04:00 |
|
|
senhuang42
|
cad6bf99af
|
Add padding to remove previous line's leftovers, and keep the printed line to around the same size
|
2020-09-15 13:01:46 -04:00 |
|
|
senhuang42
|
a71963c7b8
|
nbThreads instead of numThreads
|
2020-09-09 12:40:00 -04:00 |
|
|
senhuang42
|
0a170b20a8
|
Add ZSTD_NUMTHREADS tests to playTests.sh
|
2020-09-08 10:34:50 -04:00 |
|
|
senhuang42
|
243c8dfb41
|
Add include guards for init_numThreads()
|
2020-09-08 09:26:16 -04:00 |
|
|
senhuang42
|
cc29492c5f
|
Update documentation for environment variable
|
2020-09-08 08:42:46 -04:00 |
|
|
senhuang42
|
136a0673f6
|
Add quick documentation for ZSTD_NUMTHREADS in the code
|
2020-09-07 18:19:31 -04:00 |
|
|
senhuang42
|
888c385a49
|
Change param name to ZSTDCLI_NUMTHREADS_DEFAULT
|
2020-09-07 18:11:42 -04:00 |
|
|
senhuang42
|
972e063219
|
Change default num_threads value
|
2020-09-07 18:09:48 -04:00 |
|
|
senhuang42
|
5123496104
|
Adjust function signatures
|
2020-09-07 13:13:05 -04:00 |
|
|
senhuang42
|
28a9dc78c3
|
Always update bytes status in FIO_ctx_t
|
2020-09-03 20:23:30 -04:00 |
|
|
senhuang42
|
60ee0519ca
|
Remove extraneous FIO_ctx_t functions
|
2020-09-03 20:22:56 -04:00 |
|
|
senhuang42
|
48bca10792
|
Address memory leak in CLI from fCtx
|
2020-09-03 10:14:04 -04:00 |
|
|
senhuang42
|
23feaecbe5
|
Fix FIO_removeMultiFilesWarning conflict
|
2020-09-03 09:49:13 -04:00 |
|
|
senhuang42
|
49949f1d51
|
Merge branch 'dev' into multifile_status_update_fio_refactor
|
2020-09-03 09:44:47 -04:00 |
|
|
senhuang42
|
202b2954a2
|
Remove comma-separated decls
|
2020-09-03 09:28:40 -04:00 |
|
|
senhuang42
|
a480b02044
|
Adjust comments and struct to better reflect FIO_ctx_t
|
2020-09-03 09:26:30 -04:00 |
|
|
senhuang42
|
7842f43197
|
Fix 1 file multifile logic, remove unnecessary variable assignments
|
2020-09-03 09:22:07 -04:00 |
|
|
senhuang42
|
dbe5305250
|
Adjusted extra explanation warning to always pop up if applicable
|
2020-09-02 08:44:42 -04:00 |
|
|
senhuang42
|
99039988a5
|
Fixed newline issue and adjusted wording in comment
|
2020-09-01 13:18:30 -04:00 |
|
|
senhuang42
|
3a7d625d6b
|
Cleanup comments, add function to set FIO_ctx_t.nbFilesProcessed
|
2020-09-01 12:54:21 -04:00 |
|
|
senhuang42
|
a03917c751
|
Fix the logic in printing final status updates
|
2020-09-01 12:46:06 -04:00 |
|
|
senhuang42
|
a6414f1247
|
Integrate refactor into status print for multifiles, adjust logic for printing as needed
|
2020-09-01 12:34:43 -04:00 |
|
|
senhuang42
|
565f116a56
|
Change name to ZSTD_NUMTHREADS
|
2020-09-01 09:02:23 -04:00 |
|
|
senhuang42
|
d54566f334
|
First pass at refactoring and creating new FIO_ctx_t */
|
2020-08-28 11:01:04 -04:00 |
|
|
senhuang42
|
01828b27e2
|
Improve documentation, update man
|
2020-08-27 17:57:20 -04:00 |
|
|
senhuang42
|
7e867ad61f
|
Fix potential memory leak
|
2020-08-26 18:52:32 -04:00 |
|
|
senhuang42
|
ef11aadc0c
|
Fix UTIL_requireUserConfirmation() declaration
|
2020-08-26 17:20:37 -04:00 |
|
|
senhuang42
|
7991c55181
|
Move logic into new function FIO_removeMultiFilesWarning, add support for decompression
|
2020-08-26 16:50:20 -04:00 |
|
|
senhuang42
|
3aec385a10
|
Fix merge conflicts
|
2020-08-26 15:43:38 -04:00 |
|
|
senhuang42
|
ead2387a7e
|
Remove extraneous FIO_setNbFiles()
|
2020-08-26 12:05:04 -04:00 |
|
|
senhuang42
|
fed7e7850b
|
Fix bug in user prompt where line was not flushed on negative response
|
2020-08-26 11:57:38 -04:00 |
|
|
senhuang42
|
a73e131f10
|
Adjust playTests.sh refuse overwrite test to include -q
|
2020-08-26 11:40:05 -04:00 |
|
|
senhuang42
|
b6abbc3ce5
|
Fix single file decompression summary, remove escape code dependency, add currFileIdx field to FIO_prefs, general cleanups/bugfixes
|
2020-08-26 11:35:07 -04:00 |
|
|
senhuang42
|
70fa7b37ca
|
Added env var function for threads
|
2020-08-25 18:49:52 -04:00 |
|
|
senhuang42
|
96222cd195
|
Small formatting changes
|
2020-08-25 18:03:08 -04:00 |
|
|
senhuang42
|
47a9ad2ae3
|
Remove decompression status update
|
2020-08-25 17:54:00 -04:00 |
|
|
senhuang42
|
acee48d4c1
|
Small cleanups
|
2020-08-25 17:34:00 -04:00 |
|
|
senhuang42
|
a3401ca7d0
|
Make compatible with displaylevel = 2 and decompression
|
2020-08-25 17:23:47 -04:00 |
|
|
senhuang42
|
da38891a87
|
Add initial live update with displayLevel = 2, add new field to FIO_prefs_t
|
2020-08-25 16:46:47 -04:00 |
|
|
senhuang42
|
7a7cd8861a
|
Add initial functionality to support -q
|
2020-08-25 13:50:44 -04:00 |
|
|
senhuang42
|
aab11ce3db
|
Unified warning prompts into new function UTIL_requireUserConfirmationToProceed()
|
2020-08-25 11:25:49 -04:00 |
|
|
senhuang42
|
dde97de6c4
|
Only ask to proceed if using --rm, otherwise just display warning. -f bypasses it all. More robust tests
|
2020-08-24 20:20:39 -04:00 |
|
|
senhuang42
|
1acf243540
|
Add a warning whenever (de)compressing multiple files into one source, or into stdout
|
2020-08-24 19:10:03 -04:00 |
|
|
senhuang42
|
e1e41addb3
|
Adjust #ifndef logic
|
2020-08-24 17:36:36 -04:00 |
|
|
senhuang42
|
a030560d62
|
Add new DCtx param: validateChecksum and update unit tests
|
2020-08-24 17:28:00 -04:00 |
|
|
senhuang42
|
44c54a3e31
|
Addressing comments: more comments, cleanup, remove extra function, checksum logic
|
2020-08-24 16:14:19 -04:00 |
|
|
senhuang42
|
ffaa0df76d
|
Document change in CLI for --no-check during decompression in --help menu
|
2020-08-24 09:49:12 -04:00 |
|
|
senhuang42
|
e3f5f9658a
|
Added CLI tests for --no-check, fixed ignore checksum logic
|
2020-08-22 16:05:40 -04:00 |
|
|
senhuang42
|
20eb095882
|
Added unit test to fuzzer.c, changed definition param name
|
2020-08-22 13:26:33 -04:00 |
|
|
senhuang42
|
47685ac856
|
Move enum into zstd.h, and fix pesky switch() logic
|
2020-08-21 18:18:53 -04:00 |
|
|
senhuang42
|
1b34b15e6b
|
Adding CLI capability to invoke decompression with no checksum
|
2020-08-21 17:49:30 -04:00 |
|
|
senhuang42
|
08d3567ba8
|
Add function prototype
|
2020-08-21 16:51:43 -04:00 |
|
|
senhuang42
|
6a8dbdcd1f
|
Modify decompression loop to gnore checksums if flag is enabled
|
2020-08-21 16:46:46 -04:00 |
|
|
senhuang42
|
2f39124342
|
Rename to ZSTD_d_forceIgnoreChecksum, add to DCtx, add function to set the advanced param
|
2020-08-21 16:23:39 -04:00 |
|
|
senhuang42
|
b5cddda073
|
Add new definition of ZSTD_d_forceSkipChecksum in experimental section
|
2020-08-21 15:59:03 -04:00 |
|
|
Sen Huang
|
bc3e21578d
|
No margin on RLE test size check
|
2019-11-18 16:39:16 -05:00 |
|
|
Sen Huang
|
db8efbfe7d
|
Updated comment to reflect actual compression behavior
|
2019-11-15 16:11:14 -05:00 |
|
|
Sen Huang
|
75c34684c0
|
Modified existing RLE test to take compressed size into account
|
2019-11-15 12:26:48 -05:00 |
|
|
Sen Huang
|
d9646dcbb5
|
Fixed main compression logic changes
|
2019-11-14 19:39:09 -05:00 |
|
|
Sen Huang
|
c26d32c91c
|
Change superblock #include to be last
|
2019-11-14 13:12:17 -05:00 |
|
|
Sen Huang
|
c85d10d0ea
|
Remove mixed declarations
|
2019-11-08 13:57:26 -05:00 |
|
|
Sen Huang
|
d9c475f3b3
|
Fix static analyze error, use proper bounds for dictEnd
|
2019-11-08 13:57:26 -05:00 |
|