Commit Graph
100 Commits
Author SHA1 Message Date
Paul Cruz 7163ffafde playing around with adapt param 2017-07-07 15:56:00 -07:00
Paul Cruz 1c9d6b2c6b rewrote time elapsed with UTIL 2017-07-07 15:42:20 -07:00
Paul Cruz c0c236a28b changed to using compressCCtx 2017-07-07 15:13:40 -07:00
Paul Cruz 11fc0f4119 changed completed -> compressed 2017-07-07 13:55:38 -07:00
Paul Cruz 09d7c6a994 changed completed variables to compressed for clarity 2017-07-07 13:18:55 -07:00
Paul Cruz 8c0eb62920 removed unnecessary comments, uncommented DEBUGLOG for later use 2017-07-07 11:47:16 -07:00
Paul Cruz 70a4153bd3 added ability to force output to stdout, wrote an additional test for this functionality 2017-07-07 11:32:14 -07:00
Paul Cruz 532f439961 cleaned up code for arguments a bit 2017-07-07 10:58:43 -07:00
Paul Cruz f7e6b358d0 added tests that check to ensure stdout is working 2017-07-07 10:29:06 -07:00
Paul Cruz 4679132f59 updated avg compression rate, also hiding progress bar behind a flag now 2017-07-07 10:25:38 -07:00
Paul Cruz 00bc5df4e0 added compression rate to status bar 2017-07-07 09:35:39 -07:00
Paul Cruz f351848b76 added data amount 2017-07-06 20:40:00 -07:00
Paul Cruz 2939301023 fixed problem with progress bar not persisting, added time elapsed 2017-07-06 20:30:20 -07:00
Paul Cruz 57ec0232a8 added help menu 2017-07-06 18:09:10 -07:00
Paul Cruz b6cc084716 added really simple progress update in the corner 2017-07-06 17:48:18 -07:00
Paul Cruz ff9f2cd057 added some basic logic for altering compression level 2017-07-06 16:06:53 -07:00
Paul Cruz a407ccc215 added ability to congregate statistics into single print statement rather than using debug 2017-07-06 13:09:17 -07:00
Paul Cruz f57849b9c6 added ability to set initial compression level 2017-07-06 11:05:51 -07:00
Paul Cruz 592a0d9495 changed to work with std out 2017-07-06 10:49:26 -07:00
Paul Cruz 94fe291b83 small changes 2017-07-06 10:29:16 -07:00
Paul Cruz 79d4657ce5 small changes 2017-07-05 17:44:36 -07:00
Paul Cruz 6f3ad1b22e fixed the problem with pipeline tests by changing how jobs move through the threads 2017-07-05 17:24:21 -07:00
Paul Cruz cc714f3bd3 added print statements and debuglog 2017-07-05 16:54:34 -07:00
Paul Cruz 3f52ca94bf added more tests, changed makefile 2017-07-05 14:36:09 -07:00
Paul Cruz faeb6e0b1b added filenameTable for multiple files 2017-07-05 14:19:56 -07:00
Paul Cruz f0b9a153f3 added tests to run.sh 2017-07-05 13:23:34 -07:00
Paul Cruz b42108386a added some basic parsing for args 2017-07-05 12:20:16 -07:00
Paul Cruz 898c1a5b46 removed references to file size computation and file size function 2017-07-05 11:54:21 -07:00
Paul Cruz a2680e5b96 removed calculation of file size and replaced with limited number of available jobs 2017-07-05 11:52:55 -07:00
Paul Cruz dd8a591d5d moved main logic for job creation into a separate function 2017-07-05 10:48:04 -07:00
Paul Cruz 9ccd55f3a8 free ctx fields when error occurs during creation 2017-07-05 10:20:56 -07:00
Paul Cruz 5df4cb0530 renamed files 2017-07-05 09:57:50 -07:00
Paul Cruz c9f49198b8 fixed TODOs 2017-07-05 09:49:27 -07:00
Paul Cruz 9a147d8671 removed unnecessary checks for null pointer on free 2017-07-05 09:37:52 -07:00
Paul Cruz a47ebb1607 removed print statements 2017-07-05 09:23:46 -07:00
Paul Cruz 0b70152a9b working I believe 2017-07-03 20:05:42 -07:00
Paul Cruz cd50382c03 fixed some issues with segfaults 2017-07-03 19:28:48 -07:00
Paul Cruz 95ea54b4cf added code for waiitng for all jobs to finish 2017-07-03 19:24:22 -07:00
Paul Cruz dd447bb9a7 fixed an error with number of jobs 2017-07-03 19:00:55 -07:00
Paul Cruz ff9ac637d9 removed unnecessary files 2017-07-03 17:44:40 -07:00
Paul Cruz dd96efa9ef added print statements for debugging, fixed long memset by changing to calloc 2017-07-03 17:44:22 -07:00
Paul Cruz 0887e98d4b finished main portion of code, now need to debug 2017-07-03 17:28:59 -07:00
Paul Cruz 00b5e6c512 continuing work on v2 2017-07-03 14:18:46 -07:00
Paul Cruz ac79928960 version one complete, can compress a file given input and output names 2017-07-03 14:11:55 -07:00
Paul Cruz 7ac4724bd2 removed fnum from DISPLAY statements 2017-06-28 13:00:49 -07:00
Paul Cruz e667d33b0b fixed generation of buggy test, corrected DISPLAY statements for errors 2017-06-28 12:19:37 -07:00
Paul Cruz d67212ab97 Merge remote-tracking branch 'upstream/dev' into dev 2017-06-28 09:45:54 -07:00
Paul Cruz 298fe9f23b added cli tests to test-all 2017-06-23 17:10:41 -07:00
Paul Cruz 3a295a91f8 added additional condition so large offsets into the dictionary are not generated past windowSize 2017-06-23 15:54:51 -07:00
Paul Cruz 2085375816 fixed bug detected by the API test 2017-06-23 13:44:24 -07:00
Paul Cruz 8cd134559d type warnings 2017-06-23 12:00:48 -07:00
Paul Cruz 4219acc60a fixed bus error bug 2017-06-23 11:22:29 -07:00
Paul Cruz 2e8cc6f12a added sizeof for clarity 2017-06-22 15:52:33 -07:00
Paul Cruz 6d7f442120 changed makefile test 2017-06-22 15:44:01 -07:00
Paul Cruz b325a2e4db changed assignment 2017-06-22 15:36:28 -07:00
Paul Cruz 2935239544 added description for dictionary cli tests 2017-06-22 15:23:59 -07:00
Paul Cruz 97a8f89bec made changes to cli test so it runs properly 2017-06-22 15:13:41 -07:00
Paul Cruz 829eb29033 added cli test for decodecorpus inside tests/Makefile. Also changed calculation of offset 2017-06-22 14:43:44 -07:00
Paul Cruz 028fb9d01b added cli test case in Makefile 2017-06-22 13:53:39 -07:00
Paul Cruz 98751f69e7 should be updating seed whenever multiple files are generated 2017-06-22 10:23:36 -07:00
Paul Cruz 84cfa07d2d changed format of command to --use-dict=# 2017-06-22 10:04:14 -07:00
Paul Cruz 04094f37e9 fixed offset in this case os that it always goes past src start 2017-06-21 18:47:40 -07:00
Paul Cruz 0950b3159a more meaningful names for count variables 2017-06-21 18:30:27 -07:00
Paul Cruz 0b6eedeace malloc samples instead of static allocation 2017-06-21 18:24:19 -07:00
Paul Cruz 52a13abf3f removed comment regarding windowSize requirement 2017-06-21 18:13:52 -07:00
Paul Cruz 32e36c2d9a removed requirement that offset be less than windowSize 2017-06-21 18:00:47 -07:00
Paul Cruz eeff2d0e3c added const x2 2017-06-21 17:48:37 -07:00
Paul Cruz 04253e21bb added const 2017-06-21 17:48:01 -07:00
Paul Cruz 2ceaec1aad got rid of unnecessary casting to void* 2017-06-21 17:46:37 -07:00
Paul Cruz ccae9ec807 added comment addressing use of bits in frame header descriptor 2017-06-21 17:43:21 -07:00
Paul Cruz 5be0f5544e added newline to align output 2017-06-21 12:41:10 -07:00
Paul Cruz 6f5fe71041 added error check for when file could not be opened 2017-06-21 12:37:23 -07:00
Paul Cruz 74a725da69 reversed calculation of ratio 2017-06-21 12:27:20 -07:00
Paul Cruz db3606e249 added test for files with no frame content size 2017-06-20 17:43:36 -07:00
Paul Cruz acf0df678c fixed strange spacing 2017-06-20 15:41:43 -07:00
Paul Cruz 69bc4fab25 free the context object once done with decompression 2017-06-20 15:37:14 -07:00
Paul Cruz ceb4f65620 allocate statically so we don't have to deal with freeing 2017-06-20 15:31:54 -07:00
Paul Cruz a73c2a444a added tests with null files, changed condition to check that the file is more than 0 bytes 2017-06-20 14:33:08 -07:00
Paul Cruz 58c19b4202 spacing matters for test scripts 2017-06-20 14:14:53 -07:00
Paul Cruz 0765602903 fixed error where extremely small files were not being detected as not compressed with zstd 2017-06-20 14:04:46 -07:00
Paul Cruz 3701dde3ba changed to use LONG_SEEK 2017-06-20 13:44:05 -07:00
Paul Cruz 93a5510962 added progress metric to display 2017-06-20 13:26:25 -07:00
Paul Cruz bda57754a2 moved signifcant operations to fileio.c 2017-06-20 12:43:10 -07:00
Paul Cruz c594507871 removed double if statements for same condition 2017-06-20 11:59:45 -07:00
Paul Cruz 72e0ac9929 minor update to logic 2017-06-20 11:58:27 -07:00
Paul Cruz cea55a9217 size_t const value 2017-06-20 11:56:11 -07:00
Paul Cruz b07d0af2ba added additional tests for error detection 2017-06-20 11:54:44 -07:00
Paul Cruz bed0dc95bc changed displayInfo alignment and const 2017-06-20 11:47:24 -07:00
Paul Cruz 43ffcdde40 const dictOffset 2017-06-20 11:27:39 -07:00
Paul Cruz 1e0d125e76 const value 2017-06-20 11:15:26 -07:00
Paul Cruz 0034129270 made changes to accommodate single file use case 2017-06-20 11:07:38 -07:00
Paul Cruz 6a99de2dd8 change test to list info on .zst files 2017-06-20 10:45:06 -07:00
Paul Cruz 36e14b1963 added description to advanced usage, changed to use-dict 2017-06-20 10:34:34 -07:00
Paul Cruz 15102069a1 removed testing code from generation code 2017-06-20 10:25:16 -07:00
Paul Cruz ff5589c091 added comments for clarity 2017-06-20 10:17:38 -07:00
Paul Cruz 551fb7ca05 changed error condition 2017-06-20 10:14:03 -07:00
Paul Cruz b8237c6c66 refactoring for readability 2017-06-20 10:12:13 -07:00
Paul Cruz 6f17de2132 changed computation for readability 2017-06-20 09:50:28 -07:00
Paul Cruz cb2dbe6434 changed fileInfo initialization, updated error code 2017-06-20 09:35:21 -07:00
Paul Cruz 4a4f9ba262 const value that doesn't change 2017-06-19 17:46:21 -07:00