 Stella Lau
|
fc41a87964
|
Experiment with using a lag when hashing
|
2017-07-17 18:13:09 -07:00 |
|
|
Paul Cruz
|
5af04c57b0
|
change parameters for compression level adapt
|
2017-07-17 17:59:50 -07:00 |
|
|
Paul Cruz
|
b3c9e02bb6
|
added signal to other threads whenever error occurs
|
2017-07-17 15:34:58 -07:00 |
|
|
Stella Lau
|
a00e406231
|
Remove version archive
|
2017-07-17 15:17:32 -07:00 |
|
|
Stella Lau
|
15a041adbf
|
Add function to get valid entries only from table
|
2017-07-17 15:16:58 -07:00 |
|
|
Paul Cruz
|
6be22f1f84
|
swap buffers instead of copying memory over
|
2017-07-17 14:39:10 -07:00 |
|
|
Paul Cruz
|
708238e07e
|
open file outside of adaptCCtx, pass to the output thread
|
2017-07-17 14:01:13 -07:00 |
|
|
Stella Lau
|
4bb42b02c1
|
Add basic chaining table
|
2017-07-17 11:53:54 -07:00 |
|
|
Paul Cruz
|
044e40db5a
|
removed freeCCtx() calls from createCCtx() so that it is not called twice during errors
|
2017-07-17 11:19:23 -07:00 |
|
|
Paul Cruz
|
50ce4eaeb6
|
added error detection for pthread initialization, added compression completion measurement, fixed const values
|
2017-07-17 10:12:44 -07:00 |
|
|
Stella Lau
|
ca300ce6e0
|
Decouple hash table from compression function
|
2017-07-14 17:17:00 -07:00 |
|
|
Paul Cruz
|
1ab3f06f00
|
updated tests to use different seeds when executing different tests
|
2017-07-14 16:29:29 -07:00 |
|
|
Stella Lau
|
6e443b4960
|
Move hash table access for own functions
|
2017-07-14 14:27:55 -07:00 |
|
|
Stella Lau
|
2d8e6c6608
|
Add more statistics
|
2017-07-14 12:31:01 -07:00 |
|
|
Stella Lau
|
55f960e8db
|
Add percentages to offset histogram
|
2017-07-14 11:00:20 -07:00 |
|
|
Stella Lau
|
4db7f12ef3
|
Add offset histogram
|
2017-07-14 10:52:03 -07:00 |
|
|
Paul Cruz
|
0c8b9436b7
|
removed goto statements for the most part
|
2017-07-13 16:38:20 -07:00 |
|
|
Stella Lau
|
175a6c6029
|
[ldm] Minor refactoring
|
2017-07-13 16:16:31 -07:00 |
|
|
Stella Lau
|
361c06df75
|
Add min/max offset to stats
|
2017-07-13 15:29:41 -07:00 |
|
|
Paul Cruz
|
65a4ce2635
|
added tests for forced compression level
|
2017-07-13 14:57:24 -07:00 |
|
|
Paul Cruz
|
0d9665cef5
|
added additional tests for performance, allowed force compression level for testing purposes
|
2017-07-13 14:46:54 -07:00 |
|
|
Stella Lau
|
2b3c7e4199
|
[ldm] Make some functions shared
|
2017-07-13 14:39:35 -07:00 |
|
|
Paul Cruz
|
9165e97fc6
|
added some tests for correctness, time, and compression ratio
|
2017-07-13 13:50:23 -07:00 |
|
|
Stella Lau
|
9306feb8fa
|
[ldm] Switch to using lib/common/mem.h and move typedefs to ldm.h
Summary:
Test Plan:
Reviewers:
Subscribers:
Tasks:
Tags:
Blame Revision:
|
2017-07-13 13:44:48 -07:00 |
|
|
Stella Lau
|
50421d9474
|
[ldm] Remove old main files
|
2017-07-13 11:45:00 -07:00 |
|
|
Stella Lau
|
68c4560701
|
[ldm] Add TODO and comment for segfaulting in compress function
|
2017-07-13 10:38:19 -07:00 |
|
|
Paul Cruz
|
766663f1f1
|
added altering dictionary size depending on compression level
|
2017-07-13 10:15:27 -07:00 |
|
|
Stella Lau
|
92bed4a7e0
|
[ldm] Add CHAR_OFFSET in hash function and extend header size
|
2017-07-12 18:47:26 -07:00 |
|
|
Paul Cruz
|
7c886db0a8
|
changed to stderr
|
2017-07-12 17:28:53 -07:00 |
|
|
Paul Cruz
|
b5b18cf664
|
changed to malloc, added comment about adaptive compression level, and changed ternary operators
|
2017-07-12 17:10:58 -07:00 |
|
|
Paul Cruz
|
954d999abf
|
fixed up freeCCtx() removed BYTE since it wasn't being used
|
2017-07-12 16:50:43 -07:00 |
|
|
Paul Cruz
|
3c16edd26a
|
added copyright header, removed clean from makefile
|
2017-07-12 16:40:24 -07:00 |
|
|
Stella Lau
|
8de82b6eb0
|
[ldm] Clean up versions
|
2017-07-12 16:31:31 -07:00 |
|
|
Paul Cruz
|
74d3a6f5ae
|
passes tests with adaptive compression level
|
2017-07-12 16:18:41 -07:00 |
|
|
Paul Cruz
|
5353d350ae
|
working with fixed compression level and fixed dictionary size
|
2017-07-12 16:02:20 -07:00 |
|
|
Stella Lau
|
8ff8cdb15b
|
[ldm] Clean up code
|
2017-07-12 15:12:07 -07:00 |
|
|
Paul Cruz
|
356ddb649f
|
working with flush job->src.size and fixed cLevel
|
2017-07-12 12:21:21 -07:00 |
|
|
Stella Lau
|
3a48ffd4fd
|
Fix sumToHash to use hash space more efficiently
|
2017-07-12 10:53:19 -07:00 |
|
|
Stella Lau
|
e0d4162464
|
Minor fix for non-rolling hash
|
2017-07-12 09:50:24 -07:00 |
|
|
Stella Lau
|
50502519fb
|
Switch to using rolling hash only
|
2017-07-12 09:47:00 -07:00 |
|
|
Stella Lau
|
583dda17a8
|
Update rolling hash
|
2017-07-11 18:13:26 -07:00 |
|
|
Paul Cruz
|
0a401852c4
|
added debug statement
|
2017-07-11 16:50:50 -07:00 |
|
|
Paul Cruz
|
72a183efad
|
changed dictionary size, added debugging statements
|
2017-07-11 15:49:52 -07:00 |
|
|
Paul Cruz
|
7c54e09347
|
updated DEBUG statements
|
2017-07-11 15:15:41 -07:00 |
|
|
Paul Cruz
|
a3c077b8c6
|
added error message, updated copying dictionary into the input buffer
|
2017-07-11 15:00:52 -07:00 |
|
|
Paul Cruz
|
34afb9b23e
|
changed to using ZSTD_compressBegin_usingDict() and fixed strange issue with ZSTD_compressContinue()
|
2017-07-11 11:50:00 -07:00 |
|
|
Paul Cruz
|
7ec5928626
|
fixed an error where -c argument wasn't working for single files
|
2017-07-11 10:23:25 -07:00 |
|
|
Stella Lau
|
f6c5d07fe2
|
Save v3
|
2017-07-11 09:23:44 -07:00 |
|
|
Stella Lau
|
6c3673f4c3
|
Add rolling hash
|
2017-07-10 22:27:43 -07:00 |
|
|
Paul Cruz
|
f918545491
|
made some progress on improving compression ratio, but problems exist with speed limits, and for some reason higher compression levels are really slow
|
2017-07-10 18:16:42 -07:00 |
|