Commit Graph
3760 Commits
Author SHA1 Message Date
Stella Lau 4352e09cb0 Avoid recounting match lengths with ZSTD_count 2017-07-18 18:35:25 -07:00
Stella Lau 1fa223859f Switch to using ZSTD_count instead of function pointer 2017-07-18 18:05:10 -07:00
Stella Lau 19258f51c1 Make the meaning of LDM_MEMORY_USAGE consistent across tables 2017-07-18 14:25:39 -07:00
Stella Lau fc41a87964 Experiment with using a lag when hashing 2017-07-17 18:13:09 -07:00
Stella Lau a00e406231 Remove version archive 2017-07-17 15:17:32 -07:00
Stella Lau 15a041adbf Add function to get valid entries only from table 2017-07-17 15:16:58 -07:00
Stella Lau 4bb42b02c1 Add basic chaining table 2017-07-17 11:53:54 -07:00
Stella Lau ca300ce6e0 Decouple hash table from compression function 2017-07-14 17:17:00 -07:00
Stella Lau 6e443b4960 Move hash table access for own functions 2017-07-14 14:27:55 -07:00
Stella Lau 2d8e6c6608 Add more statistics 2017-07-14 12:31:01 -07:00
Stella Lau 55f960e8db Add percentages to offset histogram 2017-07-14 11:00:20 -07:00
Stella Lau 4db7f12ef3 Add offset histogram 2017-07-14 10:52:03 -07:00
Stella Lau 175a6c6029 [ldm] Minor refactoring 2017-07-13 16:16:31 -07:00
Stella Lau 361c06df75 Add min/max offset to stats 2017-07-13 15:29:41 -07:00
Stella Lau 2b3c7e4199 [ldm] Make some functions shared 2017-07-13 14:39:35 -07:00
Stella Lau 9306feb8fa [ldm] Switch to using lib/common/mem.h and move typedefs to ldm.h
Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Blame Revision:
2017-07-13 13:44:48 -07:00
Stella Lau 50421d9474 [ldm] Remove old main files 2017-07-13 11:45:00 -07:00
Stella Lau 68c4560701 [ldm] Add TODO and comment for segfaulting in compress function 2017-07-13 10:38:19 -07:00
Stella Lau 92bed4a7e0 [ldm] Add CHAR_OFFSET in hash function and extend header size 2017-07-12 18:47:26 -07:00
Stella Lau 8de82b6eb0 [ldm] Clean up versions 2017-07-12 16:31:31 -07:00
Stella Lau 8ff8cdb15b [ldm] Clean up code 2017-07-12 15:12:07 -07:00
Stella Lau 3a48ffd4fd Fix sumToHash to use hash space more efficiently 2017-07-12 10:53:19 -07:00
Stella Lau e0d4162464 Minor fix for non-rolling hash 2017-07-12 09:50:24 -07:00
Stella Lau 50502519fb Switch to using rolling hash only 2017-07-12 09:47:00 -07:00
Stella Lau 583dda17a8 Update rolling hash 2017-07-11 18:13:26 -07:00
Stella Lau f6c5d07fe2 Save v3 2017-07-11 09:23:44 -07:00
Stella Lau 6c3673f4c3 Add rolling hash 2017-07-10 22:27:43 -07:00
Stella Lau ef2b728316 Clean up and refactor compress function 2017-07-10 15:48:47 -07:00
Stella Lau e4155b11d7 Add warning flags to makefile and clean up code to remove warnings 2017-07-10 13:08:19 -07:00
Stella Lau 10a71d9f1c Add compression context 2017-07-10 12:38:27 -07:00
Stella Lau ae9cf235d6 Add LDM_DCtx 2017-07-10 07:38:09 -07:00
Stella Lau 5432214ee3 Minor refactoring 2017-07-10 06:50:49 -07:00
Stella Lau b94b468e84 Merge branch 'ldm' of https://github.com/stellamplau/zstd into ldm 2017-07-10 06:32:46 -07:00
Stella Lau 474e06ac5b Minor refactoring 2017-07-10 06:32:29 -07:00
Stella Lau eb280cd568 Add folder for old versions 2017-07-10 06:32:05 -07:00
Stella Lau 719ccdc5a5 Update mainfile 2017-07-09 22:45:54 -07:00
Stella Lau acdeb9f302 Add compression statistics 2017-07-07 17:09:28 -07:00
Stella Lau 4076be09ec [ldm] Update to hash every position 2017-07-07 14:52:40 -07:00
Stella Lau 7945f9ee47 Fix offset overflow bug 2017-07-07 14:14:01 -07:00
Stella Lau f791fc27e3 Add header with compress and decompress size 2017-07-07 12:44:29 -07:00
Stella Lau 3bbfa1249e Update compressor and decompressor 2017-07-06 16:47:08 -07:00
Stella Lau b96ad327a4 Add simple compress and decompress functions 2017-07-06 15:23:15 -07:00
Stella Lau 8aa34a7608 Switch to mmapping files 2017-07-06 07:30:49 -07:00
Stella Lau 88f3d8641e Initial long distance matcher commit 2017-07-05 13:57:07 -07:00
Yann Collet 27e883371d fixed wrong assert() condition
A single job created by ZSTDMT_compress() can be < 256KB
if data to compress is < 256 KB
(in which case it is delegated to single thread mode)
2017-07-04 19:33:16 -07:00
Yann Collet 2cb9774f5e more precise estimation of amount to flush at end of stream (single thread mode)
also : can use DEBUGLEVEL variable in /tests
2017-07-04 12:39:26 -07:00
Yann Collet 6383372dec fixed : 0-copy in NULL is UB 2017-07-04 10:36:41 -07:00
Yann ColletandGitHub 5051dd39ca Merge pull request #743 from facebook/fullbench
compress_generic() automatic optimization opportunities
2017-07-03 21:26:38 -07:00
Yann ColletandGitHub 9ceea19dc1 Merge pull request #747 from facebook/noExit
No exit() on decoding errors
2017-07-03 18:15:13 -07:00
Yann Collet 2de2396a36 refactor ZSTDMT_compress() 2017-07-03 16:23:36 -07:00