ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Add array to keep track of frequency within active segment, fix malloc bug, update benchmarking result

Browse Source
This commit is contained in:
Jennifer Liu
2018-07-26 13:53:13 -07:00
parent 2333ecb173
commit 3b163e0b5b
4 changed files with 75 additions and 58 deletions
Download Patch File Download Diff File Expand all files Collapse all files
contrib/experimental_dict_builders/benchmarkDictBuilder/README.md
+32 -28
View File
@@ -14,42 +14,46 @@ make ARG="in=../../../lib/dictBuilder in=../../../lib/compress"
###Benchmarking Result:
d=8
f=23
freq[i] = 0 when dmer added to best segment
github:
| Algorithm | Speed(sec) | Compression Ratio |
| ------------------|:-------------:| ------------------:|
| nodict | 0.000004 | 2.999642 |
| random | 0.148247 | 8.786957 |
| cover | 56.331553 | 10.641263 |
| legacy | 0.917595 | 8.989482 |
| fastCover(opt) | 13.169979 | 10.215174 |
| fastCover(k=200) | 2.692406 | 8.657219 |
| ----------------- | ------------- | ------------------ |
| nodict | 0.000007 | 2.999642 |
| random | 0.150258 | 8.786957 |
| cover | 60.388853 | 10.641263 |
| legacy | 0.965050 | 8.989482 |
| fastCover(opt) | 84.968131 | 10.614747 |
| fastCover(k=200) | 6.465490 | 9.484150 |
hg-commands
| Algorithm | Speed(sec) | Compression Ratio |
| ----------------- |:-------------:| ------------------:|
| nodict | 0.000007 | 2.425291 |
| random | 0.093990 | 3.489515 |
| cover | 58.602385 | 4.131136 |
| legacy | 0.865683 | 3.911896 |
| fastCover(opt) | 9.404134 | 3.977229 |
| fastCover(k=200) | 1.037434 | 3.810326 |
| ----------------- | ------------- | ------------------ |
| nodict | 0.000005 | 2.425291 |
| random | 0.084348 | 3.489515 |
| cover | 60.144894 | 4.131136 |
| legacy | 0.831981 | 3.911896 |
| fastCover(opt) | 59.030437 | 4.157595 |
| fastCover(k=200) | 3.702932 | 4.134222 |
hg-changelog
| Algorithm | Speed(sec) | Compression Ratio |
| ----------------- |:-------------:| ------------------:|
| nodict | 0.000022 | 1.377613 |
| random | 0.551539 | 2.096785 |
| cover | 221.370056 | 2.188654 |
| legacy | 2.405923 | 2.058273 |
| fastCover(opt) | 49.526246 | 2.124185 |
| fastCover(k=200) | 9.746872 | 2.114674 |
| ----------------- | ------------- | ------------------ |
| nodict | 0.000004 | 1.377613 |
| random | 0.555964 | 2.096785 |
| cover | 214.423753 | 2.188654 |
| legacy | 2.180249 | 2.058273 |
| fastCover(opt) | 102.261452 | 2.180347 |
| fastCover(k=200) | 11.81039 | 2.170673 |
hg-manifest
| Algorithm | Speed(sec) | Compression Ratio |
| ----------------- |:-------------:| ------------------:|
| nodict | 0.000019 | 1.866385 |
| random | 1.083536 | 2.309485 |
| cover | 928.894887 | 2.582597 |
| legacy | 9.110371 | 2.506775 |
| fastCover(opt) | 116.508270 | 2.525689 |
| fastCover(k=200) | 12.176555 | 2.472221 |
| ----------------- | ------------- | ------------------ |
| nodict | 0.000006 | 1.866385 |
| random | 1.063974 | 2.309485 |
| cover | 909.101849 | 2.582597 |
| legacy | 8.706580 | 2.506775 |
| fastCover(opt) | 188.598079 | 2.596761 |
| fastCover(k=200) | 13.392734 | 2.592985 |