ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,861 Commits 17 Branches 77 Tags
a21b9036fec3ff2e7fd93fb534cd4e8244c385db
Commit Graph
8861 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
senandGitHub a21b9036fe Merge pull request #2678 from senhuang42/big_endian_no_intrinsics_fuzztest 
Fuzzer test with no intrinsics on S390x (big endian)
 2021-06-09 18:46:52 +03:00
senandGitHub dd33ec9db0 Merge pull request #2700 from gauthamkrishna9991/update_readme_travis_link 
Update README for Travis CI Badge
 2021-06-09 10:41:35 +03:00
Goutham KrishnaandGitHub 912bb9fbf3 Update README for Travis CI Badge 
### Updating Badge link to the newTravis CI link.
- Update badge root to `api.travis-ci.com` (new)
  from `travis-ci.org` (old), which was migrated.
 2021-06-09 12:38:22 +05:30
aqritandGitHub dd4f6aa9e6 Flatten ZSTD_row_getMatchMask (#2681) 
* Flatten ZSTD_row_getMatchMask

* Remove the SIMD abstraction layer.
* Add big endian support.
* Align `hashTags` within `tagRow` to a 16-byte boundary. 
* Switch SSE2 to use aligned reads.
* Optimize scalar path using SWAR.
* Optimize neon path for `n == 32`
* Work around minor clang issue for NEON (https://bugs.llvm.org/show_bug.cgi?id=49577)

* replace memcpy with MEM_readST

* silence alignment warnings

* fix neon casts

* Update zstd_lazy.c

* unify simd preprocessor detection (#3)

* remove duplicate asserts

* tweak rotates

* improve endian detection

* add cast

there is a fun little catch-22 with gcc: result from pmovmskb has to be cast to uint32_t to avoid a zero-extension
but must be uint16_t to get gcc to generate a rotate instruction..

* more casts

* fix casts

better work-around for the (bogus) warning: unary minus on unsigned
 2021-06-09 08:50:25 +03:00
Felix HandteandGitHub 8a3bdfaa7b Merge pull request #2654 from wolfpld/dev 
Initialize "potentially uninitialized" pointers.
 2021-06-07 13:04:19 -04:00
senandGitHub 5fb3884f33 Merge pull request #2691 from senhuang42/per_pr_regressiontest 
Make regression test run on every PR
 2021-06-07 12:44:31 +03:00
Sen Huang 2ff5c7b59f Add no intrinsics fuzztest, rowhash compression size test, and S390X to travis 2021-06-07 00:54:53 -07:00
senhuang42 88acf0ac65 Make regression test run on every PR 2021-06-07 00:47:56 -07:00
Yann ColletandGitHub cefafc0b6e Merge pull request #2693 from binhdvo/bootcamp 
Add documentation for --patch-from
 2021-06-03 12:41:23 -07:00
Binh Vo 1e17184ad0 Add documentation for --patch-from 2021-06-03 11:12:27 -04:00
senandGitHub 0a96d00064 Merge pull request #2684 from senhuang42/old_api_ldm_blocksplit 
Add ldm and block splitter auto-enable to old api
 2021-06-03 10:10:27 +03:00
senandGitHub 18d02cbf2e Merge pull request #2686 from senhuang42/arm64fuzztest 
Add arm64 fuzz test to travis
 2021-05-27 13:50:26 -04:00
senhuang42 56b7dd121c Add arm64 fuzz test to travis 2021-05-26 14:56:47 -04:00
senandGitHub 2ee2cf9cdf Merge pull request #2682 from senhuang42/armbuild_fixtest 
Make GH Actions CI tests run apt-get update before apt-get install
 2021-05-26 14:14:43 -04:00
senhuang42 d278bede33 Update apt-get prior to tests that install packages 2021-05-26 13:38:36 -04:00
senandGitHub 414bcf239b Merge pull request #2675 from senhuang42/ci_overhaul 
[CI][1/2] Re-do the github actions workflows, migrate various travis and appveyor tests.
 2021-05-26 13:35:53 -04:00
senhuang42 939276cd0c Add ldm and block splitter auto-enable to old api 2021-05-24 13:09:32 -04:00
senhuang42 bb0cd722b6 Migrate travis CI tests 2021-05-21 09:59:57 -04:00
Nick TerrellandGitHub 3824ba6f35 Merge pull request #2673 from terrelln/regression 
[test][regression] Update results.csv
 2021-05-19 10:19:09 -07:00
Nick TerrellandGitHub ba500c8e35 Merge pull request #2674 from terrelln/trace-aix 
[trace] Refine the ZSTD_HAVE_WEAK_SYMBOLS detection
 2021-05-19 10:18:58 -07:00
Nick Terrell 746f7976ab [trace] Refine the ZSTD_HAVE_WEAK_SYMBOLS detection 
* Only enable for ELF on x86-64 or i386.
* Also explicitly disable for AIX.

Fixes #2658.
 2021-05-18 20:22:36 -07:00
Nick Terrell c468e1b9cb [test][regression] Update results.csv 
Changing the repcode search slightly, and changing when zstd is in
ext-dict vs. prefix mode in edge cases, slightly changes the compressed
results.
 2021-05-18 19:46:37 -07:00
senandGitHub d92fef0f0a Merge pull request #2667 from senhuang42/arm_tests_ci 
[CI] Add ARM tests back into CI
 2021-05-17 14:29:20 -04:00
senandGitHub 9fe1072229 Merge pull request #2668 from senhuang42/update_ci_platforms 
[CI] Fix zlib-wrapper test
 2021-05-17 14:29:04 -04:00
Yann ColletandGitHub d2c1c00712 Merge pull request #2649 from felixhandte/circleci-release-job-fix 
Fix CircleCI Config to Fully Remove `publish-github-release` Job
 2021-05-17 11:22:56 -07:00
Yann ColletandGitHub 02ece5d59f Merge pull request #2653 from TrianglesPCT/dev 
Enable SSE2 compression path to work on MSVC
 2021-05-17 11:20:50 -07:00
Yann ColletandGitHub 156145de1c Merge pull request #2660 from facebook/diaz 
improve tar compatibility
 2021-05-17 10:15:55 -07:00
senhuang42 5a75417d2b [ci] Add ARM tests back into CI 2021-05-17 13:10:57 -04:00
senhuang42 38ffe9658e [ci] Use *-latest for platforms to test on 2021-05-17 13:04:55 -04:00
Yann ColletandGitHub b8c74783a8 Merge pull request #2657 from dnelson-1901/dev-typofix 
ZSTD_VecMask_next: fix incorrect variable name in fallback code path
 2021-05-16 21:49:21 -07:00
Yann Collet 61afa154cd improve tar compatibility 
This patch is supposed to improve compatibility with less featured tar variants
"when the tar program used does not support historical options (without hyphen) nor the '-z' option."

Patch proposed by Antonio Diaz Diaz
 2021-05-15 23:09:42 -07:00
Yann Collet 0b0b62d1cf minor mention of RFC8878 
more recent update
 2021-05-15 23:04:46 -07:00
Dan Nelson 54f78e3df8 ZSTD_VecMask_next: fix incorrect variable name in fallback code path 2021-05-15 10:20:37 -05:00
TrianglesPCTandGitHub bee0ef5647 Update zstd_lazy.c 
It put the changes back when I tried to make a separate pull request, i don't understand githubs interface at all.
 2021-05-14 19:23:13 -06:00
TrianglesPCTandGitHub d688ab1e0c Add files via upload 
AVX2
 2021-05-14 19:18:12 -06:00
TrianglesPCTandGitHub bb1cdd8c63 Update zstd_lazy.c 
add space
 2021-05-14 19:11:28 -06:00
TrianglesPCTandGitHub a62856bf65 Update zstd_lazy.c 
Remove the AVX2 part
 2021-05-14 19:10:24 -06:00
TrianglesPCTandGitHub 8f7ea1afeb Update zstd_lazy.c 
Switch to other comment style
 2021-05-14 19:02:34 -06:00
Nick TerrellandGitHub accbf0af5a Merge pull request #2648 from terrelln/determinism-fuzzer 
Add determinism fuzzers and fix rare determinism bugs
 2021-05-14 17:19:41 -07:00
TrianglesPCTandGitHub 0e071214b5 Update zstd_lazy.c 
switch to unaligned load as I don't know if buffer will always be aligned to 32 bytes, and compilers aside from MSVC might actually use aligned loads
 2021-05-14 17:03:30 -06:00
TrianglesPCTandGitHub 69ac124b12 Update zstd_lazy.c 2021-05-14 16:53:19 -06:00
TrianglesPCTandGitHub 0b9f4bb0ff Update zstd_lazy.c 
use 8bit
 2021-05-14 16:47:24 -06:00
Bartosz Taudul 7012c6e7a4 Initialize "potentially uninitialized" pointers. 2021-05-15 00:40:49 +02:00
TrianglesPCTandGitHub 77d54eb3b3 Add files via upload 2021-05-14 16:40:32 -06:00
TrianglesPCTandGitHub 52f44bb365 Add files via upload 
msvc
 2021-05-14 16:33:07 -06:00
TrianglesPCTandGitHub 25bda9053a Add files via upload 
msvc suport
avx2 path
 2021-05-14 16:32:04 -06:00
W. Felix Handte 51708b2c62 Fix CircleCI Config to Fully Remove publish-github-release Job 2021-05-14 12:09:22 -04:00
Nick Terrell 725c5e4e38 [fuzz] Add determinism fuzzing to simple & dictionary round trip 
Compress the input twice in the `simple_round_trip` and
`dictionary_round_trip` fuzzers with exactly the same parameters, but
reusing the context. Then ensure that the compressed output is
identical.
 2021-05-13 17:05:59 -07:00
Nick Terrell 03c4111299 [lib] Fix dictionary invalidation logic 
Call `ZSTD_enforceMaxDist()` before each block with the beginning of the
block. This ensures that `lowLimit` is updated to `dictLimit` whenever
the ext-dict is out of range, so we can use prefix mode for speed.

This can cause non-determinism because prefix mode and ext-dict mode
match finders can return different results. It can also hurt speed
because ext-dict match finders are slower.

The scenario is:
1. Compress large data with a dictionary.
2. The dictionary goes out of bounds, so we invalidate it.
3. However, we still have `lowLimit < dictLimit`, since it is
   never updated.
4. We will call the ext-dict match finder instead of the prefix one.
 2021-05-13 17:05:59 -07:00
Nick Terrell 10b35b312b [lib] Fix off-by-one error in repcode checks 
The repcode checks disallowed repcodes that are equal to `windowLow`.
This is slightly inefficient, but isn't a problem on its own. Together
with the next commit, it cause non-determinism.
 2021-05-13 17:05:59 -07:00