ddidderr/zstd-rs
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,656 Commits 17 Branches 77 Tags
dev
Commit Graph
10656 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
daniellerozenblitandGitHub e2fc93340f Merge branch 'dev' into http-to-https 2022-12-15 10:46:13 -05:00
Nick TerrellandNick Terrell 728e73ebb4 [legacy] Remove FORCE_MEMORY_ACCESS and only use memcpy 
Delete unaligned memory access code from the legacy codebase by removing all the
non-memcpy functions. We don't care about speed at all for this codebase, only
simplicity.
 2022-12-14 17:54:35 -08:00
Nick TerrellandNick Terrell f31b83ff34 [decompress] Fix nullptr addition & improve fuzzer 
Fix an instance of `NULL + 0` in `ZSTD_decompressStream()`. Also, improve our
`stream_decompress` fuzzer to pass `NULL` in/out buffers to
`ZSTD_decompressStream()`, and fix 2 issues that were immediately surfaced.

Fixes #3351
 2022-12-14 17:54:22 -08:00
Nick TerrellandNick Terrell 15f32ad74c [fileio] Separate parameter adaption from display update rate 
Split the logic for parameter adaption from the logic to update the display rate.
This decouples the two updates, so changes to display updates don't affect
parameter adaption.

Also add a test case that checks that parameter adaption actually happens.

This fixes Issue #3353, where --adapt is broken when --no-progress is passed.
 2022-12-14 17:08:21 -08:00
Alex Xu (Hello71)andNick Terrell a78c91ae59 Use proper unaligned access attributes 
Instead of using packed attribute hack, just use aligned attribute. It
improves code generation on armv6 and armv7, and slightly improves code
generation on aarch64. GCC generates identical code to regular aligned
access on ARMv6 for all versions between 4.5 and trunk, except GCC 5
which is buggy and generates the same (bad) code as packed access:
https://gcc.godbolt.org/z/hq37rz7sb
 2022-12-14 16:00:37 -08:00
Nick TerrellandNick Terrell fbff7827fa Refactor progress bar & summary line logic 
* Centralize the logic about whether to print the progress bar or not in
  the `*_PROGRESS()` macros.
* Centralize the logc about whether to print the summary line or not in
  `FIO_shouldDisplayFileSummary()` and
  `FIO_shouldDisplayMultipleFileSummary()`.
* Make `--progress` work for non-zstd (de)compressors.
* Clean up several edge cases in compression and decompression progress
  printing along the way. E.g. wrong log level, or missing summary line.

One thing I don't like about stdout mode, which sets the display level
to 1, is that warnings aren't displayed. After this PR, we could change
stdout mode from lowering the display level, to defaulting to implied
`--no-progress`. But, I think that deserves a separate PR.
 2022-12-14 15:44:09 -08:00
Nick TerrellandNick Terrell e58a39f84e Allow tests to fake stdin/stdout/stderr is a console 
We've been unable to effectively test cases where stdin/stdout/stderr
are consoles, because in our test cases they generally aren't. Allow the
command line flags `--fake-std{in,out,err}-is-console` to tell the CLI
to pretend that std{in,out,err} is a console.
 2022-12-14 15:44:09 -08:00
Rosen PenevandNick Terrell 031de3c69c meson: make backtrace dependency on execinfo 
musl libc for example has no such header.

Signed-off-by: Rosen Penev <rosenp@gmail.com>
 2022-12-14 15:39:51 -08:00
daniellerozenblitandGitHub 72845ebad2 Merge pull request #3346 from daniellerozenblit/seekable-format-empty-string 
Seekable format empty string
 2022-12-14 14:28:32 -05:00
Elliot GorokhovskyandGitHub 588073c920 Merge pull request #3349 from embg/frame_header_fields 
Reserve two fields in ZSTD_frameHeader
 2022-12-14 10:58:35 -05:00
daniellerozenblitandGitHub 326e442dd9 Merge branch 'facebook:dev' into optimal-huff-depth-speed 2022-12-14 10:24:07 -05:00
Danielle Rozenblit 4dffc35f2e Convert references to https from http 2022-12-14 06:58:35 -08:00
Elliot Gorokhovsky c43da3d605 Fix C90 compat 2022-12-13 18:01:32 -08:00
Elliot Gorokhovsky e1e82f74f1 Reserve two fields in ZSTD_frameHeader 2022-12-13 17:45:05 -08:00
Nick TerrellandNick Terrell e767d5c7c1 [contrib][linux-kernel] Fix stack detection for newer gcc 
Newer gcc versions were getting smart and omitting the `memset()`.
Get around this issue by outlining the `memset()` into a different
function. This test is still hacky, but it works...
 2022-12-13 15:56:53 -08:00
daniellerozenblitandGitHub b0bcbbfe16 Merge pull request #3345 from daniellerozenblit/fix-1GiB-file-bug 
Fix Window Resizing Edge Case
 2022-12-13 17:56:38 -05:00
Yann ColletandGitHub 0c88a7b969 Merge pull request #3347 from facebook/fix_m68k_ci 
Fix m68k CI tests on Github Actions
 2022-12-13 14:05:37 -08:00
Danielle Rozenblit 9b9ad5af3f use .ignore for stderr output in window-resize test case 2022-12-13 13:52:54 -08:00
Danielle Rozenblit 32bb667138 added test to cli-tests 2022-12-13 12:45:41 -08:00
Yann Collet d081d98ae7 Fix m68k CI tests on Github Actions 
seems there is a bug in the qemu version shipped with Ubuntu 22.04
 2022-12-13 12:36:53 -08:00
Danielle Rozenblit 69ec75f0d5 fix window resizing edge case 2022-12-13 08:35:20 -08:00
Danielle Rozenblit aece0f258a free memory in test case 2022-12-13 08:15:16 -08:00
daniellerozenblitandGitHub 6ad71a3f0b Merge pull request #10 from yhoogstrate/seekable_header_skip 
seekable_format no header when compressing empty string to stream
 2022-12-12 17:58:58 -05:00
FRexandNick Terrell dc39409a03 Print checksum value for single frame files in cli with -v -l options 2022-12-12 10:53:57 -08:00
Yann ColletandGitHub c91a84221b Merge pull request #3337 from facebook/dependabot/github_actions/microsoft/setup-msbuild-1.1.3 
Bump microsoft/setup-msbuild from 1.0.2 to 1.1.3
 2022-12-11 23:59:25 -08:00
Yann ColletandGitHub 2b212fd924 Merge pull request #3339 from facebook/dependabot/github_actions/skx/github-action-publish-binaries-release-2.0 
Bump skx/github-action-publish-binaries from release-1.3 to 2.0
 2022-12-11 23:59:07 -08:00
dependabot[bot]andGitHub 9730aa4326 Bump actions/upload-artifact from 1 to 3 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 1 to 3.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/v1...v3)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-12-08 18:39:58 +00:00
dependabot[bot]andGitHub 88647489d4 Bump skx/github-action-publish-binaries from release-1.3 to 2.0 
Bumps [skx/github-action-publish-binaries](https://github.com/skx/github-action-publish-binaries) from release-1.3 to 2.0. This release includes the previously tagged commit.
- [Release notes](https://github.com/skx/github-action-publish-binaries/releases)
- [Commits](https://github.com/skx/github-action-publish-binaries/compare/release-1.3...release-2.0)

---
updated-dependencies:
- dependency-name: skx/github-action-publish-binaries
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-12-08 18:39:55 +00:00
dependabot[bot]andGitHub 91c7547fb5 Bump microsoft/setup-msbuild from 1.0.2 to 1.1.3 
Bumps [microsoft/setup-msbuild](https://github.com/microsoft/setup-msbuild) from 1.0.2 to 1.1.3.
- [Release notes](https://github.com/microsoft/setup-msbuild/releases)
- [Changelog](https://github.com/microsoft/setup-msbuild/blob/master/building-release.md)
- [Commits](https://github.com/microsoft/setup-msbuild/compare/v1.0.2...v1.1.3)

---
updated-dependencies:
- dependency-name: microsoft/setup-msbuild
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-12-08 18:39:49 +00:00
Yann ColletandGitHub 585deb807b Merge pull request #3284 from DimitriPapadopoulos/actions 
Automatically update GitHub Actions in the future
 2022-12-08 10:39:21 -08:00
Yann ColletandGitHub 80cf73fd66 Merge pull request #3320 from cwoffenden/msvc-arm64-size_t 
Fix for MSVC C4267 warning on ARM64 (which becomes error C2220 with /WX)
 2022-12-04 18:55:30 -08:00
Elliot GorokhovskyandGitHub a89e6b6812 Merge pull request #3331 from embg/issue3330 
Fix gcc-7 and gcc-8 CI breakages
 2022-12-02 18:34:37 -05:00
Elliot Gorokhovsky 3f0b912a80 Fix gcc-7 and gcc-8 CI breakages 2022-12-02 16:35:17 -05:00
Yann ColletandGitHub e873335ffe Merge pull request #3327 from eli-schwartz/meson-version-simplify 
meson: get version up front
 2022-12-01 06:46:23 -08:00
Eli Schwartz 6c3ed93c27 meson: get version up front 
Run the scraper command to establish the project version immediately,
rather than wait for the build to be configured. This simplifies the
code and ensures that project introspection works correctly.
 2022-11-30 21:36:24 -05:00
Yann Collet 4d82a4d3f2 minor : reorder --help 
more logical context grouping
 2022-11-22 07:23:45 -08:00
Yann Collet ecd7601c36 minor: proper pledgedSrcSize trace 2022-11-22 06:00:45 -08:00
Elliot GorokhovskyandGitHub 2a356737d8 Merge pull request #3321 from embg/ldmCparamFix 
Complete migration of ZSTD_c_enableLongDistanceMatching to ZSTD_paramSwitch_e framework
 2022-11-21 17:37:59 -05:00
Elliot Gorokhovsky bb3c01c853 Migrate other test usages of boolean LDM flag to paramSwitch enum 2022-11-21 16:20:38 -05:00
Elliot Gorokhovsky 3720910d06 Fix fuzzer failure 2022-11-21 16:09:04 -05:00
Elliot Gorokhovsky c8d870fe52 Improve LDM cparam validation logic 2022-11-21 15:39:18 -05:00
Carl Woffenden 0547c3d3f8 Random edit to re-run the CI 
I don't believe the (x64) Mac failure is related to error since it would take the SSE path.
 2022-11-19 19:04:08 +01:00
Carl Woffenden 0168914490 Fix for MSVC C4267 error 2022-11-18 11:31:17 +01:00
Elliot GorokhovskyandGitHub b1182fe242 Merge pull request #3300 from yiyuaner/dev 
Fix the wrong check for buffer overrun in UTIL_mergeFileNamesTable
 2022-11-02 15:28:02 -04:00
Felix HandteandGitHub bd4581c311 Merge pull request #3309 from joycebrum/dev 
Fix action error by upgrading Scorecard GHA to 2.0.6
 2022-11-01 17:53:37 -04:00
Joyce Brum a8f8dc8c5c fix: upgrade scorecard action to 2.0.6 
Signed-off-by: Joyce Brum <joycebrum@google.com>
 2022-11-01 14:55:31 -03:00
Elliot GorokhovskyandGitHub bb23f7b99b Merge pull request #3304 from GermanAizek/dev 
Rewrite check *bufStart condition
 2022-11-01 12:45:42 -04:00
appleman4321 5334339421 Rewrite checking condition bufStart pointer NULL 2022-11-01 02:31:09 +03:00
Danielle Rozenblit c2638212af Change threshold for benchmarking 2022-10-27 13:13:17 -07:00
daniellerozenblitandGitHub 0e1de8a205 Merge branch 'facebook:dev' into optimal-huff-depth-speed 2022-10-27 13:22:31 -04:00