Commit Graph
3359 Commits
Author SHA1 Message Date
Sean Purcell c8b2df7d62 Compile CLI using files instead of objs
This avoids conflicts between how the library was
configured and how the CLI was configured.
2017-04-17 17:13:47 -07:00
Sean Purcell e6c504dbe6 Update -T0 comment in man page 2017-04-17 17:12:02 -07:00
Yann Collet 9c4c970399 Merge branch 'dev' into compressionFlow 2017-04-17 16:33:09 -07:00
Yann ColletandGitHub ba14b389b4 Merge pull request #660 from iburinoc/zstdmt-test
Add multithreading tests to playTests.sh
2017-04-17 16:19:46 -07:00
Yann Collet c47c68f6ca proper evaluation of Huffman CTable size 2017-04-17 16:14:21 -07:00
Sean Purcell 5935c990a0 Add zstdmt and -T0 to man page 2017-04-17 16:05:20 -07:00
Yann Collet f0c9437fdf Merge branch 'dev' into compressionFlow 2017-04-17 15:48:13 -07:00
Yann ColletandGitHub a9e92bea5c Merge pull request #661 from iburinoc/zstdmt-default
Make zstd compile with mt by default
2017-04-17 15:43:59 -07:00
Yann Collet 415cb68e53 Merge branch 'dev' into compressionFlow 2017-04-17 14:51:05 -07:00
Sean Purcell f6ef4db20e Install zstdmt even without threading support 2017-04-17 12:21:11 -07:00
Sean Purcell d845dab69c Fix input size too small to trigger zstdmt 2017-04-17 12:10:58 -07:00
Sean Purcell 5a61f36474 Make zstd compile with mt by default 2017-04-17 12:06:02 -07:00
Sean Purcell c424ec2eae Add multithreading tests to playTests.sh 2017-04-17 11:41:46 -07:00
Yann ColletandGitHub ce1cf8691d Merge pull request #659 from bapt/bsd-multithread
Enable multithreading on BSD
2017-04-16 23:14:10 -07:00
Baptiste Daroussin 7dd14d03b0 Enable multithreading on BSD 2017-04-15 16:25:08 +02:00
Yann Collet 2afb075382 Merge branch 'dev' into compressionFlow 2017-04-14 15:08:31 -07:00
Yann Collet f913cbed33 fixed : memory leak in fuzzer test 2017-04-13 22:46:51 -07:00
Yann ColletandGitHub d68ed73172 Merge pull request #656 from iburinoc/core-count
Make -T0 mean "number of physical cores"
2017-04-13 20:29:41 -07:00
Sean Purcell 9626cf1ac6 Address @terrelln's comments 2017-04-13 17:48:35 -07:00
Yann ColletandGitHub 95bb8fff92 Merge pull request #657 from iburinoc/appveyor
Make appveyor small tests use new mingw as well
2017-04-13 16:36:53 -07:00
Sean Purcell e4f3235c85 Add 0 initializers to static variables 2017-04-13 16:34:28 -07:00
Sean Purcell 42bac7fa84 Change ifndef's to undef's 2017-04-13 15:35:05 -07:00
Sean Purcell ad8da8855b Make appveyor small tests use new mingw as well 2017-04-13 14:40:06 -07:00
Sean Purcell 9227aae001 Fix clang linux compilation 2017-04-13 14:06:40 -07:00
Sean Purcell 3b6207d4bd Fix compilation on windows 2017-04-13 14:04:10 -07:00
Sean Purcell f876f1200c Fix compilation on macOS 2017-04-13 12:33:45 -07:00
Sean Purcell afa48518e2 -T0 detects number of physical cores 2017-04-13 12:28:28 -07:00
Sean Purcell 2785b28e05 Reduce the limit on frame decompressed size to 2 GB 2017-04-12 14:09:13 -07:00
Yann ColletandGitHub 7ab008c57e Merge pull request #655 from iburinoc/large-data
Test large files on-disk in playTests.sh
2017-04-12 13:54:54 -07:00
Sean Purcell 5ee1135f30 s/chunk/frame/ 2017-04-12 11:15:50 -07:00
Sean Purcell e80f1d74b3 Address PR comments and minor fixes 2017-04-12 11:15:46 -07:00
Yann Collet 88009a8ba2 removed srcSize control from CStream
since it's already done from lower bufferless API level
2017-04-12 00:51:24 -07:00
Yann Collet 20d5e03893 content size is controlled at bufferless level
so it's active for all entry points

Also : added relevant test (wrong content size) in fuzzer
2017-04-11 18:34:02 -07:00
Yann Collet 6ab02e16b8 Merge branch 'dev' into compressionFlow 2017-04-11 17:42:15 -07:00
Sean Purcell d37e1df2ab Fix message 2017-04-11 17:33:26 -07:00
Sean Purcell eb70d219fd Add test of file > 4GB to playTests 2017-04-11 17:15:13 -07:00
Yann Collet 5c42d0edc8 cli : better status display for zstdmt in 1-thread mode 2017-04-11 16:57:32 -07:00
Yann Collet 324c2cd908 Merge branch 'dev' of github.com:facebook/zstd into dev 2017-04-11 14:42:46 -07:00
Yann Collet 0e30059ba1 cli : FIO_createDictBuffer() replaces FIO_loadFile()
makes it more explicit that it allocates a buffer
and that it's meant to be used for dictionary.

Also : simplified function a bit,
now only works for dictionaries up to DICTSIZE_MAX
2017-04-11 14:41:02 -07:00
Sean Purcell d048fefef7 Move seekable format content to /contrib 2017-04-11 14:38:56 -07:00
Sean Purcell b13da709e8 Fixes 2017-04-11 14:11:18 -07:00
Sean Purcell 45f3bc4801 Add format specification 2017-04-11 13:53:09 -07:00
Sean Purcell a3b7c22604 Make seekable streams work w/ small buffers, misc fixes 2017-04-11 13:53:09 -07:00
Sean Purcell c3ba15e48f Seekable compression demo 2017-04-11 13:53:09 -07:00
Yann ColletandGitHub 1f72b07cc0 Merge pull request #653 from terrelln/dev
Update linux kernel patch
2017-04-11 13:46:40 -07:00
Nick Terrell b633377d0e Add BtrFS benchmarks 2017-04-11 12:40:53 -07:00
Yann Collet 4ee6b15dac force contentSizeFlag=0 when using ZSTD_initCStream_usingCDict()
because by definition srcSize is not known when using this prototype.
added relevant test

Note : this use was already working, because at a later stage
(both ZSTD_compressBegin_usingCDict() and ZSTD_copyCCtx())
pledgedSrcSize=0 is translated into "unknown", no matter the frame parameter.
This is not correct, but of little importance,
as the medium term plan is to no longer set fParams within CDict
2017-04-11 11:59:44 -07:00
Nick Terrell b4dd3378f1 Add BtrFS patch for 4.10 kernel 2017-04-11 11:50:24 -07:00
Yann Collet ab9162ebb4 simplified call graph
by calling ZSTD_compressBegin_internal() instead of ZSTD_compressBegin_advanced()
2017-04-11 10:46:20 -07:00
Yann Collet e88034fe26 simplified ZSTD_initCStream*() flow
all variants converge towards ZSTD_initCStream_stage2()
2017-04-10 22:24:02 -07:00