sharpetronics/zstd
1
0
Fork 0
mirror of https://github.com/facebook/zstd.git synced 2025-10-15 00:02:02 -04:00
Code Issues Projects Releases Wiki Activity
8,660 Commits 38 Branches 77 Tags
Commit Graph

8660 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sen Huang
2a907bf4aa Move lastCountSize into a returned struct, fix MSAN error 2021-03-25 09:11:15 -07:00
Nick Terrell
f8ac0ea7ef
Merge pull request #2539 from terrelln/linux-kernel-fixes 
Fixes for the next linux kernel patch version
 2021-03-24 10:34:29 -07:00
sen
bf542c8a8d
Merge pull request #2447 from senhuang42/block_splitter_v2 
Recursive block splitting
 2021-03-24 12:27:22 -04:00
Yann Collet
8889ca36fc
Merge pull request #2554 from facebook/fix2553 
fix man page typo
 2021-03-24 08:55:33 -07:00
Sen Huang
5b566ebe08 Rename *compressSequences*() functions for clarity 2021-03-24 08:21:29 -07:00
Sen Huang
0ef1f935b7 Add a fallback in case the total blocksize of split blocks exceeds raw block size 2021-03-24 08:21:29 -07:00
Sen Huang
c90e81a692 Enable block splitter by default when applicable 2021-03-24 08:21:29 -07:00
Sen Huang
e34332834a Clean up various functions, add debuglogging for estimate vs. actual sizes 2021-03-24 08:21:29 -07:00
Sen Huang
41c3eae6d9 Fix various fuzzer failures: repcode history, superblocks 2021-03-24 08:21:29 -07:00
senhuang42
0633bf17c3 Change 1.3.4 bugfix to be cross-compatible with superblocks and normal compression 2021-03-24 08:21:29 -07:00
senhuang42
eb1ee8686d Refactor buildSequencesStatistics() to avoid pointer increment for superblocks 2021-03-24 08:21:29 -07:00
senhuang42
e2bb215117 Add unit tests and fuzzer param 2021-03-24 08:21:09 -07:00
senhuang42
de52de1347 Add recursive block split algorithm 2021-03-24 08:21:09 -07:00
senhuang42
f06f6626ed Update function names for consistency 2021-03-24 08:20:54 -07:00
senhuang42
c56d6e49e8 Add block splitter to experimental params 2021-03-24 08:20:54 -07:00
senhuang42
2949a95224 Refactor block compression logic into single function 2021-03-24 08:20:54 -07:00
senhuang42
c05c090cc2 Centralize entropy statistics calculations to zstd_compress.c 2021-03-24 08:20:29 -07:00
Yann Collet
0f99a0d987 fix man page typo 
fix #2553 detected by @jwilk
 2021-03-24 05:55:04 -07:00
sen
c48889f097
Merge pull request #2538 from senhuang42/monotonicity_test 
Add memory monotonicity test over srcSize
 2021-03-22 16:54:34 -04:00
Nick Terrell
ebc2dfa821
Merge pull request #2524 from terrelln/huf-stack-reduction 
[huf] Reduce stack usage of HUF_readDTableX2 by ~972 bytes
 2021-03-22 12:37:54 -07:00
Nick Terrell
634bfd339f [FSE] Clean up workspace using dynamically sized struct 2021-03-22 11:07:07 -07:00
Yann Collet
8b97931ae1
Merge pull request #2550 from facebook/vvv_srcSize 
fix #2549
 2021-03-22 10:44:44 -07:00
Sen Huang
dff4a0e867 Make ZSTD_estimateCCtxSize_internal() loop through all srcSize parameter sets as well 2021-03-21 16:15:31 -07:00
Yann Collet
9fb4a42c7b fix #2549 2021-03-20 17:29:41 -07:00
Yann Collet
515807182f
Merge pull request #2548 from SupervisedThinking/build_fix 
meson: fix build by adding missing files
 2021-03-19 15:20:14 -07:00
SupervisedThinking
edf2b1176d meson: fix build by adding missing files 
fixes https://github.com/facebook/zstd/issues/2519
 2021-03-19 19:52:45 +01:00
sen
eace4abc25
Merge pull request #2540 from senhuang42/fix_dds_supported 
Fix dedicated dict search isSupported() requirements.
 2021-03-17 23:25:53 -04:00
Nick Terrell
756bd59322 [huf][fse] Clean up workspaces 
* Move `counting` to a struct in `FSE_decompress_wksp_body()`
* Fix error code in `FSE_decompress_wksp_body()`
* Rename a variable in `HUF_ReadDTableX2_Workspace`
 2021-03-17 16:50:37 -07:00
Sen Huang
77ae664ba6 Fix ZSTD_dedicatedDictSearch_isSupported() requirements 2021-03-16 17:36:05 -07:00
senhuang42
386111adec Add a nbSeq argument to compressSequences() 
Refactor ZSTD_compressBlock_internal() to do the block header write within and add nbSeq argument to compressSequences()
 2021-03-16 14:04:22 -07:00
senhuang42
98764493cf Move block header write into compressBlock_internal() 2021-03-16 14:04:22 -07:00
Nick Terrell
ea288e0d8e [lib] Bump zstd version number 2021-03-16 11:47:27 -07:00
Nick Terrell
cd1551d261 [lib][tracing] Add ZSTD_NO_TRACE macro 
When defined, it disables tracing, and avoids including the header.
 2021-03-16 11:47:27 -07:00
Nick Terrell
7222614a19 [contrib][freestanding] Remove tracing support 
Remove tracing support from `freestanding.py` to keep things simple.
 2021-03-16 11:47:27 -07:00
Nick Terrell
e4b914e663 [contrib][linux] Expose zstd headers to avoid duplication 
Expose the zstd headers in `include/linux` to avoid struct duplication.
This makes the member names not follow Kernel style guidelines, and
exposes the zstd symbols. But, the LMKL reviewers are okay with that.
 2021-03-16 11:47:22 -07:00
Nick Terrell
49a9e070f5 [contrib][linux-kernel] Update test include stubs 
Update the test include stubs so they are able to run the current zstd
version in the kernel, so I can compare stack usage.
 2021-03-16 11:40:24 -07:00
Nick Terrell
d2dd35ae65 [contrib][linux-kernel] Fix unaligned.h 
Fix the `unaligned.h` shim in the tests that was causing corruption in
the tests. Note that this is a problem with the test shim, not the
kernel code.
 2021-03-16 11:40:24 -07:00
sen
413b3198b0
Merge pull request #2534 from foxeng/fix-seek-descriptor-check 
Fix seek table descriptor check when loading
 2021-03-16 13:09:00 -04:00
Sen Huang
b9dd821441 Add mem monotonicity test over srcSize 2021-03-16 08:24:26 -07:00
Felix Handte
d1a6d080cf
Merge pull request #2535 from felixhandte/gha-release-artifacts 
Add GitHub Action to Automatically Publish Release Tarballs
 2021-03-15 13:58:27 -04:00
W. Felix Handte
d2b7f2e27a Allow a Passphrase on the Key 2021-03-15 12:48:53 -04:00
W. Felix Handte
eed64d75f4 Maintain Artifact Name Backwards Compatibility 
When the tag is `v1.2.3`, name the artifacts `zstd-1.2.3.tar*` rather than
`zstd-v1.2.3.tar*`. When the tag doesn't match, use the full tag.
 2021-03-15 11:59:31 -04:00
Fotis Xenakis
316f3d2224 Run generic-dev:gcc-8-asan-ubsan-testzstd on latest Ubuntu 2021-03-13 11:42:47 +02:00
W. Felix Handte
a51511e7a7 Remove CircleCI Artifact Generation 2021-03-12 17:35:11 -05:00
Fotis Xenakis
3c6f5d5eca Fix seekable test to provide valid descriptor 2021-03-13 00:00:08 +02:00
Fotis Xenakis
21697b9c9e Fix seek table descriptor check when loading 2021-03-12 23:07:15 +02:00
W. Felix Handte
5d1fec8ce1 Add GitHub Action to Automatically Publish Release Tarballs 
This commit introduces a GitHub action that is triggered on release creation,
which creates the release tarball, compresses it, hashes it, signs it, and
attaches all of those files to the release.
 2021-03-12 12:33:58 -05:00
sen
a3feed8dcd
Merge pull request #2517 from PaulBone/num_cores 
Make the number of physical CPU cores detection more robust
 2021-03-08 11:14:34 -05:00
Yann Collet
3d6c903056
Merge pull request #2521 from animalize/doc_free 
doc: ZSTD_free*() functions accept NULL pointer
 2021-03-06 21:33:28 -08:00
Nick Terrell
3b1aba42cc [fse] Reduce stack usage of FSE_decompress_wksp() by 512 bytes 
* Move `counting` into the workspace
* Inrease `HUF_DECOMPRESS_WORKSPACE_SIZE` by 512 bytes
 2021-03-05 13:24:27 -08:00