sharpetronics/zstd
1
0
Fork 0
mirror of https://github.com/facebook/zstd.git synced 2025-10-04 00:02:33 -04:00
Code Issues Projects Releases Wiki Activity
11,207 Commits 38 Branches 77 Tags
Commit Graph

11207 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Yann Collet
46b2e05a33
Update publish-release-artifacts.yml 
fix version comment
 2025-03-02 23:10:09 -08:00
dependabot[bot]
83db5376d7
Bump actions/checkout from 3 to 4 
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Commits](https://github.com/actions/checkout/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-03-03 05:44:17 +00:00
Sergey Senozhatsky
0727fc5ff9 lib: zstd: export API needed for dictionary support 
Patch series "zram: introduce custom comp backends API", v7.

This series introduces support for run-time compression algorithms tuning,
so users, for instance, can adjust compression/acceleration levels and
provide pre-trained compression/decompression dictionaries which certain
algorithms support.

At this point we stop supporting (old/deprecated) comp API.  We may add
new acomp API support in the future, but before that zram needs to undergo
some major rework (we are not ready for async compression).

Some benchmarks for reference (look at column #2)

*** init zstd
/sys/block/zram0/mm_stat
1750659072 504622188 514355200        0 514355200        1        0    34204    34204

*** init zstd dict=/home/ss/zstd-dict-amd64
/sys/block/zram0/mm_stat
1750650880 465908890 475398144        0 475398144        1        0    34185    34185

*** init zstd level=8 dict=/home/ss/zstd-dict-amd64
/sys/block/zram0/mm_stat
1750654976 430803319 439873536        0 439873536        1        0    34185    34185

*** init lz4
/sys/block/zram0/mm_stat
1750646784 664266564 677060608        0 677060608        1        0    34288    34288

*** init lz4 dict=/home/ss/lz4-dict-amd64
/sys/block/zram0/mm_stat
1750650880 619990300 632102912        0 632102912        1        0    34278    34278

*** init lz4hc
/sys/block/zram0/mm_stat
1750630400 609023822 621232128        0 621232128        1        0    34288    34288

*** init lz4hc dict=/home/ss/lz4-dict-amd64
/sys/block/zram0/mm_stat
1750659072 505133172 515231744        0 515231744        1        0    34278    34278

Recompress
init zram zstd (prio=0), zstd level=5 (prio 1), zstd with dict (prio 2)

*** zstd
/sys/block/zram0/mm_stat
1750982656 504630584 514269184        0 514269184        1        0    34204    34204

*** idle recompress priority=1 (zstd level=5)
/sys/block/zram0/mm_stat
1750982656 488645601 525438976        0 514269184        1        0    34204    34204

*** idle recompress priority=2 (zstd dict)
/sys/block/zram0/mm_stat
1750982656 460869640 517914624        0 514269184        1        0    34185    34204

This patch (of 24):

We need to export a number of API functions that enable advanced zstd
usage - C/D dictionaries, dictionaries sharing between contexts, etc.

Link: https://lkml.kernel.org/r/20240902105656.1383858-1-senozhatsky@chromium.org
Link: https://lkml.kernel.org/r/20240902105656.1383858-2-senozhatsky@chromium.org
Signed-off-by: Sergey Senozhatsky <senozhatsky@chromium.org>
Cc: Nick Terrell <terrelln@fb.com>
Cc: Minchan Kim <minchan@kernel.org>
Cc: Sergey Senozhatsky <senozhatsky@chromium.org>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
 2025-02-28 17:09:46 -05:00
Yann Collet
a9337e6739
Merge pull request #4321 from Cyan4973/win_artifacts 
Automate Windows Artifact generation and publication
 2025-02-28 12:35:06 -08:00
Yann Collet
e99be473a6 automatically upload windows artifact on Release Tag creation 2025-02-28 12:04:06 -08:00
Yann Collet
bbbb2379ed test win artifact generation on pushing to release 
this will get a chance to check that win artifact generation works correctly
before creating the release tag.
 2025-02-28 09:42:50 -08:00
Yann Collet
a6d232dcad avoid double zipping 2025-02-28 09:33:22 -08:00
Yann Collet
88100bc62f proper usage of standard variables 2025-02-27 16:59:40 -08:00
Yann Collet
4e1723a7e4 fixed the script so that it fails when a copy fails 
and also: fix the list of files, as `zdict.h` was incorrectly set.
 2025-02-27 16:18:44 -08:00
Yann Collet
7340657c6f update build_package.bat by using a subrouting 2025-02-27 16:18:44 -08:00
Yann Collet
77e58994d2 updated zlib version to more recent v1.3.1 2025-02-27 16:18:44 -08:00
Yann Collet
e94e09dd7b ensure that a copy error results in the task failing clearly 
error code != 0, red status

checked by intentionally inserting an error in another run
 2025-02-27 16:18:44 -08:00
Yann Collet
017ada44b5
Merge pull request #4322 from Cyan4973/meson_win 
fix the meson windows build
 2025-02-27 16:17:34 -08:00
Yann Collet
bbf2801ddd try to fix the meson windows build 
apparently could be just a missing include
 2025-02-27 15:45:59 -08:00
Yann Collet
a1a5154b69
Merge pull request #4312 from Cyan4973/musl_ci 
introduce ZSTD_USE_C90_QSORT
 2025-02-27 14:27:21 -08:00
Yann Collet
22b2fd2517
Merge pull request #4317 from hirohira9119/fix-function-signature 
Fix function signature mismatch for ZSTD_convertBlockSequences
 2025-02-27 13:03:03 -08:00
Yann Collet
d6fbaaac99
Merge pull request #4320 from sebres/patch-1 
build_package.bat: fix path to zstd_errors.h, avoid silently ignore of the errors if build failed
 2025-02-26 15:15:03 -08:00
Yann Collet
0ac659fb00
Merge pull request #4319 from Cyan4973/Wconversion 
step towards -Wconversion
 2025-02-26 15:14:52 -08:00
Yann Collet
dca9791862 fixed minor C++ compat warnings 2025-02-26 14:30:29 -08:00
Sergey G. Brester
4d81b0000d
GHA/windows-artifacts.yml: don't ignore the error if build-package batch failed 2025-02-26 20:13:44 +01:00
Sergey G. Brester
f0d3173203
build_package.bat: don't swallow the error(s) by copy, exit with error if failed somewhere 2025-02-26 20:02:48 +01:00
Sergey G. Brester
97bc43cc68
build_package.bat: fix path to zstd_errors.h (it is in lib not in lib/common) 
closes gh-4318
 2025-02-26 19:27:44 +01:00
Yann Collet
db2d205ada fixed -Wconversion for lib/decompress/zstd_decompress_block.c 2025-02-26 10:01:05 -08:00
Yann Collet
2413f17322 fixed -Wconversion for cover.c 2025-02-26 08:33:01 -08:00
Yann Collet
8ffa27d93b fixed -Wconversion for divsufsort.c 2025-02-26 08:12:11 -08:00
Yann Collet
e635221f1b fixed -Wconversion for zdict 2025-02-26 08:07:51 -08:00
Yann Collet
30281d889f fix conversion warning 2025-02-26 07:41:34 -08:00
hirohira
2840631dc1 Fix function signature mismatch for ZSTD_convertBlockSequences 2025-02-26 08:23:48 +09:00
Yann Collet
76779f52c2
Merge pull request #4310 from Cyan4973/cmake_target_compile 
[cmake] use target_compile_definitions
 2025-02-25 10:04:10 -08:00
Yann Collet
3ff0d794b8
Merge pull request #4309 from Cyan4973/check_manual 
Check API manual and man pages before release
 2025-02-24 15:17:11 -08:00
Yann Collet
5743da491b
Merge pull request #4315 from facebook/dependabot/github_actions/msys2/setup-msys2-2.27.0 
Bump msys2/setup-msys2 from 2.26.0 to 2.27.0
 2025-02-24 01:53:48 -08:00
dependabot[bot]
e1e2f3873d
Bump msys2/setup-msys2 from 2.26.0 to 2.27.0 
Bumps [msys2/setup-msys2](https://github.com/msys2/setup-msys2) from 2.26.0 to 2.27.0.
- [Release notes](https://github.com/msys2/setup-msys2/releases)
- [Changelog](https://github.com/msys2/setup-msys2/blob/main/CHANGELOG.md)
- [Commits](d44ca8e88d...61f9e5e925)

---
updated-dependencies:
- dependency-name: msys2/setup-msys2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-02-24 05:44:08 +00:00
dependabot[bot]
b40dabeda2
Bump ossf/scorecard-action from 2.4.0 to 2.4.1 
Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action) from 2.4.0 to 2.4.1.
- [Release notes](https://github.com/ossf/scorecard-action/releases)
- [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md)
- [Commits](62b2cac7ed...f49aabe0b5)

---
updated-dependencies:
- dependency-name: ossf/scorecard-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-02-24 05:44:05 +00:00
Yann Collet
fd5498a179 document ZSTD_USE_C90_QSORT 2025-02-21 12:48:26 -08:00
Yann Collet
ebfa660b82 introduce ZSTD_USE_C90_QSORT 2025-02-21 11:36:30 -08:00
Yann Collet
8ff47f3df0 added musl compilation test in CI 2025-02-21 09:57:55 -08:00
Yann Collet
0c3345d6ec [cmake] use target_compile_definitions 
which is considered best practice.
 2025-02-20 16:00:54 -08:00
Yann Collet
c2ab0f9c4e check man page update 2025-02-20 13:14:11 -08:00
Yann Collet
4690d66c7e add CI check for zstd_manual before release 
ensures it's properly updated
 2025-02-20 13:00:16 -08:00
Yann Collet
1bef87857b
Merge pull request #4302 from facebook/man157 
updated man pages and manual
 2025-02-19 16:56:55 -08:00
Yann Collet
6af3842118 updated man pages and manual 
fixes #4301
 2025-02-19 16:25:00 -08:00
Yann Collet
d157156bb8
Merge pull request #4300 from facebook/bench_157 
updated benchmark numbers for v1.5.7
 2025-02-18 22:18:57 -08:00
Yann Collet
37077c859b updated benchmark numbers 
using latest version of @inikep's lzbench
 2025-02-18 21:22:02 -08:00
Yann Collet
eb6608869f faster clang-msan-testzstd 
this is by far our longest CI test.
Attempt to make it run a bit faster.
 2025-02-18 16:19:18 -08:00
Yann Collet
ea027ab21c
Merge pull request #4299 from facebook/ga_harden 
Improved Github Actions scorecards
 2025-02-18 15:26:29 -08:00
Yann Collet
b14d76d888 pinned dependency hash 2025-02-18 14:53:31 -08:00
Yann Collet
5c465fcabe harden github actions script Android NDK Build 2025-02-18 14:50:03 -08:00
Yann Collet
99a12e6f72
Merge pull request #4297 from facebook/changelog157 
update changelog for v1.5.7
 2025-02-18 14:35:24 -08:00
Yann Collet
c26bde119b update changelog for v1.5.7 2025-02-18 13:59:24 -08:00
Yann Collet
22c39b9891
Merge pull request #4274 from luau-project/intel-compilers 
CI: enable Intel LLVM C compiler (icx) check
 2025-02-13 20:21:35 -08:00