Elliot Gorokhovsky f6ef14329f

"Short cache" optimization for level 1-4 DMS (+5-30% compression speed) (#3152) ...

* first attempt at fast DMS short cache

* significant wins for some scenarios

* fix all clang regressions

* nits

* fix 1.5% gcc11 regression on hot 110Kdict scenario

* fix CI

* nit

* Add tags to doublefast hash table

* use tags in doublefast DMS

* Fix CI

* Clean up some hardcoded logic / constants

* Switch forCCtx to an enum

* nit

* add short cache to ip+1 long search

* Move tag size into hashLog

* Minor nits

* Truncate dictionaries greater than 16MB in short cache mode

* Helper function for tag comparison

* Cap short cache hashLog at 24 to prevent overflow

* size_t dictTagsMatch -> int dictTagsMatch

* nit

* Clean up and comment dictionary truncation

* Move ZSTD_tableFillPurpose_e next to ZSTD_dictTableLoadMethod_e

* Comment and expand helper functions

* Asserts and documentation

* nit

2022-06-21 17:27:19 -04:00

..

clevels.h

Revert "Limit ZSTD_maxCLevel to 21 for 32-bit binaries."

2021-12-20 11:43:14 -08:00

fse_compress.c

Move bitwise builtins into bits.h

2022-02-14 11:16:03 -05:00

hist.c

[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files

2021-03-30 10:30:43 -07:00

hist.h

[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files

2021-03-30 10:30:43 -07:00

huf_compress.c

Move bitwise builtins into bits.h

2022-02-14 11:16:03 -05:00

zstd_compress_internal.h

"Short cache" optimization for level 1-4 DMS (+5-30% compression speed) (#3152)

2022-06-21 17:27:19 -04:00

zstd_compress_literals.c

fix 44239

2022-02-01 10:49:38 -08:00

zstd_compress_literals.h

Proactively skip huffman compression based on sampling where non-compressibility is suspected

2021-06-30 11:02:47 -04:00

zstd_compress_sequences.c

Typo and grammar fixes

2022-03-12 08:58:04 +01:00

zstd_compress_sequences.h

[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files

2021-03-30 10:30:43 -07:00

zstd_compress_superblock.c

Typo and grammar fixes

2022-03-12 08:58:04 +01:00

zstd_compress_superblock.h

[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files

2021-03-30 10:30:43 -07:00

zstd_compress.c

"Short cache" optimization for level 1-4 DMS (+5-30% compression speed) (#3152)

2022-06-21 17:27:19 -04:00

zstd_cwksp.h

only declare debug functions in debug mode

2022-01-26 14:47:24 -08:00

zstd_double_fast.c

"Short cache" optimization for level 1-4 DMS (+5-30% compression speed) (#3152)

2022-06-21 17:27:19 -04:00

zstd_double_fast.h

"Short cache" optimization for level 1-4 DMS (+5-30% compression speed) (#3152)

2022-06-21 17:27:19 -04:00

zstd_fast.c

"Short cache" optimization for level 1-4 DMS (+5-30% compression speed) (#3152)

2022-06-21 17:27:19 -04:00

zstd_fast.h

"Short cache" optimization for level 1-4 DMS (+5-30% compression speed) (#3152)

2022-06-21 17:27:19 -04:00

zstd_lazy.c

Fix big endian ARM NEON path

2022-06-13 09:16:24 +01:00

zstd_lazy.h

Add and integrate lazy row hash strategy

2021-04-07 09:53:34 -07:00

zstd_ldm_geartab.h

Include what you use in zstd_ldm_geartab

2021-06-29 17:57:53 +01:00

zstd_ldm.c

"Short cache" optimization for level 1-4 DMS (+5-30% compression speed) (#3152)

2022-06-21 17:27:19 -04:00

zstd_ldm.h

Use new paramSwitch enum for LCM, row matchfinder, and block splitter

2021-09-21 14:22:02 -04:00

zstd_opt.c

Merge pull request #2965 from facebook/offbase

2022-01-24 15:47:42 -08:00

zstd_opt.h

[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files

2021-03-30 10:30:43 -07:00

zstdmt_compress.c

Remove expensive assert in --rsyncable hot loop

2022-06-06 11:56:13 -07:00

zstdmt_compress.h

Documentation and minor refactor to clarify MT memory management.

2022-01-18 09:43:05 -07:00