sharpetronics/zstd
1
0
Fork 0
mirror of https://github.com/facebook/zstd.git synced 2025-10-16 00:04:24 -04:00
Code Issues Projects Releases Wiki Activity
zstd/lib/compress
History
Nick Terrell 46f2710562 [HUF] Improve Huffman encoding speed 
Improve Huffman encoding speed by 20% for gcc and 10% for clang.

| Compiler |     Benchmark     | Config  |   Dataset   | Ratio | Speed MB/s (dev) | Speed MB/s (huf-cspeed) | Speed MB/s (huf-cspeed - dev) |
|----------|-------------------|---------|-------------|-------|------------------|-------------------------|-------------------------------|
| gcc      | compress          | level_1 | enwik7      | 2.43  | 253.70           | 258.72                  | 2.0%                          |
| gcc      | compress          | level_1 | silesia     | 2.88  | 341.90           | 348.15                  | 1.8%                          |
| gcc      | compress_literals | level_1 | enwik7      | 1.49  | 761.83           | 912.76                  | 19.8%                         |
| gcc      | compress_literals | level_1 | silesia     | 1.28  | 754.83           | 902.37                  | 19.5%                         |
| gcc      | compress_literals | level_7 | enwik7      | 1.29  | 502.81           | 552.79                  | 9.9%                          |
| gcc      | compress_literals | level_7 | silesia     | 1.11  | 675.97           | 776.44                  | 14.9%                         |
| clang    | compress          | level_1 | enwik7      | 2.43  | 277.54           | 280.98                  | 1.2%                          |
| clang    | compress          | level_1 | silesia     | 2.88  | 369.98           | 375.46                  | 1.5%                          |
| clang    | compress_literals | level_1 | enwik7      | 1.49  | 828.83           | 918.41                  | 10.8%                         |
| clang    | compress_literals | level_1 | silesia     | 1.28  | 815.81           | 905.41                  | 11.0%                         |
| clang    | compress_literals | level_7 | enwik7      | 1.29  | 533.13           | 553.30                  | 3.8%                          |
| clang    | compress_literals | level_7 | silesia     | 1.11  | 714.52           | 775.38                  | 8.5%                          |
2021-07-27 15:10:35 -07:00
..
fse_compress.c
[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files
2021-03-30 10:30:43 -07:00
hist.c
[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files
2021-03-30 10:30:43 -07:00
hist.h
[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files
2021-03-30 10:30:43 -07:00
huf_compress.c
[HUF] Improve Huffman encoding speed
2021-07-27 15:10:35 -07:00
zstd_compress_internal.h
[HUF] Improve Huffman encoding speed
2021-07-27 15:10:35 -07:00
zstd_compress_literals.c
Proactively skip huffman compression based on sampling where non-compressibility is suspected
2021-06-30 11:02:47 -04:00
zstd_compress_literals.h
Proactively skip huffman compression based on sampling where non-compressibility is suspected
2021-06-30 11:02:47 -04:00
zstd_compress_sequences.c
Assert no divison by 0, correct superblocks 0 sequences case (#2592)
2021-05-07 13:26:56 -04:00
zstd_compress_sequences.h
[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files
2021-03-30 10:30:43 -07:00
zstd_compress_superblock.c
Assert no divison by 0, correct superblocks 0 sequences case (#2592)
2021-05-07 13:26:56 -04:00
zstd_compress_superblock.h
[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files
2021-03-30 10:30:43 -07:00
zstd_compress.c
Proactively skip huffman compression based on sampling where non-compressibility is suspected
2021-06-30 11:02:47 -04:00
zstd_cwksp.h
[cwksp] Align all allocated "tables" and "aligneds" to 64 bytes (#2546)
2021-04-01 20:07:19 -04:00
zstd_double_fast.c
[lib] Fix off-by-one error in repcode checks
2021-05-13 17:05:59 -07:00
zstd_double_fast.h
[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files
2021-03-30 10:30:43 -07:00
zstd_fast.c
[lib] Fix off-by-one error in repcode checks
2021-05-13 17:05:59 -07:00
zstd_fast.h
[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files
2021-03-30 10:30:43 -07:00
zstd_lazy.c
Flatten ZSTD_row_getMatchMask (#2681)
2021-06-09 08:50:25 +03:00
zstd_lazy.h
Add and integrate lazy row hash strategy
2021-04-07 09:53:34 -07:00
zstd_ldm_geartab.h
Include what you use in zstd_ldm_geartab
2021-06-29 17:57:53 +01:00
zstd_ldm.c
Merge pull request #2602 from terrelln/ldm-opt
2021-05-04 23:13:09 -07:00
zstd_ldm.h
Add and integrate lazy row hash strategy
2021-04-07 09:53:34 -07:00
zstd_opt.c
[HUF] Improve Huffman encoding speed
2021-07-27 15:10:35 -07:00
zstd_opt.h
[copyright][license] Switch to yearless copyright and some cleanup in the linux-kernel files
2021-03-30 10:30:43 -07:00
zstdmt_compress.c
[lib] Add ZSTD_c_deterministicRefPrefix
2021-05-05 18:49:56 -07:00
zstdmt_compress.h
reduce Max nb Workers to 64 in 32-bit mode
2021-05-12 13:10:25 -07:00