458 Commits

Author	SHA1	Message	Date
Paul Cruz	0c8b9436b7	removed goto statements for the most part	2017-07-13 16:38:20 -07:00
Stella Lau	175a6c6029	[ldm] Minor refactoring	2017-07-13 16:16:31 -07:00
Stella Lau	361c06df75	Add min/max offset to stats	2017-07-13 15:29:41 -07:00
Paul Cruz	65a4ce2635	added tests for forced compression level	2017-07-13 14:57:24 -07:00
Paul Cruz	0d9665cef5	added additional tests for performance, allowed force compression level for testing purposes	2017-07-13 14:46:54 -07:00
Stella Lau	2b3c7e4199	[ldm] Make some functions shared	2017-07-13 14:39:35 -07:00
Paul Cruz	9165e97fc6	added some tests for correctness, time, and compression ratio	2017-07-13 13:50:23 -07:00
Stella Lau	9306feb8fa	[ldm] Switch to using lib/common/mem.h and move typedefs to ldm.h ... Summary: Test Plan: Reviewers: Subscribers: Tasks: Tags: Blame Revision:	2017-07-13 13:44:48 -07:00
Stella Lau	50421d9474	[ldm] Remove old main files	2017-07-13 11:45:00 -07:00
Stella Lau	68c4560701	[ldm] Add TODO and comment for segfaulting in compress function	2017-07-13 10:38:19 -07:00
Paul Cruz	766663f1f1	added altering dictionary size depending on compression level	2017-07-13 10:15:27 -07:00
Stella Lau	92bed4a7e0	[ldm] Add CHAR_OFFSET in hash function and extend header size	2017-07-12 18:47:26 -07:00
Paul Cruz	7c886db0a8	changed to stderr	2017-07-12 17:28:53 -07:00
Paul Cruz	b5b18cf664	changed to malloc, added comment about adaptive compression level, and changed ternary operators	2017-07-12 17:10:58 -07:00
Paul Cruz	954d999abf	fixed up freeCCtx() removed BYTE since it wasn't being used	2017-07-12 16:50:43 -07:00
Paul Cruz	3c16edd26a	added copyright header, removed clean from makefile	2017-07-12 16:40:24 -07:00
Stella Lau	8de82b6eb0	[ldm] Clean up versions	2017-07-12 16:31:31 -07:00
Paul Cruz	74d3a6f5ae	passes tests with adaptive compression level	2017-07-12 16:18:41 -07:00
Paul Cruz	5353d350ae	working with fixed compression level and fixed dictionary size	2017-07-12 16:02:20 -07:00
Stella Lau	8ff8cdb15b	[ldm] Clean up code	2017-07-12 15:12:07 -07:00
Paul Cruz	356ddb649f	working with flush job->src.size and fixed cLevel	2017-07-12 12:21:21 -07:00
Stella Lau	3a48ffd4fd	Fix sumToHash to use hash space more efficiently	2017-07-12 10:53:19 -07:00
Stella Lau	e0d4162464	Minor fix for non-rolling hash	2017-07-12 09:50:24 -07:00
Stella Lau	50502519fb	Switch to using rolling hash only	2017-07-12 09:47:00 -07:00
Stella Lau	583dda17a8	Update rolling hash	2017-07-11 18:13:26 -07:00
Paul Cruz	0a401852c4	added debug statement	2017-07-11 16:50:50 -07:00
Paul Cruz	72a183efad	changed dictionary size, added debugging statements	2017-07-11 15:49:52 -07:00
Paul Cruz	7c54e09347	updated DEBUG statements	2017-07-11 15:15:41 -07:00
Paul Cruz	a3c077b8c6	added error message, updated copying dictionary into the input buffer	2017-07-11 15:00:52 -07:00
Paul Cruz	34afb9b23e	changed to using ZSTD_compressBegin_usingDict() and fixed strange issue with ZSTD_compressContinue()	2017-07-11 11:50:00 -07:00
Paul Cruz	7ec5928626	fixed an error where -c argument wasn't working for single files	2017-07-11 10:23:25 -07:00
Stella Lau	f6c5d07fe2	Save v3	2017-07-11 09:23:44 -07:00
Stella Lau	6c3673f4c3	Add rolling hash	2017-07-10 22:27:43 -07:00
Paul Cruz	f918545491	made some progress on improving compression ratio, but problems exist with speed limits, and for some reason higher compression levels are really slow	2017-07-10 18:16:42 -07:00
Paul Cruz	01fc7c4244	changed how the detection of the last job works	2017-07-10 16:27:58 -07:00
Paul Cruz	c36552ef8a	dst buffer should use ZSTD_compressBound to determine how much space it needs	2017-07-10 16:10:19 -07:00
Paul Cruz	7aa36df6df	fixed memory leak that was happening when creating jobs	2017-07-10 16:03:09 -07:00
Stella Lau	ef2b728316	Clean up and refactor compress function	2017-07-10 15:48:47 -07:00
Paul Cruz	e410d63d45	made input buffer an internal part of the compression context	2017-07-10 15:37:14 -07:00
Stella Lau	e4155b11d7	Add warning flags to makefile and clean up code to remove warnings	2017-07-10 13:08:19 -07:00
Stella Lau	10a71d9f1c	Add compression context	2017-07-10 12:38:27 -07:00
Paul Cruz	cc7f8e4d71	small changes	2017-07-10 11:10:11 -07:00
Paul Cruz	7e09b508ff	changed name	2017-07-10 11:05:37 -07:00
Paul Cruz	ed72ea5438	removed single from Makefile	2017-07-10 10:58:03 -07:00
Paul Cruz	ced3ec5714	removed scripts	2017-07-10 10:53:02 -07:00
Paul Cruz	82f0d64bee	removed single.c	2017-07-10 10:51:50 -07:00
Paul Cruz	62ebbabd32	updated error checking in each thread	2017-07-10 09:36:22 -07:00
Stella Lau	ae9cf235d6	Add LDM_DCtx	2017-07-10 07:38:09 -07:00
Stella Lau	5432214ee3	Minor refactoring	2017-07-10 06:50:49 -07:00
Stella Lau	b94b468e84	Merge branch 'ldm' of https://github.com/stellamplau/zstd into ldm	2017-07-10 06:32:46 -07:00