CHANGELOG 50 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781782783784785786787788789790791792793794795796797798799800801802803804805806807808809810811812813814815816817818819820821822823824825826827828829830831832833834835836837838839840841842843844845846847848849850851852853854855856857858859860861862863
  1. V1.5.7 (Feb 2025)
  2. fix: compression bug in 32-bit mode associated with long-lasting sessions
  3. api: new method `ZSTD_compressSequencesAndLiterals()` (#4217, #4232)
  4. api: `ZSTD_getFrameHeader()` works on skippable frames (#4228)
  5. perf: substantial compression speed improvements (up to +30%) on small data, by @TocarIP (#4144) and @cyan4973 (#4165)
  6. perf: improved compression speed (~+5%) for dictionary compression at low levels (#4170)
  7. perf: much faster speed for `--patch-from` at high compression levels (#4276)
  8. perf: higher `--patch-from` compression ratios, notably at high levels (#4288)
  9. perf: better speed for binaries on Windows (@pps83) and when compiled with Visual Studio (@MessyHack)
  10. perf: slight compression ratio improvement thanks to better block boundaries (#4136, #4176, #4178)
  11. perf: slight compression ratio improvement for `dfast`, aka levels 3 and 4 (#4171)
  12. perf: runtime bmi2 detection enabled on x86 32-bit mode (#4251)
  13. cli: multi-threading as default CLI setting, by @daniellerozenblit
  14. cli: new `--max` command (#4290)
  15. build: improve `msbuild` version autodetection, support VS2022, by @ManuelBlanc
  16. build: fix `meson` build by @artem and @Victor-C-Zhang, and on Windows by @bgilbert
  17. build: compatibility with Apple Framework, by @Treata11
  18. build: improve icc/icx compatibility, by @josepho0918 and @luau-project
  19. build: improve compatibility with Android NDK, by Adenilson Cavalcanti
  20. portability: linux kernel branch, with improved support for Sequence producers (@embg, @gcabiddu, @cyan4973)
  21. portability: improved qnx compatibility, suggested by @rainbowball
  22. portability: improved install script for FreeBSD, by @sunpoet
  23. portability: fixed test suite compatibility with gnu hurd, by @diegonc
  24. doc: clarify specification, by @elasota
  25. misc: improved tests/decodecorpus validation tool (#4102), by antmicro
  26. V1.5.6 (Mar 2024)
  27. api: Promote `ZSTD_c_targetCBlockSize` to Stable API by @felixhandte
  28. api: new `ZSTD_d_maxBlockSize` experimental parameter, to reduce streaming decompression memory, by @terrelln
  29. perf: improve performance of param `ZSTD_c_targetCBlockSize`, by @Cyan4973
  30. perf: improved compression of arrays of integers at high compression, by @Cyan4973
  31. lib: reduce binary size with selective build-time exclusion, by @felixhandte
  32. lib: improved huffman speed on small data and linux kernel, by @terrelln
  33. lib: accept dictionaries with partial literal tables, by @terrelln
  34. lib: fix CCtx size estimation with external sequence producer, by @embg
  35. lib: fix corner case decoder behaviors, by @Cyan4973 and @aimuz
  36. lib: fix zdict prototype mismatch in static_only mode, by @ldv-alt
  37. lib: fix several bugs in magicless-format decoding, by @embg
  38. cli: add common compressed file types to `--exclude-compressed`` by @daniellerozenblit
  39. cli: fix mixing `-c` and `-o` commands with `--rm`, by @Cyan4973
  40. cli: fix erroneous exclusion of hidden files with `--output-dir-mirror` by @felixhandte
  41. cli: improved time accuracy on BSD, by @felixhandte
  42. cli: better errors on argument parsing, by @KapJI
  43. tests: better compatibility with older versions of `grep`, by @Cyan4973
  44. tests: lorem ipsum generator as default backup content, by @Cyan4973
  45. build: cmake improvements by @terrelln, @sighingnow, @gjasny, @JohanMabille, @Saverio976, @gruenich, @teo-tsirpanis
  46. build: bazel support, by @jondo2010
  47. build: fix cross-compiling for AArch64 with lld by @jcelerier
  48. build: fix Apple platform compatibility, by @nidhijaju
  49. build: fix Visual 2012 and lower compatibility, by @Cyan4973
  50. build: improve win32 support, by @DimitriPapadopoulos
  51. build: better C90 compliance for zlibWrapper, by @emaste
  52. port: make: fat binaries on macos, by @mredig
  53. port: ARM64EC compatibility for Windows, by @dunhor
  54. port: QNX support by @klausholstjacobsen
  55. port: MSYS2 and Cygwin makefile installation and test support, by @QBos07
  56. port: risc-v support validation in CI, by @Cyan4973
  57. port: sparc64 support validation in CI, by @Cyan4973
  58. port: AIX compatibility, by @likema
  59. port: HP-UX compatibility, by @likema
  60. doc: Improved specification accuracy, by @elasota
  61. bug: Fix and deprecate ZSTD_generateSequences (#3981)
  62. v1.5.5 (Apr 2023)
  63. fix: fix rare corruption bug affecting the high compression mode, reported by @danlark1 (#3517, @terrelln)
  64. perf: improve mid-level compression speed (#3529, #3533, #3543, @yoniko and #3552, @terrelln)
  65. lib: deprecated bufferless block-level API (#3534) by @terrelln
  66. cli: mmap large dictionaries to save memory, by @daniellerozenblit
  67. cli: improve speed of --patch-from mode (~+50%) (#3545) by @daniellerozenblit
  68. cli: improve i/o speed (~+10%) when processing lots of small files (#3479) by @felixhandte
  69. cli: zstd no longer crashes when requested to write into write-protected directory (#3541) by @felixhandte
  70. cli: fix decompression into block device using -o, reported by @georgmu (#3583)
  71. build: fix zstd CLI compiled with lzma support but not zlib support (#3494) by @Hello71
  72. build: fix cmake does no longer require 3.18 as minimum version (#3510) by @kou
  73. build: fix MSVC+ClangCL linking issue (#3569) by @tru
  74. build: fix zstd-dll, version of zstd CLI that links to the dynamic library (#3496) by @yoniko
  75. build: fix MSVC warnings (#3495) by @embg
  76. doc: updated zstd specification to clarify corner cases, by @Cyan4973
  77. doc: document how to create fat binaries for macos (#3568) by @rickmark
  78. misc: improve seekable format ingestion speed (~+100%) for very small chunk sizes (#3544) by @Cyan4973
  79. misc: tests/fullbench can benchmark multiple files (#3516) by @dloidolt
  80. v1.5.4 (Feb 2023)
  81. perf: +20% faster huffman decompression for targets that can't compile x64 assembly (#3449, @terrelln)
  82. perf: up to +10% faster streaming compression at levels 1-2 (#3114, @embg)
  83. perf: +4-13% for levels 5-12 by optimizing function generation (#3295, @terrelln)
  84. pref: +3-11% compression speed for `arm` target (#3199, #3164, #3145, #3141, #3138, @JunHe77 and #3139, #3160, @danlark1)
  85. perf: +5-30% faster dictionary compression at levels 1-4 (#3086, #3114, #3152, @embg)
  86. perf: +10-20% cold dict compression speed by prefetching CDict tables (#3177, @embg)
  87. perf: +1% faster compression by removing a branch in ZSTD_fast_noDict (#3129, @felixhandte)
  88. perf: Small compression ratio improvements in high compression mode (#2983, #3391, @Cyan4973 and #3285, #3302, @daniellerozenblit)
  89. perf: small speed improvement by better detecting `STATIC_BMI2` for `clang` (#3080, @TocarIP)
  90. perf: Improved streaming performance when `ZSTD_c_stableInBuffer` is set (#2974, @Cyan4973)
  91. cli: Asynchronous I/O for improved cli speed (#2975, #2985, #3021, #3022, @yoniko)
  92. cli: Change `zstdless` behavior to align with `zless` (#2909, @binhdvo)
  93. cli: Keep original file if `-c` or `--stdout` is given (#3052, @dirkmueller)
  94. cli: Keep original files when result is concatenated into a single output with `-o` (#3450, @Cyan4973)
  95. cli: Preserve Permissions and Ownership of regular files (#3432, @felixhandte)
  96. cli: Print zlib/lz4/lzma library versions with `-vv` (#3030, @terrelln)
  97. cli: Print checksum value for single frame files with `-lv` (#3332, @Cyan4973)
  98. cli: Print `dictID` when present with `-lv` (#3184, @htnhan)
  99. cli: when `stderr` is *not* the console, disable status updates, but preserve final summary (#3458, @Cyan4973)
  100. cli: support `--best` and `--no-name` in `gzip` compatibility mode (#3059, @dirkmueller)
  101. cli: support for `posix` high resolution timer `clock_gettime()`, for improved benchmark accuracy (#3423, @Cyan4973)
  102. cli: improved help/usage (`-h`, `-H`) formatting (#3094, @dirkmueller and #3385, @jonpalmisc)
  103. cli: Fix better handling of bogus numeric values (#3268, @ctkhanhly)
  104. cli: Fix input consists of multiple files _and_ `stdin` (#3222, @yoniko)
  105. cli: Fix tiny files passthrough (#3215, @cgbur)
  106. cli: Fix for `-r` on empty directory (#3027, @brailovich)
  107. cli: Fix empty string as argument for `--output-dir-*` (#3220, @embg)
  108. cli: Fix decompression memory usage reported by `-vv --long` (#3042, @u1f35c, and #3232, @zengyijing)
  109. cli: Fix infinite loop when empty input is passed to trainer (#3081, @terrelln)
  110. cli: Fix `--adapt` doesn't work when `--no-progress` is also set (#3354, @terrelln)
  111. api: Support for Block-Level Sequence Producer (#3333, @embg)
  112. api: Support for in-place decompression (#3432, @terrelln)
  113. api: New `ZSTD_CCtx_setCParams()` function, set all parameters defined in a `ZSTD_compressionParameters` structure (#3403, @Cyan4973)
  114. api: Streaming decompression detects incorrect header ID sooner (#3175, @Cyan4973)
  115. api: Window size resizing optimization for edge case (#3345, @daniellerozenblit)
  116. api: More accurate error codes for busy-loop scenarios (#3413, #3455, @Cyan4973)
  117. api: Fix limit overflow in `compressBound` and `decompressBound` (#3362, #3373, Cyan4973) reported by @nigeltao
  118. api: Deprecate several advanced experimental functions: streaming (#3408, @embg), copy (#3196, @mileshu)
  119. bug: Fix corruption that rarely occurs in 32-bit mode with wlog=25 (#3361, @terrelln)
  120. bug: Fix for block-splitter (#3033, @Cyan4973)
  121. bug: Fixes for Sequence Compression API (#3023, #3040, @Cyan4973)
  122. bug: Fix leaking thread handles on Windows (#3147, @animalize)
  123. bug: Fix timing issues with cmake/meson builds (#3166, #3167, #3170, @Cyan4973)
  124. build: Allow user to select legacy level for cmake (#3050, @shadchin)
  125. build: Enable legacy support by default in cmake (#3079, @niamster)
  126. build: Meson build script improvements (#3039, #3120, #3122, #3327, #3357, @eli-schwartz and #3276, @neheb)
  127. build: Add aarch64 to supported architectures for zstd_trace (#3054, @ooosssososos)
  128. build: support AIX architecture (#3219, @qiongsiwu)
  129. build: Fix `ZSTD_LIB_MINIFY` build macro, which now reduces static library size by half (#3366, @terrelln)
  130. build: Fix Windows issues with Multithreading translation layer (#3364, #3380, @yoniko) and ARM64 target (#3320, @cwoffenden)
  131. build: Fix `cmake` script (#3382, #3392, @terrelln and #3252 @Tachi107 and #3167 @Cyan4973)
  132. doc: Updated man page, providing more details for `--train` mode (#3112, @Cyan4973)
  133. doc: Add decompressor errata document (#3092, @terrelln)
  134. misc: Enable Intel CET (#2992, #2994, @hjl-tools)
  135. misc: Fix `contrib/` seekable format (#3058, @yhoogstrate and #3346, @daniellerozenblit)
  136. misc: Improve speed of the one-file library generator (#3241, @wahern and #3005, @cwoffenden)
  137. v1.5.3 (dev version, unpublished)
  138. v1.5.2 (Jan, 2022)
  139. perf: Regain Minimal memset()-ing During Reuse of Compression Contexts (@Cyan4973, #2969)
  140. build: Build Zstd with `noexecstack` on All Architectures (@felixhandte, #2964)
  141. doc: Clarify Licensing (@terrelln, #2981)
  142. v1.5.1 (Dec, 2021)
  143. perf: rebalanced compression levels, to better match the intended speed/level curve, by @senhuang42
  144. perf: faster huffman decoder, using x64 assembly, by @terrelln
  145. perf: slightly faster high speed modes (strategies fast & dfast), by @felixhandte
  146. perf: improved binary size and faster compilation times, by @terrelln
  147. perf: new row64 mode, used notably in level 12, by @senhuang42
  148. perf: faster mid-level compression speed in presence of highly repetitive patterns, by @senhuang42
  149. perf: minor compression ratio improvements for small data at high levels, by @cyan4973
  150. perf: reduced stack usage (mostly useful for Linux Kernel), by @terrelln
  151. perf: faster compression speed on incompressible data, by @bindhvo
  152. perf: on-demand reduced ZSTD_DCtx state size, using build macro ZSTD_DECODER_INTERNAL_BUFFER, at a small cost of performance, by @bindhvo
  153. build: allows hiding static symbols in the dynamic library, using build macro, by @skitt
  154. build: support for m68k (Motorola 68000's), by @cyan4973
  155. build: improved AIX support, by @Helflym
  156. build: improved meson unofficial build, by @eli-schwartz
  157. cli : custom memory limit when training dictionary (#2925), by @embg
  158. cli : report advanced parameters information when compressing in very verbose mode (`-vv`), by @Svetlitski-FB
  159. v1.5.0 (May 11, 2021)
  160. api: Various functions promoted from experimental to stable API: (#2579-2581, @senhuang42)
  161. `ZSTD_defaultCLevel()`
  162. `ZSTD_getDictID_fromCDict()`
  163. api: Several experimental functions have been deprecated and will emit a compiler warning (#2582, @senhuang42)
  164. `ZSTD_compress_advanced()`
  165. `ZSTD_compress_usingCDict_advanced()`
  166. `ZSTD_compressBegin_advanced()`
  167. `ZSTD_compressBegin_usingCDict_advanced()`
  168. `ZSTD_initCStream_srcSize()`
  169. `ZSTD_initCStream_usingDict()`
  170. `ZSTD_initCStream_usingCDict()`
  171. `ZSTD_initCStream_advanced()`
  172. `ZSTD_initCStream_usingCDict_advanced()`
  173. `ZSTD_resetCStream()`
  174. api: ZSTDMT_NBWORKERS_MAX reduced to 64 for 32-bit environments (@Cyan4973)
  175. perf: Significant speed improvements for middle compression levels (#2494, @senhuang42 @terrelln)
  176. perf: Block splitter to improve compression ratio, enabled by default for high compression levels (#2447, @senhuang42)
  177. perf: Decompression loop refactor, speed improvements on `clang` and for `--long` modes (#2614 #2630, @Cyan4973)
  178. perf: Reduced stack usage during compression and decompression entropy stage (#2522 #2524, @terrelln)
  179. bug: Improve setting permissions of created files (#2525, @felixhandte)
  180. bug: Fix large dictionary non-determinism (#2607, @terrelln)
  181. bug: Fix non-determinism test failures on Linux i686 (#2606, @terrelln)
  182. bug: Fix various dedicated dictionary search bugs (#2540 #2586, @senhuang42 @felixhandte)
  183. bug: Ensure `ZSTD_estimateCCtxSize*() `monotonically increases with compression level (#2538, @senhuang42)
  184. bug: Fix --patch-from mode parameter bound bug with small files (#2637, @occivink)
  185. bug: Fix UBSAN error in decompression (#2625, @terrelln)
  186. bug: Fix superblock compression divide by zero bug (#2592, @senhuang42)
  187. bug: Make the number of physical CPU cores detection more robust (#2517, @PaulBone)
  188. doc: Improve `zdict.h` dictionary training API documentation (#2622, @terrelln)
  189. doc: Note that public `ZSTD_free*()` functions accept NULL pointers (#2521, @animalize)
  190. doc: Add style guide docs for open source contributors (#2626, @Cyan4973)
  191. tests: Better regression test coverage for different dictionary modes (#2559, @senhuang42)
  192. tests: Better test coverage of index reduction (#2603, @terrelln)
  193. tests: OSS-Fuzz coverage for seekable format (#2617, @senhuang42)
  194. tests: Test coverage for ZSTD threadpool API (#2604, @senhuang42)
  195. build: Dynamic library built multithreaded by default (#2584, @senhuang42)
  196. build: Move `zstd_errors.h` and `zdict.h` to `lib/` root (#2597, @terrelln)
  197. build: Allow `ZSTDMT_JOBSIZE_MIN` to be configured at compile-time, reduce default to 512KB (#2611, @Cyan4973)
  198. build: Single file library build script moved to `build/` directory (#2618, @felixhandte)
  199. build: `ZBUFF_*()` is no longer built by default (#2583, @senhuang42)
  200. build: Fixed Meson build (#2548, @SupervisedThinking @kloczek)
  201. build: Fix excessive compiler warnings with clang-cl and CMake (#2600, @nickhutchinson)
  202. build: Detect presence of `md5` on Darwin (#2609, @felixhandte)
  203. build: Avoid SIGBUS on armv6 (#2633, @bmwiedmann)
  204. cli: `--progress` flag added to always display progress bar (#2595, @senhuang42)
  205. cli: Allow reading from block devices with `--force` (#2613, @felixhandte)
  206. cli: Fix CLI filesize display bug (#2550, @Cyan4973)
  207. cli: Fix windows CLI `--filelist` end-of-line bug (#2620, @Cyan4973)
  208. contrib: Various fixes for linux kernel patch (#2539, @terrelln)
  209. contrib: Seekable format - Decompression hanging edge case fix (#2516, @senhuang42)
  210. contrib: Seekable format - New seek table-only API (#2113 #2518, @mdittmer @Cyan4973)
  211. contrib: Seekable format - Fix seek table descriptor check when loading (#2534, @foxeng)
  212. contrib: Seekable format - Decompression fix for large offsets, (#2594, @azat)
  213. misc: Automatically published release tarballs available on Github (#2535, @felixhandte)
  214. v1.4.9 (Mar 1, 2021)
  215. bug: Use `umask()` to Constrain Created File Permissions (#2495, @felixhandte)
  216. bug: Make Simple Single-Pass Functions Ignore Advanced Parameters (#2498, @terrelln)
  217. api: Add (De)Compression Tracing Functionality (#2482, @terrelln)
  218. api: Support References to Multiple DDicts (#2446, @senhuang42)
  219. api: Add Function to Generate Skippable Frame (#2439, @senhuang42)
  220. perf: New Algorithms for the Long Distance Matcher (#2483, @mpu)
  221. perf: Performance Improvements for Long Distance Matcher (#2464, @mpu)
  222. perf: Don't Shrink Window Log when Streaming with a Dictionary (#2451, @terrelln)
  223. cli: Fix `--output-dir-mirror` rejection of `..` -containing paths (#2512, @felixhandte)
  224. cli: Allow Input From Console When `-f`/`--force` is Passed (#2466, @felixhandte)
  225. cli: Improve Help Message (#2500, @senhuang42)
  226. tests: Remove Flaky Tests (#2455, #2486, #2445, @Cyan4973)
  227. tests: Correctly Invoke md5 Utility on NetBSD (#2492, @niacat)
  228. tests: Avoid Using `stat -c` on NetBSD (#2513, @felixhandte)
  229. build: Zstd CLI Can Now be Linked to Dynamic `libzstd` (#2457, #2454 @Cyan4973)
  230. build: Hide and Avoid Using Static-Only Symbols (#2501, #2504, @skitt)
  231. build: CMake: Enable Only C for lib/ and programs/ Projects (#2498, @concatime)
  232. build: CMake: Use `configure_file()` to Create the `.pc` File (#2462, @lazka)
  233. build: Fix Fuzzer Compiler Detection & Update UBSAN Flags (#2503, @terrelln)
  234. build: Add Guards for `_LARGEFILE_SOURCE` and `_LARGEFILE64_SOURCE` (#2444, @indygreg)
  235. build: Improve `zlibwrapper` Makefile (#2437, @Cyan4973)
  236. contrib: Add `recover_directory` Program (#2473, @terrelln)
  237. doc: Change License Year to 2021 (#2452 & #2465, @terrelln & @senhuang42)
  238. doc: Fix Typos (#2459, @ThomasWaldmann)
  239. v1.4.8 (Dec 18, 2020)
  240. hotfix: wrong alignment of an internal buffer
  241. v1.4.7 (Dec 16, 2020)
  242. perf: stronger --long mode at high compression levels, by @senhuang42
  243. perf: stronger --patch-from at high compression levels, thanks to --long improvements
  244. perf: faster dictionary compression at medium compression levels, by @felixhandte
  245. perf: small speed & memory usage improvements for ZSTD_compress2(), by @terrelln
  246. perf: improved fast compression speeds with Visual Studio, by @animalize
  247. cli : Set nb of threads with environment variable ZSTD_NBTHREADS, by @senhuang42
  248. cli : accept decompressing files with *.zstd suffix
  249. cli : provide a condensed summary by default when processing multiple files
  250. cli : fix : stdin input no longer confused as user prompt
  251. cli : improve accuracy of several error messages
  252. api : new sequence ingestion API, by @senhuang42
  253. api : shared thread pool: control total nb of threads used by multiple compression jobs, by @marxin
  254. api : new ZSTD_getDictID_fromCDict(), by @LuAPi
  255. api : zlibWrapper only uses public API, and is compatible with dynamic library, by @terrelln
  256. api : fix : multithreaded compression has predictable output even in special cases (see #2327) (issue not accessible from cli)
  257. api : fix : dictionary compression correctly respects dictionary compression level (see #2303) (issue not accessible from cli)
  258. build: fix cmake script when using path with spaces, by @terrelln
  259. build: improved compile-time detection of aarch64/neon platforms, by @bsdimp
  260. build: Fix building on AIX 5.1, by @likema
  261. build: compile paramgrill with cmake on Windows, requested by @mirh
  262. doc : clarify repcode updates in format specification, by @felixhandte
  263. v1.4.6
  264. fix : Always return dstSize_tooSmall when that is the case
  265. fix : Fix ZSTD_initCStream_advanced() with static allocation and no dictionary
  266. perf: Improve small block decompression speed by 20%+, by @terrelln
  267. perf: Reduce compression stack usage by 1 KB, by @terrelln
  268. perf: Improve decompression speed by improving ZSTD_wildcopy, by @helloguo (#2252, #2256)
  269. perf: Improve histogram construction, by @cyan4973 (#2253)
  270. cli : Add --output-dir-mirror option, by @xxie24 (#2219)
  271. cli : Warn when (de)compressing multiple files into a single output, by @senhuang42 (#2279)
  272. cli : Improved progress bar and status summary when (de)compressing multiple files, by @senhuang42 (#2283)
  273. cli : Call stat less often, by @felixhandte (#2262)
  274. cli : Allow --patch-from XXX and --filelist XXX in addition to --patch-from=XXX and --filelist=XXX, by @cyan4973 (#2250)
  275. cli : Allow --patch-from to compress stdin with --stream-size, by @bimbashrestha (#2206)
  276. api : Do not install zbuff.h, since it has long been deprecated, by @cyan4973 (#2166).
  277. api : Fix ZSTD_CCtx_setParameter() with ZSTD_c_compressionLevel to make 0 mean default level, by @i-do-cpp (#2291)
  278. api : Rename ZSTDMT_NBTHREADS_MAX to ZSTDMT_NBWORKERS_MAX, by @marxin (#2228).
  279. build: Install pkg-config file with CMake and MinGW, by @tonytheodore (#2183)
  280. build: Install DLL with CMake on Windows, by @BioDataAnalysis (#2221)
  281. build: Fix DLL install location with CMake, by @xantares and @bimbashrestha (#2186)
  282. build: Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions
  283. build: Add ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics
  284. build: Add STATIC_BMI2 macro for compile time detection of BMI2 on MSVC, by @Niadb (#2258)
  285. build: Fix -Wcomma warnings, by @cwoffenden
  286. build: Remove distutils requirement for meson build, by @neheb (#2197)
  287. build: Fix cli compilation with uclibc
  288. build: Fix cli compilation without st_mtime, by @ffontaine (#2246)
  289. build: Fix shadowing warnings in library
  290. build: Fix single file library compilation with Enscripten, by @yoshihitoh (#2227)
  291. misc: Improve single file library and include dictBuilder, by @cwoffenden
  292. misc: Allow compression dictionaries with missing symbols
  293. misc: Add freestanding translation script in contrib/freestanding_lib
  294. misc: Collect all of zstd's libc dependencies into zstd_deps.h
  295. doc : Add ZSTD_versionString() to manual, by @animalize
  296. doc : Fix documentation for ZSTD_CCtxParams_setParameter(), by @felixhandte (#2270)
  297. v1.4.5 (May 22, 2020)
  298. fix : Compression ratio regression on huge files (> 3 GB) using high levels (--ultra) and multithreading, by @terrelln
  299. perf: Improved decompression speed: x64 : +10% (clang) / +5% (gcc); ARM : from +15% to +50%, depending on SoC, by @terrelln
  300. perf: Automatically downsizes ZSTD_DCtx when too large for too long (#2069, by @bimbashreshta)
  301. perf: Improved fast compression speed on aarch64 (#2040, ~+3%, by @caoyzh)
  302. perf: Small level 1 compression speed gains (depending on compiler)
  303. cli : New --patch-from command, create and apply patches from files, by @bimbashreshta
  304. cli : New --filelist= : Provide a list of files to operate upon from a file
  305. cli : -b -d command can now benchmark decompression on multiple files
  306. cli : New --no-content-size command
  307. cli : New --show-default-cparams information command
  308. api : ZDICT_finalizeDictionary() is promoted to stable (#2111)
  309. api : new experimental parameter ZSTD_d_stableOutBuffer (#2094)
  310. build: Generate a single-file libzstd library (#2065, by @cwoffenden)
  311. build: Relative includes no longer require -I compiler flags for zstd lib subdirs (#2103, by @felixhandte)
  312. build: zstd now compiles cleanly under -pedantic (#2099)
  313. build: zstd now compiles with make-4.3
  314. build: Support mingw cross-compilation from Linux, by @Ericson2314
  315. build: Meson multi-thread build fix on windows
  316. build: Some misc icc fixes backed by new ci test on travis
  317. misc: bitflip analyzer tool, by @felixhandte
  318. misc: Extend largeNbDicts benchmark to compression
  319. misc: Edit-distance match finder in contrib/
  320. doc : Improved beginner CONTRIBUTING.md docs
  321. doc : New issue templates for zstd
  322. v1.4.4 (Nov 6, 2019)
  323. perf: Improved decompression speed, by > 10%, by @terrelln
  324. perf: Better compression speed when re-using a context, by @felixhandte
  325. perf: Fix compression ratio when compressing large files with small dictionary, by @senhuang42
  326. perf: zstd reference encoder can generate RLE blocks, by @bimbashrestha
  327. perf: minor generic speed optimization, by @davidbolvansky
  328. api: new ability to extract sequences from the parser for analysis, by @bimbashrestha
  329. api: fixed decoding of magic-less frames, by @terrelln
  330. api: fixed ZSTD_initCStream_advanced() performance with fast modes, reported by @QrczakMK
  331. cli: Named pipes support, by @bimbashrestha
  332. cli: short tar's extension support, by @stokito
  333. cli: command --output-dir-flat= , generates target files into requested directory, by @senhuang42
  334. cli: commands --stream-size=# and --size-hint=#, by @nmagerko
  335. cli: command --exclude-compressed, by @shashank0791
  336. cli: faster `-t` test mode
  337. cli: improved some error messages, by @vangyzen
  338. cli: fix command `-D dictionary` on Windows, reported by @artyompetrov
  339. cli: fix rare deadlock condition within dictionary builder, by @terrelln
  340. build: single-file decoder with emscripten compilation script, by @cwoffenden
  341. build: fixed zlibWrapper compilation on Visual Studio, reported by @bluenlive
  342. build: fixed deprecation warning for certain gcc version, reported by @jasonma163
  343. build: fix compilation on old gcc versions, by @cemeyer
  344. build: improved installation directories for cmake script, by Dmitri Shubin
  345. pack: modified pkgconfig, for better integration into openwrt, requested by @neheb
  346. misc: Improved documentation : ZSTD_CLEVEL, DYNAMIC_BMI2, ZSTD_CDict, function deprecation, zstd format
  347. misc: fixed educational decoder : accept larger literals section, and removed UNALIGNED() macro
  348. v1.4.3 (Aug 20, 2019)
  349. bug: Fix Dictionary Compression Ratio Regression by @cyan4973 (#1709)
  350. bug: Fix Buffer Overflow in legacy v0.3 decompression by @felixhandte (#1722)
  351. build: Add support for IAR C/C++ Compiler for Arm by @joseph0918 (#1705)
  352. v1.4.2 (Jul 26, 2019)
  353. bug: Fix bug in zstd-0.5 decoder by @terrelln (#1696)
  354. bug: Fix seekable decompression in-memory API by @iburinoc (#1695)
  355. misc: Validate blocks are smaller than size limit by @vivekmg (#1685)
  356. misc: Restructure source files by @ephiepark (#1679)
  357. v1.4.1 (Jul 20, 2019)
  358. bug: Fix data corruption in niche use cases by @terrelln (#1659)
  359. bug: Fuzz legacy modes, fix uncovered bugs by @terrelln (#1593, #1594, #1595)
  360. bug: Fix out of bounds read by @terrelln (#1590)
  361. perf: Improve decode speed by ~7% @mgrice (#1668)
  362. perf: Slightly improved compression ratio of level 3 and 4 (ZSTD_dfast) by @cyan4973 (#1681)
  363. perf: Slightly faster compression speed when re-using a context by @cyan4973 (#1658)
  364. perf: Improve compression ratio for small windowLog by @cyan4973 (#1624)
  365. perf: Faster compression speed in high compression mode for repetitive data by @terrelln (#1635)
  366. api: Add parameter to generate smaller dictionaries by @tyler-tran (#1656)
  367. cli: Recognize symlinks when built in C99 mode by @felixhandte (#1640)
  368. cli: Expose cpu load indicator for each file on -vv mode by @ephiepark (#1631)
  369. cli: Restrict read permissions on destination files by @chungy (#1644)
  370. cli: zstdgrep: handle -f flag by @felixhandte (#1618)
  371. cli: zstdcat: follow symlinks by @vejnar (#1604)
  372. doc: Remove extra size limit on compressed blocks by @felixhandte (#1689)
  373. doc: Fix typo by @yk-tanigawa (#1633)
  374. doc: Improve documentation on streaming buffer sizes by @cyan4973 (#1629)
  375. build: CMake: support building with LZ4 @leeyoung624 (#1626)
  376. build: CMake: install zstdless and zstdgrep by @leeyoung624 (#1647)
  377. build: CMake: respect existing uninstall target by @j301scott (#1619)
  378. build: Make: skip multithread tests when built without support by @michaelforney (#1620)
  379. build: Make: Fix examples/ test target by @sjnam (#1603)
  380. build: Meson: rename options out of deprecated namespace by @lzutao (#1665)
  381. build: Meson: fix build by @lzutao (#1602)
  382. build: Visual Studio: don't export symbols in static lib by @scharan (#1650)
  383. build: Visual Studio: fix linking by @absotively (#1639)
  384. build: Fix MinGW-W64 build by @myzhang1029 (#1600)
  385. misc: Expand decodecorpus coverage by @ephiepark (#1664)
  386. v1.4.0 (Apr 17, 2019)
  387. perf: Improve level 1 compression speed in most scenarios by 6% by @gbtucker and @terrelln
  388. api: Move the advanced API, including all functions in the staging section, to the stable section
  389. api: Make ZSTD_e_flush and ZSTD_e_end block for maximum forward progress
  390. api: Rename ZSTD_CCtxParam_getParameter to ZSTD_CCtxParams_getParameter
  391. api: Rename ZSTD_CCtxParam_setParameter to ZSTD_CCtxParams_setParameter
  392. api: Don't export ZSTDMT functions from the shared library by default
  393. api: Require ZSTD_MULTITHREAD to be defined to use ZSTDMT
  394. api: Add ZSTD_decompressBound() to provide an upper bound on decompressed size by @shakeelrao
  395. api: Fix ZSTD_decompressDCtx() corner cases with a dictionary
  396. api: Move ZSTD_getDictID_*() functions to the stable section
  397. api: Add ZSTD_c_literalCompressionMode flag to enable or disable literal compression by @terrelln
  398. api: Allow compression parameters to be set when a dictionary is used
  399. api: Allow setting parameters before or after ZSTD_CCtx_loadDictionary() is called
  400. api: Fix ZSTD_estimateCStreamSize_usingCCtxParams()
  401. api: Setting ZSTD_d_maxWindowLog to 0 means use the default
  402. cli: Ensure that a dictionary is not used to compress itself by @shakeelrao
  403. cli: Add --[no-]compress-literals flag to enable or disable literal compression
  404. doc: Update the examples to use the advanced API
  405. doc: Explain how to transition from old streaming functions to the advanced API in the header
  406. build: Improve the Windows release packages
  407. build: Improve CMake build by @hjmjohnson
  408. build: Build fixes for FreeBSD by @lwhsu
  409. build: Remove redundant warnings by @thatsafunnyname
  410. build: Fix tests on OpenBSD by @bket
  411. build: Extend fuzzer build system to work with the new clang engine
  412. build: CMake now creates the libzstd.so.1 symlink
  413. build: Improve Menson build by @lzutao
  414. misc: Fix symbolic link detection on FreeBSD
  415. misc: Use physical core count for -T0 on FreeBSD by @cemeyer
  416. misc: Fix zstd --list on truncated files by @kostmo
  417. misc: Improve logging in debug mode by @felixhandte
  418. misc: Add CirrusCI tests by @lwhsu
  419. misc: Optimize dictionary memory usage in corner cases
  420. misc: Improve the dictionary builder on small or homogeneous data
  421. misc: Fix spelling across the repo by @jsoref
  422. v1.3.8 (Dec 28, 2018)
  423. perf: better decompression speed on large files (+7%) and cold dictionaries (+15%)
  424. perf: slightly better compression ratio at high compression modes
  425. api : finalized advanced API, last stage before "stable" status
  426. api : new --rsyncable mode, by @terrelln
  427. api : support decompression of empty frames into NULL (used to be an error) (#1385)
  428. build: new set of macros to build a minimal size decoder, by @felixhandte
  429. build: fix compilation on MIPS32, reported by @clbr (#1441)
  430. build: fix compilation with multiple -arch flags, by @ryandesign
  431. build: highly upgraded meson build, by @lzutao
  432. build: improved buck support, by @obelisk
  433. build: fix cmake script : can create debug build, by @pitrou
  434. build: Makefile : grep works on both colored consoles and systems without color support
  435. build: fixed zstd-pgo, by @bmwiedemann
  436. cli : support ZSTD_CLEVEL environment variable, by @yijinfb (#1423)
  437. cli : --no-progress flag, preserving final summary (#1371), by @terrelln
  438. cli : ensure destination file is not source file (#1422)
  439. cli : clearer error messages, especially when input file not present
  440. doc : clarified zstd_compression_format.md, by @ulikunitz
  441. misc: fixed zstdgrep, returns 1 on failure, by @lzutao
  442. misc: NEWS renamed as CHANGELOG, in accordance with fboss
  443. v1.3.7 (Oct 20, 2018)
  444. perf: slightly better decompression speed on clang (depending on hardware target)
  445. fix : performance of dictionary compression for small input < 4 KB at levels 9 and 10
  446. build: no longer build backtrace by default in release mode; restrict further automatic mode
  447. build: control backtrace support through build macro BACKTRACE
  448. misc: added man pages for zstdless and zstdgrep, by @samrussell
  449. v1.3.6 (Oct 6, 2018)
  450. perf: much faster dictionary builder, by @jenniferliu
  451. perf: faster dictionary compression on small data when using multiple contexts, by @felixhandte
  452. perf: faster dictionary decompression when using a very large number of dictionaries simultaneously
  453. cli : fix : does no longer overwrite destination when source does not exist (#1082)
  454. cli : new command --adapt, for automatic compression level adaptation
  455. api : fix : block api can be streamed with > 4 GB, reported by @catid
  456. api : reduced ZSTD_DDict size by 2 KB
  457. api : minimum negative compression level is defined, and can be queried using ZSTD_minCLevel().
  458. build: support Haiku target, by @korli
  459. build: Read Legacy format is limited to v0.5+ by default. Can be changed at compile time with macro ZSTD_LEGACY_SUPPORT.
  460. doc : zstd_compression_format.md updated to match wording in IETF RFC 8478
  461. misc: tests/paramgrill, a parameter optimizer, by @GeorgeLu97
  462. v1.3.5 (Jun 29, 2018)
  463. perf: much faster dictionary compression, by @felixhandte
  464. perf: small quality improvement for dictionary generation, by @terrelln
  465. perf: slightly improved high compression levels (notably level 19)
  466. mem : automatic memory release for long duration contexts
  467. cli : fix : overlapLog can be manually set
  468. cli : fix : decoding invalid lz4 frames
  469. api : fix : performance degradation for dictionary compression when using advanced API, by @terrelln
  470. api : change : clarify ZSTD_CCtx_reset() vs ZSTD_CCtx_resetParameters(), by @terrelln
  471. build: select custom libzstd scope through control macros, by @GeorgeLu97
  472. build: OpenBSD patch, by @bket
  473. build: make and make all are compatible with -j
  474. doc : clarify zstd_compression_format.md, updated for IETF RFC process
  475. misc: pzstd compatible with reproducible compilation, by @lamby
  476. v1.3.4 (Mar 27, 2018)
  477. perf: faster speed (especially decoding speed) on recent cpus (haswell+)
  478. perf: much better performance associating --long with multi-threading, by @terrelln
  479. perf: better compression at levels 13-15
  480. cli : asynchronous compression by default, for faster experience (use --single-thread for former behavior)
  481. cli : smoother status report in multi-threading mode
  482. cli : added command --fast=#, for faster compression modes
  483. cli : fix crash when not overwriting existing files, by Pádraig Brady (@pixelb)
  484. api : `nbThreads` becomes `nbWorkers` : 1 triggers asynchronous mode
  485. api : compression levels can be negative, for even more speed
  486. api : ZSTD_getFrameProgression() : get precise progress status of ZSTDMT anytime
  487. api : ZSTDMT can accept new compression parameters during compression
  488. api : implemented all advanced dictionary decompression prototypes
  489. build: improved meson recipe, by Shawn Landden (@shawnl)
  490. build: VS2017 scripts, by @HaydnTrigg
  491. misc: all /contrib projects fixed
  492. misc: added /contrib/docker script by @gyscos
  493. v1.3.3 (Dec 21, 2017)
  494. perf: faster zstd_opt strategy (levels 16-19)
  495. fix : bug #944 : multithreading with shared dictionary and large data, reported by @gsliepen
  496. cli : fix : content size written in header by default
  497. cli : fix : improved LZ4 format support, by @felixhandte
  498. cli : new : hidden command `-S`, to benchmark multiple files while generating one result per file
  499. api : fix : support large skippable frames, by @terrelln
  500. api : fix : streaming interface was adding a useless 3-bytes null block to small frames
  501. api : change : when setting `pledgedSrcSize`, use `ZSTD_CONTENTSIZE_UNKNOWN` macro value to mean "unknown"
  502. build: fix : compilation under rhel6 and centos6, reported by @pixelb
  503. build: added `check` target
  504. v1.3.2 (Oct 10, 2017)
  505. new : long range mode, using --long command, by Stella Lau (@stellamplau)
  506. new : ability to generate and decode magicless frames (#591)
  507. changed : maximum nb of threads reduced to 200, to avoid address space exhaustion in 32-bits mode
  508. fix : multi-threading compression works with custom allocators
  509. fix : ZSTD_sizeof_CStream() was over-evaluating memory usage
  510. fix : a rare compression bug when compression generates very large distances and bunch of other conditions (only possible at --ultra -22)
  511. fix : 32-bits build can now decode large offsets (levels 21+)
  512. cli : added LZ4 frame support by default, by Felix Handte (@felixhandte)
  513. cli : improved --list output
  514. cli : new : can split input file for dictionary training, using command -B#
  515. cli : new : clean operation artefact on Ctrl-C interruption
  516. cli : fix : do not change /dev/null permissions when using command -t with root access, reported by @mike155 (#851)
  517. cli : fix : write file size in header in multiple-files mode
  518. api : added macro ZSTD_COMPRESSBOUND() for static allocation
  519. api : experimental : new advanced decompression API
  520. api : fix : sizeof_CCtx() used to over-estimate
  521. build: fix : no-multithread variant compiles without pool.c dependency, reported by Mitchell Blank Jr (@mitchblank) (#819)
  522. build: better compatibility with reproducible builds, by Bernhard M. Wiedemann (@bmwiedemann) (#818)
  523. example : added streaming_memory_usage
  524. license : changed /examples license to BSD + GPLv2
  525. license : fix a few header files to reflect new license (#825)
  526. v1.3.1 (Aug 21, 2017)
  527. New license : BSD + GPLv2
  528. perf: substantially decreased memory usage in Multi-threading mode, thanks to reports by Tino Reichardt (@mcmilk)
  529. perf: Multi-threading supports up to 256 threads. Cap at 256 when more are requested (#760)
  530. cli : improved and fixed --list command, by @ib (#772)
  531. cli : command -vV to list supported formats, by @ib (#771)
  532. build : fixed binary variants, reported by @svenha (#788)
  533. build : fix Visual compilation for non x86/x64 targets, reported by Greg Slazinski (@GregSlazinski) (#718)
  534. API exp : breaking change : ZSTD_getframeHeader() provides more information
  535. API exp : breaking change : pinned down values of error codes
  536. doc : fixed huffman example, by Ulrich Kunitz (@ulikunitz)
  537. new : contrib/adaptive-compression, I/O driven compression strength, by Paul Cruz (@paulcruz74)
  538. new : contrib/long_distance_matching, statistics by Stella Lau (@stellamplau)
  539. updated : contrib/linux-kernel, by Nick Terrell (@terrelln)
  540. v1.3.0 (Jul 6, 2017)
  541. cli : new : `--list` command, by Paul Cruz
  542. cli : changed : xz/lzma support enabled by default
  543. cli : changed : `-t *` continue processing list after a decompression error
  544. API : added : ZSTD_versionString()
  545. API : promoted to stable status : ZSTD_getFrameContentSize(), by Sean Purcell
  546. API exp : new advanced API : ZSTD_compress_generic(), ZSTD_CCtx_setParameter()
  547. API exp : new : API for static or external allocation : ZSTD_initStatic?Ctx()
  548. API exp : added : ZSTD_decompressBegin_usingDDict(), requested by Guy Riddle (#700)
  549. API exp : clarified memory estimation / measurement functions.
  550. API exp : changed : strongest strategy renamed ZSTD_btultra, fastest strategy ZSTD_fast set to 1
  551. tools : decodecorpus can generate random dictionary-compressed samples, by Paul Cruz
  552. new : contrib/seekable_format, demo and API, by Sean Purcell
  553. changed : contrib/linux-kernel, updated version and license, by Nick Terrell
  554. v1.2.0 (May 5, 2017)
  555. cli : changed : Multithreading enabled by default (use target zstd-nomt or HAVE_THREAD=0 to disable)
  556. cli : new : command -T0 means "detect and use nb of cores", by Sean Purcell
  557. cli : new : zstdmt symlink hardwired to `zstd -T0`
  558. cli : new : command --threads=# (#671)
  559. cli : changed : cover dictionary builder by default, for improved quality, by Nick Terrell
  560. cli : new : commands --train-cover and --train-legacy, to select dictionary algorithm and parameters
  561. cli : experimental targets `zstd4` and `xzstd4`, with support for lz4 format, by Sean Purcell
  562. cli : fix : does not output compressed data on console
  563. cli : fix : ignore symbolic links unless --force specified,
  564. API : breaking change : ZSTD_createCDict_advanced(), only use compressionParameters as argument
  565. API : added : prototypes ZSTD_*_usingCDict_advanced(), for direct control over frameParameters.
  566. API : improved: ZSTDMT_compressCCtx() reduced memory usage
  567. API : fix : ZSTDMT_compressCCtx() now provides srcSize in header (#634)
  568. API : fix : src size stored in frame header is controlled at end of frame
  569. API : fix : enforced consistent rules for pledgedSrcSize==0 (#641)
  570. API : fix : error code "GENERIC" replaced by "dstSizeTooSmall" when appropriate
  571. build: improved cmake script, by @Majlen
  572. build: enabled Multi-threading support for *BSD, by Baptiste Daroussin
  573. tools: updated Paramgrill. Command -O# provides best parameters for sample and speed target.
  574. new : contrib/linux-kernel version, by Nick Terrell
  575. v1.1.4 (Mar 18, 2017)
  576. cli : new : can compress in *.gz format, using --format=gzip command, by Przemyslaw Skibinski
  577. cli : new : advanced benchmark command --priority=rt
  578. cli : fix : write on sparse-enabled file systems in 32-bits mode, by @ds77
  579. cli : fix : --rm remains silent when input is stdin
  580. cli : experimental : xzstd, with support for xz/lzma decoding, by Przemyslaw Skibinski
  581. speed : improved decompression speed in streaming mode for single shot scenarios (+5%)
  582. memory: DDict (decompression dictionary) memory usage down from 150 KB to 20 KB
  583. arch: 32-bits variant able to generate and decode very long matches (>32 MB), by Sean Purcell
  584. API : new : ZSTD_findFrameCompressedSize(), ZSTD_getFrameContentSize(), ZSTD_findDecompressedSize()
  585. API : changed : dropped support of legacy versions <= v0.3 (can be changed by modifying ZSTD_LEGACY_SUPPORT value)
  586. build : new: meson build system in contrib/meson, by Dima Krasner
  587. build : improved cmake script, by @Majlen
  588. build : added -Wformat-security flag, as recommended by Padraig Brady
  589. doc : new : educational decoder, by Sean Purcell
  590. v1.1.3 (Feb 7, 2017)
  591. cli : zstd can decompress .gz files (can be disabled with `make zstd-nogz` or `make HAVE_ZLIB=0`)
  592. cli : new : experimental target `make zstdmt`, with multi-threading support
  593. cli : new : improved dictionary builder "cover" (experimental), by Nick Terrell, based on prior work by Giuseppe Ottaviano.
  594. cli : new : advanced commands for detailed parameters, by Przemyslaw Skibinski
  595. cli : fix zstdless on Mac OS-X, by Andrew Janke
  596. cli : fix #232 "compress non-files"
  597. dictBuilder : improved dictionary generation quality, thanks to Nick Terrell
  598. API : new : lib/compress/ZSTDMT_compress.h multithreading API (experimental)
  599. API : new : ZSTD_create?Dict_byReference(), requested by Bartosz Taudul
  600. API : new : ZDICT_finalizeDictionary()
  601. API : fix : ZSTD_initCStream_usingCDict() properly writes dictID into frame header, by Gregory Szorc (#511)
  602. API : fix : all symbols properly exposed in libzstd, by Nick Terrell
  603. build : support for Solaris target, by Przemyslaw Skibinski
  604. doc : clarified specification, by Sean Purcell
  605. v1.1.2 (Dec 15, 2016)
  606. API : streaming : decompression : changed : automatic implicit reset when chain-decoding new frames without init
  607. API : experimental : added : dictID retrieval functions, and ZSTD_initCStream_srcSize()
  608. API : zbuff : changed : prototypes now generate deprecation warnings
  609. lib : improved : faster decompression speed at ultra compression settings and 32-bits mode
  610. lib : changed : only public ZSTD_ symbols are now exposed
  611. lib : changed : reduced usage of stack memory
  612. lib : fixed : several corner case bugs, by Nick Terrell
  613. cli : new : gzstd, experimental version able to decode .gz files, by Przemyslaw Skibinski
  614. cli : new : preserve file attributes
  615. cli : new : added zstdless and zstdgrep tools
  616. cli : fixed : status displays total amount decoded, even for file consisting of multiple frames (like pzstd)
  617. cli : fixed : zstdcat
  618. zlib_wrapper : added support for gz* functions, by Przemyslaw Skibinski
  619. install : better compatibility with FreeBSD, by Dimitry Andric
  620. source tree : changed : zbuff source files moved to lib/deprecated
  621. v1.1.1 (Nov 2, 2016)
  622. New : command -M#, --memory=, --memlimit=, --memlimit-decompress= to limit allowed memory consumption
  623. New : doc/zstd_manual.html, by Przemyslaw Skibinski
  624. Improved : slightly better compression ratio at --ultra levels (>= 20)
  625. Improved : better memory usage when using streaming compression API, thanks to @Rogier-5 report
  626. Added : API : ZSTD_initCStream_usingCDict(), ZSTD_initDStream_usingDDict() (experimental section)
  627. Added : example/multiple_streaming_compression.c
  628. Changed : zstd_errors.h is now installed within /include (and replaces errors_public.h)
  629. Updated man page
  630. Fixed : zstd-small, zstd-compress and zstd-decompress compilation targets
  631. v1.1.0 (Sep 28, 2016)
  632. New : contrib/pzstd, parallel version of zstd, by Nick Terrell
  633. added : NetBSD install target (#338)
  634. Improved : speed for batches of small files
  635. Improved : speed of zlib wrapper, by Przemyslaw Skibinski
  636. Changed : libzstd on Windows supports legacy formats, by Christophe Chevalier
  637. Fixed : CLI -d output to stdout by default when input is stdin (#322)
  638. Fixed : CLI correctly detects console on Mac OS-X
  639. Fixed : CLI supports recursive mode `-r` on Mac OS-X
  640. Fixed : Legacy decoders use unified error codes, reported by benrg (#341), fixed by Przemyslaw Skibinski
  641. Fixed : compatibility with OpenBSD, reported by Juan Francisco Cantero Hurtado (#319)
  642. Fixed : compatibility with Hurd, by Przemyslaw Skibinski (#365)
  643. Fixed : zstd-pgo, reported by octoploid (#329)
  644. v1.0.0 (Sep 1, 2016)
  645. Change Licensing, all project is now BSD, Copyright Facebook
  646. Small decompression speed improvement
  647. API : Streaming API supports legacy format
  648. API : ZDICT_getDictID(), ZSTD_sizeof_{CCtx, DCtx, CStream, DStream}(), ZSTD_setDStreamParameter()
  649. CLI supports legacy formats v0.4+
  650. Fixed : compression fails on certain huge files, reported by Jesse McGrew
  651. Enhanced documentation, by Przemyslaw Skibinski
  652. v0.8.1 (Aug 18, 2016)
  653. New streaming API
  654. Changed : --ultra now enables levels beyond 19
  655. Changed : -i# now selects benchmark time in second
  656. Fixed : ZSTD_compress* can now compress > 4 GB in a single pass, reported by Nick Terrell
  657. Fixed : speed regression on specific patterns (#272)
  658. Fixed : support for Z_SYNC_FLUSH, by Dmitry Krot (#291)
  659. Fixed : ICC compilation, by Przemyslaw Skibinski
  660. v0.8.0 (Aug 2, 2016)
  661. Improved : better speed on clang and gcc -O2, thanks to Eric Biggers
  662. New : Build on FreeBSD and DragonFly, thanks to JrMarino
  663. Changed : modified API : ZSTD_compressEnd()
  664. Fixed : legacy mode with ZSTD_HEAPMODE=0, by Christopher Bergqvist
  665. Fixed : premature end of frame when zero-sized raw block, reported by Eric Biggers
  666. Fixed : large dictionaries (> 384 KB), reported by Ilona Papava
  667. Fixed : checksum correctly checked in single-pass mode
  668. Fixed : combined --test amd --rm, reported by Andreas M. Nilsson
  669. Modified : minor compression level adaptations
  670. Updated : compression format specification to v0.2.0
  671. changed : zstd.h moved to /lib directory
  672. v0.7.5 (Aug 1, 2016)
  673. Transition version, supporting decoding of v0.8.x
  674. v0.7.4 (Jul 17, 2016)
  675. Added : homebrew for Mac, by Daniel Cade
  676. Added : more examples
  677. Fixed : segfault when using small dictionaries, reported by Felix Handte
  678. Modified : default compression level for CLI is now 3
  679. Updated : specification, to v0.1.1
  680. v0.7.3 (Jul 9, 2016)
  681. New : compression format specification
  682. New : `--` separator, stating that all following arguments are file names. Suggested by Chip Turner.
  683. New : `ZSTD_getDecompressedSize()`
  684. New : OpenBSD target, by Juan Francisco Cantero Hurtado
  685. New : `examples` directory
  686. fixed : dictBuilder using HC levels, reported by Bartosz Taudul
  687. fixed : legacy support from ZSTD_decompress_usingDDict(), reported by Felix Handte
  688. fixed : multi-blocks decoding with intermediate uncompressed blocks, reported by Greg Slazinski
  689. modified : removed "mem.h" and "error_public.h" dependencies from "zstd.h" (experimental section)
  690. modified : legacy functions no longer need magic number
  691. v0.7.2 (Jul 4, 2016)
  692. fixed : ZSTD_decompressBlock() using multiple consecutive blocks. Reported by Greg Slazinski.
  693. fixed : potential segfault on very large files (many gigabytes). Reported by Chip Turner.
  694. fixed : CLI displays system error message when destination file cannot be created (#231). Reported by Chip Turner.
  695. v0.7.1 (Jun 23, 2016)
  696. fixed : ZBUFF_compressEnd() called multiple times with too small `dst` buffer, reported by Christophe Chevalier
  697. fixed : dictBuilder fails if first sample is too small, reported by Руслан Ковалёв
  698. fixed : corruption issue, reported by cj
  699. modified : checksum enabled by default in command line mode
  700. v0.7.0 (Jun 17, 2016)
  701. New : Support for directory compression, using `-r`, thanks to Przemyslaw Skibinski
  702. New : Command `--rm`, to remove source file after successful de/compression
  703. New : Visual build scripts, by Christophe Chevalier
  704. New : Support for Sparse File-systems (do not use space for zero-filled sectors)
  705. New : Frame checksum support
  706. New : Support pass-through mode (when using `-df`)
  707. API : more efficient Dictionary API : `ZSTD_compress_usingCDict()`, `ZSTD_decompress_usingDDict()`
  708. API : create dictionary files from custom content, by Giuseppe Ottaviano
  709. API : support for custom malloc/free functions
  710. New : controllable Dictionary ID
  711. New : Support for skippable frames
  712. v0.6.1 (May 13, 2016)
  713. New : zlib wrapper API, thanks to Przemyslaw Skibinski
  714. New : Ability to compile compressor / decompressor separately
  715. Changed : new lib directory structure
  716. Fixed : Legacy codec v0.5 compatible with dictionary decompression
  717. Fixed : Decoder corruption error (#173)
  718. Fixed : null-string roundtrip (#176)
  719. New : benchmark mode can select directory as input
  720. Experimental : midipix support, VMS support
  721. v0.6.0 (Apr 13, 2016)
  722. Stronger high compression modes, thanks to Przemyslaw Skibinski
  723. API : ZSTD_getFrameParams() provides size of decompressed content
  724. New : highest compression modes require `--ultra` command to fully unleash their capacity
  725. Fixed : zstd cli return error code > 0 and removes dst file artifact when decompression fails, thanks to Chip Turner
  726. v0.5.1 (Feb 18, 2016)
  727. New : Optimal parsing => Very high compression modes, thanks to Przemyslaw Skibinski
  728. Changed : Dictionary builder integrated into libzstd and zstd cli
  729. Changed (!) : zstd cli now uses "multiple input files" as default mode. See `zstd -h`.
  730. Fix : high compression modes for big-endian platforms
  731. New : zstd cli : `-t` | `--test` command
  732. v0.5.0 (Feb 5, 2016)
  733. New : dictionary builder utility
  734. Changed : streaming & dictionary API
  735. Improved : better compression of small data
  736. v0.4.7 (Jan 22, 2016)
  737. Improved : small compression speed improvement in HC mode
  738. Changed : `zstd_decompress.c` has ZSTD_LEGACY_SUPPORT to 0 by default
  739. fix : bt search bug
  740. v0.4.6 (Jan 13, 2016)
  741. fix : fast compression mode on Windows
  742. New : cmake configuration file, thanks to Artyom Dymchenko
  743. Improved : high compression mode on repetitive data
  744. New : block-level API
  745. New : ZSTD_duplicateCCtx()
  746. v0.4.5 (Dec 18, 2015)
  747. new : -m/--multiple : compress/decompress multiple files
  748. v0.4.4 (Dec 14, 2015)
  749. Fixed : high compression modes for Windows 32 bits
  750. new : external dictionary API extended to buffered mode and accessible through command line
  751. new : windows DLL project, thanks to Christophe Chevalier
  752. v0.4.3 (Dec 7, 2015)
  753. new : external dictionary API
  754. new : zstd-frugal
  755. v0.4.2 (Dec 2, 2015)
  756. Generic minor improvements for small blocks
  757. Fixed : big-endian compatibility, by Peter Harris (#85)
  758. v0.4.1 (Dec 1, 2015)
  759. Fixed : ZSTD_LEGACY_SUPPORT=0 build mode (reported by Luben)
  760. removed `zstd.c`
  761. v0.4.0 (Nov 29, 2015)
  762. Command line utility compatible with high compression levels
  763. Removed zstdhc => merged into zstd
  764. Added : ZBUFF API (see zstd_buffered.h)
  765. Rolling buffer support
  766. v0.3.6 (Nov 10, 2015)
  767. small blocks params
  768. v0.3.5 (Nov 9, 2015)
  769. minor generic compression improvements
  770. v0.3.4 (Nov 6, 2015)
  771. Faster fast cLevels
  772. v0.3.3 (Nov 5, 2015)
  773. Small compression ratio improvement
  774. v0.3.2 (Nov 2, 2015)
  775. Fixed Visual Studio
  776. v0.3.1 (Nov 2, 2015)
  777. Small compression ratio improvement
  778. v0.3 (Oct 30, 2015)
  779. HC mode : compression levels 2-26
  780. v0.2.2 (Oct 28, 2015)
  781. Fix : Visual Studio 2013 & 2015 release compilation, by Christophe Chevalier
  782. v0.2.1 (Oct 24, 2015)
  783. Fix : Read errors, advanced fuzzer tests, by Hanno Böck
  784. v0.2.0 (Oct 22, 2015)
  785. **Breaking format change**
  786. Faster decompression speed
  787. Can still decode v0.1 format
  788. v0.1.3 (Oct 15, 2015)
  789. fix uninitialization warning, reported by Evan Nemerson
  790. v0.1.2 (Sep 11, 2015)
  791. frame concatenation support
  792. v0.1.1 (Aug 27, 2015)
  793. fix compression bug
  794. detects write-flush errors
  795. v0.1.0 (Aug 25, 2015)
  796. first release