CHANGELOG 48 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781782783784785786787788789790791792793794795796797798799800801802803804805806807808809810811812813814815816817818819820821822823824825826827828829830831832833834835836837
  1. V1.5.6 (Mar 2024)
  2. api: Promote `ZSTD_c_targetCBlockSize` to Stable API by @felixhandte
  3. api: new `ZSTD_d_maxBlockSize` experimental parameter, to reduce streaming decompression memory, by @terrelln
  4. perf: improve performance of param `ZSTD_c_targetCBlockSize`, by @Cyan4973
  5. perf: improved compression of arrays of integers at high compression, by @Cyan4973
  6. lib: reduce binary size with selective built-time exclusion, by @felixhandte
  7. lib: improved huffman speed on small data and linux kernel, by @terrelln
  8. lib: accept dictionaries with partial literal tables, by @terrelln
  9. lib: fix CCtx size estimation with external sequence producer, by @embg
  10. lib: fix corner case decoder behaviors, by @Cyan4973 and @aimuz
  11. lib: fix zdict prototype mismatch in static_only mode, by @ldv-alt
  12. lib: fix several bugs in magicless-format decoding, by @embg
  13. cli: add common compressed file types to `--exclude-compressed`` by @daniellerozenblit
  14. cli: fix mixing `-c` and `-o` commands with `--rm`, by @Cyan4973
  15. cli: fix erroneous exclusion of hidden files with `--output-dir-mirror` by @felixhandte
  16. cli: improved time accuracy on BSD, by @felixhandte
  17. cli: better errors on argument parsing, by @KapJI
  18. tests: better compatibility with older versions of `grep`, by @Cyan4973
  19. tests: lorem ipsum generator as default backup content, by @Cyan4973
  20. build: cmake improvements by @terrelln, @sighingnow, @gjasny, @JohanMabille, @Saverio976, @gruenich, @teo-tsirpanis
  21. build: bazel support, by @jondo2010
  22. build: fix cross-compiling for AArch64 with lld by @jcelerier
  23. build: fix Apple platform compatibility, by @nidhijaju
  24. build: fix Visual 2012 and lower compatibility, by @Cyan4973
  25. build: improve win32 support, by @DimitriPapadopoulos
  26. build: better C90 compliance for zlibWrapper, by @emaste
  27. port: make: fat binaries on macos, by @mredig
  28. port: ARM64EC compatibility for Windows, by @dunhor
  29. port: QNX support by @klausholstjacobsen
  30. port: MSYS2 and Cygwin makefile installation and test support, by @QBos07
  31. port: risc-v support validation in CI, by @Cyan4973
  32. port: sparc64 support validation in CI, by @Cyan4973
  33. port: AIX compatibility, by @likema
  34. port: HP-UX compatibility, by @likema
  35. doc: Improved specification accuracy, by @elasota
  36. bug: Fix and deprecate ZSTD_generateSequences (#3981)
  37. v1.5.5 (Apr 2023)
  38. fix: fix rare corruption bug affecting the high compression mode, reported by @danlark1 (#3517, @terrelln)
  39. perf: improve mid-level compression speed (#3529, #3533, #3543, @yoniko and #3552, @terrelln)
  40. lib: deprecated bufferless block-level API (#3534) by @terrelln
  41. cli: mmap large dictionaries to save memory, by @daniellerozenblit
  42. cli: improve speed of --patch-from mode (~+50%) (#3545) by @daniellerozenblit
  43. cli: improve i/o speed (~+10%) when processing lots of small files (#3479) by @felixhandte
  44. cli: zstd no longer crashes when requested to write into write-protected directory (#3541) by @felixhandte
  45. cli: fix decompression into block device using -o, reported by @georgmu (#3583)
  46. build: fix zstd CLI compiled with lzma support but not zlib support (#3494) by @Hello71
  47. build: fix cmake does no longer require 3.18 as minimum version (#3510) by @kou
  48. build: fix MSVC+ClangCL linking issue (#3569) by @tru
  49. build: fix zstd-dll, version of zstd CLI that links to the dynamic library (#3496) by @yoniko
  50. build: fix MSVC warnings (#3495) by @embg
  51. doc: updated zstd specification to clarify corner cases, by @Cyan4973
  52. doc: document how to create fat binaries for macos (#3568) by @rickmark
  53. misc: improve seekable format ingestion speed (~+100%) for very small chunk sizes (#3544) by @Cyan4973
  54. misc: tests/fullbench can benchmark multiple files (#3516) by @dloidolt
  55. v1.5.4 (Feb 2023)
  56. perf: +20% faster huffman decompression for targets that can't compile x64 assembly (#3449, @terrelln)
  57. perf: up to +10% faster streaming compression at levels 1-2 (#3114, @embg)
  58. perf: +4-13% for levels 5-12 by optimizing function generation (#3295, @terrelln)
  59. pref: +3-11% compression speed for `arm` target (#3199, #3164, #3145, #3141, #3138, @JunHe77 and #3139, #3160, @danlark1)
  60. perf: +5-30% faster dictionary compression at levels 1-4 (#3086, #3114, #3152, @embg)
  61. perf: +10-20% cold dict compression speed by prefetching CDict tables (#3177, @embg)
  62. perf: +1% faster compression by removing a branch in ZSTD_fast_noDict (#3129, @felixhandte)
  63. perf: Small compression ratio improvements in high compression mode (#2983, #3391, @Cyan4973 and #3285, #3302, @daniellerozenblit)
  64. perf: small speed improvement by better detecting `STATIC_BMI2` for `clang` (#3080, @TocarIP)
  65. perf: Improved streaming performance when `ZSTD_c_stableInBuffer` is set (#2974, @Cyan4973)
  66. cli: Asynchronous I/O for improved cli speed (#2975, #2985, #3021, #3022, @yoniko)
  67. cli: Change `zstdless` behavior to align with `zless` (#2909, @binhdvo)
  68. cli: Keep original file if `-c` or `--stdout` is given (#3052, @dirkmueller)
  69. cli: Keep original files when result is concatenated into a single output with `-o` (#3450, @Cyan4973)
  70. cli: Preserve Permissions and Ownership of regular files (#3432, @felixhandte)
  71. cli: Print zlib/lz4/lzma library versions with `-vv` (#3030, @terrelln)
  72. cli: Print checksum value for single frame files with `-lv` (#3332, @Cyan4973)
  73. cli: Print `dictID` when present with `-lv` (#3184, @htnhan)
  74. cli: when `stderr` is *not* the console, disable status updates, but preserve final summary (#3458, @Cyan4973)
  75. cli: support `--best` and `--no-name` in `gzip` compatibility mode (#3059, @dirkmueller)
  76. cli: support for `posix` high resolution timer `clock_gettime()`, for improved benchmark accuracy (#3423, @Cyan4973)
  77. cli: improved help/usage (`-h`, `-H`) formatting (#3094, @dirkmueller and #3385, @jonpalmisc)
  78. cli: Fix better handling of bogus numeric values (#3268, @ctkhanhly)
  79. cli: Fix input consists of multiple files _and_ `stdin` (#3222, @yoniko)
  80. cli: Fix tiny files passthrough (#3215, @cgbur)
  81. cli: Fix for `-r` on empty directory (#3027, @brailovich)
  82. cli: Fix empty string as argument for `--output-dir-*` (#3220, @embg)
  83. cli: Fix decompression memory usage reported by `-vv --long` (#3042, @u1f35c, and #3232, @zengyijing)
  84. cli: Fix infinite loop when empty input is passed to trainer (#3081, @terrelln)
  85. cli: Fix `--adapt` doesn't work when `--no-progress` is also set (#3354, @terrelln)
  86. api: Support for Block-Level Sequence Producer (#3333, @embg)
  87. api: Support for in-place decompression (#3432, @terrelln)
  88. api: New `ZSTD_CCtx_setCParams()` function, set all parameters defined in a `ZSTD_compressionParameters` structure (#3403, @Cyan4973)
  89. api: Streaming decompression detects incorrect header ID sooner (#3175, @Cyan4973)
  90. api: Window size resizing optimization for edge case (#3345, @daniellerozenblit)
  91. api: More accurate error codes for busy-loop scenarios (#3413, #3455, @Cyan4973)
  92. api: Fix limit overflow in `compressBound` and `decompressBound` (#3362, #3373, Cyan4973) reported by @nigeltao
  93. api: Deprecate several advanced experimental functions: streaming (#3408, @embg), copy (#3196, @mileshu)
  94. bug: Fix corruption that rarely occurs in 32-bit mode with wlog=25 (#3361, @terrelln)
  95. bug: Fix for block-splitter (#3033, @Cyan4973)
  96. bug: Fixes for Sequence Compression API (#3023, #3040, @Cyan4973)
  97. bug: Fix leaking thread handles on Windows (#3147, @animalize)
  98. bug: Fix timing issues with cmake/meson builds (#3166, #3167, #3170, @Cyan4973)
  99. build: Allow user to select legacy level for cmake (#3050, @shadchin)
  100. build: Enable legacy support by default in cmake (#3079, @niamster)
  101. build: Meson build script improvements (#3039, #3120, #3122, #3327, #3357, @eli-schwartz and #3276, @neheb)
  102. build: Add aarch64 to supported architectures for zstd_trace (#3054, @ooosssososos)
  103. build: support AIX architecture (#3219, @qiongsiwu)
  104. build: Fix `ZSTD_LIB_MINIFY` build macro, which now reduces static library size by half (#3366, @terrelln)
  105. build: Fix Windows issues with Multithreading translation layer (#3364, #3380, @yoniko) and ARM64 target (#3320, @cwoffenden)
  106. build: Fix `cmake` script (#3382, #3392, @terrelln and #3252 @Tachi107 and #3167 @Cyan4973)
  107. doc: Updated man page, providing more details for `--train` mode (#3112, @Cyan4973)
  108. doc: Add decompressor errata document (#3092, @terrelln)
  109. misc: Enable Intel CET (#2992, #2994, @hjl-tools)
  110. misc: Fix `contrib/` seekable format (#3058, @yhoogstrate and #3346, @daniellerozenblit)
  111. misc: Improve speed of the one-file library generator (#3241, @wahern and #3005, @cwoffenden)
  112. v1.5.3 (dev version, unpublished)
  113. v1.5.2 (Jan, 2022)
  114. perf: Regain Minimal memset()-ing During Reuse of Compression Contexts (@Cyan4973, #2969)
  115. build: Build Zstd with `noexecstack` on All Architectures (@felixhandte, #2964)
  116. doc: Clarify Licensing (@terrelln, #2981)
  117. v1.5.1 (Dec, 2021)
  118. perf: rebalanced compression levels, to better match the intended speed/level curve, by @senhuang42
  119. perf: faster huffman decoder, using x64 assembly, by @terrelln
  120. perf: slightly faster high speed modes (strategies fast & dfast), by @felixhandte
  121. perf: improved binary size and faster compilation times, by @terrelln
  122. perf: new row64 mode, used notably in level 12, by @senhuang42
  123. perf: faster mid-level compression speed in presence of highly repetitive patterns, by @senhuang42
  124. perf: minor compression ratio improvements for small data at high levels, by @cyan4973
  125. perf: reduced stack usage (mostly useful for Linux Kernel), by @terrelln
  126. perf: faster compression speed on incompressible data, by @bindhvo
  127. perf: on-demand reduced ZSTD_DCtx state size, using build macro ZSTD_DECODER_INTERNAL_BUFFER, at a small cost of performance, by @bindhvo
  128. build: allows hiding static symbols in the dynamic library, using build macro, by @skitt
  129. build: support for m68k (Motorola 68000's), by @cyan4973
  130. build: improved AIX support, by @Helflym
  131. build: improved meson unofficial build, by @eli-schwartz
  132. cli : custom memory limit when training dictionary (#2925), by @embg
  133. cli : report advanced parameters information when compressing in very verbose mode (`-vv`), by @Svetlitski-FB
  134. v1.5.0 (May 11, 2021)
  135. api: Various functions promoted from experimental to stable API: (#2579-2581, @senhuang42)
  136. `ZSTD_defaultCLevel()`
  137. `ZSTD_getDictID_fromCDict()`
  138. api: Several experimental functions have been deprecated and will emit a compiler warning (#2582, @senhuang42)
  139. `ZSTD_compress_advanced()`
  140. `ZSTD_compress_usingCDict_advanced()`
  141. `ZSTD_compressBegin_advanced()`
  142. `ZSTD_compressBegin_usingCDict_advanced()`
  143. `ZSTD_initCStream_srcSize()`
  144. `ZSTD_initCStream_usingDict()`
  145. `ZSTD_initCStream_usingCDict()`
  146. `ZSTD_initCStream_advanced()`
  147. `ZSTD_initCStream_usingCDict_advanced()`
  148. `ZSTD_resetCStream()`
  149. api: ZSTDMT_NBWORKERS_MAX reduced to 64 for 32-bit environments (@Cyan4973)
  150. perf: Significant speed improvements for middle compression levels (#2494, @senhuang42 @terrelln)
  151. perf: Block splitter to improve compression ratio, enabled by default for high compression levels (#2447, @senhuang42)
  152. perf: Decompression loop refactor, speed improvements on `clang` and for `--long` modes (#2614 #2630, @Cyan4973)
  153. perf: Reduced stack usage during compression and decompression entropy stage (#2522 #2524, @terrelln)
  154. bug: Improve setting permissions of created files (#2525, @felixhandte)
  155. bug: Fix large dictionary non-determinism (#2607, @terrelln)
  156. bug: Fix non-determinism test failures on Linux i686 (#2606, @terrelln)
  157. bug: Fix various dedicated dictionary search bugs (#2540 #2586, @senhuang42 @felixhandte)
  158. bug: Ensure `ZSTD_estimateCCtxSize*() `monotonically increases with compression level (#2538, @senhuang42)
  159. bug: Fix --patch-from mode parameter bound bug with small files (#2637, @occivink)
  160. bug: Fix UBSAN error in decompression (#2625, @terrelln)
  161. bug: Fix superblock compression divide by zero bug (#2592, @senhuang42)
  162. bug: Make the number of physical CPU cores detection more robust (#2517, @PaulBone)
  163. doc: Improve `zdict.h` dictionary training API documentation (#2622, @terrelln)
  164. doc: Note that public `ZSTD_free*()` functions accept NULL pointers (#2521, @animalize)
  165. doc: Add style guide docs for open source contributors (#2626, @Cyan4973)
  166. tests: Better regression test coverage for different dictionary modes (#2559, @senhuang42)
  167. tests: Better test coverage of index reduction (#2603, @terrelln)
  168. tests: OSS-Fuzz coverage for seekable format (#2617, @senhuang42)
  169. tests: Test coverage for ZSTD threadpool API (#2604, @senhuang42)
  170. build: Dynamic library built multithreaded by default (#2584, @senhuang42)
  171. build: Move `zstd_errors.h` and `zdict.h` to `lib/` root (#2597, @terrelln)
  172. build: Allow `ZSTDMT_JOBSIZE_MIN` to be configured at compile-time, reduce default to 512KB (#2611, @Cyan4973)
  173. build: Single file library build script moved to `build/` directory (#2618, @felixhandte)
  174. build: `ZBUFF_*()` is no longer built by default (#2583, @senhuang42)
  175. build: Fixed Meson build (#2548, @SupervisedThinking @kloczek)
  176. build: Fix excessive compiler warnings with clang-cl and CMake (#2600, @nickhutchinson)
  177. build: Detect presence of `md5` on Darwin (#2609, @felixhandte)
  178. build: Avoid SIGBUS on armv6 (#2633, @bmwiedmann)
  179. cli: `--progress` flag added to always display progress bar (#2595, @senhuang42)
  180. cli: Allow reading from block devices with `--force` (#2613, @felixhandte)
  181. cli: Fix CLI filesize display bug (#2550, @Cyan4973)
  182. cli: Fix windows CLI `--filelist` end-of-line bug (#2620, @Cyan4973)
  183. contrib: Various fixes for linux kernel patch (#2539, @terrelln)
  184. contrib: Seekable format - Decompression hanging edge case fix (#2516, @senhuang42)
  185. contrib: Seekable format - New seek table-only API (#2113 #2518, @mdittmer @Cyan4973)
  186. contrib: Seekable format - Fix seek table descriptor check when loading (#2534, @foxeng)
  187. contrib: Seekable format - Decompression fix for large offsets, (#2594, @azat)
  188. misc: Automatically published release tarballs available on Github (#2535, @felixhandte)
  189. v1.4.9 (Mar 1, 2021)
  190. bug: Use `umask()` to Constrain Created File Permissions (#2495, @felixhandte)
  191. bug: Make Simple Single-Pass Functions Ignore Advanced Parameters (#2498, @terrelln)
  192. api: Add (De)Compression Tracing Functionality (#2482, @terrelln)
  193. api: Support References to Multiple DDicts (#2446, @senhuang42)
  194. api: Add Function to Generate Skippable Frame (#2439, @senhuang42)
  195. perf: New Algorithms for the Long Distance Matcher (#2483, @mpu)
  196. perf: Performance Improvements for Long Distance Matcher (#2464, @mpu)
  197. perf: Don't Shrink Window Log when Streaming with a Dictionary (#2451, @terrelln)
  198. cli: Fix `--output-dir-mirror` rejection of `..` -containing paths (#2512, @felixhandte)
  199. cli: Allow Input From Console When `-f`/`--force` is Passed (#2466, @felixhandte)
  200. cli: Improve Help Message (#2500, @senhuang42)
  201. tests: Remove Flaky Tests (#2455, #2486, #2445, @Cyan4973)
  202. tests: Correctly Invoke md5 Utility on NetBSD (#2492, @niacat)
  203. tests: Avoid Using `stat -c` on NetBSD (#2513, @felixhandte)
  204. build: Zstd CLI Can Now be Linked to Dynamic `libzstd` (#2457, #2454 @Cyan4973)
  205. build: Hide and Avoid Using Static-Only Symbols (#2501, #2504, @skitt)
  206. build: CMake: Enable Only C for lib/ and programs/ Projects (#2498, @concatime)
  207. build: CMake: Use `configure_file()` to Create the `.pc` File (#2462, @lazka)
  208. build: Fix Fuzzer Compiler Detection & Update UBSAN Flags (#2503, @terrelln)
  209. build: Add Guards for `_LARGEFILE_SOURCE` and `_LARGEFILE64_SOURCE` (#2444, @indygreg)
  210. build: Improve `zlibwrapper` Makefile (#2437, @Cyan4973)
  211. contrib: Add `recover_directory` Program (#2473, @terrelln)
  212. doc: Change License Year to 2021 (#2452 & #2465, @terrelln & @senhuang42)
  213. doc: Fix Typos (#2459, @ThomasWaldmann)
  214. v1.4.8 (Dec 18, 2020)
  215. hotfix: wrong alignment of an internal buffer
  216. v1.4.7 (Dec 16, 2020)
  217. perf: stronger --long mode at high compression levels, by @senhuang42
  218. perf: stronger --patch-from at high compression levels, thanks to --long improvements
  219. perf: faster dictionary compression at medium compression levels, by @felixhandte
  220. perf: small speed & memory usage improvements for ZSTD_compress2(), by @terrelln
  221. perf: improved fast compression speeds with Visual Studio, by @animalize
  222. cli : Set nb of threads with environment variable ZSTD_NBTHREADS, by @senhuang42
  223. cli : accept decompressing files with *.zstd suffix
  224. cli : provide a condensed summary by default when processing multiple files
  225. cli : fix : stdin input no longer confused as user prompt
  226. cli : improve accuracy of several error messages
  227. api : new sequence ingestion API, by @senhuang42
  228. api : shared thread pool: control total nb of threads used by multiple compression jobs, by @marxin
  229. api : new ZSTD_getDictID_fromCDict(), by @LuAPi
  230. api : zlibWrapper only uses public API, and is compatible with dynamic library, by @terrelln
  231. api : fix : multithreaded compression has predictable output even in special cases (see #2327) (issue not accessible from cli)
  232. api : fix : dictionary compression correctly respects dictionary compression level (see #2303) (issue not accessible from cli)
  233. build: fix cmake script when using path with spaces, by @terrelln
  234. build: improved compile-time detection of aarch64/neon platforms, by @bsdimp
  235. build: Fix building on AIX 5.1, by @likema
  236. build: compile paramgrill with cmake on Windows, requested by @mirh
  237. doc : clarify repcode updates in format specification, by @felixhandte
  238. v1.4.6
  239. fix : Always return dstSize_tooSmall when that is the case
  240. fix : Fix ZSTD_initCStream_advanced() with static allocation and no dictionary
  241. perf: Improve small block decompression speed by 20%+, by @terrelln
  242. perf: Reduce compression stack usage by 1 KB, by @terrelln
  243. perf: Improve decompression speed by improving ZSTD_wildcopy, by @helloguo (#2252, #2256)
  244. perf: Improve histogram construction, by @cyan4973 (#2253)
  245. cli : Add --output-dir-mirror option, by @xxie24 (#2219)
  246. cli : Warn when (de)compressing multiple files into a single output, by @senhuang42 (#2279)
  247. cli : Improved progress bar and status summary when (de)compressing multiple files, by @senhuang42 (#2283)
  248. cli : Call stat less often, by @felixhandte (#2262)
  249. cli : Allow --patch-from XXX and --filelist XXX in addition to --patch-from=XXX and --filelist=XXX, by @cyan4973 (#2250)
  250. cli : Allow --patch-from to compress stdin with --stream-size, by @bimbashrestha (#2206)
  251. api : Do not install zbuff.h, since it has long been deprecated, by @cyan4973 (#2166).
  252. api : Fix ZSTD_CCtx_setParameter() with ZSTD_c_compressionLevel to make 0 mean default level, by @i-do-cpp (#2291)
  253. api : Rename ZSTDMT_NBTHREADS_MAX to ZSTDMT_NBWORKERS_MAX, by @marxin (#2228).
  254. build: Install pkg-config file with CMake and MinGW, by @tonytheodore (#2183)
  255. build: Install DLL with CMake on Windows, by @BioDataAnalysis (#2221)
  256. build: Fix DLL install location with CMake, by @xantares and @bimbashrestha (#2186)
  257. build: Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions
  258. build: Add ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics
  259. build: Add STATIC_BMI2 macro for compile time detection of BMI2 on MSVC, by @Niadb (#2258)
  260. build: Fix -Wcomma warnings, by @cwoffenden
  261. build: Remove distutils requirement for meson build, by @neheb (#2197)
  262. build: Fix cli compilation with uclibc
  263. build: Fix cli compilation without st_mtime, by @ffontaine (#2246)
  264. build: Fix shadowing warnings in library
  265. build: Fix single file library compilation with Enscripten, by @yoshihitoh (#2227)
  266. misc: Improve single file library and include dictBuilder, by @cwoffenden
  267. misc: Allow compression dictionaries with missing symbols
  268. misc: Add freestanding translation script in contrib/freestanding_lib
  269. misc: Collect all of zstd's libc dependencies into zstd_deps.h
  270. doc : Add ZSTD_versionString() to manual, by @animalize
  271. doc : Fix documentation for ZSTD_CCtxParams_setParameter(), by @felixhandte (#2270)
  272. v1.4.5 (May 22, 2020)
  273. fix : Compression ratio regression on huge files (> 3 GB) using high levels (--ultra) and multithreading, by @terrelln
  274. perf: Improved decompression speed: x64 : +10% (clang) / +5% (gcc); ARM : from +15% to +50%, depending on SoC, by @terrelln
  275. perf: Automatically downsizes ZSTD_DCtx when too large for too long (#2069, by @bimbashreshta)
  276. perf: Improved fast compression speed on aarch64 (#2040, ~+3%, by @caoyzh)
  277. perf: Small level 1 compression speed gains (depending on compiler)
  278. cli : New --patch-from command, create and apply patches from files, by @bimbashreshta
  279. cli : New --filelist= : Provide a list of files to operate upon from a file
  280. cli : -b -d command can now benchmark decompression on multiple files
  281. cli : New --no-content-size command
  282. cli : New --show-default-cparams information command
  283. api : ZDICT_finalizeDictionary() is promoted to stable (#2111)
  284. api : new experimental parameter ZSTD_d_stableOutBuffer (#2094)
  285. build: Generate a single-file libzstd library (#2065, by @cwoffenden)
  286. build: Relative includes no longer require -I compiler flags for zstd lib subdirs (#2103, by @felixhandte)
  287. build: zstd now compiles cleanly under -pedantic (#2099)
  288. build: zstd now compiles with make-4.3
  289. build: Support mingw cross-compilation from Linux, by @Ericson2314
  290. build: Meson multi-thread build fix on windows
  291. build: Some misc icc fixes backed by new ci test on travis
  292. misc: bitflip analyzer tool, by @felixhandte
  293. misc: Extend largeNbDicts benchmark to compression
  294. misc: Edit-distance match finder in contrib/
  295. doc : Improved beginner CONTRIBUTING.md docs
  296. doc : New issue templates for zstd
  297. v1.4.4 (Nov 6, 2019)
  298. perf: Improved decompression speed, by > 10%, by @terrelln
  299. perf: Better compression speed when re-using a context, by @felixhandte
  300. perf: Fix compression ratio when compressing large files with small dictionary, by @senhuang42
  301. perf: zstd reference encoder can generate RLE blocks, by @bimbashrestha
  302. perf: minor generic speed optimization, by @davidbolvansky
  303. api: new ability to extract sequences from the parser for analysis, by @bimbashrestha
  304. api: fixed decoding of magic-less frames, by @terrelln
  305. api: fixed ZSTD_initCStream_advanced() performance with fast modes, reported by @QrczakMK
  306. cli: Named pipes support, by @bimbashrestha
  307. cli: short tar's extension support, by @stokito
  308. cli: command --output-dir-flat= , generates target files into requested directory, by @senhuang42
  309. cli: commands --stream-size=# and --size-hint=#, by @nmagerko
  310. cli: command --exclude-compressed, by @shashank0791
  311. cli: faster `-t` test mode
  312. cli: improved some error messages, by @vangyzen
  313. cli: fix command `-D dictionary` on Windows, reported by @artyompetrov
  314. cli: fix rare deadlock condition within dictionary builder, by @terrelln
  315. build: single-file decoder with emscripten compilation script, by @cwoffenden
  316. build: fixed zlibWrapper compilation on Visual Studio, reported by @bluenlive
  317. build: fixed deprecation warning for certain gcc version, reported by @jasonma163
  318. build: fix compilation on old gcc versions, by @cemeyer
  319. build: improved installation directories for cmake script, by Dmitri Shubin
  320. pack: modified pkgconfig, for better integration into openwrt, requested by @neheb
  321. misc: Improved documentation : ZSTD_CLEVEL, DYNAMIC_BMI2, ZSTD_CDict, function deprecation, zstd format
  322. misc: fixed educational decoder : accept larger literals section, and removed UNALIGNED() macro
  323. v1.4.3 (Aug 20, 2019)
  324. bug: Fix Dictionary Compression Ratio Regression by @cyan4973 (#1709)
  325. bug: Fix Buffer Overflow in legacy v0.3 decompression by @felixhandte (#1722)
  326. build: Add support for IAR C/C++ Compiler for Arm by @joseph0918 (#1705)
  327. v1.4.2 (Jul 26, 2019)
  328. bug: Fix bug in zstd-0.5 decoder by @terrelln (#1696)
  329. bug: Fix seekable decompression in-memory API by @iburinoc (#1695)
  330. misc: Validate blocks are smaller than size limit by @vivekmg (#1685)
  331. misc: Restructure source files by @ephiepark (#1679)
  332. v1.4.1 (Jul 20, 2019)
  333. bug: Fix data corruption in niche use cases by @terrelln (#1659)
  334. bug: Fuzz legacy modes, fix uncovered bugs by @terrelln (#1593, #1594, #1595)
  335. bug: Fix out of bounds read by @terrelln (#1590)
  336. perf: Improve decode speed by ~7% @mgrice (#1668)
  337. perf: Slightly improved compression ratio of level 3 and 4 (ZSTD_dfast) by @cyan4973 (#1681)
  338. perf: Slightly faster compression speed when re-using a context by @cyan4973 (#1658)
  339. perf: Improve compression ratio for small windowLog by @cyan4973 (#1624)
  340. perf: Faster compression speed in high compression mode for repetitive data by @terrelln (#1635)
  341. api: Add parameter to generate smaller dictionaries by @tyler-tran (#1656)
  342. cli: Recognize symlinks when built in C99 mode by @felixhandte (#1640)
  343. cli: Expose cpu load indicator for each file on -vv mode by @ephiepark (#1631)
  344. cli: Restrict read permissions on destination files by @chungy (#1644)
  345. cli: zstdgrep: handle -f flag by @felixhandte (#1618)
  346. cli: zstdcat: follow symlinks by @vejnar (#1604)
  347. doc: Remove extra size limit on compressed blocks by @felixhandte (#1689)
  348. doc: Fix typo by @yk-tanigawa (#1633)
  349. doc: Improve documentation on streaming buffer sizes by @cyan4973 (#1629)
  350. build: CMake: support building with LZ4 @leeyoung624 (#1626)
  351. build: CMake: install zstdless and zstdgrep by @leeyoung624 (#1647)
  352. build: CMake: respect existing uninstall target by @j301scott (#1619)
  353. build: Make: skip multithread tests when built without support by @michaelforney (#1620)
  354. build: Make: Fix examples/ test target by @sjnam (#1603)
  355. build: Meson: rename options out of deprecated namespace by @lzutao (#1665)
  356. build: Meson: fix build by @lzutao (#1602)
  357. build: Visual Studio: don't export symbols in static lib by @scharan (#1650)
  358. build: Visual Studio: fix linking by @absotively (#1639)
  359. build: Fix MinGW-W64 build by @myzhang1029 (#1600)
  360. misc: Expand decodecorpus coverage by @ephiepark (#1664)
  361. v1.4.0 (Apr 17, 2019)
  362. perf: Improve level 1 compression speed in most scenarios by 6% by @gbtucker and @terrelln
  363. api: Move the advanced API, including all functions in the staging section, to the stable section
  364. api: Make ZSTD_e_flush and ZSTD_e_end block for maximum forward progress
  365. api: Rename ZSTD_CCtxParam_getParameter to ZSTD_CCtxParams_getParameter
  366. api: Rename ZSTD_CCtxParam_setParameter to ZSTD_CCtxParams_setParameter
  367. api: Don't export ZSTDMT functions from the shared library by default
  368. api: Require ZSTD_MULTITHREAD to be defined to use ZSTDMT
  369. api: Add ZSTD_decompressBound() to provide an upper bound on decompressed size by @shakeelrao
  370. api: Fix ZSTD_decompressDCtx() corner cases with a dictionary
  371. api: Move ZSTD_getDictID_*() functions to the stable section
  372. api: Add ZSTD_c_literalCompressionMode flag to enable or disable literal compression by @terrelln
  373. api: Allow compression parameters to be set when a dictionary is used
  374. api: Allow setting parameters before or after ZSTD_CCtx_loadDictionary() is called
  375. api: Fix ZSTD_estimateCStreamSize_usingCCtxParams()
  376. api: Setting ZSTD_d_maxWindowLog to 0 means use the default
  377. cli: Ensure that a dictionary is not used to compress itself by @shakeelrao
  378. cli: Add --[no-]compress-literals flag to enable or disable literal compression
  379. doc: Update the examples to use the advanced API
  380. doc: Explain how to transition from old streaming functions to the advanced API in the header
  381. build: Improve the Windows release packages
  382. build: Improve CMake build by @hjmjohnson
  383. build: Build fixes for FreeBSD by @lwhsu
  384. build: Remove redundant warnings by @thatsafunnyname
  385. build: Fix tests on OpenBSD by @bket
  386. build: Extend fuzzer build system to work with the new clang engine
  387. build: CMake now creates the libzstd.so.1 symlink
  388. build: Improve Menson build by @lzutao
  389. misc: Fix symbolic link detection on FreeBSD
  390. misc: Use physical core count for -T0 on FreeBSD by @cemeyer
  391. misc: Fix zstd --list on truncated files by @kostmo
  392. misc: Improve logging in debug mode by @felixhandte
  393. misc: Add CirrusCI tests by @lwhsu
  394. misc: Optimize dictionary memory usage in corner cases
  395. misc: Improve the dictionary builder on small or homogeneous data
  396. misc: Fix spelling across the repo by @jsoref
  397. v1.3.8 (Dec 28, 2018)
  398. perf: better decompression speed on large files (+7%) and cold dictionaries (+15%)
  399. perf: slightly better compression ratio at high compression modes
  400. api : finalized advanced API, last stage before "stable" status
  401. api : new --rsyncable mode, by @terrelln
  402. api : support decompression of empty frames into NULL (used to be an error) (#1385)
  403. build: new set of macros to build a minimal size decoder, by @felixhandte
  404. build: fix compilation on MIPS32, reported by @clbr (#1441)
  405. build: fix compilation with multiple -arch flags, by @ryandesign
  406. build: highly upgraded meson build, by @lzutao
  407. build: improved buck support, by @obelisk
  408. build: fix cmake script : can create debug build, by @pitrou
  409. build: Makefile : grep works on both colored consoles and systems without color support
  410. build: fixed zstd-pgo, by @bmwiedemann
  411. cli : support ZSTD_CLEVEL environment variable, by @yijinfb (#1423)
  412. cli : --no-progress flag, preserving final summary (#1371), by @terrelln
  413. cli : ensure destination file is not source file (#1422)
  414. cli : clearer error messages, especially when input file not present
  415. doc : clarified zstd_compression_format.md, by @ulikunitz
  416. misc: fixed zstdgrep, returns 1 on failure, by @lzutao
  417. misc: NEWS renamed as CHANGELOG, in accordance with fboss
  418. v1.3.7 (Oct 20, 2018)
  419. perf: slightly better decompression speed on clang (depending on hardware target)
  420. fix : performance of dictionary compression for small input < 4 KB at levels 9 and 10
  421. build: no longer build backtrace by default in release mode; restrict further automatic mode
  422. build: control backtrace support through build macro BACKTRACE
  423. misc: added man pages for zstdless and zstdgrep, by @samrussell
  424. v1.3.6 (Oct 6, 2018)
  425. perf: much faster dictionary builder, by @jenniferliu
  426. perf: faster dictionary compression on small data when using multiple contexts, by @felixhandte
  427. perf: faster dictionary decompression when using a very large number of dictionaries simultaneously
  428. cli : fix : does no longer overwrite destination when source does not exist (#1082)
  429. cli : new command --adapt, for automatic compression level adaptation
  430. api : fix : block api can be streamed with > 4 GB, reported by @catid
  431. api : reduced ZSTD_DDict size by 2 KB
  432. api : minimum negative compression level is defined, and can be queried using ZSTD_minCLevel().
  433. build: support Haiku target, by @korli
  434. build: Read Legacy format is limited to v0.5+ by default. Can be changed at compile time with macro ZSTD_LEGACY_SUPPORT.
  435. doc : zstd_compression_format.md updated to match wording in IETF RFC 8478
  436. misc: tests/paramgrill, a parameter optimizer, by @GeorgeLu97
  437. v1.3.5 (Jun 29, 2018)
  438. perf: much faster dictionary compression, by @felixhandte
  439. perf: small quality improvement for dictionary generation, by @terrelln
  440. perf: slightly improved high compression levels (notably level 19)
  441. mem : automatic memory release for long duration contexts
  442. cli : fix : overlapLog can be manually set
  443. cli : fix : decoding invalid lz4 frames
  444. api : fix : performance degradation for dictionary compression when using advanced API, by @terrelln
  445. api : change : clarify ZSTD_CCtx_reset() vs ZSTD_CCtx_resetParameters(), by @terrelln
  446. build: select custom libzstd scope through control macros, by @GeorgeLu97
  447. build: OpenBSD patch, by @bket
  448. build: make and make all are compatible with -j
  449. doc : clarify zstd_compression_format.md, updated for IETF RFC process
  450. misc: pzstd compatible with reproducible compilation, by @lamby
  451. v1.3.4 (Mar 27, 2018)
  452. perf: faster speed (especially decoding speed) on recent cpus (haswell+)
  453. perf: much better performance associating --long with multi-threading, by @terrelln
  454. perf: better compression at levels 13-15
  455. cli : asynchronous compression by default, for faster experience (use --single-thread for former behavior)
  456. cli : smoother status report in multi-threading mode
  457. cli : added command --fast=#, for faster compression modes
  458. cli : fix crash when not overwriting existing files, by Pádraig Brady (@pixelb)
  459. api : `nbThreads` becomes `nbWorkers` : 1 triggers asynchronous mode
  460. api : compression levels can be negative, for even more speed
  461. api : ZSTD_getFrameProgression() : get precise progress status of ZSTDMT anytime
  462. api : ZSTDMT can accept new compression parameters during compression
  463. api : implemented all advanced dictionary decompression prototypes
  464. build: improved meson recipe, by Shawn Landden (@shawnl)
  465. build: VS2017 scripts, by @HaydnTrigg
  466. misc: all /contrib projects fixed
  467. misc: added /contrib/docker script by @gyscos
  468. v1.3.3 (Dec 21, 2017)
  469. perf: faster zstd_opt strategy (levels 16-19)
  470. fix : bug #944 : multithreading with shared ditionary and large data, reported by @gsliepen
  471. cli : fix : content size written in header by default
  472. cli : fix : improved LZ4 format support, by @felixhandte
  473. cli : new : hidden command `-S`, to benchmark multiple files while generating one result per file
  474. api : fix : support large skippable frames, by @terrelln
  475. api : fix : streaming interface was adding a useless 3-bytes null block to small frames
  476. api : change : when setting `pledgedSrcSize`, use `ZSTD_CONTENTSIZE_UNKNOWN` macro value to mean "unknown"
  477. build: fix : compilation under rhel6 and centos6, reported by @pixelb
  478. build: added `check` target
  479. v1.3.2 (Oct 10, 2017)
  480. new : long range mode, using --long command, by Stella Lau (@stellamplau)
  481. new : ability to generate and decode magicless frames (#591)
  482. changed : maximum nb of threads reduced to 200, to avoid address space exhaustion in 32-bits mode
  483. fix : multi-threading compression works with custom allocators
  484. fix : ZSTD_sizeof_CStream() was over-evaluating memory usage
  485. fix : a rare compression bug when compression generates very large distances and bunch of other conditions (only possible at --ultra -22)
  486. fix : 32-bits build can now decode large offsets (levels 21+)
  487. cli : added LZ4 frame support by default, by Felix Handte (@felixhandte)
  488. cli : improved --list output
  489. cli : new : can split input file for dictionary training, using command -B#
  490. cli : new : clean operation artefact on Ctrl-C interruption
  491. cli : fix : do not change /dev/null permissions when using command -t with root access, reported by @mike155 (#851)
  492. cli : fix : write file size in header in multiple-files mode
  493. api : added macro ZSTD_COMPRESSBOUND() for static allocation
  494. api : experimental : new advanced decompression API
  495. api : fix : sizeof_CCtx() used to over-estimate
  496. build: fix : no-multithread variant compiles without pool.c dependency, reported by Mitchell Blank Jr (@mitchblank) (#819)
  497. build: better compatibility with reproducible builds, by Bernhard M. Wiedemann (@bmwiedemann) (#818)
  498. example : added streaming_memory_usage
  499. license : changed /examples license to BSD + GPLv2
  500. license : fix a few header files to reflect new license (#825)
  501. v1.3.1 (Aug 21, 2017)
  502. New license : BSD + GPLv2
  503. perf: substantially decreased memory usage in Multi-threading mode, thanks to reports by Tino Reichardt (@mcmilk)
  504. perf: Multi-threading supports up to 256 threads. Cap at 256 when more are requested (#760)
  505. cli : improved and fixed --list command, by @ib (#772)
  506. cli : command -vV to list supported formats, by @ib (#771)
  507. build : fixed binary variants, reported by @svenha (#788)
  508. build : fix Visual compilation for non x86/x64 targets, reported by Greg Slazinski (@GregSlazinski) (#718)
  509. API exp : breaking change : ZSTD_getframeHeader() provides more information
  510. API exp : breaking change : pinned down values of error codes
  511. doc : fixed huffman example, by Ulrich Kunitz (@ulikunitz)
  512. new : contrib/adaptive-compression, I/O driven compression strength, by Paul Cruz (@paulcruz74)
  513. new : contrib/long_distance_matching, statistics by Stella Lau (@stellamplau)
  514. updated : contrib/linux-kernel, by Nick Terrell (@terrelln)
  515. v1.3.0 (Jul 6, 2017)
  516. cli : new : `--list` command, by Paul Cruz
  517. cli : changed : xz/lzma support enabled by default
  518. cli : changed : `-t *` continue processing list after a decompression error
  519. API : added : ZSTD_versionString()
  520. API : promoted to stable status : ZSTD_getFrameContentSize(), by Sean Purcell
  521. API exp : new advanced API : ZSTD_compress_generic(), ZSTD_CCtx_setParameter()
  522. API exp : new : API for static or external allocation : ZSTD_initStatic?Ctx()
  523. API exp : added : ZSTD_decompressBegin_usingDDict(), requested by Guy Riddle (#700)
  524. API exp : clarified memory estimation / measurement functions.
  525. API exp : changed : strongest strategy renamed ZSTD_btultra, fastest strategy ZSTD_fast set to 1
  526. tools : decodecorpus can generate random dictionary-compressed samples, by Paul Cruz
  527. new : contrib/seekable_format, demo and API, by Sean Purcell
  528. changed : contrib/linux-kernel, updated version and license, by Nick Terrell
  529. v1.2.0 (May 5, 2017)
  530. cli : changed : Multithreading enabled by default (use target zstd-nomt or HAVE_THREAD=0 to disable)
  531. cli : new : command -T0 means "detect and use nb of cores", by Sean Purcell
  532. cli : new : zstdmt symlink hardwired to `zstd -T0`
  533. cli : new : command --threads=# (#671)
  534. cli : changed : cover dictionary builder by default, for improved quality, by Nick Terrell
  535. cli : new : commands --train-cover and --train-legacy, to select dictionary algorithm and parameters
  536. cli : experimental targets `zstd4` and `xzstd4`, with support for lz4 format, by Sean Purcell
  537. cli : fix : does not output compressed data on console
  538. cli : fix : ignore symbolic links unless --force specified,
  539. API : breaking change : ZSTD_createCDict_advanced(), only use compressionParameters as argument
  540. API : added : prototypes ZSTD_*_usingCDict_advanced(), for direct control over frameParameters.
  541. API : improved: ZSTDMT_compressCCtx() reduced memory usage
  542. API : fix : ZSTDMT_compressCCtx() now provides srcSize in header (#634)
  543. API : fix : src size stored in frame header is controlled at end of frame
  544. API : fix : enforced consistent rules for pledgedSrcSize==0 (#641)
  545. API : fix : error code "GENERIC" replaced by "dstSizeTooSmall" when appropriate
  546. build: improved cmake script, by @Majlen
  547. build: enabled Multi-threading support for *BSD, by Baptiste Daroussin
  548. tools: updated Paramgrill. Command -O# provides best parameters for sample and speed target.
  549. new : contrib/linux-kernel version, by Nick Terrell
  550. v1.1.4 (Mar 18, 2017)
  551. cli : new : can compress in *.gz format, using --format=gzip command, by Przemyslaw Skibinski
  552. cli : new : advanced benchmark command --priority=rt
  553. cli : fix : write on sparse-enabled file systems in 32-bits mode, by @ds77
  554. cli : fix : --rm remains silent when input is stdin
  555. cli : experimental : xzstd, with support for xz/lzma decoding, by Przemyslaw Skibinski
  556. speed : improved decompression speed in streaming mode for single shot scenarios (+5%)
  557. memory: DDict (decompression dictionary) memory usage down from 150 KB to 20 KB
  558. arch: 32-bits variant able to generate and decode very long matches (>32 MB), by Sean Purcell
  559. API : new : ZSTD_findFrameCompressedSize(), ZSTD_getFrameContentSize(), ZSTD_findDecompressedSize()
  560. API : changed : dropped support of legacy versions <= v0.3 (can be changed by modifying ZSTD_LEGACY_SUPPORT value)
  561. build : new: meson build system in contrib/meson, by Dima Krasner
  562. build : improved cmake script, by @Majlen
  563. build : added -Wformat-security flag, as recommended by Padraig Brady
  564. doc : new : educational decoder, by Sean Purcell
  565. v1.1.3 (Feb 7, 2017)
  566. cli : zstd can decompress .gz files (can be disabled with `make zstd-nogz` or `make HAVE_ZLIB=0`)
  567. cli : new : experimental target `make zstdmt`, with multi-threading support
  568. cli : new : improved dictionary builder "cover" (experimental), by Nick Terrell, based on prior work by Giuseppe Ottaviano.
  569. cli : new : advanced commands for detailed parameters, by Przemyslaw Skibinski
  570. cli : fix zstdless on Mac OS-X, by Andrew Janke
  571. cli : fix #232 "compress non-files"
  572. dictBuilder : improved dictionary generation quality, thanks to Nick Terrell
  573. API : new : lib/compress/ZSTDMT_compress.h multithreading API (experimental)
  574. API : new : ZSTD_create?Dict_byReference(), requested by Bartosz Taudul
  575. API : new : ZDICT_finalizeDictionary()
  576. API : fix : ZSTD_initCStream_usingCDict() properly writes dictID into frame header, by Gregory Szorc (#511)
  577. API : fix : all symbols properly exposed in libzstd, by Nick Terrell
  578. build : support for Solaris target, by Przemyslaw Skibinski
  579. doc : clarified specification, by Sean Purcell
  580. v1.1.2 (Dec 15, 2016)
  581. API : streaming : decompression : changed : automatic implicit reset when chain-decoding new frames without init
  582. API : experimental : added : dictID retrieval functions, and ZSTD_initCStream_srcSize()
  583. API : zbuff : changed : prototypes now generate deprecation warnings
  584. lib : improved : faster decompression speed at ultra compression settings and 32-bits mode
  585. lib : changed : only public ZSTD_ symbols are now exposed
  586. lib : changed : reduced usage of stack memory
  587. lib : fixed : several corner case bugs, by Nick Terrell
  588. cli : new : gzstd, experimental version able to decode .gz files, by Przemyslaw Skibinski
  589. cli : new : preserve file attributes
  590. cli : new : added zstdless and zstdgrep tools
  591. cli : fixed : status displays total amount decoded, even for file consisting of multiple frames (like pzstd)
  592. cli : fixed : zstdcat
  593. zlib_wrapper : added support for gz* functions, by Przemyslaw Skibinski
  594. install : better compatibility with FreeBSD, by Dimitry Andric
  595. source tree : changed : zbuff source files moved to lib/deprecated
  596. v1.1.1 (Nov 2, 2016)
  597. New : command -M#, --memory=, --memlimit=, --memlimit-decompress= to limit allowed memory consumption
  598. New : doc/zstd_manual.html, by Przemyslaw Skibinski
  599. Improved : slightly better compression ratio at --ultra levels (>= 20)
  600. Improved : better memory usage when using streaming compression API, thanks to @Rogier-5 report
  601. Added : API : ZSTD_initCStream_usingCDict(), ZSTD_initDStream_usingDDict() (experimental section)
  602. Added : example/multiple_streaming_compression.c
  603. Changed : zstd_errors.h is now installed within /include (and replaces errors_public.h)
  604. Updated man page
  605. Fixed : zstd-small, zstd-compress and zstd-decompress compilation targets
  606. v1.1.0 (Sep 28, 2016)
  607. New : contrib/pzstd, parallel version of zstd, by Nick Terrell
  608. added : NetBSD install target (#338)
  609. Improved : speed for batches of small files
  610. Improved : speed of zlib wrapper, by Przemyslaw Skibinski
  611. Changed : libzstd on Windows supports legacy formats, by Christophe Chevalier
  612. Fixed : CLI -d output to stdout by default when input is stdin (#322)
  613. Fixed : CLI correctly detects console on Mac OS-X
  614. Fixed : CLI supports recursive mode `-r` on Mac OS-X
  615. Fixed : Legacy decoders use unified error codes, reported by benrg (#341), fixed by Przemyslaw Skibinski
  616. Fixed : compatibility with OpenBSD, reported by Juan Francisco Cantero Hurtado (#319)
  617. Fixed : compatibility with Hurd, by Przemyslaw Skibinski (#365)
  618. Fixed : zstd-pgo, reported by octoploid (#329)
  619. v1.0.0 (Sep 1, 2016)
  620. Change Licensing, all project is now BSD, Copyright Facebook
  621. Small decompression speed improvement
  622. API : Streaming API supports legacy format
  623. API : ZDICT_getDictID(), ZSTD_sizeof_{CCtx, DCtx, CStream, DStream}(), ZSTD_setDStreamParameter()
  624. CLI supports legacy formats v0.4+
  625. Fixed : compression fails on certain huge files, reported by Jesse McGrew
  626. Enhanced documentation, by Przemyslaw Skibinski
  627. v0.8.1 (Aug 18, 2016)
  628. New streaming API
  629. Changed : --ultra now enables levels beyond 19
  630. Changed : -i# now selects benchmark time in second
  631. Fixed : ZSTD_compress* can now compress > 4 GB in a single pass, reported by Nick Terrell
  632. Fixed : speed regression on specific patterns (#272)
  633. Fixed : support for Z_SYNC_FLUSH, by Dmitry Krot (#291)
  634. Fixed : ICC compilation, by Przemyslaw Skibinski
  635. v0.8.0 (Aug 2, 2016)
  636. Improved : better speed on clang and gcc -O2, thanks to Eric Biggers
  637. New : Build on FreeBSD and DragonFly, thanks to JrMarino
  638. Changed : modified API : ZSTD_compressEnd()
  639. Fixed : legacy mode with ZSTD_HEAPMODE=0, by Christopher Bergqvist
  640. Fixed : premature end of frame when zero-sized raw block, reported by Eric Biggers
  641. Fixed : large dictionaries (> 384 KB), reported by Ilona Papava
  642. Fixed : checksum correctly checked in single-pass mode
  643. Fixed : combined --test amd --rm, reported by Andreas M. Nilsson
  644. Modified : minor compression level adaptations
  645. Updated : compression format specification to v0.2.0
  646. changed : zstd.h moved to /lib directory
  647. v0.7.5 (Aug 1, 2016)
  648. Transition version, supporting decoding of v0.8.x
  649. v0.7.4 (Jul 17, 2016)
  650. Added : homebrew for Mac, by Daniel Cade
  651. Added : more examples
  652. Fixed : segfault when using small dictionaries, reported by Felix Handte
  653. Modified : default compression level for CLI is now 3
  654. Updated : specification, to v0.1.1
  655. v0.7.3 (Jul 9, 2016)
  656. New : compression format specification
  657. New : `--` separator, stating that all following arguments are file names. Suggested by Chip Turner.
  658. New : `ZSTD_getDecompressedSize()`
  659. New : OpenBSD target, by Juan Francisco Cantero Hurtado
  660. New : `examples` directory
  661. fixed : dictBuilder using HC levels, reported by Bartosz Taudul
  662. fixed : legacy support from ZSTD_decompress_usingDDict(), reported by Felix Handte
  663. fixed : multi-blocks decoding with intermediate uncompressed blocks, reported by Greg Slazinski
  664. modified : removed "mem.h" and "error_public.h" dependencies from "zstd.h" (experimental section)
  665. modified : legacy functions no longer need magic number
  666. v0.7.2 (Jul 4, 2016)
  667. fixed : ZSTD_decompressBlock() using multiple consecutive blocks. Reported by Greg Slazinski.
  668. fixed : potential segfault on very large files (many gigabytes). Reported by Chip Turner.
  669. fixed : CLI displays system error message when destination file cannot be created (#231). Reported by Chip Turner.
  670. v0.7.1 (Jun 23, 2016)
  671. fixed : ZBUFF_compressEnd() called multiple times with too small `dst` buffer, reported by Christophe Chevalier
  672. fixed : dictBuilder fails if first sample is too small, reported by Руслан Ковалёв
  673. fixed : corruption issue, reported by cj
  674. modified : checksum enabled by default in command line mode
  675. v0.7.0 (Jun 17, 2016)
  676. New : Support for directory compression, using `-r`, thanks to Przemyslaw Skibinski
  677. New : Command `--rm`, to remove source file after successful de/compression
  678. New : Visual build scripts, by Christophe Chevalier
  679. New : Support for Sparse File-systems (do not use space for zero-filled sectors)
  680. New : Frame checksum support
  681. New : Support pass-through mode (when using `-df`)
  682. API : more efficient Dictionary API : `ZSTD_compress_usingCDict()`, `ZSTD_decompress_usingDDict()`
  683. API : create dictionary files from custom content, by Giuseppe Ottaviano
  684. API : support for custom malloc/free functions
  685. New : controllable Dictionary ID
  686. New : Support for skippable frames
  687. v0.6.1 (May 13, 2016)
  688. New : zlib wrapper API, thanks to Przemyslaw Skibinski
  689. New : Ability to compile compressor / decompressor separately
  690. Changed : new lib directory structure
  691. Fixed : Legacy codec v0.5 compatible with dictionary decompression
  692. Fixed : Decoder corruption error (#173)
  693. Fixed : null-string roundtrip (#176)
  694. New : benchmark mode can select directory as input
  695. Experimental : midipix support, VMS support
  696. v0.6.0 (Apr 13, 2016)
  697. Stronger high compression modes, thanks to Przemyslaw Skibinski
  698. API : ZSTD_getFrameParams() provides size of decompressed content
  699. New : highest compression modes require `--ultra` command to fully unleash their capacity
  700. Fixed : zstd cli return error code > 0 and removes dst file artifact when decompression fails, thanks to Chip Turner
  701. v0.5.1 (Feb 18, 2016)
  702. New : Optimal parsing => Very high compression modes, thanks to Przemyslaw Skibinski
  703. Changed : Dictionary builder integrated into libzstd and zstd cli
  704. Changed (!) : zstd cli now uses "multiple input files" as default mode. See `zstd -h`.
  705. Fix : high compression modes for big-endian platforms
  706. New : zstd cli : `-t` | `--test` command
  707. v0.5.0 (Feb 5, 2016)
  708. New : dictionary builder utility
  709. Changed : streaming & dictionary API
  710. Improved : better compression of small data
  711. v0.4.7 (Jan 22, 2016)
  712. Improved : small compression speed improvement in HC mode
  713. Changed : `zstd_decompress.c` has ZSTD_LEGACY_SUPPORT to 0 by default
  714. fix : bt search bug
  715. v0.4.6 (Jan 13, 2016)
  716. fix : fast compression mode on Windows
  717. New : cmake configuration file, thanks to Artyom Dymchenko
  718. Improved : high compression mode on repetitive data
  719. New : block-level API
  720. New : ZSTD_duplicateCCtx()
  721. v0.4.5 (Dec 18, 2015)
  722. new : -m/--multiple : compress/decompress multiple files
  723. v0.4.4 (Dec 14, 2015)
  724. Fixed : high compression modes for Windows 32 bits
  725. new : external dictionary API extended to buffered mode and accessible through command line
  726. new : windows DLL project, thanks to Christophe Chevalier
  727. v0.4.3 (Dec 7, 2015)
  728. new : external dictionary API
  729. new : zstd-frugal
  730. v0.4.2 (Dec 2, 2015)
  731. Generic minor improvements for small blocks
  732. Fixed : big-endian compatibility, by Peter Harris (#85)
  733. v0.4.1 (Dec 1, 2015)
  734. Fixed : ZSTD_LEGACY_SUPPORT=0 build mode (reported by Luben)
  735. removed `zstd.c`
  736. v0.4.0 (Nov 29, 2015)
  737. Command line utility compatible with high compression levels
  738. Removed zstdhc => merged into zstd
  739. Added : ZBUFF API (see zstd_buffered.h)
  740. Rolling buffer support
  741. v0.3.6 (Nov 10, 2015)
  742. small blocks params
  743. v0.3.5 (Nov 9, 2015)
  744. minor generic compression improvements
  745. v0.3.4 (Nov 6, 2015)
  746. Faster fast cLevels
  747. v0.3.3 (Nov 5, 2015)
  748. Small compression ratio improvement
  749. v0.3.2 (Nov 2, 2015)
  750. Fixed Visual Studio
  751. v0.3.1 (Nov 2, 2015)
  752. Small compression ratio improvement
  753. v0.3 (Oct 30, 2015)
  754. HC mode : compression levels 2-26
  755. v0.2.2 (Oct 28, 2015)
  756. Fix : Visual Studio 2013 & 2015 release compilation, by Christophe Chevalier
  757. v0.2.1 (Oct 24, 2015)
  758. Fix : Read errors, advanced fuzzer tests, by Hanno Böck
  759. v0.2.0 (Oct 22, 2015)
  760. **Breaking format change**
  761. Faster decompression speed
  762. Can still decode v0.1 format
  763. v0.1.3 (Oct 15, 2015)
  764. fix uninitialization warning, reported by Evan Nemerson
  765. v0.1.2 (Sep 11, 2015)
  766. frame concatenation support
  767. v0.1.1 (Aug 27, 2015)
  768. fix compression bug
  769. detects write-flush errors
  770. v0.1.0 (Aug 25, 2015)
  771. first release