Zstandard

from Wikipedia, the free encyclopedia
Zstandard
Basic data

Current  version 1.4.5
( May 22, 2020 )
programming language C.
License 3-Clause BSD License, GNU General Public License, Version 2
facebook.github.io/zstd/

Zstandard (or zstd ) is a lossless data compression algorithm developed by Yann Collet at Facebook . Version 1 of the reference implementation was released as Free Software on August 31, 2016 .

Features and technology

Zstandard was designed to achieve a compression rate comparable to Deflate at a higher speed, especially during decompression. The zstd package allows compression and decompression in multiple threads .

Zstandard combines dictionary matching with a large search window ( LZ77 ) and fast entropy coding that includes both Huffman coding and Tabled Asymmetric Numeral Systems .

commitment

Zstandard
File extension : .zst
MIME type : application / zstd


Zstandard is used by various software to compress data.

In the Linux kernel ZStandard since Version 4.14 (November 2017) as the compression method for file systems Btrfs and SquashFS included.

For the OpenZFS file system it is planned to also offer Zstandard for compression in the future.

Some Linux distributions use Zstandard to compress their packages. This is the case with Fedora since version 31 (October 2019) . The Arch Linux package manager Pacman understands zstd-compressed packages since version 5.2 (October 2019). The official repositories were changed at the turn of the year 2019/2020 . The settings are made so that the decompression is around 1300 percent faster than with xz , while the packet size increases by around 0.8 percent. In January 2020, Open Mandriva chose Zstandard for its RPM packages.

Web links

Individual evidence

  1. Release 1.4.5 . May 22, 2020 (accessed May 23, 2020).
  2. a b github.com . (accessed on January 14, 2018): “ Zstandard is dual-licensed under BSD and GPLv2. "
  3. github.com . (accessed on January 14, 2018): “ Zstandard is dual-licensed under BSD and GPLv2. "
  4. github.com . (accessed on January 14, 2018): “ Zstandard is dual-licensed under BSD and GPLv2. "
  5. Sergio De Simone: Facebook Open Sources New Compression Algorithm Outperforming Zlib. In: InfoQ. September 2, 2016, accessed June 23, 2020 .
  6. Chris Williams: Life imitates satire: Facebook touts zlib killer just like Silicon Valley's Pied Piper. In: The Register . August 31, 2016, accessed June 23, 2020 .
  7. Zstandard Compression Format. In: GitHub . Retrieved June 23, 2020 (English).
  8. RFC 8478 . - Zstandard Compression and the application / zstd Media Type . (English).
  9. Jonathan Corbet: The rest of the 4.14 merge window. In: LWN.net . September 17, 2017, accessed June 23, 2020 .
  10. Mirko Lindner: OpenZFS introduces Zstd compression. In: Pro-Linux . May 19, 2020, accessed June 23, 2020 .
  11. James Sanders: Fedora 31 release brings massive improvements to update install speed. In: TechRepublic. October 29, 2019, accessed June 23, 2020 .
  12. Michael Larabel: Arch Linux Nears Roll-Out Of Zstd Compressed Packages For Faster Pacman Installs. In: Phoronix. October 16, 2019, accessed on June 23, 2020 .
  13. ^ Robin Broda: Arch Linux - News: Now using Zstandard instead of xz for package compression. In: archlinux.org. January 4, 2020, accessed on June 23, 2020 .
  14. Michael Larabel: OpenMandriva Is The Latest Linux Distribution Using Zstd To Compress Packages. In: Phoronix. January 7, 2020, accessed on June 23, 2020 .