New Gzip version 1.14 improves decompression speed on modern systems

  • Gzip 1.14 improves decompression performance on Intel and AMD CPUs by using PCLMUL instructions.
  • The update has been nearly two years in development but features few changes in terms of functionality.
  • The new 'slice by 8' algorithm allows for a reduction in decompression time of up to 13%.
  • Support for hardware from the last decade ensures that most users will notice improvements without changing equipment.

GZip 1.14

Gzip, one of the most widely used tools in Linux environments for compressing and decompressing files, has received a new update after almost two years of waiting.. La version 1.14 has been officially released and includes a significant performance improvement when unzipping files, especially on systems with Intel and AMD x86_64 architectures.

This release focuses primarily on performance optimizations rather than adding new features. Although the number of code changes is limited, the improvement in decompression speed is especially relevant for users who handle large volumes of data or systems with limited resources. For faster compression, it may be worth exploring tools such as zstd.

Performance improvements thanks to new instructions

One of the biggest advances in Gzip 1.14 is the Incorporation of a new approach to calculating CRCs (Cyclic Redundancy Checks), known as the 'slice by 8' algorithm. This method, combined with the use of PCLMULQDQ (Carry-less Multiplication Quadword) instructions, significantly accelerates decompression. These instructions are available on Intel processors starting with the Westmere architecture and on AMD chips starting with Bulldozer, so they cover a wide range of devices manufactured in the last 10-15 years.

The tests carried out indicate that These optimizations can reduce the time required to decompress files by approximately 13%. While figures may vary depending on the hardware and the type of data being compressed, this is a tangible improvement that can have a positive impact, especially in environments where multiple decompression operations are performed daily. This can be seen in compression services that aim to minimize wait times.

One of the great advantages of this change is that does not require cutting-edge hardware to benefit. Processors that support PCLMUL instructions have been on the market for over a decade, so most current Intel- or AMD-based systems already have this capability built in.

This means that most users of Linux and other platforms that use Gzip will be able to notice the improvement simply by updating the tool. There is no need to modify configurations or compile custom versions, making adoption much easier.

Other minor changes in Gzip 1.14

Despite the long time elapsed since the last version, Gzip 1.14 does not introduce a large set of new features or dramatic modifications. In addition to the new approach to CRC calculation and the integration of PCLMUL instructions, the developers have implemented some bug fixes and minor internal tweaks.

Those interested can consult the complete list of changes and download the source code from the official announcement of the publication. While most of the new features focus on performance, there may be other technical details relevant to advanced users or system administrators managing mission-critical environments where intensive compression and decompression processes are used.

Gzip has been a staple tool for decades in the Unix and Linux world, and Although its evolution has been slow, it continues to adapt to technological changes. Version 1.14 doesn't revolutionize the program's operation, but it demonstrates that there are still improvements to be made in such fundamental aspects as decompression performance.

By implementing CRC calculations more efficiently and leveraging hardware capabilities that are already widely deployed, This update represents a solid technical step forward. It is especially useful in server contexts or automated jobs where every second counts, and where optimizing resources without the need for large investments is a priority.