Today, Facebook is releasing its Zstandard compression algorithm into the wild as open source. The lossless compression technology is aimed at replacing existing libraries like Zlib that are powered by the outdated Deflate compression algorithm. In addition to Zstandard, Facebook is also dropping its MyRocks storage engine as open source. MyRocks is currently being used by Facebook to improve the storage efficiency of its MySQL databases.
Both releases occurred in coordination with Facebook’s @Scale conference in San Jose. The conference supports engineers working to solve large scale engineering challenges by bringing them together, side-by-side,… Continue reading