Compressing Large Data Sets in Redis With Gzip: When publishing it, the post dropped the quote and my comments. A long post analyzing different scenarios of compressing data stored in Redis using Gzip: Year and a half ago, I was working wi

Compressing Large Data Sets in Redis With Gzip:

When publishing it, the post dropped the quote and my comments.

A long post analyzing different scenarios of compressing data stored in Redis using Gzip:

Year and a half ago, I was working with a software that used Redis as a buffer to store large sets of text data. We had some bottlenecks there. 
One
of them was related to Redis and the large amount of data, that we had there
(large comparing to RAM amount). Since then, I’ve wanted to check if using
Gzip would be a big improvement or would it be just a next bottleneck (CPU).
Unfortunately I don’t have access to this software any more, that’s why I’ve
decided to create a simple test case just to check this matter.
登录后复制

If what’s important is the speed, I think algorithms like snappy and lzo are a better fit. If data density is important, then Zopfli is probably a better fit.

Original title and link: Compressing Large Data Sets in Redis With Gzip (NoSQL database?myNoSQL)

Compressing Large Data Sets in Redis With Gzip-LMLPHP

原文地址:Compressing Large Data Sets in Redis With Gzip, 感谢原作者分享。

09-05 13:23