Impact of lossless compression algorithms on in-memory database synchronization
Ladda ner
Typ
Examensarbete för masterexamen
Master's Thesis
Master's Thesis
Program
Computer systems and networks (MPCSN), MSc
Publicerad
2022
Författare
ION, ANDREI
Modellbyggare
Tidskriftstitel
ISSN
Volymtitel
Utgivare
Sammanfattning
In-memory databases have gained popularity in the last decades due to the increased demand for high-speed access to data. Redis is one such database that provides a sub-millisecond response time for incoming requests. These speedups are of particular interest in the telecommunication industry, where 5G technology needs to provide multi-Gbps network speeds. Ericsson is a global leader in 5G network equipment that benefits from in-memory database improvements. When a fault occurs in the system, methods to prevent data loss are needed. One such method is the data replication on a secondary node. Synchronization after a fault in the replica node puts pressure on the primary node to withstand the incoming requests from clients. Requests are buffered until the replica is ready. The buffering can demand a lot of main memory space, and if the system runs out of memory, the synchronization restarts. The novelty of the thesis work focuses on minimizing the impact over main memory size when synchronization between primary and replica nodes is taking place. Practically, adding multiple types of compression over received data in the Redis network layer. We gather performance metrics related to memory size reduction, requests per second, CPU utilization, relative time spent on CPU, and
Maximum Main Memory used.
We show that compression over the random data set, an extreme case, does not provide any memory size reduction, and it has a significant negative impact on performance. Another extreme data set is a single character generated multiple times. Intuitively, this data set is highly compressible and provided unrealistic compression ratios of 71.1. Lastly, we showcase the real data set with a 3.582 compression ratio when using the ZSTD algorithm; furthermore, the above data-set showed a higher maximum transfer rate when using compression. The maximum transfer rate shows how much bandwidth can the system support when synchronization is ongoing. Given these data sets, we showcase the positive impact of adopting compression in a 5G network.
Beskrivning
Ämne/nyckelord
in-memory database , redis , replication , compression , performance , synchronization