PAC: A monitoring framework for performance analysis of compression algorithms in Spark

In Spark, a massive amount of immediate data inevitably leads to excessive I/O overhead. To mitigate this issue, Spark incorporates four compression algorithms to reduce the size of the data for better performance. However, compression and decompression only constitute a portion of the overall logic...

Full description

Bibliographic Details

Published in:	Future generation computer systems Vol. 157; pp. 237 - 249
Main Authors:	Zhu, Changpeng, Han, Bo, Li, Gang
Format:	Journal Article
Language:	English
Published:	Elsevier B.V 01.08.2024
Subjects:	Compression algorithms Log analysis Performance comparison Root-cause analysis Spark Log analysis Performance comparison Root-cause analysis Spark Compression algorithms
ISSN:	0167-739X, 1872-7115
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!