Optimization Techniques for a Distributed In-Memory Computing Platform by Leveraging SSD

In this paper, we present several optimization strategies that can improve the overall performance of the distributed in-memory computing system, “Apache Spark”. Despite its distributed memory management capability for iterative jobs and intermediate data, Spark has a significant performance degrada...

Full description

Saved in:

Bibliographic Details
Published in:	Applied sciences Vol. 11; no. 18; p. 8476
Main Authors:	Choi, June, Lee, Jaehyun, Kim, Jik-Soo, Lee, Jaehwan
Format:	Journal Article
Language:	English
Published:	Basel MDPI AG 01.09.2021
Subjects:	Apache Spark Big Data Data analysis in-memory processing framework Machine learning memory management Optimization techniques PageRank Sanitation services solid-state drive Workloads
ISSN:	2076-3417, 2076-3417
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!