MespaConfig: Memory-Sparing Configuration Auto-Tuning for Co-Located In-Memory Cluster Computing Jobs

Distributed in-memory computing frameworks usually have lots of parameters (e.g., the buffer size of shuffle) to form a configuration for each execution. A well-tuned configuration can bring large improvements of performance. However, to improve resource utilization, jobs are often share the same cl...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE transactions on services computing Vol. 15; no. 5; pp. 2883 - 2896
Main Authors:	Zong, Zan, Wen, Lijie, Hu, Xuming, Han, Rui, Qian, Chen, Lin, Li
Format:	Journal Article
Language:	English
Published:	Piscataway IEEE 01.09.2022 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	Cluster computing Clusters co-locate Computation Computational modeling Configuration tuning Configurations Distributed memory in-memory computing Load modeling memory-sparing Optimization Parallel processing Performance enhancement performance optimization Predictive models Resource utilization Tuning
ISSN:	1939-1374, 2372-0204
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!