A hard real-time scheduler for Spark on YARN

Apache Spark is a fast and general engine for large-scale data processing using distributed memory. It provides different deploy modes to meet the needs of different users and Spark on YARN is the most popular deploy mode. Different deploy modes have different scheduling mechanisms. Spark on YARN ha...

Full description

Saved in:

Bibliographic Details
Published in:	2018 18th IEEE ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID) pp. 645 - 652
Main Authors:	Wang, Guolu, Xu, Jungang, Liu, Renfeng, Huang, Shanshan
Format:	Conference Proceeding
Language:	English
Published:	Piscataway, NJ, USA IEEE Press 01.05.2018 IEEE
Series:	ACM Conferences
Subjects:	Big Data deadline hard real-time Processor scheduling Real-time systems Scheduling Spark Sparks Task analysis value density Yarn hard real-time Spark value density deadline YARN
ISBN:	1538658151, 9781538658154
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!