Improving Data Locality of Tasks by Executor Allocation in Spark Computing Environment

The concept of data locality is crucial for distributed systems (e.g., Spark and Hadoop) to process Big Data. Most of the existing research optimized the data locality from the aspect of task scheduling. However, as the execution container of Spark's tasks, the executor launched on different no...

Celý popis

Uloženo v:

Podrobná bibliografie
Vydáno v:	IEEE transactions on cloud computing Ročník 12; číslo 3; s. 876 - 888
Hlavní autoři:	Fu, Zhongming, He, Mengsi, Yi, Yang, Tang, Zhuo
Médium:	Journal Article
Jazyk:	angličtina
Vydáno:	Piscataway IEEE 01.07.2024 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Témata:	Access time Algorithms Benchmarks Big Data Communication Communications traffic Costs Data locality Distributed databases distributed systems executor allocation Heuristic methods Performance evaluation Resource management Scheduling Scheduling algorithms Spark framework Sparks Task analysis Task scheduling
ISSN:	2168-7161, 2372-0018
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!

Buďte první, kdo okomentuje tento záznam!