A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds

Bag-of-Tasks (BoT) workflows are widespread in many big data analysis fields. However, there are very few cloud resource provisioning and scheduling algorithms tailored for BoT workflows. Furthermore, existing algorithms fail to consider the stochastic task execution times of BoT workflows which lea...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Future generation computer systems Ročník 71; s. 57 - 72
Hlavní autoři: Cai, Zhicheng, Li, Xiaoping, Ruiz, Rubén, Li, Qianmu
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier B.V 01.06.2017
Témata:
Bag of tasks
Cloud computing
Scheduling
Stochastic
Workflow
Cloud computing
Workflow
Scheduling
Stochastic
Bag of tasks
ISSN:0167-739X, 1872-7115
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Bag-of-Tasks (BoT) workflows are widespread in many big data analysis fields. However, there are very few cloud resource provisioning and scheduling algorithms tailored for BoT workflows. Furthermore, existing algorithms fail to consider the stochastic task execution times of BoT workflows which leads to deadline violations and increased resource renting costs. In this paper, we propose a dynamic cloud resource provisioning and scheduling algorithm which aims to fulfill the workflow deadline by using the sum of task execution time expectation and standard deviation to estimate real task execution times. A bag-based delay scheduling strategy and a single-type based virtual machine interval renting method are presented to decrease the resource renting cost. The proposed algorithm is evaluated using a cloud simulator ElasticSim which is extended from CloudSim. The results show that the dynamic algorithm decreases the resource renting cost while guaranteeing the workflow deadline compared to the existing algorithms. •Minimizing the cloud resource renting cost of bag-of-tasks workflows.•A bag-based delay triggering strategy is proposed to fully use the bag structure.•Using expectation-and-variance of execution times to estimate practical times.•A single-type based greedy method is developed for each ready BoT.
ISSN:0167-739X
1872-7115
DOI:10.1016/j.future.2017.01.020