ExPERT: Pareto-Efficient Task Replication on Grids and a Cloud

Many scientists perform extensive computations by executing large bags of similar tasks (BoTs) in mixtures of computational environments, such as grids and clouds. Although the reliability and cost may vary considerably across these environments, no tool exists to assist scientists in the selection...

Full description

Saved in:
Bibliographic Details
Published in:2012 IEEE 26th International Parallel and Distributed Processing Symposium pp. 167 - 178
Main Authors: Ben-Yehuda, O. A., Schuster, A., Sharov, A., Silberstein, M., Iosup, A.
Format: Conference Proceeding
Language:English
Published: IEEE 01.05.2012
Subjects:
bags-of-tasks
cloud
Cloud computing
Computational modeling
Equations
grid
Mathematical model
Pareto-frontier
Processor scheduling
Reliability
Throughput
ISBN:1467309753, 9781467309752
ISSN:1530-2075
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Many scientists perform extensive computations by executing large bags of similar tasks (BoTs) in mixtures of computational environments, such as grids and clouds. Although the reliability and cost may vary considerably across these environments, no tool exists to assist scientists in the selection of environments that can both fulfill deadlines and fit budgets. To address this situation, we introduce the Expert BoT scheduling framework. Our framework systematically selects from a large search space the Pareto-efficient scheduling strategies, that is, the strategies that deliver the best results for both make span and cost. Expert chooses from them the best strategy according to a general, user-specified utility function. Through simulations and experiments in real production environments, we demonstrate that Expert can substantially reduce both make span and cost in comparison to common scheduling strategies. For bioinformatics BoTs executed in a real mixed grid + cloud environment, we show how the scheduling strategy selected by Expert reduces both make span and cost by 30%-70%, in comparison to commonly-used scheduling strategies.
AbstractList Many scientists perform extensive computations by executing large bags of similar tasks (BoTs) in mixtures of computational environments, such as grids and clouds. Although the reliability and cost may vary considerably across these environments, no tool exists to assist scientists in the selection of environments that can both fulfill deadlines and fit budgets. To address this situation, we introduce the Expert BoT scheduling framework. Our framework systematically selects from a large search space the Pareto-efficient scheduling strategies, that is, the strategies that deliver the best results for both make span and cost. Expert chooses from them the best strategy according to a general, user-specified utility function. Through simulations and experiments in real production environments, we demonstrate that Expert can substantially reduce both make span and cost in comparison to common scheduling strategies. For bioinformatics BoTs executed in a real mixed grid + cloud environment, we show how the scheduling strategy selected by Expert reduces both make span and cost by 30%-70%, in comparison to commonly-used scheduling strategies.
Author Schuster, A.
Silberstein, M.
Iosup, A.
Ben-Yehuda, O. A.
Sharov, A.
Author_xml – sequence: 1
  givenname: O. A.
  surname: Ben-Yehuda
  fullname: Ben-Yehuda, O. A.
  email: ladypine@cs.technion.ac.il
  organization: Technion - Israel Inst. of Technol., Haifa, Israel
– sequence: 2
  givenname: A.
  surname: Schuster
  fullname: Schuster, A.
  email: assaf@cs.technion.ac.il
  organization: Technion - Israel Inst. of Technol., Haifa, Israel
– sequence: 3
  givenname: A.
  surname: Sharov
  fullname: Sharov, A.
  email: sharov@cs.technion.ac.il
  organization: Technion - Israel Inst. of Technol., Haifa, Israel
– sequence: 4
  givenname: M.
  surname: Silberstein
  fullname: Silberstein, M.
  email: marks@cs.technion.ac.il
  organization: Technion - Israel Inst. of Technol., Haifa, Israel
– sequence: 5
  givenname: A.
  surname: Iosup
  fullname: Iosup, A.
  email: A.Iosup@tudelft.nl
  organization: Parallel & Distrib. Syst. Group, Tech. Univ. Delft, Delft, Netherlands
BookMark eNotjEFLwzAYQCNOcJ07evKSP9D6JWmSxoMgtc7BwDLreSTNF4jWdrQV9N87UHjw3uklZNEPPRJyzSBjDMzttn6sXzMOjGdcnpG10QVoZWSutDTnJGGnEGC0FAuyZFJAykHLS5JM0zsAB5GbJbmvvutq39zR2o44D2kVQmwj9jNt7PRB93jsYmvnOPT0xGaMfqK299TSshu-_BW5CLabcP3vFXl7qpryOd29bLblwy6NTMs51UEGbdCBYUFi7r0L0gkNedH6tvXCOW0cM5gXRoEDsFYpbzQTUrXcoRUrcvP3jYh4OI7x044_B8WVLoQQv-ENSy0
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/IPDPS.2012.25
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 9780769546759
0769546757
EndPage 178
ExternalDocumentID 6267833
Genre orig-research
GroupedDBID 29O
6IE
6IF
6IH
6IK
6IL
6IN
AAJGR
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IPLJI
OCL
RIE
RIL
ID FETCH-LOGICAL-i175t-7f5f79eb091f5e4ddbf5b37048cdccd3bb79b19e48960b00aa66d971356c2bea3
IEDL.DBID RIE
ISBN 1467309753
9781467309752
ISICitedReferencesCount 21
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000309131900016&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1530-2075
IngestDate Wed Aug 27 04:45:00 EDT 2025
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i175t-7f5f79eb091f5e4ddbf5b37048cdccd3bb79b19e48960b00aa66d971356c2bea3
PageCount 12
ParticipantIDs ieee_primary_6267833
PublicationCentury 2000
PublicationDate 2012-May
PublicationDateYYYYMMDD 2012-05-01
PublicationDate_xml – month: 05
  year: 2012
  text: 2012-May
PublicationDecade 2010
PublicationTitle 2012 IEEE 26th International Parallel and Distributed Processing Symposium
PublicationTitleAbbrev ipdps
PublicationYear 2012
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0020349
ssj0000781219
Score 1.6808239
Snippet Many scientists perform extensive computations by executing large bags of similar tasks (BoTs) in mixtures of computational environments, such as grids and...
SourceID ieee
SourceType Publisher
StartPage 167
SubjectTerms bags-of-tasks
cloud
Cloud computing
Computational modeling
Equations
grid
Mathematical model
Pareto-frontier
Processor scheduling
Reliability
Throughput
Title ExPERT: Pareto-Efficient Task Replication on Grids and a Cloud
URI https://ieeexplore.ieee.org/document/6267833
WOSCitedRecordID wos000309131900016&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwED61FQMTjxbxlgdGQkvsxDUDS0mBpYqgSN0qP6UKlKA-ED-fs5O2DCxIGZIMUXTxyd9d7vs-gCvHNAILZyPnEhYx5zUgdY9FRmohDBVUSxfMJvho1J9MRN6A6w0Xxlobhs_sjT8N__JNqVe-VdZF8M37lDahyTmvuFqbfooXrYm9NFldbHndlUortYcrgSeB1JXievZM0rXWU30db8U3u8_5Q_7qR77iYJ_9y3Il7DjDvf-96z50ttQ9km82pQNo2OIQ9tbeDaRO5TbcZ9959jK-I7m3uS2jLEhJ4CPJWC7eCeLydTeP4PE4n5kFkYUhkgw-ypXpwNswGw-eotpLIZohQFhG3CWOC6sQHrjEMmOUSxTlmL_aaG2oUlyoW2FZH0saTEUp09QI79-X6lhZSY-gVZSFPQYiuFbWYSXEERpQZ7BE1A7rXIZIi5ukdwJtH47pZyWXMa0jcfr37TPY9cGuZgjPobWcr-wF7Oiv5Wwxvwzf-AeMy5_C
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NT8JAEN0gmugJFYzf7sGjFehuu6wHL1iEiKTRmnAj3a-EaFrDh_HnO7st4MGLSQ9tD00z3cm-mc57D6FrQyUAC6M9YwLqUWM1IGWLeiqVnCvCiUyNM5tgo1FnPOZxBd2suTBaazd8pm_tqfuXr3K5tK2yJoBv1iFkC20HlPrtgq217qhY2RrfipOV5ZZVXinUUluwFljgaF0hrGjLJV2pPZXX_kZ-szmIH-JXO_TlOwPtX6Yrbs_p1f73tvuosSHv4Xi9LR2gis4OUW3l3oDLZK6j--g7jl6SOxxbo9vci5yYBDwSJ-n8HQMyX_XzMByPs6ma4zRTOMXdj3ypGuitFyXdvle6KXhTgAgLj5nAMK4FAAQTaKqUMIEgDDJYKikVEYJx0eaadqCogWRM0zBU3Dr4hdIXOiVHqJrlmT5GmDMptIFaiAE4IEZBkSgNVLoUsBZTQesE1W04Jp-FYMakjMTp37ev0G4_eR5OhoPR0xnas4EvJgrPUXUxW-oLtCO_FtP57NJ97x8V4qMJ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2012+IEEE+26th+International+Parallel+and+Distributed+Processing+Symposium&rft.atitle=ExPERT%3A+Pareto-Efficient+Task+Replication+on+Grids+and+a+Cloud&rft.au=Ben-Yehuda%2C+O.+A.&rft.au=Schuster%2C+A.&rft.au=Sharov%2C+A.&rft.au=Silberstein%2C+M.&rft.date=2012-05-01&rft.pub=IEEE&rft.isbn=9781467309752&rft.issn=1530-2075&rft.spage=167&rft.epage=178&rft_id=info:doi/10.1109%2FIPDPS.2012.25&rft.externalDocID=6267833
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1530-2075&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1530-2075&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1530-2075&client=summon