Scheduling across Multiple Applications using Task-Based Programming Models

Task-based programming models have shown their potential for efficiency and scalability in parallel and distributed systems. With such a model, a parallel application is broken down into a graph of tasks, which are subsequently scheduled for execution. Recently, implementations of task-based models...

Full description

Saved in:
Bibliographic Details
Published in:2020 IEEE/ACM Fourth Annual Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware (IPDRM) pp. 1 - 8
Main Authors: Chung, Minh Thanh, Weidendorfer, Josef, Samfass, Philipp, Fuerlinger, Karl, Kranzlmuller, Dieter
Format: Conference Proceeding
Language:English
Published: IEEE 01.11.2020
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Task-based programming models have shown their potential for efficiency and scalability in parallel and distributed systems. With such a model, a parallel application is broken down into a graph of tasks, which are subsequently scheduled for execution. Recently, implementations of task-based models have addressed distributed memory and heterogeneous systems with accelerators. However, the problem of scheduling tasks as well as allocating resources at runtime is still a challenge. In this paper, we propose coordinated and cooperative task scheduling across multiple applications. The main idea is to exploit the application's idle time e.g. from imbalance to serve tasks from another application. The experiments use Chameleon, a task-based framework for reactive tasking in distributed memory systems. In various example scenarios, we show improvements in CPU utilization of 5% - 15% by coordinated scheduling.
AbstractList Task-based programming models have shown their potential for efficiency and scalability in parallel and distributed systems. With such a model, a parallel application is broken down into a graph of tasks, which are subsequently scheduled for execution. Recently, implementations of task-based models have addressed distributed memory and heterogeneous systems with accelerators. However, the problem of scheduling tasks as well as allocating resources at runtime is still a challenge. In this paper, we propose coordinated and cooperative task scheduling across multiple applications. The main idea is to exploit the application's idle time e.g. from imbalance to serve tasks from another application. The experiments use Chameleon, a task-based framework for reactive tasking in distributed memory systems. In various example scenarios, we show improvements in CPU utilization of 5% - 15% by coordinated scheduling.
Author Samfass, Philipp
Fuerlinger, Karl
Chung, Minh Thanh
Weidendorfer, Josef
Kranzlmuller, Dieter
Author_xml – sequence: 1
  givenname: Minh Thanh
  surname: Chung
  fullname: Chung, Minh Thanh
  email: minh.thanh.chung@ifi.lmu.de
  organization: MNM-Team, Ludwig-Maximilians-Universitaet,Munich,Germany
– sequence: 2
  givenname: Josef
  surname: Weidendorfer
  fullname: Weidendorfer, Josef
  email: josef.weidendorfer@lrz.de
  organization: Leibniz Supercomputing Centre (LRZ),Garching,Germany
– sequence: 3
  givenname: Philipp
  surname: Samfass
  fullname: Samfass, Philipp
  email: samfass@in.tum.de
  organization: Technical University of Munich,Department of Informatics
– sequence: 4
  givenname: Karl
  surname: Fuerlinger
  fullname: Fuerlinger, Karl
  email: karl.fuerlinger@ifi.lmu.de
  organization: MNM-Team, Ludwig-Maximilians-Universitaet,Munich,Germany
– sequence: 5
  givenname: Dieter
  surname: Kranzlmuller
  fullname: Kranzlmuller, Dieter
  email: kranzlmueller@ifi.lmu.de
  organization: MNM-Team, Ludwig-Maximilians-Universitaet Leibniz Supercomputing Centre (LRZ),Munich,Germany
BookMark eNotjMlOwzAYhI0EB1p4AoSUF0j4vcY-lrJVNKKCcq68pVg4i-LkwNuTCuYy0nyfZoHO2671CN1iKDAGdbfZPbxXHCumCgIECpjDz9ACC8EZIaVQl-j1w355N8XQHjNthy6lrJriGPros1Xfx2D1GLo2ZVM6KXudvvN7nbzLdkN3HHTTnOaqcz6mK3RR65j89X8v0efT4379km_fnjfr1TYPBOiYMwLCUSxYjZWjyoJ3gAUYaaiVxpRcGmcx4zP3THIDyjMta-xKcELM1hLd_P0G7_2hH0Kjh5-DolDiUtJf_7tK-A
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/IPDRM51949.2020.00005
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 1665422769
9781665422765
EndPage 8
ExternalDocumentID 9307178
Genre orig-research
GroupedDBID 6IE
6IL
CBEJK
RIE
RIL
ID FETCH-LOGICAL-i203t-4206d3164f19d39c0ed0160b8b3c8bb758bdc1454f1e485b09e4a8f1d70d668b3
IEDL.DBID RIE
ISICitedReferencesCount 6
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000659318300001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Thu Jun 29 18:39:03 EDT 2023
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i203t-4206d3164f19d39c0ed0160b8b3c8bb758bdc1454f1e485b09e4a8f1d70d668b3
PageCount 8
ParticipantIDs ieee_primary_9307178
PublicationCentury 2000
PublicationDate 2020-Nov.
PublicationDateYYYYMMDD 2020-11-01
PublicationDate_xml – month: 11
  year: 2020
  text: 2020-Nov.
PublicationDecade 2020
PublicationTitle 2020 IEEE/ACM Fourth Annual Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware (IPDRM)
PublicationTitleAbbrev IPDRM
PublicationYear 2020
Publisher IEEE
Publisher_xml – name: IEEE
Score 1.7799364
Snippet Task-based programming models have shown their potential for efficiency and scalability in parallel and distributed systems. With such a model, a parallel...
SourceID ieee
SourceType Publisher
StartPage 1
SubjectTerms cooperative task scheduling
coordinated scheduling
distributed memory systems
distributed system
Libraries
parallel application
parallel distributed systems
parallel programming
Programming
reactive tasking
resource allocation
resource management
Runtime
scheduling
scheduling tasks
Synchronization
task analysis
task migration
task-based framework
task-based models
task-based programming model
task-based programming models
Title Scheduling across Multiple Applications using Task-Based Programming Models
URI https://ieeexplore.ieee.org/document/9307178
WOSCitedRecordID wos000659318300001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEB5q8eBJpRXf5ODR2GST3U2OvoqiLUUr9FY2jy1FbaUPf7-ZdKkKXryFJCQwIXwzyffNAJxZxSwrZU55mTgabmJJtdIpDcGILpUNToSN2fUf825XDQa6V4PztRbGex_JZ_4Cm_Ev303tEp_KWlpg9KE2YCPP85VWqxLlcKZb972bp05wSCTqTxIWMxOmv4qmRMxob_9vtx1ofovvSG8NK7tQ85MGPDwH4zpkjY9IEZGNdCoqILn88QdNkMc-Iv1i_kqvAkA5XAoJWO_YjYXP3uZNeGnf9q_vaFUHgY4TJhZUJixzIsQ1JddOaMu8w7xwRhlhlTHB4zfOcpmGcS9Vapj2slAldzlzWRZm7UF9Mp34fSAZLwpnQzQdYEhqIZVQmbWsyFJvuUmTA2igIYYfq1QXw8oGh393H8EWWnolzTuG-mK29CewaT8X4_nsNJ7PFxWpkyE
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1JS0MxEB5qFfSk0oq7OXg0NnlJXpOjKy1dKFqht_KyvFLUVrr4-03SR1Xw4i0kIYEJ4ZtJvm8G4NJIYkjO65jmicX-JuZYSSWwD0ZULo13IkzMrt-ud7tyMFC9ElyttTDOuUg-c9ehGf_y7dQsw1NZTbEQfcgN2BScJ3Sl1ipkOZSoWrN3_9TxLgkPCpSExNyE4lfZlIgaj7v_228Pqt_yO9RbA8s-lNykAq1nb14beOMjlEVsQ52CDIhufvxCo8BkH6F-Nn_Ftx6ibFgqULDeQ3coffY2r8LL40P_roGLSgh4nBC2wDwhqWU-ssmpskwZ4mzIDKelZkZq7X1-bQ3lwo87LoUmyvFM5tTWiU1TP-sAypPpxB0CSmmWWePjaQ9EXDEumUyNIVkqnKFaJEdQCYYYfqySXQwLGxz_3X0B241-pz1sN7utE9gJVl8J9U6hvJgt3Rlsmc_FeD47j2f1Bexqlmg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2020+IEEE%2FACM+Fourth+Annual+Workshop+on+Emerging+Parallel+and+Distributed+Runtime+Systems+and+Middleware+%28IPDRM%29&rft.atitle=Scheduling+across+Multiple+Applications+using+Task-Based+Programming+Models&rft.au=Chung%2C+Minh+Thanh&rft.au=Weidendorfer%2C+Josef&rft.au=Samfass%2C+Philipp&rft.au=Fuerlinger%2C+Karl&rft.date=2020-11-01&rft.pub=IEEE&rft.spage=1&rft.epage=8&rft_id=info:doi/10.1109%2FIPDRM51949.2020.00005&rft.externalDocID=9307178