DPX10: An Efficient X10 Framework for Dynamic Programming Applications

X10 language and Asynchronous Partitioned Global Address Space (APGAS) model is an emerging mechanism for programming high-performance computers and commodity clusters. However, little work exists on distributed programming framework for dynamic programming (DP) problems based on X10 and APGAS model...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings of the International Conference on Parallel Processing pp. 869 - 878
Main Authors: Wang, Chen, Yu, Ce, Sun, Jizhou, Meng, Xiangfei
Format: Conference Proceeding Journal Article
Language:English
Published: IEEE 01.09.2015
Subjects:
APGAS
Arrays
Commodities
Communication systems
Computation
Computational modeling
Dynamic programming
Fault tolerance
Fault tolerant systems
Libraries
Object oriented modeling
Parallel processing
Programming
programming framework
X10
ISSN:0190-3918
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract X10 language and Asynchronous Partitioned Global Address Space (APGAS) model is an emerging mechanism for programming high-performance computers and commodity clusters. However, little work exists on distributed programming framework for dynamic programming (DP) problems based on X10 and APGAS model. In this paper we present DPX10, an efficient distributed X10 framework for DP applications. DPX10 enables developers to write highly efficient DP programs without much effort. A DPX10 program is specified by a directed acyclic graph (DAG) pattern and a compute method for the vertices. DPX10 provides eight commonly used DAG patterns and a simple API to create custom patterns. The system handles all the tiresome work of implementing parallelization including DAG distribution, vertices scheduling, and vertices communication. Moreover, a new recovery method for distributed arrays is developed to provide transparent fault tolerance. We describe the design of the framework and use four DP applications with up to a billion vertices on 120 cores to demonstrate its simplicity, efficiency, and scalability.
AbstractList X10 language and Asynchronous Partitioned Global Address Space (APGAS) model is an emerging mechanism for programming high-performance computers and commodity clusters. However, little work exists on distributed programming framework for dynamic programming (DP) problems based on X10 and APGAS model. In this paper we present DPX10, an efficient distributed X10 framework for DP applications. DPX10 enables developers to write highly efficient DP programs without much effort. A DPX10 program is specified by a directed acyclic graph (DAG) pattern and a compute method for the vertices. DPX10 provides eight commonly used DAG patterns and a simple API to create custom patterns. The system handles all the tiresome work of implementing parallelization including DAG distribution, vertices scheduling, and vertices communication. Moreover, a new recovery method for distributed arrays is developed to provide transparent fault tolerance. We describe the design of the framework and use four DP applications with up to a billion vertices on 120 cores to demonstrate its simplicity, efficiency, and scalability.
Author Jizhou Sun
Ce Yu
Chen Wang
Xiangfei Meng
Author_xml – sequence: 1
  givenname: Chen
  surname: Wang
  fullname: Wang, Chen
– sequence: 2
  givenname: Ce
  surname: Yu
  fullname: Yu, Ce
– sequence: 3
  givenname: Jizhou
  surname: Sun
  fullname: Sun, Jizhou
– sequence: 4
  givenname: Xiangfei
  surname: Meng
  fullname: Meng, Xiangfei
BookMark eNotjE1Lw0AYhFdQsNbevHnZo5fU993d7Ie30g8tFMxBwVvYbDZlMdnEJEX67w1UGJhh5mHuyHVsoyfkAWGJCOZ5v86yJQNMl0ZekYVRGoVUXKVawTWZARpIuEF9SxbDEApgUkkxaUZ2m-wL4YWuIt1WVXDBx5FODd31tvG_bf9Nq7anm3O0TXA069vjNDQhHumq6-rg7BjaONyTm8rWg1_8-5x87rYf67fk8P66X68OSWCgx8QpbYHrUjJp0aFMQarUclGVsqy04FN0JTIUhUCmoQDgzHrltDVlCq7gc_J0-e369ufkhzFvwuB8Xdvo29OQo8bUaK7QTOjjBQ3e-7zrQ2P7c664MFIw_gclZ1j-
CODEN IEEPAD
ContentType Conference Proceeding
Journal Article
DBID 6IE
6IL
CBEJK
RIE
RIL
7SC
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/ICPP.2015.96
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
Computer and Information Systems Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle Computer and Information Systems Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Advanced Technologies Database with Aerospace
ProQuest Computer Science Collection
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Computer and Information Systems Abstracts
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 9781467375870
146737587X
EndPage 878
ExternalDocumentID 7349642
Genre orig-research
GroupedDBID -~X
23M
29P
6IE
6IF
6IH
6IK
6IL
6IN
AAJGR
AAWTH
ABDPE
ADZIZ
AFFNX
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IPLJI
M43
OCL
RIE
RIL
RNS
XOL
7SC
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-i208t-c78a038d626a1c1650675a34fd6df843a34cd1214b41280b0032ae7c8a9d50cb3
IEDL.DBID RIE
ISICitedReferencesCount 1
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000379202700088&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 0190-3918
IngestDate Thu Jul 10 22:02:47 EDT 2025
Wed Aug 27 02:55:25 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i208t-c78a038d626a1c1650675a34fd6df843a34cd1214b41280b0032ae7c8a9d50cb3
Notes ObjectType-Article-2
SourceType-Scholarly Journals-1
ObjectType-Conference-1
ObjectType-Feature-3
content type line 23
SourceType-Conference Papers & Proceedings-2
PQID 1815983719
PQPubID 23500
PageCount 10
ParticipantIDs proquest_miscellaneous_1815983719
ieee_primary_7349642
PublicationCentury 2000
PublicationDate 20150901
PublicationDateYYYYMMDD 2015-09-01
PublicationDate_xml – month: 09
  year: 2015
  text: 20150901
  day: 01
PublicationDecade 2010
PublicationTitle Proceedings of the International Conference on Parallel Processing
PublicationTitleAbbrev ICPP
PublicationYear 2015
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssib026764764
ssj0020354
Score 2.0221972
Snippet X10 language and Asynchronous Partitioned Global Address Space (APGAS) model is an emerging mechanism for programming high-performance computers and commodity...
SourceID proquest
ieee
SourceType Aggregation Database
Publisher
StartPage 869
SubjectTerms APGAS
Arrays
Commodities
Communication systems
Computation
Computational modeling
Dynamic programming
Fault tolerance
Fault tolerant systems
Libraries
Object oriented modeling
Parallel processing
Programming
programming framework
X10
Title DPX10: An Efficient X10 Framework for Dynamic Programming Applications
URI https://ieeexplore.ieee.org/document/7349642
https://www.proquest.com/docview/1815983719
WOSCitedRecordID wos000379202700088&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwED6VioGpQIsoLxmJkbRx4sQ2W9U2gqXKAFK3yLEdqQMp6oPfzzmPggQLmaxIuUR3fnyX--4O4CGnAc0LhhaIC-0xywJPIrD3jAoCZRV1wbuq2QRfLMRyKdMOPB5yYay1FfnMjtywiuWbtd67X2Vj7qqbM9xwjziP61ytdu4EMY8Zd9C_cbb8MGJtqnQoqTiQ3uX4ZZqmjtQVjapS_e49v3bi6nhJev_7sFMYfOfpkfRwAp1Bx5bn0GsbNZBm3fYhmaVL6j-RSUnmVckIlEbwDklaahZB7EpmdXd6J9Jxtt5RJpn8CHAP4C2Zv06fvaaBgrcKfLHzNBfKD4VBp0VRTRGMoXugQlaY2BSChTjUBo3FcoZG8d0KRwNxLZQ0ka_z8AK65bq0l0CkX0hjcf1KJpjCi7M8QCwQo2uNEM4Ooe_Ukn3UNTKyRiNDuG_1muG8dcEIVdr1fpshsogkesdUXv396DWcOBvVfK4b6O42e3sLx_pzt9pu7irjfwHNy6sK
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3LS8MwGA9jCnqauonzGcGj3Zo0bRNvw61sOEcPE3YraZLCDnayh3-_X_qYgl7sKRT6tXyP5Pf1eyH0kBJK0oyBBIJMOcww6ggA9o6WlEojiQ3eFcMmwtmMLxYibqDHfS2MMaZIPjM9uyxi-XqldvZXWT-03c0ZbLgHPmPULau1au2hQRiw0IL_yt1yPZ_VxdKeIHyf9i76k-c4tmldfq9o1m_f9GsvLg6YqPW_TztBne9KPRzvz6BT1DD5GWrVoxpwZbltFA3jBXGf8CDHo6JpBFDDcAdHdXIWBvSKh-V8ekvSZm29A008-BHi7qC3aDR_HjvVCAVnSV2-dVTIpetxDW6LJIoAHAMHQXos04HOOPNgqTSIi6UMxOJaGwcRhYpLoX1Xpd45auar3FwgLNxMaAMWLBhnEq6QpRTQQADONYA400Vty5bko-ySkVQc6aL7mq8JaK4NR8jcrHabBLCFL8A_JuLy70fv0NF4_jpNppPZyxU6tvIqs7uuUXO73pkbdKg-t8vN-rZQhC_lUa5R
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+of+the+International+Conference+on+Parallel+Processing&rft.atitle=DPX10%3A+An+Efficient+X10+Framework+for+Dynamic+Programming+Applications&rft.au=Chen+Wang&rft.au=Ce+Yu&rft.au=Jizhou+Sun&rft.au=Xiangfei+Meng&rft.date=2015-09-01&rft.pub=IEEE&rft.issn=0190-3918&rft.spage=869&rft.epage=878&rft_id=info:doi/10.1109%2FICPP.2015.96&rft.externalDocID=7349642
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0190-3918&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0190-3918&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0190-3918&client=summon