NavP: Structured and Multithreaded Distributed Parallel Programming

We present Navigational Programming (NavP) - a distributed parallel programming methodology based on the principles of migrating computations and multithreading. The four major steps of NavP are: (1) Distribute the data using the data communication pattern in a given algorithm; (2) Insert navigation...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:2007 IEEE Aerospace Conference s. 1 - 11
Hlavný autor: Lei Pan
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: IEEE 01.03.2007
Predmet:
ISBN:1424405246, 9781424405244
ISSN:1095-323X
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Abstract We present Navigational Programming (NavP) - a distributed parallel programming methodology based on the principles of migrating computations and multithreading. The four major steps of NavP are: (1) Distribute the data using the data communication pattern in a given algorithm; (2) Insert navigational commands for the computation to migrate and follow large-sized distributed data; (3) Cut the sequential migrating thread and construct a mobile pipeline; and (4) Loop back for refinement. NavP is significantly different from the current prevailing Message Passing (MP) approach. The advantages of NavP include: (1) NavP is structured distributed programming and it does not change the code structure of an original algorithm. This is in sharp contrast to MP as MP implementations in general do not resemble the original sequential code; (2) NavP implementations are always competitive with the best MPI implementations in terms of performance. Approaches such as DSM or HPF have failed to deliver satisfying performance as of today in contrast, even if they are relatively easy to use compared to MP; (3) NavP provides incremental parallelization, which is beyond the reach of MP; and (4) NavP is a unifying approach that allows us to exploit both fine-(multithreading on shared memory) and coarse-(pipelined tasks on distributed memory) grained parallelism. This is in contrast to the currently popular hybrid use of MP+OpenMP, which is known to be complex to use. We present experimental results that demonstrate the effectiveness of NavP.
AbstractList We present Navigational Programming (NavP) - a distributed parallel programming methodology based on the principles of migrating computations and multithreading. The four major steps of NavP are: (1) Distribute the data using the data communication pattern in a given algorithm; (2) Insert navigational commands for the computation to migrate and follow large-sized distributed data; (3) Cut the sequential migrating thread and construct a mobile pipeline; and (4) Loop back for refinement. NavP is significantly different from the current prevailing Message Passing (MP) approach. The advantages of NavP include: (1) NavP is structured distributed programming and it does not change the code structure of an original algorithm. This is in sharp contrast to MP as MP implementations in general do not resemble the original sequential code; (2) NavP implementations are always competitive with the best MPI implementations in terms of performance. Approaches such as DSM or HPF have failed to deliver satisfying performance as of today in contrast, even if they are relatively easy to use compared to MP; (3) NavP provides incremental parallelization, which is beyond the reach of MP; and (4) NavP is a unifying approach that allows us to exploit both fine-(multithreading on shared memory) and coarse-(pipelined tasks on distributed memory) grained parallelism. This is in contrast to the currently popular hybrid use of MP+OpenMP, which is known to be complex to use. We present experimental results that demonstrate the effectiveness of NavP.
Author Lei Pan
Author_xml – sequence: 1
  surname: Lei Pan
  fullname: Lei Pan
  organization: California Inst. of Technol., Pasadena
BookMark eNpFjMtKw0AYhUesYFPdC27yAon_3DIddyXWC1QbtAt3ZTKXOpKmMpkIvr0jCnIW5wLfydCkP_QWoQsMJcYgrxbL53VJAERJOZkDPUIZZoQx4ISz4__CqgmaJoAXlNDXU5QNwzsAgcRMUf2kPpvr_CWGUccxWJOr3uSPYxd9fAtWmbTc-CEG344x5UYF1XW2y5tw2AW13_t-d4ZOnOoGe_7nM7S5XW7q-2K1vnuoF6vCS4iFwdKBpEDU3BiCDRUaU62BmUq6FETLeDKugGFhiFZOiFY7WVWaOIIFnaHL31tvrd1-BL9X4WvLcPUj-g0QEU3Y
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/AERO.2007.352803
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Xplore Digital Library
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISBN 1424405254
9781424405251
EndPage 11
ExternalDocumentID 4161616
Genre orig-research
GroupedDBID 23M
29O
6IE
6IF
6IH
6IK
6IL
6IN
AAJGR
AAWTH
ABLEC
ACGFS
ADZIZ
AI.
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IPLJI
M43
OCL
RIE
RIL
RNS
VH1
ID FETCH-LOGICAL-i90t-d19f09302a8dd21d37c13cc04d69f3cc7b453cc5a0417d2caf77bcf966c2f2173
IEDL.DBID RIE
ISBN 1424405246
9781424405244
ISSN 1095-323X
IngestDate Wed Aug 27 01:38:05 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i90t-d19f09302a8dd21d37c13cc04d69f3cc7b453cc5a0417d2caf77bcf966c2f2173
PageCount 11
ParticipantIDs ieee_primary_4161616
PublicationCentury 2000
PublicationDate 2007-March
PublicationDateYYYYMMDD 2007-03-01
PublicationDate_xml – month: 03
  year: 2007
  text: 2007-March
PublicationDecade 2000
PublicationTitle 2007 IEEE Aerospace Conference
PublicationTitleAbbrev AERO
PublicationYear 2007
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0020280
ssj0001764186
Score 1.622637
Snippet We present Navigational Programming (NavP) - a distributed parallel programming methodology based on the principles of migrating computations and...
SourceID ieee
SourceType Publisher
StartPage 1
SubjectTerms Concurrent computing
Data communication
Distributed computing
distributed parallel programming
distributed sequential computing (DSC)
Message passing
migrating computations
Mobile computing
mobile pipelines
Multithreading
Navigation
navigational programming (NavP)
Parallel programming
Pipelines
Yarn
Title NavP: Structured and Multithreaded Distributed Parallel Programming
URI https://ieeexplore.ieee.org/document/4161616
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwED6VigEWHi3irQyMhMZ2kqvZUGnFgEoEHbpVjh9SJUhRafv7OSfpY2BBGXzxYCW25Ht-3wHcJWTTJi5lITJuwth1Hd2DToY8dUawnOfISqDwKw6H3fFYZg2432BhrLVl8Zl98GKZyzczvfShso43xunZgz1ErLBa23gKpjHzVGi1s-VThmWmUyah4GK8BnVFCY_TNddT_R6v85eR7Dz1398qZkPPe-J7ae10XSmVzuDof597DO0tei_INnrpBBq2OIXDHeLBFvSGapU9Bh8leexybk2gChNUYFw6XGVo5tlT6vpuWCRnau57rnz6dX051xet0obRoD_qvYR1O4VwKqNFaJh0kRQRV11jODMCNRNaR7FJpSMB8zihIVFRzNBwrRxirh25Q5o7clzEGTSLWWHPIRBaSFJ-AhUZIwnK3CktNKbKkreplbyAlt-NyXdFmDGpN-Ly7-krOKgCpr6w6xqa9Ov2Bvb1ajH9md-Wp_wLZ1Wgnw
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1JT8JAFH5BNFEvLmDc7cGjlc7WYbwZhGDESpQDNzKdJSHRYhD4_c60ZTl4MT30zRwmzZukb_2-B3DLnE_LbIxCjrAOqW1a9x-0IsSx1QSlOOUoBwr3eJI0h0PRr8DdCgtjjMmbz8y9F_Navp6ouU-VNbwz7p4t2GaUYlSgtdYZFR5T5MnQynDLFw3zWqdgIcFkuIR1RQzTeMn2VK7psoIZicZj-_2t4Db0zCd-mtbG3JXc7HQO_vfBh1Bf4_eC_soyHUHFZMewv0E9WINWIhf9h-Ajp4-dT40OZKaDAo7rrldqt_PkSXX9PCwn9-XUT1359Of6hq4vd0odBp32oNUNy4EK4VhEs1AjYSNBIiybWmOkCVeIKBVRHQvrBJ5S5l5MRhRxjZW0nKfKuoBIYetCF3IC1WySmVMIiCLCmT_CpXNHGBeplYooHkvj4k0lxRnUvDZG3wVlxqhUxPnf2zew2x289ka95-TlAvaK9Klv87qEqlODuYIdtZiNf6bX-Y3_AvlRo-Y
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2007+IEEE+Aerospace+Conference&rft.atitle=NavP%3A+Structured+and+Multithreaded+Distributed+Parallel+Programming&rft.au=Lei+Pan&rft.date=2007-03-01&rft.pub=IEEE&rft.isbn=9781424405244&rft.issn=1095-323X&rft.spage=1&rft.epage=11&rft_id=info:doi/10.1109%2FAERO.2007.352803&rft.externalDocID=4161616
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1095-323X&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1095-323X&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1095-323X&client=summon