NavP: Structured and Multithreaded Distributed Parallel Programming

We present Navigational Programming (NavP) - a distributed parallel programming methodology based on the principles of migrating computations and multithreading. The four major steps of NavP are: (1) Distribute the data using the data communication pattern in a given algorithm; (2) Insert navigation...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2007 IEEE Aerospace Conference s. 1 - 11
Hlavní autor: Lei Pan
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.03.2007
Témata:
ISBN:1424405246, 9781424405244
ISSN:1095-323X
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract We present Navigational Programming (NavP) - a distributed parallel programming methodology based on the principles of migrating computations and multithreading. The four major steps of NavP are: (1) Distribute the data using the data communication pattern in a given algorithm; (2) Insert navigational commands for the computation to migrate and follow large-sized distributed data; (3) Cut the sequential migrating thread and construct a mobile pipeline; and (4) Loop back for refinement. NavP is significantly different from the current prevailing Message Passing (MP) approach. The advantages of NavP include: (1) NavP is structured distributed programming and it does not change the code structure of an original algorithm. This is in sharp contrast to MP as MP implementations in general do not resemble the original sequential code; (2) NavP implementations are always competitive with the best MPI implementations in terms of performance. Approaches such as DSM or HPF have failed to deliver satisfying performance as of today in contrast, even if they are relatively easy to use compared to MP; (3) NavP provides incremental parallelization, which is beyond the reach of MP; and (4) NavP is a unifying approach that allows us to exploit both fine-(multithreading on shared memory) and coarse-(pipelined tasks on distributed memory) grained parallelism. This is in contrast to the currently popular hybrid use of MP+OpenMP, which is known to be complex to use. We present experimental results that demonstrate the effectiveness of NavP.
AbstractList We present Navigational Programming (NavP) - a distributed parallel programming methodology based on the principles of migrating computations and multithreading. The four major steps of NavP are: (1) Distribute the data using the data communication pattern in a given algorithm; (2) Insert navigational commands for the computation to migrate and follow large-sized distributed data; (3) Cut the sequential migrating thread and construct a mobile pipeline; and (4) Loop back for refinement. NavP is significantly different from the current prevailing Message Passing (MP) approach. The advantages of NavP include: (1) NavP is structured distributed programming and it does not change the code structure of an original algorithm. This is in sharp contrast to MP as MP implementations in general do not resemble the original sequential code; (2) NavP implementations are always competitive with the best MPI implementations in terms of performance. Approaches such as DSM or HPF have failed to deliver satisfying performance as of today in contrast, even if they are relatively easy to use compared to MP; (3) NavP provides incremental parallelization, which is beyond the reach of MP; and (4) NavP is a unifying approach that allows us to exploit both fine-(multithreading on shared memory) and coarse-(pipelined tasks on distributed memory) grained parallelism. This is in contrast to the currently popular hybrid use of MP+OpenMP, which is known to be complex to use. We present experimental results that demonstrate the effectiveness of NavP.
Author Lei Pan
Author_xml – sequence: 1
  surname: Lei Pan
  fullname: Lei Pan
  organization: California Inst. of Technol., Pasadena
BookMark eNpFjMtKw0AYhUesYFPdC27yAon_3DIddyXWC1QbtAt3ZTKXOpKmMpkIvr0jCnIW5wLfydCkP_QWoQsMJcYgrxbL53VJAERJOZkDPUIZZoQx4ISz4__CqgmaJoAXlNDXU5QNwzsAgcRMUf2kPpvr_CWGUccxWJOr3uSPYxd9fAtWmbTc-CEG344x5UYF1XW2y5tw2AW13_t-d4ZOnOoGe_7nM7S5XW7q-2K1vnuoF6vCS4iFwdKBpEDU3BiCDRUaU62BmUq6FETLeDKugGFhiFZOiFY7WVWaOIIFnaHL31tvrd1-BL9X4WvLcPUj-g0QEU3Y
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/AERO.2007.352803
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
Accès Toulouse INP et ENVT - IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISBN 1424405254
9781424405251
EndPage 11
ExternalDocumentID 4161616
Genre orig-research
GroupedDBID 23M
29O
6IE
6IF
6IH
6IK
6IL
6IN
AAJGR
AAWTH
ABLEC
ACGFS
ADZIZ
AI.
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IPLJI
M43
OCL
RIE
RIL
RNS
VH1
ID FETCH-LOGICAL-i90t-d19f09302a8dd21d37c13cc04d69f3cc7b453cc5a0417d2caf77bcf966c2f2173
IEDL.DBID RIE
ISBN 1424405246
9781424405244
ISSN 1095-323X
IngestDate Wed Aug 27 01:38:05 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i90t-d19f09302a8dd21d37c13cc04d69f3cc7b453cc5a0417d2caf77bcf966c2f2173
PageCount 11
ParticipantIDs ieee_primary_4161616
PublicationCentury 2000
PublicationDate 2007-March
PublicationDateYYYYMMDD 2007-03-01
PublicationDate_xml – month: 03
  year: 2007
  text: 2007-March
PublicationDecade 2000
PublicationTitle 2007 IEEE Aerospace Conference
PublicationTitleAbbrev AERO
PublicationYear 2007
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0020280
ssj0001764186
Score 1.6224369
Snippet We present Navigational Programming (NavP) - a distributed parallel programming methodology based on the principles of migrating computations and...
SourceID ieee
SourceType Publisher
StartPage 1
SubjectTerms Concurrent computing
Data communication
Distributed computing
distributed parallel programming
distributed sequential computing (DSC)
Message passing
migrating computations
Mobile computing
mobile pipelines
Multithreading
Navigation
navigational programming (NavP)
Parallel programming
Pipelines
Yarn
Title NavP: Structured and Multithreaded Distributed Parallel Programming
URI https://ieeexplore.ieee.org/document/4161616
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwELbaigEWHi3irQyMhDqxY9dsqLRiQCWCCnWrHD-kSpCi0Pb3c5ekj4EFRXIuHk6OLeve3xFyq0Fo2izJQq40DCZRoYqlDxGnBPVlTksEvo8XORr1JhOVNsjdphbGOVcmn7l7JMtYvp2bJbrKuqiMw9MkTSlFVau19adIwSOEQquNLQwZlpFOlYQsZpN1URdNYi7WWE_1N1_HL6nqPg7eXitkQ8Q9wV5aO11XSqEzPPzfco9IZ1u9F6QbuXRMGi4_IQc7wINt0h_pVfoQvJfgscvC2UDnNqiKceFwtYWZJ4TUxW5YQKe6wJ4rn8gX07m-gEuHjIeDcf85rNsphDNFF6GNlKeK0Vj3rI0jy6SJmDGUW6E8EDLjCbwSTXkkbWy0lzIzHswhE3swXNgpaeXz3J2RwDCWRcKCJWk9Fw6URCcy4ZgF5nDJ_Tlp425MvyvAjGm9ERd_T1-S_cphioldV6QFv-6uyZ5ZLWY_xU15yr-X1aBN
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NT8IwFG8QTdSLH2D8dgePTrq2W6k3gxCMOBclhhvp2i4hUTAI_P2-tw3w4MUs6V57eFles7zv3yPkWoPStGmY-kJpWEyofMVk5iNOCdrLguYIfO89GcfNwUAlFXKz6oVxzuXFZ-4WyTyXbydmjqGyBhrj8GyQzVAIRoturXVERUYiQDC00t3CpGGe61ShzxkfLNu6aMhEtER7KvdimcGkqnHffn0psA0R-QSnaf2au5Krnc7e_z54n9TX_XtestJMB6Tixodk9xf0YI20Yr1I7ry3HD52PnXW02PrFe24cL3awskDguriPCygEz3FqSsfyBcLuj6BS530O-1-q-uXAxX8kaIz3wYqo4pTppvWssByaQJuDBU2UhkQMhUhvEJNRSAtMzqTMjUZOESGZeC68CNSHU_G7ph4hvM0iCz4kjYTkQMz0UVp5LgF5vCbZyekhtIYfhWQGcNSEKd_H1-R7W7_uTfsPcZPZ2SnCJ9imdc5qYIY3AXZMovZ6Ht6md_4DyUwo5Q
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2007+IEEE+Aerospace+Conference&rft.atitle=NavP%3A+Structured+and+Multithreaded+Distributed+Parallel+Programming&rft.au=Lei+Pan&rft.date=2007-03-01&rft.pub=IEEE&rft.isbn=9781424405244&rft.issn=1095-323X&rft.spage=1&rft.epage=11&rft_id=info:doi/10.1109%2FAERO.2007.352803&rft.externalDocID=4161616
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1095-323X&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1095-323X&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1095-323X&client=summon