Swift: A language for distributed parallel scripting
► The Swift parallel scripting language is described in detail. ► Swift provides an implicitly parallel functional data flow computation model that simplifies parallel scripting. ► Swift scripts describe parallel execution patterns for running independent serial or parallel programs. ► Swift scales...
Gespeichert in:
| Veröffentlicht in: | Parallel computing Jg. 37; H. 9; S. 633 - 652 |
|---|---|
| Hauptverfasser: | , , , , , |
| Format: | Journal Article |
| Sprache: | Englisch |
| Veröffentlicht: |
Elsevier B.V
01.09.2011
|
| Schlagworte: | |
| ISSN: | 0167-8191, 1872-7336 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | ► The Swift parallel scripting language is described in detail. ► Swift provides an implicitly parallel functional data flow computation model that simplifies parallel scripting. ► Swift scripts describe parallel execution patterns for running independent serial or parallel programs. ► Swift scales from multicore workstations to petascale systems, using parallel and distributed resources, including clusters, grids, and clouds.
Scientists, engineers, and statisticians must execute domain-specific application programs many times on large collections of file-based data. This activity requires complex orchestration and data management as data is passed to, from, and among application invocations. Distributed and parallel computing resources can accelerate such processing, but their use further increases programming complexity. The Swift parallel scripting language reduces these complexities by making file system structures accessible via language constructs and by allowing ordinary application programs to be composed into powerful parallel scripts that can efficiently utilize parallel and distributed resources. We present Swift’s implicitly parallel and deterministic programming model, which applies external applications to file collections using a functional style that abstracts and simplifies distributed parallel execution. |
|---|---|
| AbstractList | ► The Swift parallel scripting language is described in detail. ► Swift provides an implicitly parallel functional data flow computation model that simplifies parallel scripting. ► Swift scripts describe parallel execution patterns for running independent serial or parallel programs. ► Swift scales from multicore workstations to petascale systems, using parallel and distributed resources, including clusters, grids, and clouds.
Scientists, engineers, and statisticians must execute domain-specific application programs many times on large collections of file-based data. This activity requires complex orchestration and data management as data is passed to, from, and among application invocations. Distributed and parallel computing resources can accelerate such processing, but their use further increases programming complexity. The Swift parallel scripting language reduces these complexities by making file system structures accessible via language constructs and by allowing ordinary application programs to be composed into powerful parallel scripts that can efficiently utilize parallel and distributed resources. We present Swift’s implicitly parallel and deterministic programming model, which applies external applications to file collections using a functional style that abstracts and simplifies distributed parallel execution. |
| Author | Foster, Ian Clifford, Ben Katz, Daniel S. Hategan, Mihael Wozniak, Justin M. Wilde, Michael |
| Author_xml | – sequence: 1 givenname: Michael surname: Wilde fullname: Wilde, Michael email: wilde@mcs.anl.gov organization: Computation Institute, University of Chicago and Argonne National Laboratory, United States – sequence: 2 givenname: Mihael surname: Hategan fullname: Hategan, Mihael organization: Computation Institute, University of Chicago and Argonne National Laboratory, United States – sequence: 3 givenname: Justin M. surname: Wozniak fullname: Wozniak, Justin M. organization: Mathematics and Computer Science Division, Argonne National Laboratory, United States – sequence: 4 givenname: Ben surname: Clifford fullname: Clifford, Ben organization: Department of Astronomy and Astrophysics, University of Chicago, United States – sequence: 5 givenname: Daniel S. surname: Katz fullname: Katz, Daniel S. organization: Computation Institute, University of Chicago and Argonne National Laboratory, United States – sequence: 6 givenname: Ian surname: Foster fullname: Foster, Ian organization: Computation Institute, University of Chicago and Argonne National Laboratory, United States |
| BookMark | eNqFj71OwzAUhS1UJNrCE7DkBRKu7dhOkBiqij-pEgMwW7ZzE7kKSWW7IN6elDIxwHSW852jb0FmwzggIZcUCgpUXm2LnQluLBhQWoAoAMQJmdNKsVxxLmdkPrVUXtGanpFFjFsAkGUFc1I-f_g2XWerrDdDtzcdZu0YssbHFLzdJ2yyadr0PfZZdMHvkh-6c3Lamj7ixU8uyevd7cv6Id883T-uV5vc8VqmvJHWGV4qtK61WDbTJVpVY8uEUBVjXLCqqQUoBaIExqWT0tUWmDGS1Wj5ktTHXRfGGAO22vlkkh-HFIzvNQV90Ndb_a2vD_oahJ70J5b_YnfBv5nw-Q91c6Rw0nr3GHR0HgeHjQ_okm5G_yf_BWTydwY |
| CitedBy_id | crossref_primary_10_1080_17445760_2017_1422501 crossref_primary_10_1109_MCSE_2019_2920048 crossref_primary_10_1002_cpe_3540 crossref_primary_10_1016_j_future_2017_02_029 crossref_primary_10_1016_j_procs_2015_05_276 crossref_primary_10_1177_1094342019866891 crossref_primary_10_1109_MCSE_2019_2918766 crossref_primary_10_1007_s11227_017_2047_1 crossref_primary_10_1007_s10619_012_7105_3 crossref_primary_10_1016_j_imu_2022_101024 crossref_primary_10_1016_j_jpdc_2015_10_001 crossref_primary_10_1177_1094342017703448 crossref_primary_10_1145_3177851 crossref_primary_10_1016_j_future_2017_02_026 crossref_primary_10_1109_TSTE_2016_2593607 crossref_primary_10_1007_s10723_013_9259_2 crossref_primary_10_7717_peerj_241 crossref_primary_10_1016_j_future_2013_09_023 crossref_primary_10_1016_j_jss_2020_110665 crossref_primary_10_1016_j_jpdc_2014_09_009 crossref_primary_10_1145_3463478_3463486 crossref_primary_10_1007_s10723_017_9409_z crossref_primary_10_1109_MCSE_2012_92 crossref_primary_10_1016_j_cola_2021_101074 crossref_primary_10_1016_j_envsoft_2020_104778 crossref_primary_10_1002_adem_202101176 crossref_primary_10_1016_j_jpdc_2012_02_002 crossref_primary_10_1007_s10723_015_9329_8 crossref_primary_10_1016_j_future_2016_04_023 crossref_primary_10_1016_j_scico_2017_06_002 crossref_primary_10_1145_2517327_2442559 crossref_primary_10_1002_cpe_3563 crossref_primary_10_1109_TPDS_2015_2497693 crossref_primary_10_1016_j_advwatres_2015_06_006 crossref_primary_10_1109_MC_2014_262 crossref_primary_10_1016_j_future_2016_02_008 crossref_primary_10_1016_j_future_2015_05_015 crossref_primary_10_1016_j_future_2019_05_020 crossref_primary_10_1049_iet_gtd_2016_1582 crossref_primary_10_1016_j_future_2015_03_017 crossref_primary_10_1016_j_future_2022_01_024 crossref_primary_10_1002_spe_3328 crossref_primary_10_1109_ACCESS_2023_3272619 crossref_primary_10_1080_08940886_2015_1013415 crossref_primary_10_1016_j_future_2020_08_012 crossref_primary_10_1002_cpe_3032 crossref_primary_10_1016_j_future_2017_02_038 crossref_primary_10_1016_j_future_2018_03_002 crossref_primary_10_1016_j_sbi_2018_09_005 crossref_primary_10_1111_gcbb_12919 crossref_primary_10_1177_1094342017704893 crossref_primary_10_1371_journal_pcbi_1009835 crossref_primary_10_1002_pro_767 crossref_primary_10_1016_j_cma_2020_113188 crossref_primary_10_1109_TAI_2023_3246032 crossref_primary_10_1145_3457119 crossref_primary_10_1002_cpe_3834 crossref_primary_10_1007_s10115_018_1164_3 crossref_primary_10_1371_journal_pone_0032647 crossref_primary_10_1186_s13673_018_0150_9 crossref_primary_10_1007_s10270_023_01112_6 crossref_primary_10_1186_s40537_016_0055_2 crossref_primary_10_1016_j_parco_2019_102584 crossref_primary_10_1016_j_future_2019_07_046 crossref_primary_10_1107_S1600577519007495 crossref_primary_10_1016_j_future_2015_08_015 crossref_primary_10_1016_j_future_2019_07_043 crossref_primary_10_1016_j_parco_2016_10_003 crossref_primary_10_7717_peerj_9762 crossref_primary_10_1158_0008_5472_CAN_13_0324 crossref_primary_10_1002_cpe_5802 crossref_primary_10_1016_j_future_2022_04_014 crossref_primary_10_1145_3550488 crossref_primary_10_1002_cpe_3505 crossref_primary_10_1016_j_future_2016_08_016 crossref_primary_10_1108_COMPEL_10_2012_0271 crossref_primary_10_1371_journal_pone_0242453 crossref_primary_10_1016_j_future_2018_05_051 crossref_primary_10_1016_j_future_2014_11_017 crossref_primary_10_3390_s21092974 crossref_primary_10_7717_peerj_5551 crossref_primary_10_1016_j_future_2017_05_041 crossref_primary_10_1371_journal_pone_0211608 crossref_primary_10_1016_j_future_2020_04_005 crossref_primary_10_1007_s10723_013_9272_5 crossref_primary_10_1016_j_jpdc_2021_02_009 crossref_primary_10_1038_s41598_021_99288_8 crossref_primary_10_1016_j_future_2015_10_001 crossref_primary_10_1007_s10723_017_9413_3 crossref_primary_10_1016_j_future_2020_05_030 crossref_primary_10_1016_j_future_2020_07_007 crossref_primary_10_1145_2831270 crossref_primary_10_1016_j_cosrev_2021_100422 crossref_primary_10_1007_s10619_012_7104_4 crossref_primary_10_1016_j_simpat_2016_10_009 crossref_primary_10_1177_1094342016649766 crossref_primary_10_1016_j_future_2016_11_004 crossref_primary_10_1002_wat2_1561 crossref_primary_10_1186_s13677_016_0070_z crossref_primary_10_3389_fdata_2021_756041 crossref_primary_10_1002_cpe_6519 crossref_primary_10_1088_2515_7639_ab8c2d crossref_primary_10_1063_1_4944683 crossref_primary_10_1177_10943420231167800 crossref_primary_10_1007_s10766_016_0441_6 crossref_primary_10_1109_TC_2018_2801300 crossref_primary_10_1177_10943420211019119 crossref_primary_10_7717_peerj_3509 crossref_primary_10_1016_j_future_2023_01_010 crossref_primary_10_1186_s40537_021_00555_2 crossref_primary_10_1016_j_future_2020_01_030 crossref_primary_10_3389_fpls_2017_00786 crossref_primary_10_1186_s13173_015_0035_y crossref_primary_10_1021_ct500852y crossref_primary_10_1145_3600096 crossref_primary_10_1016_j_cpc_2016_05_020 |
| Cites_doi | 10.1023/A:1015617019423 10.1109/MC.2009.365 10.1016/j.jpdc.2005.03.002 10.1109/eScience.2010.43 10.1109/MTAGS.2010.5699433 10.1109/MC.1986.1663305 10.1177/109434209701100205 10.1038/nphys1050 10.1147/rd.521.0199 10.1145/1806596.1806638 10.1016/j.neuroimage.2007.09.021 10.1088/1742-6596/78/1/012057 10.1109/2.660187 10.1145/1327452.1327492 10.1002/cpe.938 10.1145/1645164.1645175 10.1145/1713072.1713078 10.1021/pr1005179 10.1098/rsta.2005.1602 10.1145/2080.357392 10.1109/SERVICES.2007.63 10.1109/HPDC.2003.1210024 10.1002/pro.330 10.1007/s10586-010-0134-7 10.1109/SC.2008.5219768 10.1145/1272996.1273005 |
| ContentType | Journal Article |
| Copyright | 2011 Elsevier B.V. |
| Copyright_xml | – notice: 2011 Elsevier B.V. |
| DBID | AAYXX CITATION |
| DOI | 10.1016/j.parco.2011.05.005 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 1872-7336 |
| EndPage | 652 |
| ExternalDocumentID | 10_1016_j_parco_2011_05_005 S0167819111000524 |
| GroupedDBID | --K --M -~X .DC .~1 0R~ 123 1B1 1~. 1~5 29O 4.4 457 4G. 5VS 6OB 7-5 71M 8P~ 9JN AACTN AAEDT AAEDW AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO AAYFN ABBOA ABEFU ABFNM ABJNI ABMAC ABXDB ABYKQ ACDAQ ACGFS ACNNM ACRLP ACZNC ADBBV ADEZE ADJOM ADMUD ADTZH AEBSH AECPX AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHJVU AHZHX AIALX AIEXJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD ASPBG AVWKF AXJTR AZFZN BJAXD BKOJK BLXMC CS3 DU5 EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 F5P FDB FEDTE FGOYB FIRID FNPLU FYGXN G-Q G8K GBLVA GBOLZ HLZ HVGLF HZ~ H~9 IHE J1W JJJVA KOM LG9 M41 MO0 N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. Q38 R2- RIG ROL RPZ SBC SCC SDF SDG SDP SES SEW SPC SPCBC SST SSV SSZ T5K WH7 WUQ XPP ZMT ~G- 9DU AATTM AAXKI AAYWO AAYXX ABDPE ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD |
| ID | FETCH-LOGICAL-c396t-d6bca347ebcfbe4d064eb79ef25578223528d950770540236c66c9b02aa629eb3 |
| ISICitedReferencesCount | 248 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000295150400010&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0167-8191 |
| IngestDate | Sat Nov 29 08:17:07 EST 2025 Tue Nov 18 21:14:54 EST 2025 Fri Feb 23 02:30:42 EST 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 9 |
| Keywords | Swift Parallel programming Dataflow Scripting |
| Language | English |
| License | https://www.elsevier.com/tdm/userlicense/1.0 |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c396t-d6bca347ebcfbe4d064eb79ef25578223528d950770540236c66c9b02aa629eb3 |
| PageCount | 20 |
| ParticipantIDs | crossref_citationtrail_10_1016_j_parco_2011_05_005 crossref_primary_10_1016_j_parco_2011_05_005 elsevier_sciencedirect_doi_10_1016_j_parco_2011_05_005 |
| PublicationCentury | 2000 |
| PublicationDate | 2011-09-01 |
| PublicationDateYYYYMMDD | 2011-09-01 |
| PublicationDate_xml | – month: 09 year: 2011 text: 2011-09-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationTitle | Parallel computing |
| PublicationYear | 2011 |
| Publisher | Elsevier B.V |
| Publisher_xml | – name: Elsevier B.V |
| References | Wilde, Foster, Iskra, Beckman, Zhang, Espinosa, Hategan, Clifford, Raicu (b0100) 2009; 42 Y. Yu, M. Isard, D. Fetterly, M. Budiu, U. Erlingsson, P.K. Gunda, J. Currey, DryadLINQ: A system for general-purpose distributed data-parallel computing using a high-level language, in: Proceedings of Symposium on Operating System Design and Implementation (OSDI), 2008. Y. Zhao, M. Hategan, B. Clifford, I. Foster, G. von Laszewski, V. Nefedova, I. Raicu, T. Stef-Praun, M. Wilde, Swift: fast, reliable, loosely coupled parallel computation, in: 2007 IEEE Congress on Services, 2007, pp. 199 –206. doi:10.1109/SERVICES.2007.63. Frey, Tannenbaum, Livny, Foster, Tuecke (b0080) 2002; 5 I. Raicu, Z. Zhang, M. Wilde, I. Foster, P. Beckman, K. Iskra, B. Clifford, Toward loosely coupled programming on petascale systems, in: Proceedings of the 2008 ACM/IEEE Conference on Supercomputing, SC ’08, IEEE Press, Piscataway, NJ, USA, 2008, pp. 22:1–22:12. URL Yu, Moretti, Thrasher, Emrich, Judd, Thain (b0235) 2010; 13 Lee, Chen, Luo, Wu, Wilde, Schumacker, Zhao (b0120) 2010; 9 Allcock, Bresnahan, Kettimuthu, Link, Dumitrescu, Raicu, Foster (b0055) 2005 Ousterhout (b0160) 1998; 31 Birrell, Nelson (b0015) 1984; 2 Stef-Praun, Clifford, Foster, Hasson, Hategan, Small, Wilde, Zhao (b0130) 2007; 126 T. Stef-Praun, G. Madeira, I. Foster, R. Townsend, Accelerating solution of a moral hazard problem with Swift, in: e-Social Science 2007, Indianapolis, 2007. Wassermann, Emmerich, Butchart, Cameron, Chen, Patel (b0195) 2007 Pike, Dorward, Griesemer, Quinlan (b0180) 2005; 13 Dean, Ghemawat (b0065) 2008; 51 Hasson, Skipper, Wilde, Nusbaum, Small, analysis (b0135) 2008; 39 Ahuja, Carriero, Gelernter (b0165) 1986; 19 C. Chambers, A. Raniwala, F. Perry, S. Adams, R.R. Henry, R. Bradshaw, N. Weizenbaum, FlumeJava: Easy, efficient data-parallel pipelines, in: Proceedings of the 2010 ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI ’10, ACM, New York, NY, USA, 2010, pp. 363–375. doi:10.1145/1806596.1806638. URL M. Isard, M. Budiu, Y. Yu, A. Birrell, D. Fetterly, Dryad: Distributed data-parallel programs from sequential building blocks, in: Proceedings of European Conference on Computer Systems (EuroSys), 2007. K. Taura, T. Matsuzaki, M. Miwa, Y. Kamoshida, D. Yokoyama, N. Dun, T. Shibata, C.S. Jun, J. Tsujii, Design and implementation of GXP make – a workflow system based on make, in: Proceedings of IEEE International Conference on eScience, IEEE Computer Society, Los Alamitos, CA, 2010, pp. 214–221. doi:10.1109/eScience.2010.43 Kenny, Andric, M, Neale, Wilde, Small (b0140) 2009; 3 Foster, Olson, Tuecke (b0175) 1992; 1 . von Laszewski, Hategan, Kodeboyina (b0040) 2007 I. Foster, S. Taylor, Strand: A practical parallel programming language, in: Proceedings of the North American Conference on Logic Programming, 1989, pp. 497–512. B.-D. Kim, J.E. Cazes, Performance and scalability study of Sun Constellation cluster ‘Ranger’ using application-based benchmarks, in: Proceedings of TeraGrid’2008, 2008. Czajkowski, Foster, Karonis, Kesselman, Martin, Smith, Tuecke (b0050) 1998; vol. 1459 G. Hocky, M. Wilde, J. DeBartolo, M. Hategan, I. Foster, T.R. Sosnick, K.F. Freed, Towards petascale ab initio protein folding through parallel scripting, Technical Report, ANL/MCS-P1612-0409, Argonne National Laboratory, April 2009. IBM Blue Gene team, Overview of the IBM Blue Gene/P project, IBM J. Res. Dev. 52, 2008, pp. 199–220. URL T. Armstrong, M. Wilde, D. Katz, Z. Zhang, I. Foster, Scheduling many-task workloads on supercomputers: dealing with trailing tasks, in: MTAGS 2010: 3rd IEEE Workshop on Many-Task Computing on Grids and Supercomputers, 2010. ImageMagick project web site (2010). URL M. Hategan S. Boker, M. Neale, H. Maes, M. Wilde, M. Spiegel, T. Brick, J. Spies, R. Estabrook, S. Kenny, T. Bates, P. Mehta, J. Fox, OpenMx: An open source extended structural equation modeling framework, Psychometrika, in press. Beckman (b0085) 2005; 363 Biroli, Bouchaud, Cavagna, Grigera, Verrocchio (b0155) 2008; 4 Foster, Kesselman (b0045) 1997; 11 DeBartolo, Hocky, Wilde, Xu, Freed, Sosnick (b0110) 2010; 19 J.M. Wozniak, M. Wilde, Case studies in storage access by loosely coupled petascale applications, in: Proceedings of the 4th Annual Workshop on Petascale Data Storage, PDSW ’09, ACM, New York, 2009, pp. 16–20. doi:10.1145/1713072.1713078. URL D. Thain, M. Livny, The ethernet approach to grid computing, in: Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing, HPDC ’03, IEEE Computer Society, Washington, DC, USA, 2003, pp. 138–151. URL E. Walker, W. Xu, V. Chandar, Composing and executing parallel data-flow graphs with shell pipes, in: Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science, WORKS ’09, ACM, New York, 2009, pp. 11:1–11:10. doi:10.1145/1645164.1645175. URL Juric (b0190) 2006 Deelman, Singh, Su, Blythe, Gila, Kesselman, Mehta, Vahi, Berriman, Good, Laity, Jacob, Katz (b0205) 2005; 13 Garzoglio, Levshina, Mhashilkar, Timm (b0095) 2009 Pordes, Petravick, Kramer, Olson, Livny, Roy, Avery, Blackburn, Wenaus, Würthwein, Foster, Gardner, Wilde, Blatecky, McGee, Quick (b0090) 2007; 78 Baker, Hewitt (b0010) 1977 Ching Lian, Tang, Issac, Krishnan (b0220) 2005; 65 A. Fedorov, B. Clifford, S.K. Wareld, R. Kikinis, N. Chrisochoides, Non-rigid Registration for Image-guided Neurosurgery on the TeraGrid: A case study, Technical Report WM-CS-2009-05, College of William and Mary, 2009. Haskell 98 Language and Libraries – The Revised Report, Internet document (2002). URL Thain, Tannenbaum, Livny (b0200) 2005; 17 DeBartolo (10.1016/j.parco.2011.05.005_b0110) 2010; 19 Stef-Praun (10.1016/j.parco.2011.05.005_b0130) 2007; 126 10.1016/j.parco.2011.05.005_b0070 Hasson (10.1016/j.parco.2011.05.005_b0135) 2008; 39 Pordes (10.1016/j.parco.2011.05.005_b0090) 2007; 78 Birrell (10.1016/j.parco.2011.05.005_b0015) 1984; 2 von Laszewski (10.1016/j.parco.2011.05.005_b0040) 2007 Allcock (10.1016/j.parco.2011.05.005_b0055) 2005 Lee (10.1016/j.parco.2011.05.005_b0120) 2010; 9 10.1016/j.parco.2011.05.005_b0075 10.1016/j.parco.2011.05.005_b0230 10.1016/j.parco.2011.05.005_b0210 Ousterhout (10.1016/j.parco.2011.05.005_b0160) 1998; 31 10.1016/j.parco.2011.05.005_b0170 Wassermann (10.1016/j.parco.2011.05.005_b0195) 2007 10.1016/j.parco.2011.05.005_b0150 Baker (10.1016/j.parco.2011.05.005_b0010) 1977 10.1016/j.parco.2011.05.005_b0030 10.1016/j.parco.2011.05.005_b0105 Garzoglio (10.1016/j.parco.2011.05.005_b0095) 2009 Wilde (10.1016/j.parco.2011.05.005_b0100) 2009; 42 10.1016/j.parco.2011.05.005_b0145 Juric (10.1016/j.parco.2011.05.005_b0190) 2006 10.1016/j.parco.2011.05.005_b0025 Dean (10.1016/j.parco.2011.05.005_b0065) 2008; 51 10.1016/j.parco.2011.05.005_b0125 10.1016/j.parco.2011.05.005_b0005 10.1016/j.parco.2011.05.005_b0225 Biroli (10.1016/j.parco.2011.05.005_b0155) 2008; 4 Thain (10.1016/j.parco.2011.05.005_b0200) 2005; 17 Beckman (10.1016/j.parco.2011.05.005_b0085) 2005; 363 Yu (10.1016/j.parco.2011.05.005_b0235) 2010; 13 Foster (10.1016/j.parco.2011.05.005_b0175) 1992; 1 10.1016/j.parco.2011.05.005_b0020 10.1016/j.parco.2011.05.005_b0185 10.1016/j.parco.2011.05.005_b0240 10.1016/j.parco.2011.05.005_b0060 Frey (10.1016/j.parco.2011.05.005_b0080) 2002; 5 10.1016/j.parco.2011.05.005_b0215 Kenny (10.1016/j.parco.2011.05.005_b0140) 2009; 3 Ching Lian (10.1016/j.parco.2011.05.005_b0220) 2005; 65 10.1016/j.parco.2011.05.005_b0035 Foster (10.1016/j.parco.2011.05.005_b0045) 1997; 11 10.1016/j.parco.2011.05.005_b0115 Czajkowski (10.1016/j.parco.2011.05.005_b0050) 1998; vol. 1459 Pike (10.1016/j.parco.2011.05.005_b0180) 2005; 13 Deelman (10.1016/j.parco.2011.05.005_b0205) 2005; 13 Ahuja (10.1016/j.parco.2011.05.005_b0165) 1986; 19 |
| References_xml | – start-page: 428 year: 2007 end-page: 449 ident: b0195 article-title: Sedna: A BPEL-based environment for visual scientific workflow modeling publication-title: Workflows for e-Science – reference: T. Armstrong, M. Wilde, D. Katz, Z. Zhang, I. Foster, Scheduling many-task workloads on supercomputers: dealing with trailing tasks, in: MTAGS 2010: 3rd IEEE Workshop on Many-Task Computing on Grids and Supercomputers, 2010. – reference: T. Stef-Praun, G. Madeira, I. Foster, R. Townsend, Accelerating solution of a moral hazard problem with Swift, in: e-Social Science 2007, Indianapolis, 2007. – volume: 31 start-page: 23 year: 1998 end-page: 30 ident: b0160 article-title: Scripting: Higher level programming for the 21st century publication-title: Computer – volume: 13 start-page: 219 year: 2005 end-page: 237 ident: b0205 article-title: Pegasus: a framework for mapping complex scientific workflows onto distributed systems publication-title: Sci. Prog. – reference: I. Foster, S. Taylor, Strand: A practical parallel programming language, in: Proceedings of the North American Conference on Logic Programming, 1989, pp. 497–512. – volume: 65 start-page: 857 year: 2005 end-page: 869 ident: b0220 article-title: Gel: Grid execution language publication-title: J. Parallel Distrib. Comput. – reference: Haskell 98 Language and Libraries – The Revised Report, Internet document (2002). URL – reference: M. Isard, M. Budiu, Y. Yu, A. Birrell, D. Fetterly, Dryad: Distributed data-parallel programs from sequential building blocks, in: Proceedings of European Conference on Computer Systems (EuroSys), 2007. – volume: 363 start-page: 1715 year: 2005 end-page: 1728 ident: b0085 article-title: Building the TeraGrid publication-title: Philos. Trans. Roy. Soc. A – start-page: 55 year: 1977 end-page: 59 ident: b0010 article-title: The incremental garbage collection of processes publication-title: Proceedings of the 1977 Symposium on Artificial Intelligence and Programming Languages – volume: 4 start-page: 771 year: 2008 end-page: 775 ident: b0155 article-title: Thermodynamic signature of growing amorphous order in glass-forming liquids publication-title: Nature Phys. – volume: 19 start-page: 520 year: 2010 end-page: 534 ident: b0110 article-title: Protein structure prediction enhanced with evolutionary diversity: speed publication-title: Protein Sci. – reference: E. Walker, W. Xu, V. Chandar, Composing and executing parallel data-flow graphs with shell pipes, in: Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science, WORKS ’09, ACM, New York, 2009, pp. 11:1–11:10. doi:10.1145/1645164.1645175. URL – reference: I. Raicu, Z. Zhang, M. Wilde, I. Foster, P. Beckman, K. Iskra, B. Clifford, Toward loosely coupled programming on petascale systems, in: Proceedings of the 2008 ACM/IEEE Conference on Supercomputing, SC ’08, IEEE Press, Piscataway, NJ, USA, 2008, pp. 22:1–22:12. URL – volume: 1 start-page: 51 year: 1992 end-page: 66 ident: b0175 article-title: Productive parallel programming: The PCN approach publication-title: Sci. Program. – volume: 42 start-page: 50 year: 2009 end-page: 60 ident: b0100 article-title: Parallel scripting for applications at the petascale and beyond publication-title: Computer – volume: 2 start-page: 39 year: 1984 end-page: 59 ident: b0015 article-title: Implementing remote procedure calls publication-title: ACM Trans. Comput. Syst. – volume: 13 start-page: 243 year: 2010 end-page: 256 ident: b0235 article-title: Harnessing parallelism in multicore clusters with the all-pairs, wavefront, and makeflow abstractions publication-title: Cluster Comput. – reference: K. Taura, T. Matsuzaki, M. Miwa, Y. Kamoshida, D. Yokoyama, N. Dun, T. Shibata, C.S. Jun, J. Tsujii, Design and implementation of GXP make – a workflow system based on make, in: Proceedings of IEEE International Conference on eScience, IEEE Computer Society, Los Alamitos, CA, 2010, pp. 214–221. doi:10.1109/eScience.2010.43 – reference: S. Boker, M. Neale, H. Maes, M. Wilde, M. Spiegel, T. Brick, J. Spies, R. Estabrook, S. Kenny, T. Bates, P. Mehta, J. Fox, OpenMx: An open source extended structural equation modeling framework, Psychometrika, in press. – reference: . – reference: A. Fedorov, B. Clifford, S.K. Wareld, R. Kikinis, N. Chrisochoides, Non-rigid Registration for Image-guided Neurosurgery on the TeraGrid: A case study, Technical Report WM-CS-2009-05, College of William and Mary, 2009. – reference: G. Hocky, M. Wilde, J. DeBartolo, M. Hategan, I. Foster, T.R. Sosnick, K.F. Freed, Towards petascale ab initio protein folding through parallel scripting, Technical Report, ANL/MCS-P1612-0409, Argonne National Laboratory, April 2009. – volume: 3 year: 2009 ident: b0140 article-title: Parallel workflows for data-driven structural equation modeling in functional neuroimaging publication-title: Front. Neuroinform. – reference: Y. Zhao, M. Hategan, B. Clifford, I. Foster, G. von Laszewski, V. Nefedova, I. Raicu, T. Stef-Praun, M. Wilde, Swift: fast, reliable, loosely coupled parallel computation, in: 2007 IEEE Congress on Services, 2007, pp. 199 –206. doi:10.1109/SERVICES.2007.63. – reference: M. Hategan, – reference: D. Thain, M. Livny, The ethernet approach to grid computing, in: Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing, HPDC ’03, IEEE Computer Society, Washington, DC, USA, 2003, pp. 138–151. URL – reference: ImageMagick project web site (2010). URL – volume: 19 start-page: 26 year: 1986 end-page: 34 ident: b0165 article-title: Linda and Friends publication-title: IEEE Comput. – volume: 78 start-page: 012057 year: 2007 ident: b0090 article-title: The open science grid publication-title: J. Phys.: Conf. Ser. – reference: J.M. Wozniak, M. Wilde, Case studies in storage access by loosely coupled petascale applications, in: Proceedings of the 4th Annual Workshop on Petascale Data Storage, PDSW ’09, ACM, New York, 2009, pp. 16–20. doi:10.1145/1713072.1713078. URL – reference: B.-D. Kim, J.E. Cazes, Performance and scalability study of Sun Constellation cluster ‘Ranger’ using application-based benchmarks, in: Proceedings of TeraGrid’2008, 2008. – volume: 9 start-page: 5705 year: 2010 end-page: 5714 ident: b0120 article-title: The first global screening of protein substrates bearing protein-bound 3,4-dihydroxyphenylalanine in Escherichia coli and human mitochondria publication-title: J. Proteome Res. – volume: 5 start-page: 237 year: 2002 end-page: 246 ident: b0080 article-title: Condor-G: a computation management agent for multi-institutional grids publication-title: Cluster Comput. – reference: IBM Blue Gene team, Overview of the IBM Blue Gene/P project, IBM J. Res. Dev. 52, 2008, pp. 199–220. URL – volume: 39 start-page: 693 year: 2008 end-page: 706 ident: b0135 article-title: storage and sharing of neuroimaging data using relational databases and distributed computing publication-title: NeuroImage – volume: 126 start-page: 207 year: 2007 end-page: 216 ident: b0130 article-title: Accelerating medical research using the Swift workflow system publication-title: Stud. Health Technol. Inf. – start-page: 341 year: 2007 end-page: 356 ident: b0040 article-title: Java CoG kit workflow publication-title: Workflows for e-Science – volume: 17 start-page: 323 year: 2005 end-page: 356 ident: b0200 article-title: Distributed computing in practice: The Condor experience publication-title: Concurrency Comput.: Pract. Exp. – volume: vol. 1459 start-page: 62 year: 1998 end-page: 82 ident: b0050 article-title: A resource management architecture for metacomputing systems publication-title: Job scheduling strategies for parallel processing – reference: C. Chambers, A. Raniwala, F. Perry, S. Adams, R.R. Henry, R. Bradshaw, N. Weizenbaum, FlumeJava: Easy, efficient data-parallel pipelines, in: Proceedings of the 2010 ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI ’10, ACM, New York, NY, USA, 2010, pp. 363–375. doi:10.1145/1806596.1806638. URL – year: 2006 ident: b0190 article-title: Business Process Execution Language for Web Services – start-page: 54 year: 2005 ident: b0055 article-title: The Globus striped GridFTP framework and server publication-title: Proceedings of the 2005 ACM/IEEE Conference on Supercomputing, SC ’05 – volume: 13 start-page: 277 year: 2005 end-page: 298 ident: b0180 article-title: Interpreting the data: Parallel analysis with Sawzall publication-title: Sci. Prog. – start-page: 89 year: 2009 end-page: 98 ident: b0095 article-title: ReSS: a resource selection service for the open science grid publication-title: Grid Computing – reference: Y. Yu, M. Isard, D. Fetterly, M. Budiu, U. Erlingsson, P.K. Gunda, J. Currey, DryadLINQ: A system for general-purpose distributed data-parallel computing using a high-level language, in: Proceedings of Symposium on Operating System Design and Implementation (OSDI), 2008. – volume: 11 start-page: 115 year: 1997 end-page: 128 ident: b0045 article-title: Globus: a metacomputing infrastructure toolkit publication-title: J. Supercomput. Appl. – volume: 51 start-page: 107 year: 2008 end-page: 113 ident: b0065 article-title: MapReduce: simplified data processing on large clusters publication-title: Commun. ACM – ident: 10.1016/j.parco.2011.05.005_b0145 – ident: 10.1016/j.parco.2011.05.005_b0170 – ident: 10.1016/j.parco.2011.05.005_b0030 – volume: 5 start-page: 237 year: 2002 ident: 10.1016/j.parco.2011.05.005_b0080 article-title: Condor-G: a computation management agent for multi-institutional grids publication-title: Cluster Comput. doi: 10.1023/A:1015617019423 – volume: 42 start-page: 50 issue: 11 year: 2009 ident: 10.1016/j.parco.2011.05.005_b0100 article-title: Parallel scripting for applications at the petascale and beyond publication-title: Computer doi: 10.1109/MC.2009.365 – volume: 13 start-page: 219 year: 2005 ident: 10.1016/j.parco.2011.05.005_b0205 article-title: Pegasus: a framework for mapping complex scientific workflows onto distributed systems publication-title: Sci. Prog. – start-page: 89 year: 2009 ident: 10.1016/j.parco.2011.05.005_b0095 article-title: ReSS: a resource selection service for the open science grid – ident: 10.1016/j.parco.2011.05.005_b0105 – volume: 65 start-page: 857 year: 2005 ident: 10.1016/j.parco.2011.05.005_b0220 article-title: Gel: Grid execution language publication-title: J. Parallel Distrib. Comput. doi: 10.1016/j.jpdc.2005.03.002 – ident: 10.1016/j.parco.2011.05.005_b0230 doi: 10.1109/eScience.2010.43 – ident: 10.1016/j.parco.2011.05.005_b0070 doi: 10.1109/MTAGS.2010.5699433 – volume: 19 start-page: 26 issue: 8 year: 1986 ident: 10.1016/j.parco.2011.05.005_b0165 article-title: Linda and Friends publication-title: IEEE Comput. doi: 10.1109/MC.1986.1663305 – ident: 10.1016/j.parco.2011.05.005_b0215 – volume: 11 start-page: 115 year: 1997 ident: 10.1016/j.parco.2011.05.005_b0045 article-title: Globus: a metacomputing infrastructure toolkit publication-title: J. Supercomput. Appl. doi: 10.1177/109434209701100205 – volume: 4 start-page: 771 year: 2008 ident: 10.1016/j.parco.2011.05.005_b0155 article-title: Thermodynamic signature of growing amorphous order in glass-forming liquids publication-title: Nature Phys. doi: 10.1038/nphys1050 – volume: 13 start-page: 277 issue: 4 year: 2005 ident: 10.1016/j.parco.2011.05.005_b0180 article-title: Interpreting the data: Parallel analysis with Sawzall publication-title: Sci. Prog. – start-page: 54 year: 2005 ident: 10.1016/j.parco.2011.05.005_b0055 article-title: The Globus striped GridFTP framework and server – ident: 10.1016/j.parco.2011.05.005_b0005 – ident: 10.1016/j.parco.2011.05.005_b0150 – ident: 10.1016/j.parco.2011.05.005_b0035 doi: 10.1147/rd.521.0199 – volume: 3 issue: 34 year: 2009 ident: 10.1016/j.parco.2011.05.005_b0140 article-title: Parallel workflows for data-driven structural equation modeling in functional neuroimaging publication-title: Front. Neuroinform. – ident: 10.1016/j.parco.2011.05.005_b0185 doi: 10.1145/1806596.1806638 – volume: 39 start-page: 693 issue: 2 year: 2008 ident: 10.1016/j.parco.2011.05.005_b0135 article-title: storage and sharing of neuroimaging data using relational databases and distributed computing publication-title: NeuroImage doi: 10.1016/j.neuroimage.2007.09.021 – volume: 78 start-page: 012057 issue: 1 year: 2007 ident: 10.1016/j.parco.2011.05.005_b0090 article-title: The open science grid publication-title: J. Phys.: Conf. Ser. doi: 10.1088/1742-6596/78/1/012057 – start-page: 428 year: 2007 ident: 10.1016/j.parco.2011.05.005_b0195 article-title: Sedna: A BPEL-based environment for visual scientific workflow modeling – ident: 10.1016/j.parco.2011.05.005_b0125 – volume: 31 start-page: 23 issue: 3 year: 1998 ident: 10.1016/j.parco.2011.05.005_b0160 article-title: Scripting: Higher level programming for the 21st century publication-title: Computer doi: 10.1109/2.660187 – volume: 51 start-page: 107 year: 2008 ident: 10.1016/j.parco.2011.05.005_b0065 article-title: MapReduce: simplified data processing on large clusters publication-title: Commun. ACM doi: 10.1145/1327452.1327492 – volume: 17 start-page: 323 issue: 2–4 year: 2005 ident: 10.1016/j.parco.2011.05.005_b0200 article-title: Distributed computing in practice: The Condor experience publication-title: Concurrency Comput.: Pract. Exp. doi: 10.1002/cpe.938 – volume: 1 start-page: 51 year: 1992 ident: 10.1016/j.parco.2011.05.005_b0175 article-title: Productive parallel programming: The PCN approach publication-title: Sci. Program. – ident: 10.1016/j.parco.2011.05.005_b0225 doi: 10.1145/1645164.1645175 – start-page: 55 year: 1977 ident: 10.1016/j.parco.2011.05.005_b0010 article-title: The incremental garbage collection of processes – volume: 126 start-page: 207 year: 2007 ident: 10.1016/j.parco.2011.05.005_b0130 article-title: Accelerating medical research using the Swift workflow system publication-title: Stud. Health Technol. Inf. – ident: 10.1016/j.parco.2011.05.005_b0240 doi: 10.1145/1713072.1713078 – volume: 9 start-page: 5705 issue: 11 year: 2010 ident: 10.1016/j.parco.2011.05.005_b0120 article-title: The first global screening of protein substrates bearing protein-bound 3,4-dihydroxyphenylalanine in Escherichia coli and human mitochondria publication-title: J. Proteome Res. doi: 10.1021/pr1005179 – ident: 10.1016/j.parco.2011.05.005_b0025 – volume: 363 start-page: 1715 issue: 1833 year: 2005 ident: 10.1016/j.parco.2011.05.005_b0085 article-title: Building the TeraGrid publication-title: Philos. Trans. Roy. Soc. A doi: 10.1098/rsta.2005.1602 – start-page: 341 year: 2007 ident: 10.1016/j.parco.2011.05.005_b0040 article-title: Java CoG kit workflow – ident: 10.1016/j.parco.2011.05.005_b0075 – volume: 2 start-page: 39 issue: 1 year: 1984 ident: 10.1016/j.parco.2011.05.005_b0015 article-title: Implementing remote procedure calls publication-title: ACM Trans. Comput. Syst. doi: 10.1145/2080.357392 – volume: vol. 1459 start-page: 62 year: 1998 ident: 10.1016/j.parco.2011.05.005_b0050 article-title: A resource management architecture for metacomputing systems – ident: 10.1016/j.parco.2011.05.005_b0020 doi: 10.1109/SERVICES.2007.63 – ident: 10.1016/j.parco.2011.05.005_b0060 doi: 10.1109/HPDC.2003.1210024 – volume: 19 start-page: 520 issue: 3 year: 2010 ident: 10.1016/j.parco.2011.05.005_b0110 article-title: Protein structure prediction enhanced with evolutionary diversity: speed publication-title: Protein Sci. doi: 10.1002/pro.330 – year: 2006 ident: 10.1016/j.parco.2011.05.005_b0190 – volume: 13 start-page: 243 year: 2010 ident: 10.1016/j.parco.2011.05.005_b0235 article-title: Harnessing parallelism in multicore clusters with the all-pairs, wavefront, and makeflow abstractions publication-title: Cluster Comput. doi: 10.1007/s10586-010-0134-7 – ident: 10.1016/j.parco.2011.05.005_b0115 doi: 10.1109/SC.2008.5219768 – ident: 10.1016/j.parco.2011.05.005_b0210 doi: 10.1145/1272996.1273005 |
| SSID | ssj0006480 |
| Score | 2.4627805 |
| Snippet | ► The Swift parallel scripting language is described in detail. ► Swift provides an implicitly parallel functional data flow computation model that simplifies... |
| SourceID | crossref elsevier |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 633 |
| SubjectTerms | Dataflow Parallel programming Scripting Swift |
| Title | Swift: A language for distributed parallel scripting |
| URI | https://dx.doi.org/10.1016/j.parco.2011.05.005 |
| Volume | 37 |
| WOSCitedRecordID | wos000295150400010&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1872-7336 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0006480 issn: 0167-8191 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LT9wwELYK9MCltLSoPFr50BsEhdjxg9tSUbWVipAAsbfIdhy0dJVFsAXEr2f8ykZahEqlXqIoXucxM_o8np35BqEvnCvBBVEZoKLIaGHLTJBcgCNnFTWybihpfLMJfnQkhkN5HGO6N76dAG9bcX8vr_6rquEaKNuVzr5A3d1N4QKcg9LhCGqH418p_uRu1IR4XxeM9LmEtaPIdd2twMV0hN_jsXX1kB404vIVndTjNGp8y4c0GqIzgaa3n23v8WtqL1TMw-8PnE8e2pH6Heo_AE3a7V-73d8e41GTUusPYkVaPQuoyn78Yb4wJsQpAX_dXjAsMwFbBQdnngS-kwS-gfElGpnsISkL_BhxUWaB5nYO70Po4XIXxGYmkZDVBcnK2fLWJR2euJdy7-RY8vKyoAtoqeClBCxcGvw4HP7sVnBGfce97iMSW5XPC5x71NMeTc9LOX2L3sTtBR4Es3iHXtl2Fa2k1h04Ivl7RL2V7OMBTjaCQRW4ZyM42QjubOQDOvt2ePr1exYbaGSGSDbNaqaNIpRbbRptaQ0fZjWXtoF9pPMMHbNPLWFHwJ3jXhBmGDNS54VSrJBWkzW02E5a-xFhLZniqs5FXVLKVanNntKOm9GIkhHerKMiCaEykV3eNTkZVymN8LLykquc5Kq8rEBy62inm3QVyFWe_zlL0q2ifxj8vgrM4bmJG_86cRMtz0x-Cy1Or__YT-i1uZ2Obq4_R7N5BIZ-iGA |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Swift%3A+A+language+for+distributed+parallel+scripting&rft.jtitle=Parallel+computing&rft.au=Wilde%2C+Michael&rft.au=Hategan%2C+Mihael&rft.au=Wozniak%2C+Justin+M.&rft.au=Clifford%2C+Ben&rft.date=2011-09-01&rft.pub=Elsevier+B.V&rft.issn=0167-8191&rft.eissn=1872-7336&rft.volume=37&rft.issue=9&rft.spage=633&rft.epage=652&rft_id=info:doi/10.1016%2Fj.parco.2011.05.005&rft.externalDocID=S0167819111000524 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0167-8191&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0167-8191&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0167-8191&client=summon |