Developing Distributed High-performance Computing Capabilities of an Open Science Platform for Robust Epidemic Analysis
COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among domain experts, mathematical modelers, and scientific computing specialists. Computationally, however, it also revealed critical gaps...
Uloženo v:
| Vydáno v: | 2023 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) Ročník 2023; s. 868 - 877 |
|---|---|
| Hlavní autoři: | , , , , , , , , |
| Médium: | Konferenční příspěvek Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
United States
IEEE
01.05.2023
|
| Témata: | |
| ISSN: | 2164-7062 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among domain experts, mathematical modelers, and scientific computing specialists. Computationally, however, it also revealed critical gaps in the ability of researchers to exploit advanced computing systems. These challenging areas include gaining access to scalable computing systems, porting models and workflows to new systems, sharing data of varying sizes, and producing results that can be reproduced and validated by others. Informed by our team's work in supporting public health decision makers during the COVID-19 pandemic and by the identified capability gaps in applying high-performance computing (HPC) to the modeling of complex social systems, we present the goals, requirements, and initial implementation of OSPREY, an open science platform for robust epidemic analysis. The prototype implementation demonstrates an integrated, algorithm-driven HPC workflow architecture, coordinating tasks across federated HPC resources, with robust, secure and automated access to each of the resources. We demonstrate scalable and fault-tolerant task execution, an asynchronous API to support fast time-to-solution algorithms, an inclusive, multi-language approach, and efficient wide-area data management. The example OSPREY code is made available on a public repository. |
|---|---|
| AbstractList | COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among domain experts, mathematical modelers, and scientific computing specialists. Computationally, however, it also revealed critical gaps in the ability of researchers to exploit advanced computing systems. These challenging areas include gaining access to scalable computing systems, porting models and workflows to new systems, sharing data of varying sizes, and producing results that can be reproduced and validated by others. Informed by our team's work in supporting public health decision makers during the COVID-19 pandemic and by the identified capability gaps in applying high-performance computing (HPC) to the modeling of complex social systems, we present the goals, requirements, and initial implementation of OSPREY, an open science platform for robust epidemic analysis. The prototype implementation demonstrates an integrated, algorithm-driven HPC workflow architecture, coordinating tasks across federated HPC resources, with robust, secure and automated access to each of the resources. We demonstrate scalable and fault-tolerant task execution, an asynchronous API to support fast time-to-solution algorithms, an inclusive, multi-language approach, and efficient wide-area data management. The example OSPREY code is made available on a public repository. COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among domain experts, mathematical modelers, and scientific computing specialists. Computationally, however, it also revealed critical gaps in the ability of researchers to exploit advanced computing systems. These challenging areas include gaining access to scalable computing systems, porting models and workflows to new systems, sharing data of varying sizes, and producing results that can be reproduced and validated by others. Informed by our team's work in supporting public health decision makers during the COVID-19 pandemic and by the identified capability gaps in applying high-performance computing (HPC) to the modeling of complex social systems, we present the goals, requirements, and initial implementation of OSPREY, an open science platform for robust epidemic analysis. The prototype implementation demonstrates an integrated, algorithm-driven HPC workflow architecture, coordinating tasks across federated HPC resources, with robust, secure and automated access to each of the resources. We demonstrate scalable and fault-tolerant task execution, an asynchronous API to support fast time-to-solution algorithms, an inclusive, multi-language approach, and efficient wide-area data management. The example OSPREY code is made available on a public repository.COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among domain experts, mathematical modelers, and scientific computing specialists. Computationally, however, it also revealed critical gaps in the ability of researchers to exploit advanced computing systems. These challenging areas include gaining access to scalable computing systems, porting models and workflows to new systems, sharing data of varying sizes, and producing results that can be reproduced and validated by others. Informed by our team's work in supporting public health decision makers during the COVID-19 pandemic and by the identified capability gaps in applying high-performance computing (HPC) to the modeling of complex social systems, we present the goals, requirements, and initial implementation of OSPREY, an open science platform for robust epidemic analysis. The prototype implementation demonstrates an integrated, algorithm-driven HPC workflow architecture, coordinating tasks across federated HPC resources, with robust, secure and automated access to each of the resources. We demonstrate scalable and fault-tolerant task execution, an asynchronous API to support fast time-to-solution algorithms, an inclusive, multi-language approach, and efficient wide-area data management. The example OSPREY code is made available on a public repository. |
| Author | Collier, Nicholson Wurth, Alexandra Stevens, Abby Fadikar, Arindam Chard, Kyle Ozik, Jonathan Babuji, Yadu Binois, Mickael Wozniak, Justin M. |
| Author_xml | – sequence: 1 givenname: Nicholson surname: Collier fullname: Collier, Nicholson organization: Argonne National Laboratory,Decision and Infrastructure Sciences,Lemont,IL,U.S.A – sequence: 2 givenname: Justin M. surname: Wozniak fullname: Wozniak, Justin M. organization: Argonne National Laboratory,Data Science and Learning,Lemont,IL,U.S.A – sequence: 3 givenname: Abby surname: Stevens fullname: Stevens, Abby organization: Argonne National Laboratory,Decision and Infrastructure Sciences,Lemont,IL,U.S.A – sequence: 4 givenname: Yadu surname: Babuji fullname: Babuji, Yadu organization: University of Chicago,Computer Science,Chicago,IL,U.S.A – sequence: 5 givenname: Mickael surname: Binois fullname: Binois, Mickael organization: Inria centre at Université Côte d'Azur Sophia Antipolis,Acumes project-team,France – sequence: 6 givenname: Arindam surname: Fadikar fullname: Fadikar, Arindam organization: Argonne National Laboratory,Decision and Infrastructure Sciences,Lemont,IL,U.S.A – sequence: 7 givenname: Alexandra surname: Wurth fullname: Wurth, Alexandra organization: Inria centre at Université Côte d'Azur Sophia Antipolis,Acumes project-team,France – sequence: 8 givenname: Kyle surname: Chard fullname: Chard, Kyle organization: University of Chicago,Computer Science,Chicago,IL,U.S.A – sequence: 9 givenname: Jonathan surname: Ozik fullname: Ozik, Jonathan organization: Argonne National Laboratory,Decision and Infrastructure Sciences,Lemont,IL,U.S.A |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/39991121$$D View this record in MEDLINE/PubMed |
| BookMark | eNo90M1uwjAMAOBMYtoY4w0mlOMuZXGTtOSIgA0kJNBA2hElqcsi9W9Nu4m3XxFsF_vgz7bsB9IrygIJGQEbAzD1strOt7sPqThj45CFfMwYCH5DhipWEy4ZB1CK9Ug_hEgEMYvCO3LPlVIAIfTJzxy_MSsrVxzp3PmmdqZtMKFLd_wMKqzTss51YZHOyrxqmzOb6Uobl7nGoadlSnVBNxUWdGcdnuU20825jXaBvpem9Q1dVC7B3Fk6LXR28s4_kttUZx6H1zwg-9fFfrYM1pu31Wy6DhxnkyZI0lTIyEZSqyROUMSSI8Q2skIabQBZlMTCaMm7spGpsYLr7nAbJakEAXxAni9jq7r8atE3h9x5i1mmCyxbf-AQszCWQvCOjq60NTkmh6p2ua5Ph79fdeDpAhwi_peBgYq6_fwXLV54BA |
| CODEN | IEEPAD |
| ContentType | Conference Proceeding Journal Article |
| DBID | 6IE 6IL CBEJK RIE RIL NPM 7X8 |
| DOI | 10.1109/IPDPSW59300.2023.00143 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Xplore POP ALL IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP All) 1998-Present PubMed MEDLINE - Academic |
| DatabaseTitle | PubMed MEDLINE - Academic |
| DatabaseTitleList | PubMed MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: RIE name: IEL url: https://ieeexplore.ieee.org/ sourceTypes: Publisher – sequence: 3 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| EISBN | 9798350311990 |
| EndPage | 877 |
| ExternalDocumentID | 39991121 10196539 |
| Genre | orig-research Journal Article |
| GrantInformation_xml | – fundername: Office of Science funderid: 10.13039/100006132 – fundername: Health funderid: 10.13039/100018696 – fundername: National Science Foundation funderid: 10.13039/100000001 – fundername: U.S. Department of Energy funderid: 10.13039/100000015 – fundername: NIDA NIH HHS grantid: R01 DA055502 |
| GroupedDBID | 6IE 6IL CBEJK RIE RIL NPM 7X8 |
| ID | FETCH-LOGICAL-i308t-dff456c65a9d7de4753e17c6c45bab1e06d74ba539d7b5fbc43a979c6df51413 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 8 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001055030700105&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 2164-7062 |
| IngestDate | Fri Jul 11 08:50:14 EDT 2025 Thu Feb 27 03:20:42 EST 2025 Thu Jan 18 11:13:28 EST 2024 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | false |
| Keywords | computational epidemiology HPC workflows open science platform high-performance computing |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-i308t-dff456c65a9d7de4753e17c6c45bab1e06d74ba539d7b5fbc43a979c6df51413 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| ORCID | 0000-0003-1976-1806 0000-0002-3495-6735 0000-0002-2376-4156 0000-0002-2441-2048 0000-0002-6099-0531 0000-0001-7396-0350 0000-0002-9162-6003 0000-0002-7225-1680 0000-0002-7370-4805 |
| OpenAccessLink | https://www.ncbi.nlm.nih.gov/pmc/articles/11845093 |
| PMID | 39991121 |
| PQID | 3170275443 |
| PQPubID | 23479 |
| PageCount | 10 |
| ParticipantIDs | ieee_primary_10196539 proquest_miscellaneous_3170275443 pubmed_primary_39991121 |
| PublicationCentury | 2000 |
| PublicationDate | 2023-May |
| PublicationDateYYYYMMDD | 2023-05-01 |
| PublicationDate_xml | – month: 05 year: 2023 text: 2023-May |
| PublicationDecade | 2020 |
| PublicationPlace | United States |
| PublicationPlace_xml | – name: United States |
| PublicationTitle | 2023 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) |
| PublicationTitleAbbrev | IPDPSW |
| PublicationTitleAlternate | IEEE Int Symp Parallel Distrib Process Workshops Phd Forum |
| PublicationYear | 2023 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| Score | 1.9183902 |
| Snippet | COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new... |
| SourceID | proquest pubmed ieee |
| SourceType | Aggregation Database Index Database Publisher |
| StartPage | 868 |
| SubjectTerms | computational epidemiology Computational modeling COVID-19 High performance computing HPC workflows Mathematical models open science platform Pandemics Prototypes Scientific computing |
| Title | Developing Distributed High-performance Computing Capabilities of an Open Science Platform for Robust Epidemic Analysis |
| URI | https://ieeexplore.ieee.org/document/10196539 https://www.ncbi.nlm.nih.gov/pubmed/39991121 https://www.proquest.com/docview/3170275443 |
| Volume | 2023 |
| WOSCitedRecordID | wos001055030700105&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwELZoxcAEiALlURmJNSWunTie-xAMVBFUolvkV6RKKKnaBP4-Pidtpw4sVoY4Ss5n3efcffch9OxQhIvruQyY0DRgStkgMQx8OVK5TqKYU-3FJvh8niyXIm3J6p4LY631xWd2CJc-l29KXcOvMrfDof8dFR3U4TxuyFot65eE4uUtnaSfX5GgYTgEVXDIMgAbx8umHEeQPpLMzv_5Dheod-Dk4XQfbS7RiS2u0O9kz3nCE2iBC-pV1mCo3gjWB04AbsQb4Laxi46-INYdkXGZY1lgKCrB7SbH6besYBp2A_4oVb2t8LSRkdV418Kkhxaz6WL8GrRSCsGKhkkVmDx3SEnHkRSGG8vcIcUSrmPNIiUVsWFsOFPSfZfhKsqVZlQKLnRscoeoCL1G3aIs7C3CNsyjkRbQUZQxLpSw2i1qTIlloSQ66aMeGC1bN80ysp29-uhpZ__MeTCkJWRhy3qbOQQDuVPGaB_dNAuzn00Bv5IRuTvy1Ht0BivdVCA-oG61qe0jOtU_1Wq7GTg3WSZunKfvA-8sf50twXc |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwELWgIMEJEAXKaiSuKU7txPG5i1pRqggq0VvkLVIllFRtAr-PJ-ly6oFLlENsJTO25jkzbx5CLw5FuLieSo8JTT2mlPUiw2AtByrVURByqiuxCT6ZRLOZiNdk9YoLY62tis9sG26rXL7JdQm_ytwOh_53VByio4CxDqnpWmver0_E6yjuxZ9fgaCEtEEXHPIMwMephFP2Y8gqlgzO_vkW56i5Y-XheBtvLtCBzS7Rb2_LesI9aIIL-lXWYKjf8BY7VgCu5Rvgsa6Lj1VJrDsk4zzFMsNQVoLX2xzH37KAYdhd8EeuylWB-7WQrMabJiZNNB30p92htxZT8OaURIVn0tRhJR0GUhhuLHPHFOtzHWoWKKl8S0LDmZLuuwxXQao0o1JwoUOTOkzl0yvUyPLM3iBsSRp0tICeooxxoYTVzq0h9S0j0tdRCzXBaMmibpeRbOzVQs8b-yduDUNiQmY2L1eJwzCQPWWMttB17ZjtaAoI1u_4t3tmfUInw-n7OBmPJm936BS8Xtcj3qNGsSztAzrWP8V8tXysFssfs5vCyg |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2023+IEEE+International+Parallel+and+Distributed+Processing+Symposium+Workshops+%28IPDPSW%29&rft.atitle=Developing+Distributed+High-performance+Computing+Capabilities+of+an+Open+Science+Platform+for+Robust+Epidemic+Analysis&rft.au=Collier%2C+Nicholson&rft.au=Wozniak%2C+Justin+M.&rft.au=Stevens%2C+Abby&rft.au=Babuji%2C+Yadu&rft.date=2023-05-01&rft.pub=IEEE&rft.spage=868&rft.epage=877&rft_id=info:doi/10.1109%2FIPDPSW59300.2023.00143&rft.externalDocID=10196539 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2164-7062&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2164-7062&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2164-7062&client=summon |