Exploring HPC-based scientific software as a service using CometCloud
The use of in-silico simulations in experimental science can greatly increase laboratory efficiency and provide additional insights into interactions not easily described by traditional methods. Such simulations require significant amounts of computational resources, accessible only via supercompute...
Uloženo v:
| Vydáno v: | 10th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing s. 35 - 44 |
|---|---|
| Hlavní autoři: | , , , , , , |
| Médium: | Konferenční příspěvek |
| Jazyk: | angličtina |
| Vydáno: |
ICST
01.10.2014
|
| Témata: | |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | The use of in-silico simulations in experimental science can greatly increase laboratory efficiency and provide additional insights into interactions not easily described by traditional methods. Such simulations require significant amounts of computational resources, accessible only via supercomputers of large-scale high-performance clusters. Due to the complexity of the computational experiments, as well as the usage of the underlying resources, experimental scientists heavily rely on computational scientists with HPC expertise to perform these simulations. This additional bottleneck prevents the widespread adoption of real time in-silico simulation as a driver for laboratory experimentation. In this paper, we aim to overcome this bottleneck by presenting the architecture of an end-to-end framework to enable HPC Software as a Service. This framework is designed to make it easy for scientific applications to run on top of dynamically federated HPC resources. The framework enables HPC resource sharing while maximizing throughput and utilization. We focus specifically on a use case where an experimental scientist uses a mobile portal to control dissipative particle dynamics experiments that are executed on a remote supercomputer (IBM Blue Gene/Q). |
|---|---|
| AbstractList | The use of in-silico simulations in experimental science can greatly increase laboratory efficiency and provide additional insights into interactions not easily described by traditional methods. Such simulations require significant amounts of computational resources, accessible only via supercomputers of large-scale high-performance clusters. Due to the complexity of the computational experiments, as well as the usage of the underlying resources, experimental scientists heavily rely on computational scientists with HPC expertise to perform these simulations. This additional bottleneck prevents the widespread adoption of real time in-silico simulation as a driver for laboratory experimentation. In this paper, we aim to overcome this bottleneck by presenting the architecture of an end-to-end framework to enable HPC Software as a Service. This framework is designed to make it easy for scientific applications to run on top of dynamically federated HPC resources. The framework enables HPC resource sharing while maximizing throughput and utilization. We focus specifically on a use case where an experimental scientist uses a mobile portal to control dissipative particle dynamics experiments that are executed on a remote supercomputer (IBM Blue Gene/Q). |
| Author | Jordan, Kirk E. Parashar, Manish Sachdeva, Vipin Anderson, Richard L. Diaz-Montes, Javier Johnston, Michael AbdelBaky, Moustafa |
| Author_xml | – sequence: 1 givenname: Moustafa surname: AbdelBaky fullname: AbdelBaky, Moustafa email: moustafa.a@rutgers.edu organization: Rutgers Discovery Inf. Inst. (RDI2), Rutgers Univ., Piscataway, NJ, USA – sequence: 2 givenname: Javier surname: Diaz-Montes fullname: Diaz-Montes, Javier email: javidiaz@rdi2.rutgers.edu organization: Rutgers Discovery Inf. Inst. (RDI2), Rutgers Univ., Piscataway, NJ, USA – sequence: 3 givenname: Michael surname: Johnston fullname: Johnston, Michael email: michaelj@ie.ibm.com organization: IBM TJ Watson Res. Center, Cambridge, MA, USA – sequence: 4 givenname: Vipin surname: Sachdeva fullname: Sachdeva, Vipin email: vsachde@us.ibm.com organization: IBM TJ Watson Res. Center, Cambridge, MA, USA – sequence: 5 givenname: Richard L. surname: Anderson fullname: Anderson, Richard L. email: richard.anderson@stfc.ac.uk organization: Hartree Centre, Sci. & Technol. Facilities Council, Warrington, UK – sequence: 6 givenname: Kirk E. surname: Jordan fullname: Jordan, Kirk E. email: kjordan@us.ibm.com organization: IBM TJ Watson Res. Center, Cambridge, MA, USA – sequence: 7 givenname: Manish surname: Parashar fullname: Parashar, Manish email: parashar@rutgers.edu organization: Rutgers Discovery Inf. Inst. (RDI2), Rutgers Univ., Piscataway, NJ, USA |
| BookMark | eNotj8tKxDAUQCMoqGO_wE12rlrzapIupVRHGNCFrofb9EYCbTMkGR9_r6KrszoHziU5XeOKhNxw1ijO7G1wuTQuzjOMMUFBF5dGMK4a0Ror5QmpOmO5lrxjTEl5Tqqcw8iENlppIS7IMHwe5pjC-ka3z309QsaJZhdwLcEHR3P05QMSUsgUaMb0HhzSY_4V-rhg6ed4nK7ImYc5Y_XPDXm9H176bb17enjs73Z1EFKUmndOg_XGGQPG2VFxbxh6rcFPI3jnJydabia01k6sAwbCGc-9NiN0LbNyQ67_ugER94cUFkhfe_Mz3CorvwHzBVM2 |
| ContentType | Conference Proceeding |
| DBID | 6IE 6IL CBEJK RIE RIL |
| DOI | 10.4108/icst.collaboratecom.2014.257833 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP All) 1998-Present |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| EISBN | 9781631900433 1631900439 |
| EndPage | 44 |
| ExternalDocumentID | 7014548 |
| Genre | orig-research |
| GroupedDBID | 6IE 6IL ALMA_UNASSIGNED_HOLDINGS CBEJK RIB RIC RIE RIL |
| ID | FETCH-LOGICAL-i232t-19c6a8f7c77a7c8b41f70ef66afdbafcfdc2517de888d09a0a2c7f1f67ba95083 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 3 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000380476700005&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Wed Dec 20 05:18:47 EST 2023 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-i232t-19c6a8f7c77a7c8b41f70ef66afdbafcfdc2517de888d09a0a2c7f1f67ba95083 |
| OpenAccessLink | http://eudl.eu/pdf/10.4108/icst.collaboratecom.2014.257833 |
| PageCount | 10 |
| ParticipantIDs | ieee_primary_7014548 |
| PublicationCentury | 2000 |
| PublicationDate | 2014-Oct. |
| PublicationDateYYYYMMDD | 2014-10-01 |
| PublicationDate_xml | – month: 10 year: 2014 text: 2014-Oct. |
| PublicationDecade | 2010 |
| PublicationTitle | 10th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing |
| PublicationTitleAbbrev | ColCom |
| PublicationYear | 2014 |
| Publisher | ICST |
| Publisher_xml | – name: ICST |
| SSID | ssib026764622 |
| Score | 1.5872986 |
| Snippet | The use of in-silico simulations in experimental science can greatly increase laboratory efficiency and provide additional insights into interactions not... |
| SourceID | ieee |
| SourceType | Publisher |
| StartPage | 35 |
| SubjectTerms | Computational modeling dissipative particle dymanics Laboratories Monitoring Portals science as a service scientific computing Software as a service Supercomputers |
| Title | Exploring HPC-based scientific software as a service using CometCloud |
| URI | https://ieeexplore.ieee.org/document/7014548 |
| WOSCitedRecordID | wos000380476700005&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEB5qEfGk0opvchC8mJrdhszmXFp6Kj0o9FbylIK00t3q3zezW1cPXjwEQk7JZPgmj2_mA7inInI6Ne6C1VzawnMthOXRYkLCoCS6WItN4GxWLBZ63oHHNhcmhFCTz8KAuvVfvt-4HT2VPSH9gcniAA4QscnV-vadXKGSKs-P4CHhgCRxm5Ur0-W1tWYgdkgKd3JAXkpCub_kVOpoMjn53zxOof-TlsfmbcA5g05Y92DcsujYdD7iFJU8a9IciQXEyoSzn2YbmCmZYWUDDYzo7q8sgUGoRm-bne_Dy2T8PJryvTYCX6UzUMUz7ZQpIjpEg66wMosoQlTKRG9NdNE7KkbmQ7rheqGNMLnDmEWF1pDw6_AcuuvNOlwAK6zWwWl62_BSi2ilzqKMRqXtHSphL6FHJli-N-UvlvvVX_09fA3HZOSG73YD3Wq7C7dw6D6qVbm9q_fsC71jm04 |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEB5qFfWk0opvcxC8mLq7jcnmXFoq1tJDhd5KnlKQrnS3-vfN7NbVgxcPgZBTMhm-yeOb-QBusIicDI0apyVlOrVURpGmXouAhI4zYXwpNiHG43Q2k5MG3NW5MM65knzmOtgt__JtZtb4VHYv8A-MpVuw_cBYElfZWt_ek3DBGU-SXbgNSMBQ3mZh8nB9re3pkB8SAh7roJ-iVO4vQZUyngwO_jeTQ2j_JOaRSR1yjqDhli3o1zw6Mpz0KMYlS6pER-QBkTwg7adaOaJyokhegQNBwvsrCXDgit5btrZteBn0p70h3agj0EU4BRU0loar1AsjhBIm1Sz2InKec-WtVt54a7AcmXXhjmsjqSKVGOFjz4VWKP3aPYbmMlu6EyCpltIZia8blsnIayZjz7ziYYO7PNKn0EITzN-rAhjzzerP_h6-hr3h9Hk0Hz2On85hHw1esd8uoFms1u4SdsxHschXV-X-fQH-H56V |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=10th+IEEE+International+Conference+on+Collaborative+Computing%3A+Networking%2C+Applications+and+Worksharing&rft.atitle=Exploring+HPC-based+scientific+software+as+a+service+using+CometCloud&rft.au=AbdelBaky%2C+Moustafa&rft.au=Diaz-Montes%2C+Javier&rft.au=Johnston%2C+Michael&rft.au=Sachdeva%2C+Vipin&rft.date=2014-10-01&rft.pub=ICST&rft.spage=35&rft.epage=44&rft_id=info:doi/10.4108%2Ficst.collaboratecom.2014.257833&rft.externalDocID=7014548 |