Omnisc'IO a grammar-based approach to spatial and temporal I/O patterns prediction

The increasing gap between the computation performance of post-petascale machines and the performance of their I/O subsystem has motivated many I/O optimizations including prefetching, caching, and scheduling techniques. In order to further improve these techniques, modeling and predicting spatial a...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis s. 623 - 634
Hlavní autoři: Dorier, Matthieu, Ibrahim, Shadi, Antoniu, Gabriel, Ross, Rob
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: Piscataway, NJ, USA IEEE Press 16.11.2014
IEEE
Edice:ACM Conferences
Témata:
Computer systems organization > Dependable and fault-tolerant systems and networks
Context
Exascale
General and reference > Cross-computing tools and techniques > Performance
Grammar
Hidden Markov models
HPC
I/O
Libraries
Networks > Network performance evaluation
Omnisc'IO
Prediction
Prediction algorithms
Predictive models
Prefetching
Software and its engineering > Software organization and properties > Contextual software domains > Operating systems > Communications management > Input > output
Storage
Theory of computation > Formal languages and automata theory > Formalisms > Rewrite systems
Theory of computation > Formal languages and automata theory > Grammars and context-free languages
grammar
exascale
I/O
prediction
HPC
storage
Omnisc'IO
ISBN:1479955000, 9781479955008
ISSN:2167-4329
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract The increasing gap between the computation performance of post-petascale machines and the performance of their I/O subsystem has motivated many I/O optimizations including prefetching, caching, and scheduling techniques. In order to further improve these techniques, modeling and predicting spatial and temporal I/O patterns of HPC applications as they run has became crucial. In this paper we present Omnisc'IO, an approach that builds a grammar-based model of the I/O behavior of HPC applications and uses it to predict when future I/O operations will occur, and where and how much data will be accessed. Omnisc'IO is transparently integrated into the POSIX and MPI I/O stacks and does not require any modification in applications or higher-level I/O libraries. It works without any prior knowledge of the application and converges to accurate predictions within a couple of iterations only. Its implementation is efficient in both computation time and memory footprint.
AbstractList The increasing gap between the computation performance of post-petascale machines and the performance of their I/O subsystem has motivated many I/O optimizations including prefetching, caching, and scheduling techniques. In order to further improve these techniques, modeling and predicting spatial and temporal I/O patterns of HPC applications as they run has became crucial. In this paper we present Omnisc'IO, an approach that builds a grammar-based model of the I/O behavior of HPC applications and uses it to predict when future I/O operations will occur, and where and how much data will be accessed. Omnisc'IO is transparently integrated into the POSIX and MPI I/O stacks and does not require any modification in applications or higher-level I/O libraries. It works without any prior knowledge of the application and converges to accurate predictions within a couple of iterations only. Its implementation is efficient in both computation time and memory footprint.
The increasing gap between the computation performance of post-petascale machines and the performance of their I/O subsystem has motivated many I/O optimizations including prefetching, caching, and scheduling techniques. In order to further improve these techniques, modeling and predicting spatial and temporal I/O patterns of HPC applications as they run has became crucial. In this paper we present Omnisc'IO, an approach that builds a grammar-based model of the I/O behavior of HPC applications and uses it to predict when future I/O operations will occur, and where and how much data will be accessed. Omnisc'IO is transparently integrated into the POSIX and MPI I/O stacks and does not require any modification in applications or higher level I/O libraries. It works without any prior knowledge of the application and converges to accurate predictions within a couple of iterations only. Its implementation is efficient in both computation time and memory footprint.
Author Ibrahim, Shadi
Dorier, Matthieu
Antoniu, Gabriel
Ross, Rob
Author_xml – sequence: 1
  givenname: Matthieu
  surname: Dorier
  fullname: Dorier, Matthieu
  email: matthieu.dorier@irisa.fr
  organization: ENS Rennes, IRISA, Rennes, France
– sequence: 2
  givenname: Shadi
  surname: Ibrahim
  fullname: Ibrahim, Shadi
  email: shadi.ibrahim@inria.fr
  organization: Inria, Centre de Rennes Bretagne-Atlanique, France
– sequence: 3
  givenname: Gabriel
  surname: Antoniu
  fullname: Antoniu, Gabriel
  email: gabriel.antoniu@inria.fr
  organization: Inria, Centre de Rennes Bretagne-Atlanique, France
– sequence: 4
  givenname: Rob
  surname: Ross
  fullname: Ross, Rob
  email: rross@mcs.anl.gov
  organization: Argonne National Laboratory, Argonne, IL
BookMark eNqFjz1PwzAYhI0oEmnpwsrIgBgSXn_bI4r4qFQpQ9vZsuPXUoAkKGbh35OqMDOd7p7TSbcki2EckJBrChWlYB92dcWAikqqM7KkQlsrhbX8_M9IAFiQglGlS8GZvSTrnN_mkAqpKJMFKZp-6HJ7t2muyEXyHxnXv7oih-enff1abpuXTf24LT3j-qtEDT5GFVmbDDcqGI9aR8-AW-mT0QIgaoUGJCjRQhsDglUiCREwJUC-Ijen3Q4R3efU9X76dhooB25men-ivu1dGMf37Ci441m3q93xrJPKhanDNHdv_-_yH5k-Tnc
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/SC.2014.56
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE/IET Electronic Library (IEL) (UW System Shared)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 1479954993
9781479955008
9781479954995
1479955000
EndPage 634
ExternalDocumentID 7013038
Genre orig-research
GroupedDBID 6IE
6IF
6IK
6IL
6IN
AAJGR
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
IEGSK
IERZE
OCL
RIE
RIL
6IH
AAWTH
ABLEC
ADZIZ
CHZPO
IPLJI
ID FETCH-LOGICAL-a237t-e70add6d2cf8386b8ae77da20395af87400d76e805064c0cdbe0964f44beff0e3
IEDL.DBID RIE
ISBN 1479955000
9781479955008
ISICitedReferencesCount 32
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000393484400051&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2167-4329
IngestDate Wed Aug 27 01:54:35 EDT 2025
Wed Jan 31 06:40:24 EST 2024
IsPeerReviewed false
IsScholarly false
Keywords grammar
exascale
I/O
prediction
HPC
storage
Omnisc'IO
Language English
LinkModel DirectLink
MeetingName SC '14: International Conference for High Performance Computing, Networking, Storage and Analysis
MergedId FETCHMERGED-LOGICAL-a237t-e70add6d2cf8386b8ae77da20395af87400d76e805064c0cdbe0964f44beff0e3
PageCount 12
ParticipantIDs ieee_primary_7013038
acm_books_10_1109_SC_2014_56_brief
acm_books_10_1109_SC_2014_56
PublicationCentury 2000
PublicationDate 20141116
2014-Nov.
PublicationDateYYYYMMDD 2014-11-16
2014-11-01
PublicationDate_xml – month: 11
  year: 2014
  text: 20141116
  day: 16
PublicationDecade 2010
PublicationPlace Piscataway, NJ, USA
PublicationPlace_xml – name: Piscataway, NJ, USA
PublicationSeriesTitle ACM Conferences
PublicationTitle Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
PublicationTitleAbbrev SC
PublicationYear 2014
Publisher IEEE Press
IEEE
Publisher_xml – name: IEEE Press
– name: IEEE
SSID ssj0001456125
ssj0001947932
ssj0003204180
Score 1.7454239
Snippet The increasing gap between the computation performance of post-petascale machines and the performance of their I/O subsystem has motivated many I/O...
SourceID ieee
acm
SourceType Publisher
StartPage 623
SubjectTerms Computer systems organization -- Dependable and fault-tolerant systems and networks
Context
Exascale
General and reference -- Cross-computing tools and techniques -- Performance
Grammar
Hidden Markov models
HPC
I/O
Libraries
Networks -- Network performance evaluation
Omnisc'IO
Prediction
Prediction algorithms
Predictive models
Prefetching
Software and its engineering -- Software organization and properties -- Contextual software domains -- Operating systems -- Communications management -- Input -- output
Storage
Theory of computation -- Formal languages and automata theory -- Formalisms -- Rewrite systems
Theory of computation -- Formal languages and automata theory -- Grammars and context-free languages
Subtitle a grammar-based approach to spatial and temporal I/O patterns prediction
Title Omnisc'IO
URI https://ieeexplore.ieee.org/document/7013038
WOSCitedRecordID wos000393484400051&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dS8MwED_c8MEnv3F-EUTwxbo06ZrWtzn8AnGDKfhW0uQCA9fJNv37zWV1Iogg9KFpKS2XK7_cXe73Azi1sfW4gWXkjJORX9-KqLS5iGJtDCp_cAwkrg_q8TF7eckHK3C-7IVBxLD5DC_oNNTy7cS8U6qsrajMJrMGNJRKF71a3_kUWgnUvhnGOeWMxHIsBU_iIKQmAtW3FHnNVhrzvD3s0S6v5IJ0rBvajH9orQSouVn_30duwM53zx4bLNFoE1aw2oL1L9EGVv_D2zDsj6vRzJzd9y9Zl91ONTWvRVcezCzr1gTjbD5hpFXsfZPpyrKnBX_VK7tv99kgMHJWM_82KvLQxO7A8831U-8uqpUVIi2kmkd-CjRJSQnjMpmlZaZRKasFl3lHO1Lp41almHGiszPc2BJ9qJO4JCnROY5yF5rVpMI9YKlKeSl13Ck92huXZCGi5EYLVFmO2IJDb8-CQoZZESIOnhfDXkHmLjppC07-ul2U0xG6FmyTnYu3BQFHUZt4__fLB7BGTy8aBg-hOZ--4xGsmo_5aDY9Dl7zCZ1gujA
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3fi9NAEB7uqqBP1buK1aqLCL6Y62Y3zSa-ncXzir220B70bdnszkLBS6U__Pvd2cYeghwIecgmkITZCd_OzM73AXxwqQu4gVXirZdJWN-KpHKlSFJjLapwcIwkrmM1mRTLZTk7gU_HXhhEjJvP8IJOYy3fre2eUmV9RWU2WZzCo0EW4p5Dt9Z9RoXWAo13xnFJWSNxHEvBszRKqYlI9i1F2fCVprzsz4e0zyu7ICXrU2Pv_lJbiWBz1f6_z3wGnfuuPTY74tFzOMH6DNp_ZBtY8xefw3x6V6-29uNo-pldsm8bQ-1ryZcAZ45dNhTjbLdmpFYcvJOZ2rHFgcHqBxv1p2wWOTnrbXgblXloajtwe_V1MbxOGm2FxAipdkmYBENiUsL6QhZ5VRhUyhnBZTkwnnT6uFM5FpwI7Sy3rsIQ7GQ-yyr0nqN8Aa16XeNLYLnKeSVNOqgC3lufFTGm5NYIVEWJ2IVesKemoGGrY8zBSz0fajK3HuRdeP_QbV1tVui7cE521j8PFBy6MfGrf19-B0-uFzdjPR5Nvr-Gp_SkQ_tgD1q7zR7fwGP7a7fabt5GD_oNgY69dw
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+of+the+International+Conference+for+High+Performance+Computing%2C+Networking%2C+Storage+and+Analysis&rft.atitle=Omnisc%27IO&rft.au=Dorier%2C+Matthieu&rft.au=Ibrahim%2C+Shadi&rft.au=Antoniu%2C+Gabriel&rft.au=Ross%2C+Rob&rft.series=ACM+Conferences&rft.date=2014-11-16&rft.pub=IEEE+Press&rft.isbn=1479955000&rft.spage=623&rft.epage=634&rft_id=info:doi/10.1109%2FSC.2014.56
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2167-4329&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2167-4329&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2167-4329&client=summon