Omnisc'IO a grammar-based approach to spatial and temporal I/O patterns prediction

The increasing gap between the computation performance of post-petascale machines and the performance of their I/O subsystem has motivated many I/O optimizations including prefetching, caching, and scheduling techniques. In order to further improve these techniques, modeling and predicting spatial a...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis s. 623 - 634
Hlavní autori: Dorier, Matthieu, Ibrahim, Shadi, Antoniu, Gabriel, Ross, Rob
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: Piscataway, NJ, USA IEEE Press 16.11.2014
IEEE
Edícia:ACM Conferences
Predmet:
Computer systems organization > Dependable and fault-tolerant systems and networks
Context
Exascale
General and reference > Cross-computing tools and techniques > Performance
Grammar
Hidden Markov models
HPC
I/O
Libraries
Networks > Network performance evaluation
Omnisc'IO
Prediction
Prediction algorithms
Predictive models
Prefetching
Software and its engineering > Software organization and properties > Contextual software domains > Operating systems > Communications management > Input > output
Storage
Theory of computation > Formal languages and automata theory > Formalisms > Rewrite systems
Theory of computation > Formal languages and automata theory > Grammars and context-free languages
grammar
exascale
I/O
prediction
HPC
storage
Omnisc'IO
ISBN:1479955000, 9781479955008
ISSN:2167-4329
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:The increasing gap between the computation performance of post-petascale machines and the performance of their I/O subsystem has motivated many I/O optimizations including prefetching, caching, and scheduling techniques. In order to further improve these techniques, modeling and predicting spatial and temporal I/O patterns of HPC applications as they run has became crucial. In this paper we present Omnisc'IO, an approach that builds a grammar-based model of the I/O behavior of HPC applications and uses it to predict when future I/O operations will occur, and where and how much data will be accessed. Omnisc'IO is transparently integrated into the POSIX and MPI I/O stacks and does not require any modification in applications or higher-level I/O libraries. It works without any prior knowledge of the application and converges to accurate predictions within a couple of iterations only. Its implementation is efficient in both computation time and memory footprint.
ISBN:1479955000
9781479955008
ISSN:2167-4329
DOI:10.1109/SC.2014.56