I/O Access Patterns in HPC Applications: A 360-Degree Survey

Saved in:
Bibliographic Details
Title: I/O Access Patterns in HPC Applications: A 360-Degree Survey
Authors: Bez, Jean Luca, Byna, Suren, Ibrahim, Shadi
Contributors: Lawrence Berkeley National Laboratory Berkeley (LBNL), Design and Implementation of Autonomous Distributed Systems (MYRIADS), Centre Inria de l'Université de Rennes, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-SYSTÈMES LARGE ÉCHELLE (IRISA-D1), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom Paris (IMT)-Institut Mines-Télécom Paris (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom Paris (IMT)-Institut Mines-Télécom Paris (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom Paris (IMT)-Institut Mines-Télécom Paris (IMT), ANR-16-CE25-0014,KerStream,Traitement de données massives: allons au-delà d'Hadoop!(2016)
Source: ISSN: 0360-0300 ; ACM Computing Surveys ; https://hal.science/hal-04173899 ; ACM Computing Surveys, 2023, ⟨10.1145/3611007⟩.
Publisher Information: CCSD
Association for Computing Machinery
Publication Year: 2023
Subject Terms: I/O access pattern, HPC I/O, Storage, I/O characterization, [INFO]Computer Science [cs]
Description: International audience ; The high-performance computing (HPC) I/O stack has been complex due to multiple software layers, the inter-dependencies among these layers, and the different performance tuning options for each layer. In this complex stack, the definition of an “I/O access pattern” has been re-appropriated to describe what an application is doing to write or read data from the perspective of different layers of the stack, often comprising a different set of features. It has become common having to redefine what is meant when discussing a pattern in every new study as no assumption can be made. This survey aims to propose a baseline taxonomy, harnessing the I/O community’s knowledge over the last 20 years. This definition can serve as a common ground for HPC I/O researchers and developers to apply known I/O tuning strategies and design new strategies for improving I/O performance. We seek to summarize and bring a consensus with the multiple ways to describe a pattern based on common features already used by the community over the years.
Document Type: article in journal/newspaper
Language: English
DOI: 10.1145/3611007
Availability: https://hal.science/hal-04173899
https://hal.science/hal-04173899v1/document
https://hal.science/hal-04173899v1/file/3611007.pdf
https://doi.org/10.1145/3611007
Rights: http://creativecommons.org/licenses/by/ ; info:eu-repo/semantics/OpenAccess
Accession Number: edsbas.A9065394
Database: BASE
Be the first to leave a comment!
You must be logged in first