Multi-Threaded Parallel I/O for OpenMP Applications

Processing large quantities of data is a common scenario for parallel applications. While distributed memory applications are able to improve the performance of their I/O operations by using parallel I/O libraries, there is no support for parallel I/O operations for applications using shared-memory...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:International journal of parallel programming Ročník 43; číslo 2; s. 286 - 309
Hlavní autori: Mehta, Kshitij, Gabriel, Edgar
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Boston Springer US 01.04.2015
Springer Nature B.V
Predmet:
Benchmarks
Compilers
Computer Science
Data processing
Design engineering
Interfaces
Libraries
Message passing
Optimization
Parallel programming
Processor Architectures
Programming
Software Engineering/Programming and Operating Systems
Specifications
Studies
Theory of Computation
Parallel I/O
OpenMP
Shared memory system
ISSN:0885-7458, 1573-7640
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Processing large quantities of data is a common scenario for parallel applications. While distributed memory applications are able to improve the performance of their I/O operations by using parallel I/O libraries, there is no support for parallel I/O operations for applications using shared-memory programming models such as OpenMP available as of today. This paper presents parallel I/O interfaces for OpenMP. We discuss the rationale of our design decisions, present the interface specification, an implementation within the OpenUH compiler and discuss a number of optimizations performed. We demonstrate the benefits of this approach on different file systems for multiple benchmarks and application scenarios. In most cases, we observe significant improvements in I/O performance as compared to the sequential version. Furthermore, we perform a comparison of the OpenMP I/O functions introduced in this paper to message passing interface I/O, and demonstrate the benefits of the new interfaces.
Bibliografia:SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ObjectType-Article-1
ObjectType-Feature-2
content type line 23
ISSN:0885-7458
1573-7640
DOI:10.1007/s10766-014-0306-9