Search Results - "Parallel I/O"

HDF5 in the exascale era: Delivering efficient and scalable parallel I/O for exascale applications

Authors: Breitenfeld, M Scot Tang, Houjun Zheng, Huihuo et al.

Source: The International Journal of High Performance Computing Applications. 39(1)

Subject Terms: Distributed Computing and Systems Software, Information and Computing Sciences, Affordable and Clean Energy, Hierarchical data format version 5, parallel I/O, I/O performance, virtual object layer, asynchronous I/O, caching I/O, subfiling, Distributed Computing, Applied computing, Distributed computing and systems software

File Description: application/pdf

Access URL: https://escholarship.org/uc/item/7hk1591p
https://escholarship.org/content/qt7hk1591p/qt7hk1591p.pdf

Object-Centric Data Management in HPC Workflows - A Case Study

Authors: Wang, Chen Tang, Houjun Bez, Jean Luca et al.

Source: 2024 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING WORKSHOPS, CLUSTER WORKSHOPS 2024. 00

Subject Terms: 4606 Distributed Computing and Systems Software (for-2020), 46 Information and Computing Sciences (for-2020), 4601 Applied Computing (for-2020), Parallel I/O, Object Stores, HPC Workflow

File Description: application/pdf

Access URL: https://escholarship.org/uc/item/15s7k2f4
https://escholarship.org/content/qt15s7k2f4/qt15s7k2f4.pdf

Job-aware Striping Optimization Approach via Job Paths in Storage Systems

Authors: XIAN Gang, YANG Wenxiang, ZHANG Xiaorong, YU Jie, TIAN Yongqiang

Source: Jisuanji gongcheng, Vol 51, Iss 3, Pp 34-44 (2025)

Subject Terms: job awareness, file striping, high performance computing (hpc), parallel i/o, storage system, Computer engineering. Computer hardware, TK7885-7895, Computer software, QA76.75-76.765

File Description: electronic resource

Relation: https://www.ecice06.com/fileup/1000-3428/PDF/20250303.pdf; https://doaj.org/toc/1000-3428

Access URL: https://doaj.org/article/c465faa441b647a096543b91ab366106

IO-Sets: Simple and Efficient Approaches for I/O Bandwidth Management

Authors: Francieli Boito Guillaume Pallez Luan Teylo et al.

Contributors: Francieli Boito Guillaume Pallez Luan Teylo et al.

Source: IEEE Transactions on Parallel and Distributed Systems. 34:2783-2796

Subject Terms: I/O performance, I/O Scheduling, Parallel I/O, Resource management, HPC, I/O scheduling, [INFO.INFO-DC] Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC], [INFO.INFO-DS] Computer Science [cs]/Data Structures and Algorithms [cs.DS], Bandwidth Management

File Description: application/pdf

Access URL: https://inria.hal.science/hal-03773392v1
https://inria.hal.science/hal-03648225v3/document
https://doi.org/10.1109/tpds.2023.3305028
https://inria.hal.science/hal-03648225v3

I/O performance of multiscale finite element simulations on HPC environments

Authors: Boito, Francieli Gomes, Antonio Peyrondet, Louis et al.

Contributors: Boito, Francieli Gomes, Antonio Peyrondet, Louis et al.

Source: 2022 International Symposium on Computer Architecture and High Performance Computing Workshops (SBAC-PADW)

Subject Terms: I/O kernel, parallel I/O, mini-app, [INFO.INFO-DC] Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC], 0101 mathematics, High-performance computing, 01 natural sciences, multiscale simulation, numeric library

File Description: application/pdf

Access URL: https://inria.hal.science/hal-03808833v1

Understanding the Impact of OpenPMD on BIT1, a Particle-in-Cell Monte Carlo Code, Through Instrumentation, Monitoring, and In-Situ Analysis

Authors: Williams, Jeremy J. Costea, Stefan Malony, Allen D. et al.

Source: Euro-Par 2024: Parallel Processing Workshops - Euro-Par 2024 International Workshops, Proceedings. :214-226

Subject Terms: ADIOS2, Cray Apprentice2, CrayPat, Darshan, Distributed Storage, Efficient Data Processing, gprof, In-Situ Analysis, IPM, Large-Scale PIC Simulations, openPMD, Parallel I/O, Performance Monitoring and Analysis

File Description: print

Access URL: https://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-368833

The role of storage target allocation in applications’ I/O performance with BeeGFS

Authors: Boito, Francieli Pallez, Guillaume Teylo, Luan et al.

Contributors: Boito, Francieli Pallez, Guillaume Teylo, Luan et al.

Source: 2022 IEEE International Conference on Cluster Computing (CLUSTER)

Subject Terms: I/O performance, Parallel file system, parallel I/O, stripe count, [INFO.INFO-DC] Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC], 0202 electrical engineering, electronic engineering, information engineering, 02 engineering and technology, BeeGFS, performance evaluation

File Description: application/pdf

Access URL: https://inria.hal.science/hal-03753813v1

Understanding the I/O Impact on the Performance of High-Throughput Molecular Docking

Authors: MARKIDIS, STEFANO GADIOLI, DAVIDE VITALI, EMANUELE et al.

Source: PDSW 2021 (SC21 Workshop) 6TH INTERNATIONAL PARALLEL DATA SYSTEMS WORKSHOP (HELD IN CONJUNCTION WITH SC21: THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS)
2021 IEEE/ACM Sixth International Parallel Data Systems Workshop (PDSW)

Subject Terms: 0301 basic medicine, 03 medical and health sciences, Darshan, Parallel I/O, 0202 electrical engineering, electronic engineering, information engineering, I/O Profiling, 02 engineering and technology, High-Throughput Molecular Docking, Parallel I/O, Darshan, I/O Profiling, High-Throughput Molecular Docking

File Description: application/pdf

Access URL: https://hdl.handle.net/11311/1198330
https://doi.org/10.1109/PDSW54622.2021.00007

hpc.bw: an evaluation of short-term performance engineering projects

Authors: Duffek, Johann Antonio Bechelaoui, Imane Leinen, Willi Günter et al.

Subject Terms: Performance engineering, Parallel I/O, hpc.bw, HPC, Fortran, dtec.bw

Scheduling Distributed I/O Resources in HPC Systems

Authors: Bandet, Alexis Boito, Francieli Pallez, Guillaume

Contributors: Bandet, Alexis Boito, Francieli Pallez, Guillaume

Source: Lecture Notes in Computer Science ISBN: 9783031695766

Subject Terms: I/O forwarding, [SCCO.COMP] Cognitive science/Computer science, parallel I/O, HPC, [INFO.INFO-DC] Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC], resource allocation, parallel file system, scheduling, object storage targets

File Description: application/pdf

Access URL: https://inria.hal.science/hal-04394004v2

ExaHDF5: Delivering Efficient Parallel I/O on Exascale Computing Systems

Authors: Byna, Surendra Breitenfeld, Scot Dong, Bin et al.

Source: Journal of Computer Science and Technology. 35(1)

Subject Terms: HDF5, Parallel I/O, Data querying, 4605 Data Management and Data Science (for-2020), 4606 Distributed Computing and Systems Software (for-2020), 46 Information and Computing Sciences (for-2020), 7 Affordable and Clean Energy (sdg), parallel I, O, Hierarchical Data Format version 5 (HDF5), I, O performance, virtual object layer, HDF5 optimizations, 08 Information and Computing Sciences (for), Software Engineering (science-metrix), 46 Information and computing sciences (for-2020)

File Description: application/pdf

Access URL: https://escholarship.org/uc/item/9x80d9n2
https://escholarship.org/content/qt9x80d9n2/qt9x80d9n2.pdf

CIOFC1.0: a Common Parallel Input/Output Framework Based on C-Coupler2.0

Authors: X. Yu L. Liu C. Sun et al.

Source: Geoscientific Model Development, Vol 16, Pp 6285-6308 (2023)

Subject Terms: QE1-996.5, parallel I/O, Geology

File Description: application/pdf

Access URL: https://gmd.copernicus.org/articles/16/6285/2023/
https://doaj.org/article/1bf48e4537744b79874fe0d937694acb

Hierarchical Semi-Sparse Cubes—Parallel Framework for Storing Multi-Modal Big Data in HDF5

Authors: Jiri Nadvornik Petr Skoda Pavel Tvrdik

Source: IEEE Access, Vol 11, Pp 119876-119897 (2023)

Subject Terms: Big data, multi-modal data, multi-dimensional data, semi-sparse data, HDF5, parallel I/O, Electrical engineering. Electronics. Nuclear engineering, TK1-9971

File Description: electronic resource

Relation: https://ieeexplore.ieee.org/document/10278401/; https://doaj.org/toc/2169-3536

Access URL: https://doaj.org/article/b71c4ddc08e8461da00a28cde3b68a2a

DXT: Darshan eXtended Tracing

Authors: Xu, Cong Snyder, Shane Kulkarni, Omkar et al.

Source: Cray User Group (CUG) meeting 2017

Subject Terms: Darshan, I/O tracing, Parallel I/O, I/O performance

Access URL: https://escholarship.org/uc/item/5rh6h9qv

Evaluation and optimisation of the I/O scalability for the next generation of Earth system models: IFS CY43R3 and XIOS 2.0 integration as a case study

Authors: Yepes-Arbós, Xavier van den Oord, Gijs Acosta, Mario C. et al.

Contributors: Yepes-Arbós, Xavier van den Oord, Gijs Acosta, Mario C. et al.

Source: UPCommons. Portal del coneixement obert de la UPC
Universitat Politècnica de Catalunya (UPC)
Geoscientific Model Development, Vol 15, Pp 379-394 (2022)
Geoscientific Model Development

Subject Terms: QE1-996.5, Àrees temàtiques de la UPC::Informàtica::Aplicacions de la informàtica, Parallel I/O, Climatologia -- Models matemàtics, Geology, Earth system models, 15. Life on land, 01 natural sciences, Climate models, Climatology -- Mathematical models, Informàtica::Aplicacions de la informàtica [Àrees temàtiques de la UPC], Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors, 13. Climate action, Informàtica::Arquitectura de computadors [Àrees temàtiques de la UPC], 0105 earth and related environmental sciences

File Description: application/pdf

Access URL: https://gmd.copernicus.org/articles/15/379/2022/gmd-15-379-2022.pdf
https://gmd.copernicus.org/articles/15/379/2022/
https://doaj.org/article/1a6c72aca43f4462810bb430363732ae
https://gmd.copernicus.org/preprints/gmd-2021-65/gmd-2021-65.pdf
https://gmd.copernicus.org/preprints/gmd-2021-65/

Fully Parallel Mesh I/O Using PETSc DMPlex with an Application to Waveform Modeling

Authors: Hapla, Vaclav Knepley, Matthew G. Afanasiev, Michael et al.

Source: SIAM Journal on Scientific Computing, 43 (2)
SIAM Journal on Scientific Computing

Subject Terms: FOS: Computer and information sciences, Parallel I/O, DMPlex, Unstructured mesh, Directed acyclic graph, Partitioning, Topological interpolation, PETSc, Seismic waveform modeling, Spectral-element method, Numerical Analysis (math.NA), 65-04, 65Y05, 65M50, 05C90, 35L05, 01 natural sciences, FOS: Mathematics, Computer Science - Mathematical Software, Mathematics - Numerical Analysis, 0101 mathematics, Mathematical Software (cs.MS), 0105 earth and related environmental sciences

File Description: application/application/pdf

Access URL: http://arxiv.org/pdf/2004.08729
http://arxiv.org/abs/2004.08729
http://ui.adsabs.harvard.edu/abs/2020arXiv200408729H/abstract
https://arxiv.org/abs/2004.08729
http://arxiv.org/pdf/2004.08729.pdf
http://export.arxiv.org/pdf/2004.08729
http://hdl.handle.net/20.500.11850/463520

Implementation of an unbalanced I/O Bandwidth Management system in a Parallel File System

Authors: Barthélemy, Clément Zanon Boito, Francieli Jeannot, Emmanuel et al.

Contributors: Barthélemy, Clément Zanon Boito, Francieli Jeannot, Emmanuel et al.

Source: RR-9537, Inria. 2024

Subject Terms: E/S parallèles, High-performance Computing, parallel I/O, parallel file systems, I/O scheduling, ordonnancement d'E/S, [INFO.INFO-DC]Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC], calcul hautes performances

Access URL: https://inria.hal.science/hal-04417412v1/document
https://inria.hal.science/hal-04417412v1/file/main.pdf
https://inria.hal.science/hal-04417412

Allocation and Placement Algorithms for Scheduling Distributed I/O Resources in HPC Systems

Authors: Bandet, Alexis Zanon Boito, Francieli Pallez, Guillaume

Contributors: Bandet, Alexis Zanon Boito, Francieli Pallez, Guillaume

Subject Terms: I/O forwarding, HPC, parallel I/O, [INFO.INFO-DC] Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC], parallel file system, scheduling, object storage targets, Resource Allocation

File Description: application/pdf

Access URL: https://hal.science/hal-04593977v1

Reducing I/O variability using dynamic I/O path characterization in petascale storage systems

Contributors: Choudhary, Alok [Northwestern Univ., Evanston, IL (United States)]

Source: Journal of Supercomputing; 73; 5

File Description: Medium: ED; Size: p. 2069-2097

Access URL: http://www.osti.gov/scitech/servlets/purl/1356839

Implementation of an unbalanced I/O Bandwidth Management system in a Parallel File System ; Implémentation d'un ordonnancement déséquilibré d'E/S dans un système de fichiers parallèle

Authors: Barthélemy, Clément Zanon Boito, Francieli Jeannot, Emmanuel et al.

Contributors: Barthélemy, Clément Zanon Boito, Francieli Jeannot, Emmanuel et al.

Source: https://inria.hal.science/hal-04417412 ; RR-9537, Inria. 2024.

Subject Terms: High-performance Computing, parallel I/O, parallel file systems, I/O scheduling, calcul hautes performances, E/S parallèles, ordonnancement d’E/S, [INFO.INFO-DC]Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC]

Relation: info:eu-repo/grantAgreement//956748/EU/Adaptive multi-tier intelligent data manager for Exascale/ADMIRE

Availability: https://inria.hal.science/hal-04417412
https://inria.hal.science/hal-04417412v1/document
https://inria.hal.science/hal-04417412v1/file/main.pdf