MDLoader: A Hybrid Model-Driven Data Loader for Distributed Graph Neural Network Training

Scalable data management is essential for processing large scientific dataset on HPC platforms for distributed deep learning. In-memory distributed storage is preferred for its speed, enabling rapid, random, and frequent data access required by stochastic optimizers. Processes use one-sided or colle...

Full description

Bibliographic Details

Published in:	SC24-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis pp. 1046 - 1057
Main Authors:	Bae, Jonghyun, Choi, Jong Youl, Pasini, Massimiliano Lupo, Mehta, Kshitij, Zhang, Pei, Ibrahim, Khaled Z.
Format:	Conference Proceeding
Language:	English
Published:	IEEE 17.11.2024
Subjects:	Data models Distributed databases Graph Neural Network Graph neural networks Libraries Load modeling Loading Low latency communication MPI communication Multiprocessor interconnection Performance estimator Stochastic processes Training
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!