Reducing Communication in Graph Neural Network Training

Graph Neural Networks (GNNs) are powerful and flexible neural networks that use the naturally sparse connectivity information of the data. GNNs represent this connectivity as sparse matrices, which have lower arithmetic intensity and thus higher communication costs compared to dense matrices, making...

Full description

Bibliographic Details

Published in:	International Conference for High Performance Computing, Networking, Storage and Analysis (Online) Vol. 2020; pp. 1 - 14
Main Authors:	Tripathy, Alok, Yelick, Katherine, Buluc, Aydin
Format:	Conference Proceeding Journal Article
Language:	English
Published:	United States IEEE 01.11.2020
Subjects:	Clustering algorithms communication-avoiding algorithms distributed training Graph neural networks MATHEMATICS AND COMPUTING Proteins Sparse matrices Three-dimensional displays Training Two dimensional displays
ISSN:	2167-4329
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!