PHDFS: Optimizing I/O performance of HDFS in deep learning cloud computing platform

For deep learning cloud computing platforms, file system is a fundamental and critical component. Hadoop distributed file system (HDFS) is widely used in large scale clusters due to its high performance and high availability. However, in deep learning datasets, the number of files is huge but the fi...

Full description

Bibliographic Details

Published in:	Journal of systems architecture Vol. 109; p. 101810
Main Authors:	Zhu, Zongwei, Tan, Luchao, Li, Yinzhen, Ji, Cheng
Format:	Journal Article
Language:	English
Published:	Elsevier B.V 01.10.2020
Subjects:	Cloud computing Deep learning Distributed file system Small files Deep learning Cloud computing Small files Distributed file system
ISSN:	1383-7621, 1873-6165
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!