Enabling Efficient Large Recommendation Model Training with Near CXL Memory Processing

Personalized recommendation systems have become one of the most important Internet services nowadays. A critical challenge of training and deploying the recommendation models is their high memory capacity and bandwidth demands, with the embedding layers occupying hundreds of GBs to TBs of storage. T...

Full description

Bibliographic Details

Published in:	2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA) pp. 382 - 395
Main Authors:	Liu, Haifeng, Zheng, Long, Huang, Yu, Zhou, Jingyi, Liu, Chaoqiang, Wang, Runze, Liao, Xiaofei, Jin, Hai, Xue, Jingling
Format:	Conference Proceeding
Language:	English
Published:	IEEE 29.06.2024
Subjects:	Bandwidth Data transfer Degradation Hardware Memory management Prefetching Recommender systems Scalability Training Web and internet services
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!