Gacer: Granularity-Aware Concurrency Regulation for Multi-Tenant Deep Learning

As deep learning continues to advance and is applied to increasingly complex scenarios, the demand for concurrent deployment of multiple neural network models has arisen. This demand, commonly referred to as multi-tenant computing, is becoming more and more important. However, even the most mature G...

Full description

Bibliographic Details

Published in:	Digest of technical papers - IEEE/ACM International Conference on Computer-Aided Design pp. 01 - 09
Main Authors:	Yu, Yongbo, Yu, Fuxun, Tian, Zhi, Chen, Xiang
Format:	Conference Proceeding
Language:	English
Published:	ACM 27.10.2024
Subjects:	Computational modeling Deep learning Low latency communication Optimization Regulation Resource management Runtime Solids Throughput Training
ISSN:	1558-2434
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!