CD-MSA: Cooperative and Deadline-Aware Scheduling for Efficient Multi-Tenancy on DNN Accelerators

With DNN turning into the backbone of AI cloud services and propelling the emergence of INFerence-as-a-Service (INFaaS), DNN-specific accelerators have become the indispensable components of cloud inference systems. Due to the conservative "one-task-at-a-time" working mode and deadline bli...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE transactions on parallel and distributed systems Vol. 34; no. 7; pp. 1 - 17
Main Authors:	Wang, Chunyang, Bai, Yuebin, Sun, Desen
Format:	Journal Article
Language:	English
Published:	New York IEEE 01.07.2023 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	Accelerators Arrays Computer architecture deep neural networks domain-specific architectures Hardware Inference Preempting Processor scheduling Quality of service Real-time systems Run time (computers) Scheduling scheduling and task partitioning Switches System-on-chip Systolic arrays Task analysis Throughput
ISSN:	1045-9219, 1558-2183
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!