CD-MSA: Cooperative and Deadline-Aware Scheduling for Efficient Multi-Tenancy on DNN Accelerators

With DNN turning into the backbone of AI cloud services and propelling the emergence of INFerence-as-a-Service (INFaaS), DNN-specific accelerators have become the indispensable components of cloud inference systems. Due to the conservative "one-task-at-a-time" working mode and deadline bli...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	IEEE transactions on parallel and distributed systems Jg. 34; H. 7; S. 1 - 17
Hauptverfasser:	Wang, Chunyang, Bai, Yuebin, Sun, Desen
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	New York IEEE 01.07.2023 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:	Accelerators Arrays Computer architecture deep neural networks domain-specific architectures Hardware Inference Preempting Processor scheduling Quality of service Real-time systems Run time (computers) Scheduling scheduling and task partitioning Switches System-on-chip Systolic arrays Task analysis Throughput
ISSN:	1045-9219, 1558-2183
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Schreiben Sie den ersten Kommentar!