nvshare: Practical GPU Sharing Without Memory Size Constraints

GPUs are essential for accelerating Machine Learning (ML) work-loads. A common practice is deploying ML jobs as containers managed by an orchestrator such as Kubernetes. Kubernetes schedules GPU workloads by exclusively assigning a device to a single job, which leads to massive GPU underutilization,...

Full description

Bibliographic Details

Published in:	Proceedings (IEEE/ACM International Conference on Software Engineering Companion. Online) pp. 16 - 20
Main Authors:	Alexopoulos, Georgios, Mitropoulos, Dimitris
Format:	Conference Proceeding
Language:	English
Published:	ACM 14.04.2024
Subjects:	Containers Graphics Processing Unit Graphics processing units Machine learning Memory management Random access memory Reliability Resource Sharing Schedules
ISSN:	2574-1934
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!