Achieving Scalability in a k-NN Multi-GPU Network Service with Centaur

Centaur is a GPU-centric architecture for building a low-latency approximate k-Nearest-Neighbors network server. We implement a multi-GPU distributed data flow runtime which enables efficient and scalable network request processing on GPUs. The runtime eliminates GPU management overheads from the CP...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings / International Conference on Parallel Architectures and Compilation Techniques pp. 245 - 257
Main Authors: Watad, Amir, Libov, Alexander, Shacham, Ohad, Bortnikov, Edward, Silberstein, Mark
Format: Conference Proceeding
Language:English
Published: IEEE 01.09.2019
Subjects:
Approximation algorithms
Clustering algorithms
Computer architecture
GPU
Graphics processing units
Kernel
Parallel Computing
Servers
Throughput
ISSN:2641-7936
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Centaur is a GPU-centric architecture for building a low-latency approximate k-Nearest-Neighbors network server. We implement a multi-GPU distributed data flow runtime which enables efficient and scalable network request processing on GPUs. The runtime eliminates GPU management overheads from the CPU, making the server throughput and response time largely agnostic to the CPU load, speed or the number of dedicated CPU cores. Our experiments systems show that our server achieves near-perfect scaling for 16 GPUs, beating the throughput of a highly-optimized CPU-driven server by 35% while maintaining about 2msec average request latency. Furthermore, it requires only a single CPU core to run, achieving over an order of magnitude higher throughput than the standard CPU-driven server architecture in this setting.
ISSN:2641-7936
DOI:10.1109/PACT.2019.00027