Predicting service metrics for cluster-based services using real-time analytics

Predicting the performance of cloud services is intrinsically hard. In this work, we pursue an approach based upon statistical learning, whereby the behaviour of a system is learned from observations. Specifically, our testbed implementation collects device statistics from a server cluster and uses...

Full description

Saved in:
Bibliographic Details
Published in:2015 11th International Conference on Network and Service Management (CNSM) pp. 135 - 143
Main Authors: Yanggratoke, Rerngvit, Ahmed, Jawwad, Ardelius, John, Flinta, Christofer, Johnsson, Andreas, Gillblad, Daniel, Stadler, Rolf
Format: Conference Proceeding
Language:English
Published: IFIP 01.11.2015
Subjects:
cloud computing
Computational modeling
machine learning
Measurement
network analytics
Predictive models
Quality of service
Real-time systems
Servers
Statistical learning
Yttrium
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Predicting the performance of cloud services is intrinsically hard. In this work, we pursue an approach based upon statistical learning, whereby the behaviour of a system is learned from observations. Specifically, our testbed implementation collects device statistics from a server cluster and uses a regression method that accurately predicts, in real-time, client-side service metrics for a video streaming service running on the cluster. The method is service-agnostic in the sense that it takes as input operating-systems statistics instead of service-level metrics. We show that feature set reduction significantly improves prediction accuracy in our case, while simultaneously reducing model computation time. We also discuss design and implementation of a real-time analytics engine, which processes streams of device statistics and service metrics from testbed sensors and produces model predictions through online learning.
DOI:10.1109/CNSM.2015.7367349