Deep Reinforcement Learning techniques for dynamic task offloading in the 5G edge-cloud continuum

The integration of new Internet of Things (IoT) applications and services heavily relies on task offloading to external devices due to the constrained computing and battery resources of IoT devices. Up to now, Cloud Computing (CC) paradigm has been a good approach for tasks where latency is not crit...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of cloud computing : advances, systems and applications Jg. 13; H. 1; S. 94 - 24
Hauptverfasser: Nieto, Gorka, de la Iglesia, Idoia, Lopez-Novoa, Unai, Perfecto, Cristina
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Berlin/Heidelberg Springer Berlin Heidelberg 01.12.2024
Springer Nature B.V
SpringerOpen
Schlagworte:
Algorithms
Cloud computing
Computation offloading
Computer Communication Networks
Computer Science
Computer System Implementation
Computer Systems Organization and Communication Networks
Deep learning
Edge computing
Energy consumption
Information Systems Applications (incl.Internet)
Internet of Things
Mobile computing
Mobile Edge Computing Meets AI
Multi-access Edge Computing (MEC)
Performance evaluation
Quality-of-Experience (QoE)
Reinforcement Learning (RL)
Software Engineering/Programming and Operating Systems
Special Purpose and Application-Based Systems
Task offloading
Performance evaluation
Energy consumption
Internet of Things (IoT)
Quality-of-Experience (QoE)
Multi-access Edge Computing (MEC)
Edge-Cloud-Continuum
Task offloading
Reinforcement Learning (RL)
ISSN:2192-113X, 2192-113X
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The integration of new Internet of Things (IoT) applications and services heavily relies on task offloading to external devices due to the constrained computing and battery resources of IoT devices. Up to now, Cloud Computing (CC) paradigm has been a good approach for tasks where latency is not critical, but it is not useful when latency matters, so Multi-access Edge Computing (MEC) can be of use. In this work, we propose a distributed Deep Reinforcement Learning (DRL) tool to optimize the binary task offloading decision, this is, the independent decision of where to execute each computing task, depending on many factors. The optimization goal in this work is to maximize the Quality-of-Experience (QoE) when performing tasks, which is defined as a metric related to the battery level of the UE, but subject to satisfying tasks’ latency requirements. This distributed DRL approach, specifically an Actor-Critic (AC) algorithm running on each User Equipment (UE), is evaluated through the simulation of two distinct scenarios and outperforms other analyzed baselines in terms of QoE values and/or energy consumption in dynamic environments, also demonstrating that decisions need to be adapted to the environment’s evolution.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2192-113X
2192-113X
DOI:10.1186/s13677-024-00658-0