Reinforcement learning based Dynamic Network Self-optimization for heterogeneous networks

The coexistence of different heterogeneous Radio Access Technologies (RATs) is a significant feature of current wireless networks. Thus, it is important for network elements, such as the Base Stations (BSs) of cellular networks or access points (APs) of wireless local area networks (WLANs) to be rec...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2009 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing S. 319 - 324
Hauptverfasser: Feng, Zhiyong, Tan, Li, Li, Wei, Gulliver, T. Aaron
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.08.2009
Schlagworte:
Femtocell networks
Heuristic algorithms
Intelligent agent
LAN interconnection
Land mobile radio cellular systems
Learning
Q-Learning
Radio access networks
Radio access technologies
Reconfigurable system
Reinforcement learning
Self-optimization
Wireless LAN
Wireless networks
ISBN:9781424445608, 1424445604
ISSN:1555-5798
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The coexistence of different heterogeneous Radio Access Technologies (RATs) is a significant feature of current wireless networks. Thus, it is important for network elements, such as the Base Stations (BSs) of cellular networks or access points (APs) of wireless local area networks (WLANs) to be reconfigurable according to the real-time network environment. This will enable interconnection between different networks. In this paper, we propose an efficient distributed reconfiguration algorithm: the Dynamic Network Self-optimization Algorithm (DNSA). This algorithm is based on the widely used Q-learning algorithm and regards the network self-optimization entity of each radio access network as an independent intelligent agent. Multiple agents perform the optimization cooperatively to reduce the system blocking rate and improve network revenue. In the proposed algorithm, the dynamic network self-optimization problem is transformed into a multi-agent reinforcement learning problem, which has much lower complexity and better performance.
ISBN:9781424445608
1424445604
ISSN:1555-5798
DOI:10.1109/PACRIM.2009.5291353