Optimizing Drone Deployment for Maximized User Connectivity in Areas of Interest Via Deep Reinforcement Learning

In areas with limited communication capabilities, such as disaster zones, network service providers can deploy groups of Unmanned Aerial Vehicles (UAVs), commonly referred to as drones, serving as Drone Base Stations (DBSs) to temporarily supplement traditional communication infrastructure. In these...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Journal of network and systems management Ročník 33; číslo 3; s. 49
Hlavní autoři: Rajashekar, Kolichala, Garg, Ashutosh, M. Baswade, Anand, Sidhanta, Subhajit
Médium: Journal Article
Jazyk:angličtina
Vydáno: New York Springer US 01.07.2025
Springer Nature B.V
Témata:
Bandwidths
Communication
Communications Engineering
Computer Communication Networks
Computer Science
Computer Systems Organization and Communication Networks
Connectivity
Deep learning
Deployment
Disasters
Drone aircraft
Drones
Information Systems and Communication Service
Infrastructure
Learning
Markov processes
Networks
Normalization
Objectives
Operations Research/Decision Theory
Optimization
Reinforcement
Robotics
Robots
Unmanned aerial vehicles
Drone base station
Deep reinforcement learning
DBS deployment
Soft actor-critic (SAC) algorithm
Normalized continuous action space for reinforcement learning
Drone disaster emergency communications
ISSN:1064-7570, 1573-7705
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:In areas with limited communication capabilities, such as disaster zones, network service providers can deploy groups of Unmanned Aerial Vehicles (UAVs), commonly referred to as drones, serving as Drone Base Stations (DBSs) to temporarily supplement traditional communication infrastructure. In these regions, people who have survived the disaster adapt their positions to seek protection as the affected area gradually expands. Therefore, it is necessary to change the relative position of the DBSs to ensure adequate network performance and uninterrupted connectivity for users. This objective involves continuously updating the DBS position, which is subject to a long-term objective. To achieve this objective, we use Deep Reinforcement Learning (DRL) to adaptively modify the position of the DBS in response to the varying location of the User Equipment (UE). To this end, we design a Markov Decision Process (MDP) accounting for the continuous nature of the DBS position and the DBS 360-degree movement in the horizontal plane. This allows our solution to actively explore various positions of the DBSs, leading to significantly enhanced connectivity and bandwidth for the non-stationary user equipment (UEs). This work is the first to utilize action-space normalization in a continuous action space, using linear interpolation-based techniques commonly employed in robotics and related research fields. This approach allows for a comprehensive exploration of the continuous space, resulting in significantly enhanced optimization. We demonstrate that our approach can improve on previous research in this area while considering a much more complex optimization problem while providing uninterrupted connectivity to mobile UEs using multiple DBSs while maintaining stable bandwidth.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1064-7570
1573-7705
DOI:10.1007/s10922-025-09924-1