Robust Energy-Efficient DRL-Based Optimization in UAV-Mounted RIS Systems with Jitter

In this letter, we propose an energy-efficient design for an unmanned aerial vehicle (UAV)-mounted reconfigurable intelligent surface (RIS) communication system with nonlinear energy harvesting (EH) and UAV jitter. A joint optimization problem is formulated to maximize the EH efficiency of the UAV-m...

Full description

Saved in:
Bibliographic Details
Published in:IEEE communications letters p. 1
Main Authors: Salim, Mahmoud M., Rabie, Khaled M., Muqaibel, Ali H.
Format: Journal Article
Language:English
Published: IEEE 2025
Subjects:
Array signal processing
Autonomous aerial vehicles
DRL
Energy harvesting
Jitter
Optimization
Quality of service
Radio frequency
Reconfigurable intelligent surfaces
Resource management
RIS
UAV
Vectors
ISSN:1089-7798, 1558-2558
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this letter, we propose an energy-efficient design for an unmanned aerial vehicle (UAV)-mounted reconfigurable intelligent surface (RIS) communication system with nonlinear energy harvesting (EH) and UAV jitter. A joint optimization problem is formulated to maximize the EH efficiency of the UAV-mounted RIS by controlling the user powers, RIS phase shifts, and time-switching factor, subject to quality of service and practical EH constraints. The problem is nonconvex and time-coupled due to UAV angular jitter and nonlinear EH dynamics, making it intractable for conventional optimization methods. To address this, we reformulate the problem as a deep reinforcement learning (DRL) environment and develop a smoothed softmax dual deep deterministic policy gradient algorithm. The proposed method incorporates action clipping, entropy regularization, and softmax-weighted Q-value estimation to improve learning stability and exploration. Simulation results show that the proposed algorithm converges reliably under various UAV jitter levels and achieves an average EH efficiency of 45.07%, approaching the 53.09% upper bound of exhaustive search, and outperforming other DRL baselines.
ISSN:1089-7798
1558-2558
DOI:10.1109/LCOMM.2025.3612448