Joint Adaptive Modulation Coding and Power Optimization in Heterogeneous Networks based on Constrained Deep Reinforcement Learning

In cognitive heterogeneous networks, multiple secondary transmitters (STs) co-exist with primary users (PUs) on the same frequency band channel through spectrum sensing. Due to inaccurate sensing of whether the channel is occupied, STs can cause interference to PUs, thereby affecting the transmissio...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:IEEE transactions on wireless communications s. 1
Hlavní autori: Wang, Tao, Gu, Xin, Chen, Haipeng, Chang, Cheng, Tang, Tiantian, Huang, Hao, Jiao, Donglai, Lin, Yun, Gui, Guan
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: IEEE 2025
Predmet:
Adaptive Modulation Coding
Constrained Optimization
Data communication
Deep Reinforcement Learning
Heterogeneous Networks
Heuristic algorithms
Interference
Modulation coding
Optimization
Rayleigh channels
Resource Optimization
Sensors
Telecommunications
Wireless communication
Wireless sensor networks
ISSN:1536-1276, 1558-2248
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:In cognitive heterogeneous networks, multiple secondary transmitters (STs) co-exist with primary users (PUs) on the same frequency band channel through spectrum sensing. Due to inaccurate sensing of whether the channel is occupied, STs can cause interference to PUs, thereby affecting the transmission performance of PUs. This paper proposes a constrained deep reinforcement learning-based joint adaptive modulation coding and power selection (CDRL-JAMCPS) algorithm. The proposed CDRL-JAMCPS learns the interference patterns of STs to PUs through interaction with the environment and selects the modulation coding scheme and transmit power for future frames of PUs based on the learned patterns, aiming to maximize the transmission rate while reducing energy consumption. Furthermore, addressing the issue where existing optimization algorithms solely consider network transmission rates while neglecting data transmission quality, this paper proposes a reward function in Lagrangian form based on frame error rate (FER) constraints. By optimizing this reward function in its dual domain, the problem of poor data transmission quality is resolved. The simulation results demonstrate that the proposed algorithm achieves better transmission performance compared to other reinforcement learning algorithms in environments where signal interference is difficult to perceive. Meanwhile, compared to algorithms that do not consider transmission quality, our algorithm exhibits significant advantages in meeting FER requirements and improving data transmission quality.
ISSN:1536-1276
1558-2248
DOI:10.1109/TWC.2025.3609334