An Intelligent Communication-Navigation Electronic System Based on Hierarchical Reinforcement Learning for Unmanned Surface Vehicles

Unmanned surface vehicles (USVs) play a vital role in maritime operations, yet they face significant challenges in maintaining reliable communication and accurate navigation in complex and dynamic electromagnetic environments. This paper presents a novel communication- navigation electronic system (...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on cognitive communications and networking p. 1
Main Authors: Shi, Hanzhang, Tang, Chengkai, Zhang, Lingling, Liu, Yangyang, Dan, Zesheng
Format: Journal Article
Language:English
Published: IEEE 2025
Subjects:
Accuracy
Adaptive control strategies
Chirp
Code division multiplexing
communication–navigation electronic systems
Decision making
Heuristic algorithms
hierarchical reinforcement learning (HRL)
Navigation
OFDM
orthogonal chirp division multiplexing (OCDM)
Real-time systems
Resource management
Robustness
unmanned surface vehicles (USVs)
ISSN:2332-7731, 2332-7731
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Unmanned surface vehicles (USVs) play a vital role in maritime operations, yet they face significant challenges in maintaining reliable communication and accurate navigation in complex and dynamic electromagnetic environments. This paper presents a novel communication- navigation electronic system (CNES), designed to support mission-aware resource management and system adaptability under real-world marine conditions. The system incorporates an orthogonal chirp division multiplexing (OCDM) waveform and supports flexible task modes through dynamic subcarrier allocation mechanisms. To enhance the decision-making capability of CNES, we further propose an intelligent control algorithm, termed Integrated communication and navigation technology based on hierarchical reinforcement learning (ICNT-HRL). The ICNT-HRL algorithm adopts a two-layer control structure, where the high-level agent selects subcarrier block types based on mission modes, while the low-level agent jointly optimizes modulation schemes and power distribution. Simulation and field experiments are conducted by deploying ICNT-HRL on the CNES platform and benchmarking it against representative learning-based algorithms under identical conditions. Results demonstrate that ICNT-HRL achieves superior performance in terms of communication throughput, navigation accuracy, and system robustness, validating its practical effectiveness for real-world USV deployments.
ISSN:2332-7731
2332-7731
DOI:10.1109/TCCN.2025.3627913