An Online Distributed Satellite Cooperative Observation Scheduling Algorithm Based on Multiagent Deep Reinforcement Learning

The provision of real-time information services is one of the crucial functions of satellites. In comparison with the centralized scheduling, the distributed scheduling can provide better robustness and extendibility. However, the existing distributed satellite scheduling algorithms require a large...

Full description

Saved in:
Bibliographic Details
Published in:IEEE geoscience and remote sensing letters Vol. 18; no. 11; pp. 1901 - 1905
Main Authors: Dalin, Li, Haijiao, Wang, Zhen, Yang, Yanfeng, Gu, Shi, Shen
Format: Journal Article
Language:English
Published: Piscataway IEEE 01.11.2021
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Aerospace electronics
Algorithms
Communication
Decisions
Deep learning
Deep reinforcement learning (DRL)
distributed scheduling
Games
imaging satellites
Information services
Machine learning
Markov processes
Multiagent systems
neural network
Policies
Real time
real-time scheduling
Real-time systems
Reinforcement
Response time
Satellite observation
Satellites
Scheduling
Task analysis
Task scheduling
ISSN:1545-598X, 1558-0571
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The provision of real-time information services is one of the crucial functions of satellites. In comparison with the centralized scheduling, the distributed scheduling can provide better robustness and extendibility. However, the existing distributed satellite scheduling algorithms require a large amount of communication between satellites to coordinate tasks, which makes it difficult to support scheduling in real-time. This letter proposes a multiagent deep reinforcement learning (MADRL)-based method to solve the problem of scheduling real-time multisatellite cooperative observation. The method enables satellites to share their decision policy, but it is not necessary to share data on the decisions they make or data on their current internal state. The satellites can use the decision policy to infer the decisions of other satellites to decide whether to accept a task when they receive a new request for observations. In this way, our method can significantly reduce the communication overhead and improve the response time. The pillar of the architecture is a multiagent deep deterministic policy gradient network. Our simulation results show that the proposed method is stable and effective. In comparison with the Contract Net Protocol method, our algorithm can reduce the communication overhead and achieve better use of satellite resources.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1545-598X
1558-0571
DOI:10.1109/LGRS.2020.3009823