Grid-area coordinated load frequency control strategy using large-scale multi-agent deep reinforcement learning

In order to enable full participation of high-performance units controlled by different dispatching centers in the performance-based frequency regulation market, a data-driven grid-area coordinated load frequency control (GAC-LFC) strategy using unified performance-based frequency regulation market...

Full description

Saved in:

Bibliographic Details
Published in:	Energy reports Vol. 8; pp. 255 - 274
Main Authors:	Li, Jiawen, Geng, Jian, Yu, Tao
Format:	Journal Article
Language:	English
Published:	Elsevier Ltd 01.11.2022 Elsevier
Subjects:	Deep reinforcement learning Grid-area coordinated load frequency control strategy Interconnected power grid Load frequency control Multi-agent deep deterministic policy gradient algorithm Performance-based frequency regulation market mechanism Deep reinforcement learning Grid-area coordinated load frequency control strategy Load frequency control Interconnected power grid Multi-agent deep deterministic policy gradient algorithm Performance-based frequency regulation market mechanism
ISSN:	2352-4847, 2352-4847
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	In order to enable full participation of high-performance units controlled by different dispatching centers in the performance-based frequency regulation market, a data-driven grid-area coordinated load frequency control (GAC-LFC) strategy using unified performance-based frequency regulation market mechanism is proposed. The strategy takes into account the coordination of LFC controllers in different areas of the interconnected power grid, and accommodates a large number of high-performance units controlled by dispatching centers in secondary frequency regulation. In addition, an effective exploration-based multi-agent deep deterministic policy gradient (EE-MADDPG) algorithm is proposed as the framework algorithm. In this algorithm, the LFC controller controlled by the grid-dispatching center and the LFC controller controlled by the area-dispatching center in each area are treated as different agents. Through centralized training with decentralized execution, the coordination of LFC controllers controlled by different levels of dispatching centers in different areas can be realized. Moreover, the algorithm introduces effective exploration strategies, agents operating on various principles, and artificial intelligence functions based on imitation learning and curriculum learning, which altogether constitute a more robust strategy. Through the simulation of the four-area LFC model of the China Southern Grid (CSG), it is demonstrated that the proposed method can simultaneously call more high-performance units, improve multi-area LFC control performance, and reduce the frequency regulation mileage payment in each area. •A data-driven grid-area load frequency control strategy is proposed.•An EE-MADDPG algorithm is proposed.•The LFC controllers are treated as different agents.•The proposed algorithm effectively improve the performance of the LFC.
ISSN:	2352-4847 2352-4847
DOI:	10.1016/j.egyr.2021.11.260