Twin-delayed deep deterministic policy gradient algorithm for the energy management of microgrids

The microgrid market is growing significantly due to several drivers, such as the need to lower greenhouse gas emissions by integrating higher shares of distributed renewable energy sources, falling costs of microgrid components, the need for more reliable power supply infrastructures, and new off-g...

Full description

Saved in:
Bibliographic Details
Published in:Engineering applications of artificial intelligence Vol. 125; p. 106693
Main Authors: Domínguez-Barbero, David, García-González, Javier, Sanz-Bobi, Miguel Á.
Format: Journal Article
Language:English
Published: Elsevier Ltd 01.10.2023
Subjects:
Continuous action space
Deep reinforcement learning
Energy management system
Microgrids
TD3
Deep reinforcement learning
TD3
Continuous action space
Energy management system
Microgrids
ISSN:0952-1976
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The microgrid market is growing significantly due to several drivers, such as the need to lower greenhouse gas emissions by integrating higher shares of distributed renewable energy sources, falling costs of microgrid components, the need for more reliable power supply infrastructures, and new off-grid solutions to foster electricity access in developing economies. Coordinated management of the microgrid components is crucial for their effectiveness, and this can be very challenging when hosting solar or wind generation. This paper studies the energy management problem of a microgrid based on reinforcement learning algorithms. The advantage of using these algorithms against other optimization and machine learning techniques is that they do not need past experiences to learn a strategy. The learning is based on trial and error experiences, which facilitates its easy implementation to other microgrids while demonstrating their facility to be applied in real cases. In particular, this paper proposes an implementation for an Energy Management System (EMS) in microgrids using the Twin-Delayed Deep Deterministic Policy Gradient (TD3) algorithm. Moreover, it compares the proposed algorithm with the Deep Q-Network (DQN). This comparison evaluates the improvement over exploiting the continuous nature of the decision variables against a discretization of the same since the DQN cannot make actions over a continuous space.
ISSN:0952-1976
DOI:10.1016/j.engappai.2023.106693