Energy-efficient operation by cooperative control among trains: A multi-agent reinforcement learning approach

With the ever-increasing operating mileage of urban rail transit systems, a large amount of energy is consumed for train operation, and the energy-saving for train operation has become an attractive topic in the research community in recent years. In order to minimize the net energy consumption (i.e...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Control engineering practice Ročník 116; s. 104901
Hlavní autoři: Su, Shuai, Wang, Xuekai, Tang, Tao, Wang, Guang, Cao, Yuan
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier Ltd 01.11.2021
Témata:
Cooperative control
Energy saving
Multi-agent reinforcement learning
Regenerative energy
Multi-agent reinforcement learning
Energy saving
Regenerative energy
Cooperative control
ISSN:0967-0661, 1873-6939
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:With the ever-increasing operating mileage of urban rail transit systems, a large amount of energy is consumed for train operation, and the energy-saving for train operation has become an attractive topic in the research community in recent years. In order to minimize the net energy consumption (i.e., the difference between the traction energy and the reused regenerative energy), an energy-efficient train operation method using the cooperative control approach is proposed in this paper. Firstly, a set of mathematical models for the cooperative control are formulated with considering the transmission mechanism of regenerative energy. Then, a multi-agent reinforcement learning algorithm is designed to obtain the cooperative driving strategy for trains. In this algorithm, the global Q-function is decomposed into several local Q-functions by using value function factorization method. A proposed update method is applied to update the local Q-functions according to the transmission mechanism of regenerative energy. Finally, the case studies built upon a metro line is performed to illustrate the effectiveness of the proposed method. According to the simulation results, the net energy consumption is reduced by more than 11.1% compared to the method in which the driving strategy of each train is independently optimized. •An innovative framework of the energy-efficient operation by cooperative control among trains.•An improved multi-agent reinforcement learning algorithm based on the weighted decomposition of individual reward.•The energy-efficient ratio can reach more than 11.1%.
ISSN:0967-0661
1873-6939
DOI:10.1016/j.conengprac.2021.104901