Deep Reinforcement Learning-Based Dynamic Reconfiguration Planning for Digital Twin-Driven Smart Manufacturing Systems With Reconfigurable Machine Tools

Smart manufacturing systems are a new paradigm in Industry 4.0 driven by the emerging information and communication technology and artificial intelligence that converge to digital twin, which are able to perceive, recognize, and handle the changes in demand and production. Reconfigurable machine too...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:IEEE transactions on industrial informatics Ročník 20; číslo 11; s. 13135 - 13146
Hlavní autori: Huang, Jintang, Huang, Sihan, Moghaddam, Shokraneh K., Lu, Yuqian, Wang, Guoxin, Yan, Yan, Shi, Xuejiang
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Piscataway IEEE 01.11.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Predmet:
ISSN:1551-3203, 1941-0050
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Smart manufacturing systems are a new paradigm in Industry 4.0 driven by the emerging information and communication technology and artificial intelligence that converge to digital twin, which are able to perceive, recognize, and handle the changes in demand and production. Reconfigurable machine tools (RMTs) can promote the flexibility of smart manufacturing systems. The fundamental problem lies in dynamically reconfiguring the RMTs in smart manufacturing systems efficiently and accurately by considering the flexibility of production precedence and operation sequences simultaneously. Therefore, in this article, a deep reinforcement learning-based reconfiguration planning method of digital twin-driven smart manufacturing systems with RMT is proposed to seek optimal reconfiguration policy online. The reconfiguration processes of smart manufacturing systems are modeled by considering reconfiguration cost, moving cost, and processing cost. Deep Q -network is adopted to explore the state space and action space to find the optimal reconfiguration scheme with the highest return. An industry case study is presented to demonstrate the effectiveness and efficiency of the proposed method, where the reconfiguration processes of a smart manufacturing system consisting of five RMTs for producing four parts are discussed.
Bibliografia:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1551-3203
1941-0050
DOI:10.1109/TII.2024.3431095