Enhancing human-guided robotic assembly: AR-assisted DT for skill-based and low-code programming

Efficient and natural programming strategies play a crucial role in enabling human-guided robotic assembly to adapt quickly to dynamic tasks. The combination of Augmented Reality (AR) and Digital Twins (DT) has shown promising potential in enhancing the intuitiveness of human–robot interaction while...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Journal of manufacturing systems Ročník 74; s. 676 - 689
Hlavní autori: Yin, Yue, Zheng, Pai, Li, Chengxi, Wan, Ke
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Elsevier Ltd 01.06.2024
Predmet:
Augmented reality
Digital twin
Human–robot interaction
Robot programming
Robotic assembly
Robotic assembly
Human–robot interaction
Digital twin
Augmented reality
Robot programming
ISSN:0278-6125, 1878-6642
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Efficient and natural programming strategies play a crucial role in enabling human-guided robotic assembly to adapt quickly to dynamic tasks. The combination of Augmented Reality (AR) and Digital Twins (DT) has shown promising potential in enhancing the intuitiveness of human–robot interaction while leveraging digital representations of human intelligence to empower robots in manufacturing tasks. However, traditional programming methods lack intuitive interaction and rely heavily on simulation environments or pre-set CAD models, leading to high costs for both initial setup and sim-to-real deployment. On the other hand, existing AR-based robot control methods have primarily focused on the basic movements of robots, overlooking higher-level skills necessary for complex tasks. To address these limitations, this study introduces a four-layer system architecture that integrates AR-assisted DT into skill-based robotic assembly scenarios. Additionally, a skill-based and low-code programming system for human-guided robotic assembly is designed and implemented, which incorporates natural human guidance and robot autonomous intelligence to generate adaptive and feasible action plans. The feasibility and efficiency of the proposed system are verified by two case studies and a quantitative experiment comparing to traditional programming methods. The results demonstrate the usability of our AR-assisted DT approach in improving programming efficiency, intuitiveness, and safety for human-guided robotic assembly while reducing cognitive load. •A system architecture combining AR and DT is proposed for skill-based human-guided robotic assembly.•A low-code robot programming method is designed for multi-granularity robot skill parameterization.•A robot programming system is implemented and verified by case studies in assembly scenarios.
ISSN:0278-6125
1878-6642
DOI:10.1016/j.jmsy.2024.04.016