Enhancing human-guided robotic assembly: AR-assisted DT for skill-based and low-code programming

Efficient and natural programming strategies play a crucial role in enabling human-guided robotic assembly to adapt quickly to dynamic tasks. The combination of Augmented Reality (AR) and Digital Twins (DT) has shown promising potential in enhancing the intuitiveness of human–robot interaction while...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Journal of manufacturing systems Ročník 74; s. 676 - 689
Hlavní autoři: Yin, Yue, Zheng, Pai, Li, Chengxi, Wan, Ke
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier Ltd 01.06.2024
Témata:
Augmented reality
Digital twin
Human–robot interaction
Robot programming
Robotic assembly
Robotic assembly
Human–robot interaction
Digital twin
Augmented reality
Robot programming
ISSN:0278-6125, 1878-6642
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Efficient and natural programming strategies play a crucial role in enabling human-guided robotic assembly to adapt quickly to dynamic tasks. The combination of Augmented Reality (AR) and Digital Twins (DT) has shown promising potential in enhancing the intuitiveness of human–robot interaction while leveraging digital representations of human intelligence to empower robots in manufacturing tasks. However, traditional programming methods lack intuitive interaction and rely heavily on simulation environments or pre-set CAD models, leading to high costs for both initial setup and sim-to-real deployment. On the other hand, existing AR-based robot control methods have primarily focused on the basic movements of robots, overlooking higher-level skills necessary for complex tasks. To address these limitations, this study introduces a four-layer system architecture that integrates AR-assisted DT into skill-based robotic assembly scenarios. Additionally, a skill-based and low-code programming system for human-guided robotic assembly is designed and implemented, which incorporates natural human guidance and robot autonomous intelligence to generate adaptive and feasible action plans. The feasibility and efficiency of the proposed system are verified by two case studies and a quantitative experiment comparing to traditional programming methods. The results demonstrate the usability of our AR-assisted DT approach in improving programming efficiency, intuitiveness, and safety for human-guided robotic assembly while reducing cognitive load. •A system architecture combining AR and DT is proposed for skill-based human-guided robotic assembly.•A low-code robot programming method is designed for multi-granularity robot skill parameterization.•A robot programming system is implemented and verified by case studies in assembly scenarios.
ISSN:0278-6125
1878-6642
DOI:10.1016/j.jmsy.2024.04.016