No-code robotic programming for agile production: A new markerless-approach for multimodal natural interaction in a human-robot collaboration context

Industrial robots and cobots are widely deployed in most industrial sectors. However, robotic programming still needs a lot of time and effort in small batch sizes, and it demands specific expertise and special training, especially when various robotic platforms are required. Actual low-code or no-c...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Frontiers in robotics and AI Ročník 9; s. 1001955
Hlavní autoři: Halim, Jayanto, Eichler, Paul, Krusche, Sebastian, Bdiwi, Mohamad, Ihlenfeldt, Steffen
Médium: Journal Article
Jazyk:angličtina
Vydáno: Frontiers Media S.A 04.10.2022
Témata:
human robot collaboration
intuitive robot programming
learning from demonstration
multimodal intraction
no-code robotic teaching
Robotics and AI
ISSN:2296-9144, 2296-9144
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Industrial robots and cobots are widely deployed in most industrial sectors. However, robotic programming still needs a lot of time and effort in small batch sizes, and it demands specific expertise and special training, especially when various robotic platforms are required. Actual low-code or no-code robotic programming solutions are exorbitant and meager. This work proposes a novel approach for no-code robotic programming for end-users with adequate or no expertise in industrial robotic. The proposed method ensures intuitive and fast robotic programming by utilizing a finite state machine with three layers of natural interactions based on hand gesture, finger gesture, and voice recognition. The implemented system combines intelligent computer vision and voice control capabilities. Using a vision system, the human could transfer spatial information of a 3D point, lines, and trajectories using hand and finger gestures. The voice recognition system will assist the user in parametrizing robot parameters and interacting with the robot’s state machine. Furthermore, the proposed method will be validated and compared with state-of-the-art “Hand-Guiding” cobot devices within real-world experiments. The results obtained are auspicious, and indicate the capability of this novel approach for real-world deployment in an industrial context.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
Amir Naderolasli, Islamic Azad University of Najafabad, Iran
Reviewed by: Abbas Chatraei, Islamic Azad University of Najafabad, Iran
This article was submitted to Robotic Control Systems, a section of the journal Frontiers in Robotics and AI
Edited by: Khoshnam Shojaei, Islamic Azad University of Najafabad, Iran
ISSN:2296-9144
2296-9144
DOI:10.3389/frobt.2022.1001955