No-code robotic programming for agile production: A new markerless-approach for multimodal natural interaction in a human-robot collaboration context

Industrial robots and cobots are widely deployed in most industrial sectors. However, robotic programming still needs a lot of time and effort in small batch sizes, and it demands specific expertise and special training, especially when various robotic platforms are required. Actual low-code or no-c...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Frontiers in robotics and AI Jg. 9; S. 1001955
Hauptverfasser: Halim, Jayanto, Eichler, Paul, Krusche, Sebastian, Bdiwi, Mohamad, Ihlenfeldt, Steffen
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Frontiers Media S.A 04.10.2022
Schlagworte:
human robot collaboration
intuitive robot programming
learning from demonstration
multimodal intraction
no-code robotic teaching
Robotics and AI
ISSN:2296-9144, 2296-9144
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Industrial robots and cobots are widely deployed in most industrial sectors. However, robotic programming still needs a lot of time and effort in small batch sizes, and it demands specific expertise and special training, especially when various robotic platforms are required. Actual low-code or no-code robotic programming solutions are exorbitant and meager. This work proposes a novel approach for no-code robotic programming for end-users with adequate or no expertise in industrial robotic. The proposed method ensures intuitive and fast robotic programming by utilizing a finite state machine with three layers of natural interactions based on hand gesture, finger gesture, and voice recognition. The implemented system combines intelligent computer vision and voice control capabilities. Using a vision system, the human could transfer spatial information of a 3D point, lines, and trajectories using hand and finger gestures. The voice recognition system will assist the user in parametrizing robot parameters and interacting with the robot’s state machine. Furthermore, the proposed method will be validated and compared with state-of-the-art “Hand-Guiding” cobot devices within real-world experiments. The results obtained are auspicious, and indicate the capability of this novel approach for real-world deployment in an industrial context.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
Amir Naderolasli, Islamic Azad University of Najafabad, Iran
Reviewed by: Abbas Chatraei, Islamic Azad University of Najafabad, Iran
This article was submitted to Robotic Control Systems, a section of the journal Frontiers in Robotics and AI
Edited by: Khoshnam Shojaei, Islamic Azad University of Najafabad, Iran
ISSN:2296-9144
2296-9144
DOI:10.3389/frobt.2022.1001955