No-code robotic programming for agile production: A new markerless-approach for multimodal natural interaction in a human-robot collaboration context
Industrial robots and cobots are widely deployed in most industrial sectors. However, robotic programming still needs a lot of time and effort in small batch sizes, and it demands specific expertise and special training, especially when various robotic platforms are required. Actual low-code or no-c...
Uložené v:
| Vydané v: | Frontiers in robotics and AI Ročník 9; s. 1001955 |
|---|---|
| Hlavní autori: | , , , , |
| Médium: | Journal Article |
| Jazyk: | English |
| Vydavateľské údaje: |
Frontiers Media S.A
04.10.2022
|
| Predmet: | |
| ISSN: | 2296-9144, 2296-9144 |
| On-line prístup: | Získať plný text |
| Tagy: |
Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
|
| Abstract | Industrial robots and cobots are widely deployed in most industrial sectors. However, robotic programming still needs a lot of time and effort in small batch sizes, and it demands specific expertise and special training, especially when various robotic platforms are required. Actual low-code or no-code robotic programming solutions are exorbitant and meager. This work proposes a novel approach for no-code robotic programming for end-users with adequate or no expertise in industrial robotic. The proposed method ensures intuitive and fast robotic programming by utilizing a finite state machine with three layers of natural interactions based on hand gesture, finger gesture, and voice recognition. The implemented system combines intelligent computer vision and voice control capabilities. Using a vision system, the human could transfer spatial information of a 3D point, lines, and trajectories using hand and finger gestures. The voice recognition system will assist the user in parametrizing robot parameters and interacting with the robot’s state machine. Furthermore, the proposed method will be validated and compared with state-of-the-art “Hand-Guiding” cobot devices within real-world experiments. The results obtained are auspicious, and indicate the capability of this novel approach for real-world deployment in an industrial context. |
|---|---|
| AbstractList | Industrial robots and cobots are widely deployed in most industrial sectors. However, robotic programming still needs a lot of time and effort in small batch sizes, and it demands specific expertise and special training, especially when various robotic platforms are required. Actual low-code or no-code robotic programming solutions are exorbitant and meager. This work proposes a novel approach for no-code robotic programming for end-users with adequate or no expertise in industrial robotic. The proposed method ensures intuitive and fast robotic programming by utilizing a finite state machine with three layers of natural interactions based on hand gesture, finger gesture, and voice recognition. The implemented system combines intelligent computer vision and voice control capabilities. Using a vision system, the human could transfer spatial information of a 3D point, lines, and trajectories using hand and finger gestures. The voice recognition system will assist the user in parametrizing robot parameters and interacting with the robot’s state machine. Furthermore, the proposed method will be validated and compared with state-of-the-art “Hand-Guiding” cobot devices within real-world experiments. The results obtained are auspicious, and indicate the capability of this novel approach for real-world deployment in an industrial context. Industrial robots and cobots are widely deployed in most industrial sectors. However, robotic programming still needs a lot of time and effort in small batch sizes, and it demands specific expertise and special training, especially when various robotic platforms are required. Actual low-code or no-code robotic programming solutions are exorbitant and meager. This work proposes a novel approach for no-code robotic programming for end-users with adequate or no expertise in industrial robotic. The proposed method ensures intuitive and fast robotic programming by utilizing a finite state machine with three layers of natural interactions based on hand gesture, finger gesture, and voice recognition. The implemented system combines intelligent computer vision and voice control capabilities. Using a vision system, the human could transfer spatial information of a 3D point, lines, and trajectories using hand and finger gestures. The voice recognition system will assist the user in parametrizing robot parameters and interacting with the robot's state machine. Furthermore, the proposed method will be validated and compared with state-of-the-art "Hand-Guiding" cobot devices within real-world experiments. The results obtained are auspicious, and indicate the capability of this novel approach for real-world deployment in an industrial context.Industrial robots and cobots are widely deployed in most industrial sectors. However, robotic programming still needs a lot of time and effort in small batch sizes, and it demands specific expertise and special training, especially when various robotic platforms are required. Actual low-code or no-code robotic programming solutions are exorbitant and meager. This work proposes a novel approach for no-code robotic programming for end-users with adequate or no expertise in industrial robotic. The proposed method ensures intuitive and fast robotic programming by utilizing a finite state machine with three layers of natural interactions based on hand gesture, finger gesture, and voice recognition. The implemented system combines intelligent computer vision and voice control capabilities. Using a vision system, the human could transfer spatial information of a 3D point, lines, and trajectories using hand and finger gestures. The voice recognition system will assist the user in parametrizing robot parameters and interacting with the robot's state machine. Furthermore, the proposed method will be validated and compared with state-of-the-art "Hand-Guiding" cobot devices within real-world experiments. The results obtained are auspicious, and indicate the capability of this novel approach for real-world deployment in an industrial context. |
| Author | Bdiwi, Mohamad Halim, Jayanto Eichler, Paul Ihlenfeldt, Steffen Krusche, Sebastian |
| AuthorAffiliation | 2 Departement of Production System and Factory Automation , Fraunhofer Institute for Machine Tools and Forming Technology , Chemnitz , Germany 1 Departement of Cognitive Human-Machine System , Fraunhofer Institute for Machine Tools and Forming Technology , Chemnitz , Germany |
| AuthorAffiliation_xml | – name: 1 Departement of Cognitive Human-Machine System , Fraunhofer Institute for Machine Tools and Forming Technology , Chemnitz , Germany – name: 2 Departement of Production System and Factory Automation , Fraunhofer Institute for Machine Tools and Forming Technology , Chemnitz , Germany |
| Author_xml | – sequence: 1 givenname: Jayanto surname: Halim fullname: Halim, Jayanto – sequence: 2 givenname: Paul surname: Eichler fullname: Eichler, Paul – sequence: 3 givenname: Sebastian surname: Krusche fullname: Krusche, Sebastian – sequence: 4 givenname: Mohamad surname: Bdiwi fullname: Bdiwi, Mohamad – sequence: 5 givenname: Steffen surname: Ihlenfeldt fullname: Ihlenfeldt, Steffen |
| BookMark | eNp9kk1v1DAQhiNUJErpH-DkI5csdmInNgekquKjUtVe4GxN7PGuS2IvjsPHD-H_4s0uEuXAaUYz7zz2jN7n1VmIAavqJaObtpXqtUtxyJuGNs2GUcqUEE-q86ZRXa0Y52d_5c-qy3l-oEUkJG_7_rz6dRdrEy2SwojZG7JPcZtgmnzYEhcTga0f8VC1i8k-hjfkigT8TiZIXzCNOM817EsbzG7VT8uY_RQtjCRAXlKJPmRMsE6XnADZLROEen2RmDiOMMQEa9vEov2RX1RPHYwzXp7iRfX5_btP1x_r2_sPN9dXt7XhXOR64A4Va7pOClSooDVcut4aYZTrBTqFFAYFDGhbAm2tsINAKV2ptbLr2ovq5si1ER70Pvmy1U8dweu1ENNWQypXGVFbJx1ysI72PTccBuGYs7xzIKgynSist0fWfhkmtAZDLss_gj7uBL_T2_hNKyFbxWQBvDoBUvy64Jz15GeD5TwB4zLrpm8k4x1TbZHKo9SkOM8JnTY-rxcsZD9qRvXBGXp1hj44Q5-cUUabf0b__PA_Q78BquDGFA |
| CitedBy_id | crossref_primary_10_1016_j_dte_2025_100039 crossref_primary_10_3389_frobt_2023_1028329 crossref_primary_10_1016_j_procs_2024_01_120 crossref_primary_10_1007_s10846_024_02141_z crossref_primary_10_1080_19411243_2025_2562503 crossref_primary_10_4173_mic_2023_4_1 crossref_primary_10_1515_zwf_2025_1068 crossref_primary_10_1080_0951192X_2024_2358042 crossref_primary_10_3389_frobt_2025_1605682 crossref_primary_10_1007_s42524_025_4136_9 crossref_primary_10_1109_TASE_2025_3528051 crossref_primary_10_3389_frobt_2023_1120357 crossref_primary_10_3390_machines13090772 |
| Cites_doi | 10.1016/j.mechatronics.2018.02.009 10.1007/s40436-020-00303-4 10.1109/70.326576 10.3389/frobt.2021.767878 10.1177/17298814211064767 10.1007/s12541-013-0306-5 10.3390/s21175976 10.1109/tie.2014.2362095 10.1016/j.patcog.2014.01.005 10.1016/j.robot.2021.103845 10.1109/ACCESS.2020.2981378 10.1177/027836499501400301 10.1109/CVPR.2017.494 10.1109/tase.2018.2874454 10.1108/01439911211268796 10.1145/2010324.1964964 10.1177/16878140211004034 10.1007/s41315-018-0053-y 10.14257/ijsip.2016.9.4.34 10.5898/jhri.2.1.wrede 10.1016/j.robot.2008.10.024 10.1016/j.procir.2020.05.213 10.1016/j.jmapro.2020.03.047 10.1016/j.rcim.2020.102033 10.1016/j.procir.2020.03.022 10.5772/55640 10.1016/j.cirp.2022.04.074 10.1016/j.rcim.2019.101923 10.3390/app11041467 10.1016/j.procir.2021.11.215 10.1109/70.34770 10.1177/02783649922066213 10.1109/tii.2019.2900119 10.1108/ir-11-2014-0413 10.1007/978-3-319-32552-1_54 10.1016/j.robot.2013.02.005 10.1016/j.cirpj.2020.11.015 10.1016/j.promfg.2020.10.022 10.1007/s00170-016-8527-2 10.1007/978-3-540-30301-5_60 10.1609/aaai.v34i07.6761 10.1177/1729881417695560 10.1109/jsen.2018.2877976 10.3390/s22030923 10.1109/TVCG.2015.2513408 10.1007/s00502-019-00741-4 10.1177/1729881419851665 10.1016/j.procir.2018.02.028 10.1080/0951192x.2019.1686177 10.1016/j.dib.2020.105676 10.1146/annurev-control-100819-063206 10.1016/j.robot.2019.03.003 10.3390/s21227770 |
| ContentType | Journal Article |
| Copyright | Copyright © 2022 Halim, Eichler, Krusche, Bdiwi and Ihlenfeldt. Copyright © 2022 Halim, Eichler, Krusche, Bdiwi and Ihlenfeldt. 2022 Halim, Eichler, Krusche, Bdiwi and Ihlenfeldt |
| Copyright_xml | – notice: Copyright © 2022 Halim, Eichler, Krusche, Bdiwi and Ihlenfeldt. – notice: Copyright © 2022 Halim, Eichler, Krusche, Bdiwi and Ihlenfeldt. 2022 Halim, Eichler, Krusche, Bdiwi and Ihlenfeldt |
| DBID | AAYXX CITATION 7X8 5PM DOA |
| DOI | 10.3389/frobt.2022.1001955 |
| DatabaseName | CrossRef MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Directory of Open Access Journals |
| DatabaseTitle | CrossRef MEDLINE - Academic |
| DatabaseTitleList | CrossRef MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| DocumentTitleAlternate | Halim et al |
| EISSN | 2296-9144 |
| ExternalDocumentID | oai_doaj_org_article_df8fe4adf0774c4ab5f1fd46fa509c65 PMC9583918 10_3389_frobt_2022_1001955 |
| GroupedDBID | 53G 5VS 9T4 AAFWJ AAYXX ACGFS ADBBV AFPKN ALMA_UNASSIGNED_HOLDINGS BCNDV CITATION GROUPED_DOAJ KQ8 M~E OK1 PGMZT RPM 7X8 5PM |
| ID | FETCH-LOGICAL-c445t-b4fe9126685e9e9a3c48f7dc5c9f75ef9e0ab9a1a03b9a03d5db5e88f9a138663 |
| IEDL.DBID | DOA |
| ISICitedReferencesCount | 16 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000875596300001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 2296-9144 |
| IngestDate | Fri Oct 03 12:51:25 EDT 2025 Thu Aug 21 18:39:42 EDT 2025 Fri Sep 05 10:28:30 EDT 2025 Sat Nov 29 05:50:10 EST 2025 Tue Nov 18 20:58:32 EST 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Language | English |
| License | This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c445t-b4fe9126685e9e9a3c48f7dc5c9f75ef9e0ab9a1a03b9a03d5db5e88f9a138663 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 Amir Naderolasli, Islamic Azad University of Najafabad, Iran Reviewed by: Abbas Chatraei, Islamic Azad University of Najafabad, Iran This article was submitted to Robotic Control Systems, a section of the journal Frontiers in Robotics and AI Edited by: Khoshnam Shojaei, Islamic Azad University of Najafabad, Iran |
| OpenAccessLink | https://doaj.org/article/df8fe4adf0774c4ab5f1fd46fa509c65 |
| PQID | 2728146193 |
| PQPubID | 23479 |
| ParticipantIDs | doaj_primary_oai_doaj_org_article_df8fe4adf0774c4ab5f1fd46fa509c65 pubmedcentral_primary_oai_pubmedcentral_nih_gov_9583918 proquest_miscellaneous_2728146193 crossref_citationtrail_10_3389_frobt_2022_1001955 crossref_primary_10_3389_frobt_2022_1001955 |
| PublicationCentury | 2000 |
| PublicationDate | 2022-10-04 |
| PublicationDateYYYYMMDD | 2022-10-04 |
| PublicationDate_xml | – month: 10 year: 2022 text: 2022-10-04 day: 04 |
| PublicationDecade | 2020 |
| PublicationTitle | Frontiers in robotics and AI |
| PublicationYear | 2022 |
| Publisher | Frontiers Media S.A |
| Publisher_xml | – name: Frontiers Media S.A |
| References | Ravichandar (B62) 2020; 3 (B79) 2022 Bdiwi (B8) 2021 B69 Li (B50) 2017; 14 Park (B59) 1994; 10 Balogh (B7) 2018 Langmann (B47) 2012 Servi (B66) 2021; 21 Daniilidis (B19) 1999; 18 (B22) 2021 Ajaykumar (B1) 2021; 145 Ionescu (B39) 2021; 97 El Zaatari (B26) 2019; 116 Du (B25) 2014; 62 Kalaitzakis (B43) 2020 Lambrecht (B46) 2013; 10 Tsai (B75) 1989; 5 Zirkelbach (B90) 2019 Liu (B52) 2021; 32 Kakinuma (B42) 2022; 71 Soares (B68) 2021; 21 Tadic (B72) 2021; 11 Bdiwi (B9) Marchand (B55) 2016; 22 Qiao (B61) 2013 Zhang (B87); 8 Billard (B14) 2008 Intel (B38) 2015 Yang (B83); 19 Elliott (B27) 2017 Wrede (B80) 2013; 2 Zhang (B88) 2019; 15 Jokesch (B41) 2014 Zhang (B85); 63 Zhou (B89) 2021; 13 Bdiwi (B10) Horaud (B34) 1995; 14 Dietz (B20) 2012 van Delden (B77) 2012; 39 Kana (B44) 2021; 67 Sanchez-Diaz (B65) 2019; 32 Iturrate (B40) 2021; 8 Zhang (B86) Haugaard (B32) 2020 Robots (B63) 2015 Bolano (B16) 2020 Lourenço (B54) 2021 Garrido-Jurado (B29) 2014; 47 Ruan (B64) 2016 Chryssolouris (B18) 2012 Huang (B36) 2020 Akkaladevi (B2) 2019; 136 Angelidis (B5) 2014; 15 Villani (B78) 2018; 55 Lippiello (B51) 2005 (B23) 2017 Yang (B82); 16 Akkaladevi (B3) 2020; 51 Tian (B73) 2016; 87 Argall (B6) 2009; 57 Tirmizi (B74) 2019 Neto (B58) 2013; 61 Strazdas (B70) 2022; 22 Ding (B24) 2019; 16 Karpagavalli (B45) 2016; 9 Andreff (B4) 1999 Beck (B13) 2021; 104 Gastal (B30) 2011; 30 Infante (B37) 2011 Bdiwi (B11) 2015 Sun (B71) 2022 Hoang (B33) 2020; 30 Xiang (B81) 2017 Peng (B60) 2018; 2 Tykal (B76) 2016 Lee (B48) 2017 Cho (B17) 2020; 8 Liu (B53) 2020; 93 MMPose-Contributors (B57) 2020 Blankemeyer (B15) 2018; 76 (B21) 2012 Hägele (B31) 2016 Bdiwi (B12) Lei (B49) 2021; 63 Simon (B67) 2017 Zakiev (B84) 2020 Hornung (B35) 2022 Funes-Lora (B28) 2021; 18 Massa (B56) 2015; 42 |
| References_xml | – volume-title: Din ISO/TS 15066: Roboter und Robotikgeräte - kollaborierende Roboter. Norm year: 2017 ident: B23 – volume: 55 start-page: 248 year: 2018 ident: B78 article-title: Survey on human–robot collaboration in industrial settings: Safety, intuitive interfaces and applications publication-title: Mechatronics doi: 10.1016/j.mechatronics.2018.02.009 – start-page: 40 ident: B9 article-title: Automated assistance robot system for transferring model-free objects from/to human hand using vision/force control – volume: 8 start-page: 216 ident: B87 article-title: Robot programming by demonstration: A novel system for robot trajectory programming based on robot operating system publication-title: Adv. Manuf. doi: 10.1007/s40436-020-00303-4 – start-page: 150 year: 2021 ident: B8 article-title: Empirical study for measuring the mental states of humans during the interaction with heavy-duty industrial robots – volume: 10 start-page: 717 year: 1994 ident: B59 article-title: Robot sensor calibration: Solving ax=xb on the Euclidean group publication-title: IEEE Trans. Rob. Autom. doi: 10.1109/70.326576 – volume: 8 start-page: 767878 year: 2021 ident: B40 article-title: Quick setup of force-controlled industrial gluing tasks using learning from demonstration publication-title: Front. Robot. AI doi: 10.3389/frobt.2021.767878 – volume: 18 year: 2021 ident: B28 article-title: Novel surface optimization for trajectory reconstruction in industrial robot tasks publication-title: Int. J. Adv. Robotic Syst. doi: 10.1177/17298814211064767 – start-page: 438 year: 2012 ident: B47 article-title: Depth camera technology comparison and performance evaluation publication-title: ICPRAM – volume: 15 start-page: 63 year: 2014 ident: B5 article-title: Prediction and compensation of relative position error along industrial robot end-effector paths publication-title: Int. Suchy’ J. Precis. Eng. Manuf. doi: 10.1007/s12541-013-0306-5 – start-page: 430 year: 1999 ident: B4 article-title: On-line hand-eye calibration – start-page: 15 year: 2012 ident: B18 article-title: Production systems flexibility: Theory and practice – year: 2012 ident: B20 article-title: Programming system for efficient use of industrial robots for deburring in sme environments – start-page: 1 year: 2015 ident: B11 article-title: Improved peg-in-hole (5-pin plug) task: Intended for charging electric vehicles by robot system automatically – start-page: 1 ident: B10 article-title: Segmentation of model-free objects carried by human hand: Intended for human-robot interaction applications – volume-title: A survey of robot learning from demonstrations for human-robot collaboration year: 2017 ident: B48 – volume: 21 start-page: 5976 year: 2021 ident: B68 article-title: Programming robots by demonstration using augmented reality publication-title: Sensors doi: 10.3390/s21175976 – volume: 62 start-page: 2257 year: 2014 ident: B25 article-title: A markerless human–robot interface using particle filter and kalman filter for dual robots publication-title: IEEE Trans. Ind. Electron. doi: 10.1109/tie.2014.2362095 – start-page: 1 year: 2019 ident: B74 article-title: User-friendly programming of flexible assembly applications with collaborative robots – volume: 47 start-page: 2280 year: 2014 ident: B29 article-title: Automatic generation and detection of highly reliable fiducial markers under occlusion publication-title: Pattern Recognit. doi: 10.1016/j.patcog.2014.01.005 – volume: 145 start-page: 103845 year: 2021 ident: B1 article-title: Designing user-centric programming aids for kinesthetic teaching of collaborative robots publication-title: Robotics Aut. Syst. doi: 10.1016/j.robot.2021.103845 – volume: 8 start-page: 53901 year: 2020 ident: B17 article-title: Hole-filling of realsense depth images using a color edge map publication-title: IEEE Access doi: 10.1109/ACCESS.2020.2981378 – volume-title: DIN EN ISO 10218-1: Robotik sicherheitsanforderungen - teil 1: Industrieroboter year: 2012 ident: B21 – start-page: 5354 year: 2005 ident: B51 article-title: Eye-in-hand/eye-to-hand multi-camera visual servoing – volume: 14 start-page: 195 year: 1995 ident: B34 article-title: Hand-eye calibration publication-title: Int. J. Rob. Res. doi: 10.1177/027836499501400301 – start-page: 85 year: 2018 ident: B7 article-title: Using finite state machines in introductory robotics – start-page: 78 year: 2014 ident: B41 article-title: Integration of vision/force robot control for transporting different shaped/colored objects from moving circular conveyor – volume-title: User Manual UR10/CB3 - original instructions (en) year: 2015 ident: B63 – year: 2017 ident: B67 article-title: Hand keypoint detection in single images using multiview bootstrapping doi: 10.1109/CVPR.2017.494 – volume: 16 start-page: 1512 ident: B82 article-title: Haptics electromyography perception and learning enhanced intelligence for teleoperated robot publication-title: IEEE Trans. Autom. Sci. Eng. doi: 10.1109/tase.2018.2874454 – volume-title: OpenMMLab pose estimation toolbox and benchmark year: 2020 ident: B57 – volume-title: Mediapipe hands: On-device real-time hand tracking ident: B86 – volume: 39 start-page: 592 year: 2012 ident: B77 article-title: Pick-and-place application development using voice and visual commands publication-title: Industrial Robot An Int. J. doi: 10.1108/01439911211268796 – start-page: 1 year: 2020 ident: B84 article-title: Virtual experiments on aruco and apriltag systems comparison for fiducial marker rotation resistance under noisy sensory data – start-page: 1 ident: B12 article-title: Handing-over model-free objects to human hand with the help of vision/force robot control – volume: 30 start-page: 1 year: 2011 ident: B30 article-title: Domain transform for edge-aware image and video processing publication-title: ACM Trans. Graph. doi: 10.1145/2010324.1964964 – volume: 13 start-page: 168781402110040 year: 2021 ident: B89 article-title: A hybrid control strategy for grinding and polishing robot based on adaptive impedance control publication-title: Adv. Mech. Eng. doi: 10.1177/16878140211004034 – volume: 2 start-page: 252 year: 2018 ident: B60 article-title: Collaborative manipulation with multiple dual-arm robots under human guidance publication-title: Int. J. Intell. Robot. Appl. doi: 10.1007/s41315-018-0053-y – volume: 9 start-page: 393 year: 2016 ident: B45 article-title: A review on automatic speech recognition architecture and approaches publication-title: Int. J. Signal Process. Image Process. Pattern Recognit. doi: 10.14257/ijsip.2016.9.4.34 – volume: 2 start-page: 56 year: 2013 ident: B80 article-title: A user study on kinesthetic teaching of redundant robots in task and configuration space publication-title: J. Hum. Robot. Interact. doi: 10.5898/jhri.2.1.wrede – ident: B69 – volume: 57 start-page: 469 year: 2009 ident: B6 article-title: A survey of robot learning from demonstration publication-title: Robotics Aut. Syst. doi: 10.1016/j.robot.2008.10.024 – volume: 97 start-page: 123 year: 2021 ident: B39 article-title: Programming cobots by voice: A human-centered, web-based approach publication-title: Procedia CIRP doi: 10.1016/j.procir.2020.05.213 – volume-title: Posecnn: A convolutional neural network for 6d object pose estimation in cluttered scenes year: 2017 ident: B81 – volume: 63 start-page: 60 year: 2021 ident: B49 article-title: Automatic weld seam tracking of tube-to-tubesheet tig welding robot with multiple sensors publication-title: J. Manuf. Process. doi: 10.1016/j.jmapro.2020.03.047 – volume: 67 start-page: 102033 year: 2021 ident: B44 article-title: Human–robot co-manipulation during surface tooling: A general framework based on impedance control, haptic rendering and discrete geometry publication-title: Robotics Computer-Integrated Manuf. doi: 10.1016/j.rcim.2020.102033 – volume: 93 start-page: 1188 year: 2020 ident: B53 article-title: Symbiotic human-robot collaboration: Multimodal control using function blocks publication-title: Procedia CIRP doi: 10.1016/j.procir.2020.03.022 – volume: 10 start-page: 254 year: 2013 ident: B46 article-title: Spatial programming for industrial robots through task demonstration publication-title: Int. J. Adv. Robotic Syst. doi: 10.5772/55640 – volume: 71 start-page: 341 year: 2022 ident: B42 article-title: Robot polishing control with an active end effector based on macro-micro mechanism and the extended preston’s law publication-title: CIRP Ann. doi: 10.1016/j.cirp.2022.04.074 – volume: 63 start-page: 101923 ident: B85 article-title: Accurate dynamic modeling and control parameters design of an industrial hybrid spray-painting robot publication-title: Robotics Computer-Integrated Manuf. doi: 10.1016/j.rcim.2019.101923 – volume-title: Modularization of research software for collaborative open source development year: 2019 ident: B90 – volume-title: Fast robust peg-in-hole insertion with continuous visual servoing year: 2020 ident: B32 – start-page: 6825 year: 2022 ident: B71 article-title: Onepose: One-shot object pose estimation without cad models – volume: 11 start-page: 1467 year: 2021 ident: B72 article-title: Painting path planning for a painting robot with a realsense depth sensor publication-title: Appl. Sci. doi: 10.3390/app11041467 – start-page: 781 year: 2020 ident: B43 article-title: Experimental comparison of fiducial markers for pose estimation – volume: 104 start-page: 1280 year: 2021 ident: B13 article-title: Towards a cad-based automated robot offline-programming approach for disassembly publication-title: Procedia CIRP doi: 10.1016/j.procir.2021.11.215 – volume: 5 start-page: 345 year: 1989 ident: B75 article-title: A new technique for fully autonomous and efficient 3d robotics hand/eye calibration publication-title: IEEE Trans. Rob. Autom. doi: 10.1109/70.34770 – volume: 18 start-page: 286 year: 1999 ident: B19 article-title: Hand-eye calibration using dual quaternions publication-title: Int. J. Robotics Res. doi: 10.1177/02783649922066213 – volume-title: Industrieroboter - sicherheitsanforderungen - Teil 2: Robotersysteme und Integration year: 2021 ident: B22 – start-page: 517 volume-title: Materials engineering and automatic control II (trans tech publications ltd) year: 2013 ident: B61 article-title: Camera calibration method based on opencv – volume: 15 start-page: 5204 year: 2019 ident: B88 article-title: A sensorless hand guiding scheme based on model identification and control for industrial robot publication-title: IEEE Trans. Ind. Inf. doi: 10.1109/tii.2019.2900119 – volume: 42 start-page: 457 year: 2015 ident: B56 article-title: Manual guidance for industrial robot programming publication-title: Industrial Robot An Int. J. doi: 10.1108/ir-11-2014-0413 – start-page: 355 year: 2011 ident: B37 article-title: Usability of force-based controllers in physical human-robot interaction – volume-title: Industrial robotics year: 2016 ident: B31 doi: 10.1007/978-3-319-32552-1_54 – volume: 61 start-page: 896 year: 2013 ident: B58 article-title: Direct off-line robot programming via a common cad package publication-title: Robotics Aut. Syst. doi: 10.1016/j.robot.2013.02.005 – volume: 32 start-page: 132 year: 2021 ident: B52 article-title: Sensorless haptic control for human-robot collaborative assembly publication-title: CIRP J. Manuf. Sci. Technol. doi: 10.1016/j.cirpj.2020.11.015 – start-page: 362 year: 2021 ident: B54 article-title: Intel realsense sr305, d415 and l515: Experimental evaluation and comparison of depth estimation – volume: 51 start-page: 148 year: 2020 ident: B3 article-title: Programming by interactive demonstration for a human robot collaborative assembly publication-title: Procedia Manuf. doi: 10.1016/j.promfg.2020.10.022 – volume: 87 start-page: 639 year: 2016 ident: B73 article-title: Polishing pressure investigations of robot automatic polishing on curved surfaces publication-title: Int. J. Adv. Manuf. Technol. doi: 10.1007/s00170-016-8527-2 – volume-title: Intel RealSense D400 series product family year: 2015 ident: B38 – volume-title: Springer handbook of robotics year: 2008 ident: B14 article-title: Robot programming by demonstration doi: 10.1007/978-3-540-30301-5_60 – year: 2020 ident: B36 article-title: Awr: Adaptive weighting regression for 3d hand pose estimation doi: 10.1609/aaai.v34i07.6761 – volume: 14 start-page: 172988141769556 year: 2017 ident: B50 article-title: Real-time rgb-d image stitching using multiple kinects for improved field of view publication-title: Int. J. Adv. Robotic Syst. doi: 10.1177/1729881417695560 – volume-title: Speech is 3x faster than typing for English and Mandarin text entry on mobile devices year: 2016 ident: B64 – volume: 19 start-page: 763 ident: B83 article-title: A novel 3-d path extraction method for arc welding robot based on stereo structured light sensor publication-title: IEEE Sens. J. doi: 10.1109/jsen.2018.2877976 – volume: 22 start-page: 923 year: 2022 ident: B70 article-title: Robot system assistant (rosa): Towards intuitive multi-modal and multi-device human-robot interaction publication-title: Sensors doi: 10.3390/s22030923 – start-page: 205 year: 2016 ident: B76 article-title: Incrementally assisted kinesthetic teaching for programming by demonstration – volume: 22 start-page: 2633 year: 2016 ident: B55 article-title: Pose estimation for augmented reality: A hands-on survey publication-title: IEEE Trans. Vis. Comput. Graph. doi: 10.1109/TVCG.2015.2513408 – volume-title: vicCONTROL industrial version 6.3.0 - User guide - phytec Voice Control Kits (phyBOARD®-Mira). voice INTER connect GmbH year: 2022 ident: B79 – start-page: 10 year: 2022 ident: B35 article-title: Human-robot collaboration: a survey on the state of the art focusing on risk assessment – volume: 136 start-page: 326 year: 2019 ident: B2 article-title: Skill-based programming of complex robotic assembly tasks for industrial application publication-title: Elektrotech. Inftech. doi: 10.1007/s00502-019-00741-4 – volume: 16 start-page: 172988141985166 year: 2019 ident: B24 article-title: Stitching of depth and color images from multiple rgb-d sensors for extended field of view publication-title: Int. J. Adv. Robotic Syst. doi: 10.1177/1729881419851665 – start-page: 625 year: 2020 ident: B16 article-title: Virtual reality for offline programming of robotic applications with online teaching methods – volume: 76 start-page: 155 year: 2018 ident: B15 article-title: Intuitive robot programming using augmented reality publication-title: Procedia CIRP doi: 10.1016/j.procir.2018.02.028 – volume: 32 start-page: 1098 year: 2019 ident: B65 article-title: Operation of a haptic interface for offline programming of welding robots by applying a spring-damper model publication-title: Int. J. Comput. Integr. Manuf. doi: 10.1080/0951192x.2019.1686177 – volume: 30 start-page: 105676 year: 2020 ident: B33 article-title: Hgm-4: A new multi-cameras dataset for hand gesture recognition publication-title: Data Brief doi: 10.1016/j.dib.2020.105676 – start-page: 993 year: 2017 ident: B27 article-title: Learning generalizable surface cleaning actions from demonstration – volume: 3 start-page: 297 year: 2020 ident: B62 article-title: Recent advances in robot learning from demonstration publication-title: Annu. Rev. Control Robot. Auton. Syst. doi: 10.1146/annurev-control-100819-063206 – volume: 116 start-page: 162 year: 2019 ident: B26 article-title: Cobot programming for collaborative industrial tasks: An overview publication-title: Robotics Aut. Syst. doi: 10.1016/j.robot.2019.03.003 – volume: 21 start-page: 7770 year: 2021 ident: B66 article-title: Metrological characterization and comparison of d415, d455, l515 realsense devices in the close range publication-title: Sensors doi: 10.3390/s21227770 |
| SSID | ssj0001584377 |
| Score | 2.3431807 |
| Snippet | Industrial robots and cobots are widely deployed in most industrial sectors. However, robotic programming still needs a lot of time and effort in small batch... |
| SourceID | doaj pubmedcentral proquest crossref |
| SourceType | Open Website Open Access Repository Aggregation Database Enrichment Source Index Database |
| StartPage | 1001955 |
| SubjectTerms | human robot collaboration intuitive robot programming learning from demonstration multimodal intraction no-code robotic teaching Robotics and AI |
| Title | No-code robotic programming for agile production: A new markerless-approach for multimodal natural interaction in a human-robot collaboration context |
| URI | https://www.proquest.com/docview/2728146193 https://pubmed.ncbi.nlm.nih.gov/PMC9583918 https://doaj.org/article/df8fe4adf0774c4ab5f1fd46fa509c65 |
| Volume | 9 |
| WOSCitedRecordID | wos000875596300001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 2296-9144 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001584377 issn: 2296-9144 databaseCode: DOA dateStart: 20140101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 2296-9144 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001584377 issn: 2296-9144 databaseCode: M~E dateStart: 20140101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1Lb9QwEB6VqodyQFCK2BYqI3FDUfOw13ZvBbXiwopDkfZm-QmV2KTa3XLsv-D_MuNkq-QCFy5xZDuxkxlnZuKZbwDeKy1iVBxtk8RdwWvpC116NFaqxs1DUKVyPCebkIuFWi7111GqL_IJ6-GB-xd3HpJKkduQSlRUPLdOpCoFPk8WRZ2fZ_TSUuqRMdXHByveSNlHyaAVps_TunPkO1nXGXZIU2zfSBJlwP6Jljn1kRwJnevn8GzQFtllP8sXsBfbI3g6whB8Cb8XXUFx6QxH7rAbGzyuVtjKUCNl9jsufKoNPVDsBbtkqEuzFTnm0Fb7ptgBi-f-2cVw1QUcN6N-YkmYEus-AgLPmWU5s1-RR2QTTmLk-o7f-2P4dn118-lzMeRaKDznYls4nqKuUForEXXUtvFcJRm88DpJEZOOpXXaVrZssCibIIITUamEdY1CteUV7LddG18DQ2rMU-ks8kbFHd5MIzW0s1GmoOvazqDavXfjByByyofx06BBQrQymVaGaGUGWs3gw-M1dz0Mx197fyRyPvYkCO1cgYxlBsYy_2KsGbzbMYPBJUf7KLaN3f3G1LKmH6eo-s5ATrhkMuK0pb39kcG7tUCVtFIn_2OKp3BIj519C_kb2N-u7-NbOPC_treb9Rk8kUt1ltcFHr88XP0B1fobkQ |
| linkProvider | Directory of Open Access Journals |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=No-code+robotic+programming+for+agile+production%3A+A+new+markerless-approach+for+multimodal+natural+interaction+in+a+human-robot+collaboration+context&rft.jtitle=Frontiers+in+robotics+and+AI&rft.au=Halim%2C+Jayanto&rft.au=Eichler%2C+Paul&rft.au=Krusche%2C+Sebastian&rft.au=Bdiwi%2C+Mohamad&rft.date=2022-10-04&rft.pub=Frontiers+Media+S.A&rft.eissn=2296-9144&rft.volume=9&rft_id=info:doi/10.3389%2Ffrobt.2022.1001955&rft.externalDocID=PMC9583918 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2296-9144&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2296-9144&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2296-9144&client=summon |