Enhancing human-guided robotic assembly: AR-assisted DT for skill-based and low-code programming
Efficient and natural programming strategies play a crucial role in enabling human-guided robotic assembly to adapt quickly to dynamic tasks. The combination of Augmented Reality (AR) and Digital Twins (DT) has shown promising potential in enhancing the intuitiveness of human–robot interaction while...
Uložené v:
| Vydané v: | Journal of manufacturing systems Ročník 74; s. 676 - 689 |
|---|---|
| Hlavní autori: | , , , |
| Médium: | Journal Article |
| Jazyk: | English |
| Vydavateľské údaje: |
Elsevier Ltd
01.06.2024
|
| Predmet: | |
| ISSN: | 0278-6125, 1878-6642 |
| On-line prístup: | Získať plný text |
| Tagy: |
Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
|
| Abstract | Efficient and natural programming strategies play a crucial role in enabling human-guided robotic assembly to adapt quickly to dynamic tasks. The combination of Augmented Reality (AR) and Digital Twins (DT) has shown promising potential in enhancing the intuitiveness of human–robot interaction while leveraging digital representations of human intelligence to empower robots in manufacturing tasks. However, traditional programming methods lack intuitive interaction and rely heavily on simulation environments or pre-set CAD models, leading to high costs for both initial setup and sim-to-real deployment. On the other hand, existing AR-based robot control methods have primarily focused on the basic movements of robots, overlooking higher-level skills necessary for complex tasks. To address these limitations, this study introduces a four-layer system architecture that integrates AR-assisted DT into skill-based robotic assembly scenarios. Additionally, a skill-based and low-code programming system for human-guided robotic assembly is designed and implemented, which incorporates natural human guidance and robot autonomous intelligence to generate adaptive and feasible action plans. The feasibility and efficiency of the proposed system are verified by two case studies and a quantitative experiment comparing to traditional programming methods. The results demonstrate the usability of our AR-assisted DT approach in improving programming efficiency, intuitiveness, and safety for human-guided robotic assembly while reducing cognitive load.
•A system architecture combining AR and DT is proposed for skill-based human-guided robotic assembly.•A low-code robot programming method is designed for multi-granularity robot skill parameterization.•A robot programming system is implemented and verified by case studies in assembly scenarios. |
|---|---|
| AbstractList | Efficient and natural programming strategies play a crucial role in enabling human-guided robotic assembly to adapt quickly to dynamic tasks. The combination of Augmented Reality (AR) and Digital Twins (DT) has shown promising potential in enhancing the intuitiveness of human–robot interaction while leveraging digital representations of human intelligence to empower robots in manufacturing tasks. However, traditional programming methods lack intuitive interaction and rely heavily on simulation environments or pre-set CAD models, leading to high costs for both initial setup and sim-to-real deployment. On the other hand, existing AR-based robot control methods have primarily focused on the basic movements of robots, overlooking higher-level skills necessary for complex tasks. To address these limitations, this study introduces a four-layer system architecture that integrates AR-assisted DT into skill-based robotic assembly scenarios. Additionally, a skill-based and low-code programming system for human-guided robotic assembly is designed and implemented, which incorporates natural human guidance and robot autonomous intelligence to generate adaptive and feasible action plans. The feasibility and efficiency of the proposed system are verified by two case studies and a quantitative experiment comparing to traditional programming methods. The results demonstrate the usability of our AR-assisted DT approach in improving programming efficiency, intuitiveness, and safety for human-guided robotic assembly while reducing cognitive load.
•A system architecture combining AR and DT is proposed for skill-based human-guided robotic assembly.•A low-code robot programming method is designed for multi-granularity robot skill parameterization.•A robot programming system is implemented and verified by case studies in assembly scenarios. |
| Author | Yin, Yue Li, Chengxi Wan, Ke Zheng, Pai |
| Author_xml | – sequence: 1 givenname: Yue orcidid: 0000-0002-8376-6102 surname: Yin fullname: Yin, Yue organization: Research Institute for Advanced Manufacturing, Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China – sequence: 2 givenname: Pai orcidid: 0000-0002-2329-8634 surname: Zheng fullname: Zheng, Pai email: pai.zheng@polyu.edu.hk organization: Research Institute for Advanced Manufacturing, Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China – sequence: 3 givenname: Chengxi surname: Li fullname: Li, Chengxi organization: Research Institute for Advanced Manufacturing, Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China – sequence: 4 givenname: Ke orcidid: 0000-0002-9338-5207 surname: Wan fullname: Wan, Ke organization: Research Institute for Advanced Manufacturing, Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University, Hong Kong Special Administrative Region, China |
| BookMark | eNp9kF1LwzAUhoNMcFP_gFf9A5knaU0z8WbM-QEDQeZ1TJN0S22TkXTK_r0p88qLwYHz-bxw3gkaOe8MQjcEpgQIu22mTRcPUwq0mEIKws7QmPCSY8YKOkJjoENN6N0FmsTYABBaAB2jz6XbSqes22TbfScd3uytNjoLvvK9VZmM0XRVe7jP5u84NTb2afu4zmofsvhl2xZXMqaRdDpr_Q9WXptsF_wmyK5LslfovJZtNNd_-RJ9PC3Xixe8ent-XcxXWOUAPZYSdDWDWoGRYDgrOFU6z3mhVFlyxpkpZlXJZlVNua7KnBYGwNSFTse5VHV-ifhRVwUfYzC1ULaXvfWuD9K2goAYnBKNGJwSg1MCUhCWUPoP3QXbyXA4DT0cIZOe-rYmiKisccpoG4zqhfb2FP4LmXSGXw |
| CitedBy_id | crossref_primary_10_1016_j_jmsy_2025_02_001 crossref_primary_10_3390_robotics13080118 crossref_primary_10_1016_j_dte_2025_100039 crossref_primary_10_1016_j_jmsy_2024_11_017 crossref_primary_10_1016_j_jmsy_2025_09_003 crossref_primary_10_1016_j_rcim_2025_103103 crossref_primary_10_3390_robotics14040042 crossref_primary_10_1007_s42524_025_4136_9 crossref_primary_10_1016_j_cirp_2025_04_015 crossref_primary_10_1016_j_cirp_2025_04_058 crossref_primary_10_1016_j_rcim_2025_103064 |
| Cites_doi | 10.1016/j.jmsy.2021.11.001 10.1016/j.procir.2018.02.028 10.3390/s22134950 10.1016/j.jmsy.2023.02.010 10.1080/10447318.2023.2221599 10.1016/j.jmsy.2020.10.017 10.1016/j.cirp.2023.04.057 10.1016/j.rcim.2018.03.008 10.1016/j.rcim.2022.102515 10.1016/j.promfg.2017.07.131 10.1016/j.jmsy.2022.07.010 10.1016/j.ifacol.2018.08.236 10.1016/j.rcim.2022.102321 10.1016/j.rcim.2022.102366 10.1016/j.rcim.2021.102304 10.1016/j.rcim.2019.101820 10.1016/j.rcim.2011.08.004 10.1016/j.aei.2023.102203 10.1016/j.autcon.2022.104272 10.1162/pres.1997.6.4.355 10.1016/j.rcim.2022.102471 10.1145/3371382.3378300 10.1016/j.cirp.2022.03.024 10.1016/j.aei.2022.101820 |
| ContentType | Journal Article |
| Copyright | 2024 |
| Copyright_xml | – notice: 2024 |
| DBID | AAYXX CITATION |
| DOI | 10.1016/j.jmsy.2024.04.016 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1878-6642 |
| EndPage | 689 |
| ExternalDocumentID | 10_1016_j_jmsy_2024_04_016 S0278612524000827 |
| GroupedDBID | --K --M -~X .DC .~1 0R~ 1B1 1~. 1~5 29K 3EH 3V. 4.4 457 4G. 5GY 5VS 7-5 71M 7WY 883 88I 8AO 8FE 8FG 8FL 8FW 8G5 8P~ 8R4 8R5 9JN 9M8 AACTN AAEDT AAEDW AAIAV AAIKC AAIKJ AAKOC AALRI AAMNW AAOAW AAQFI AAQXK AAXUO ABFNM ABJCF ABJNI ABMAC ABUWG ABXDB ACDAQ ACGFO ACGFS ACGOD ACIWK ACNNM ACRLP ADBBV ADEZE ADMUD ADTZH AEBSH AECPX AEKER AENEX AFFNX AFKRA AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHJVU AIEXJ AIKHN AITUG AJOXV AKRWK ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ ARAPS ASPBG AVWKF AXJTR AZFZN AZQEC BENPR BEZIV BGLVJ BJAXD BKOJK BKOMP BLXMC BPHCQ C1A CCPQU CS3 D-I DU5 DWQXO E3Z EBS EFJIC EJD EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FRNLG FYGXN G-2 GBLVA GNUQQ GROUPED_ABI_INFORM_COMPLETE GROUPED_ABI_INFORM_RESEARCH GUQSH HCIFZ HVGLF HZ~ H~9 IHE J1W JJJVA K60 K6V K6~ K7- KOM L6V LY7 M0C M0F M0N M2O M2P M41 M7S MO0 MS~ N9A O-L O9- OAUVE OZT P-8 P-9 P2P P62 PC. PQBIZ PQBZA PQQKQ PRG PROAC PTHSS Q2X Q38 R2- RIG ROL RPZ RWL S0X SDF SES SET SPC SPCBC SST SSZ T5K TAE TN5 U5U WH7 WUQ ZHY ~G- 9DU AATTM AAXKI AAYWO AAYXX ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFFHD AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKYEP ANKPU APXCP CITATION EFKBS EFLBG PHGZM PHGZT PQGLB ~HD |
| ID | FETCH-LOGICAL-c300t-aa0db90fc0ea0e86482cd3384cc778686e49b769bf28db7324e00ef4d0e83acf3 |
| ISICitedReferencesCount | 17 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001237856600001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0278-6125 |
| IngestDate | Sat Nov 29 03:35:04 EST 2025 Tue Nov 18 22:30:17 EST 2025 Sat Jul 13 15:32:45 EDT 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Robotic assembly Human–robot interaction Digital twin Augmented reality Robot programming |
| Language | English |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c300t-aa0db90fc0ea0e86482cd3384cc778686e49b769bf28db7324e00ef4d0e83acf3 |
| ORCID | 0000-0002-8376-6102 0000-0002-2329-8634 0000-0002-9338-5207 |
| PageCount | 14 |
| ParticipantIDs | crossref_citationtrail_10_1016_j_jmsy_2024_04_016 crossref_primary_10_1016_j_jmsy_2024_04_016 elsevier_sciencedirect_doi_10_1016_j_jmsy_2024_04_016 |
| PublicationCentury | 2000 |
| PublicationDate | June 2024 2024-06-00 |
| PublicationDateYYYYMMDD | 2024-06-01 |
| PublicationDate_xml | – month: 06 year: 2024 text: June 2024 |
| PublicationDecade | 2020 |
| PublicationTitle | Journal of manufacturing systems |
| PublicationYear | 2024 |
| Publisher | Elsevier Ltd |
| Publisher_xml | – name: Elsevier Ltd |
| References | Yin, Zheng, Li, Wang (b6) 2023; 81 Settimi, Gamerro, Weinand (b8) 2022; 139 Schou, Andersen, Chrysostomou, Bøgh, Madsen (b14) 2018; 53 Zou, Andulkar, Berger (b4) 2018 Kapinus, Beran, Materna, Bambušek (b17) 2019 Fan, Zheng, Li (b36) 2022; 75 Li, Zheng, Li, Pang, Lee (b19) 2022; 76 Ji, Liu, Xu, Yao, Liu, Zhou (b21) 2021 Jiang, Huang, Yang, Yang (b34) 2022; 78 Heimann, Guhl (b2) 2020; Vol. 1 Baroroh, Chu, Wang (b7) 2021; 61 Rivera-Pinto, Kildal, Lazkano (b24) 2023 Halt, Nagele, Tenbrock, Pott (b40) 2018 Krieglstein, Held, Bálint, Nägele, Kraus (b28) 2023 I.K. Final. Bambuŝek, Materna, Kapinus, Beran, Smrž (b27) 2019 Zheng, Li, Fan, Li, Wang (b35) 2023 Wang (b1) 2022; 62 Liu, Wang, Wang (b30) 2022; 71 Gallala, Kumar, Hichri, Plapper (b26) 2022; 22 Pan, Polden, Larkin, Van Duin, Norrish (b3) 2012; 28 ISO/DIS 23247-1 (b31) 2020 Matthaiakis, Dimoulas, Athanasatos, Mparis, Dimitrakopoulos, Gkournelos (b15) 2017; 11 Blankemeyer, Wiemann, Posniak, Pregizer, Raatz (b18) 2018; 76 Liu, Bao, Zheng (b9) 2023; 67 Akan, Ameri, Cürüklü, Asplund (b29) 2011 Ong, Yew, Thanigaivel, Nee (b22) 2020; 61 Wang, Zheng, Li, Wang (b33) 2023 Villani, Pini, Leali, Secchi, Fantuzzi (b5) 2018; 51 Huang, Wang, Li, Zheng, Mourtzis, Wang (b11) 2022; 64 Gäbert, Djemal, Hellara, Atitallah, Ramalingame, Barioul (b16) 2022 . Villagrossi, Delledonne, Faroni, Beschi, Pedrocchi (b12) 2023 Perzylo, Somani, Profanter, Kessler, Rickert, Knoll (b13) 2016 Yin, Zheng, Li, Cong, Pang (b38) 2023; 58 Azuma (b32) 1997; 6 Yang, Xiao, Zhang (b25) 2023 Quintero, Li, Pan, Chan, Van der Loos, Croft (b20) 2018 Ajaykumar Gopika, Huang Chien-Ming. User needs and design opportunities in end-user robot programming. In: Companion of the 2020 ACM/IEEE international conference on human-robot interaction. 2020, p. 93–5. Li, Zheng, Yin, Pang, Huo (b23) 2023; 80 Vann, Zhou, Zhu, Du (b37) 2023; 55 Yang (10.1016/j.jmsy.2024.04.016_b25) 2023 Vann (10.1016/j.jmsy.2024.04.016_b37) 2023; 55 Villani (10.1016/j.jmsy.2024.04.016_b5) 2018; 51 Ong (10.1016/j.jmsy.2024.04.016_b22) 2020; 61 Bambuŝek (10.1016/j.jmsy.2024.04.016_b27) 2019 Baroroh (10.1016/j.jmsy.2024.04.016_b7) 2021; 61 Zheng (10.1016/j.jmsy.2024.04.016_b35) 2023 Halt (10.1016/j.jmsy.2024.04.016_b40) 2018 Matthaiakis (10.1016/j.jmsy.2024.04.016_b15) 2017; 11 Gäbert (10.1016/j.jmsy.2024.04.016_b16) 2022 Settimi (10.1016/j.jmsy.2024.04.016_b8) 2022; 139 Li (10.1016/j.jmsy.2024.04.016_b23) 2023; 80 Heimann (10.1016/j.jmsy.2024.04.016_b2) 2020; Vol. 1 Perzylo (10.1016/j.jmsy.2024.04.016_b13) 2016 Azuma (10.1016/j.jmsy.2024.04.016_b32) 1997; 6 Blankemeyer (10.1016/j.jmsy.2024.04.016_b18) 2018; 76 Quintero (10.1016/j.jmsy.2024.04.016_b20) 2018 Kapinus (10.1016/j.jmsy.2024.04.016_b17) 2019 Fan (10.1016/j.jmsy.2024.04.016_b36) 2022; 75 Zou (10.1016/j.jmsy.2024.04.016_b4) 2018 Wang (10.1016/j.jmsy.2024.04.016_b33) 2023 Yin (10.1016/j.jmsy.2024.04.016_b38) 2023; 58 Huang (10.1016/j.jmsy.2024.04.016_b11) 2022; 64 Liu (10.1016/j.jmsy.2024.04.016_b30) 2022; 71 Rivera-Pinto (10.1016/j.jmsy.2024.04.016_b24) 2023 Villagrossi (10.1016/j.jmsy.2024.04.016_b12) 2023 Jiang (10.1016/j.jmsy.2024.04.016_b34) 2022; 78 Akan (10.1016/j.jmsy.2024.04.016_b29) 2011 Schou (10.1016/j.jmsy.2024.04.016_b14) 2018; 53 Gallala (10.1016/j.jmsy.2024.04.016_b26) 2022; 22 Pan (10.1016/j.jmsy.2024.04.016_b3) 2012; 28 ISO/DIS 23247-1 (10.1016/j.jmsy.2024.04.016_b31) 2020 Liu (10.1016/j.jmsy.2024.04.016_b9) 2023; 67 10.1016/j.jmsy.2024.04.016_b10 Krieglstein (10.1016/j.jmsy.2024.04.016_b28) 2023 Yin (10.1016/j.jmsy.2024.04.016_b6) 2023; 81 Wang (10.1016/j.jmsy.2024.04.016_b1) 2022; 62 Ji (10.1016/j.jmsy.2024.04.016_b21) 2021 Li (10.1016/j.jmsy.2024.04.016_b19) 2022; 76 10.1016/j.jmsy.2024.04.016_b39 |
| References_xml | – volume: 81 year: 2023 ident: b6 article-title: A state-of-the-art survey on Augmented Reality-assisted digital twin for futuristic human-centric industry transformation publication-title: Robot Comput-Integr Manuf – start-page: 11612 year: 2023 end-page: 11618 ident: b28 article-title: Skill-based robot programming in mixed reality with ad-hoc validation using a force-enabled digital twin publication-title: 2023 IEEE international conference on robotics and automation – reference: I.K. Final. – start-page: 1838 year: 2018 end-page: 1844 ident: b20 article-title: Robot programming through augmented trajectories in augmented reality publication-title: 2018 IEEE/RSJ international conference on intelligent robots and systems – year: 2023 ident: b33 article-title: Multimodal human–robot interaction for human-centric smart manufacturing: A survey publication-title: Adv Intell Syst – reference: Ajaykumar Gopika, Huang Chien-Ming. User needs and design opportunities in end-user robot programming. In: Companion of the 2020 ACM/IEEE international conference on human-robot interaction. 2020, p. 93–5. – start-page: 1 year: 2023 end-page: 20 ident: b12 article-title: Hiding task-oriented programming complexity: an industrial case study publication-title: Int J Comput Integr Manuf – volume: 76 start-page: 155 year: 2018 end-page: 160 ident: b18 article-title: Intuitive robot programming using augmented reality publication-title: Procedia CIRP – year: 2023 ident: b35 article-title: A collaborative intelligence-based approach for handling human-robot collaboration uncertainties publication-title: CIRP Ann – volume: 64 start-page: 424 year: 2022 end-page: 428 ident: b11 article-title: Industry 5.0 and society 5.0—Comparison, complementation and co-evolution publication-title: J Manuf Syst – volume: 11 start-page: 431 year: 2017 end-page: 440 ident: b15 article-title: Flexible programming tool enabling synergy between human and robot publication-title: Procedia Manuf – volume: 76 year: 2022 ident: b19 article-title: AR-assisted digital twin-enabled robot collaborative manufacturing system with human-in-the-loop publication-title: Robot Comput-Integr Manuf – start-page: 520 year: 2018 end-page: 526 ident: b40 article-title: Intuitive constraint-based robot programming for robotic assembly tasks publication-title: 2018 IEEE international conference on robotics and automation – volume: 62 start-page: 199 year: 2022 end-page: 201 ident: b1 article-title: A futuristic perspective on human-centric assembly publication-title: J Manuf Syst – start-page: 1 year: 2023 end-page: 19 ident: b25 article-title: HA R 2 bot: a human-centered augmented reality robot programming method with the awareness of cognitive load publication-title: J Intell Manuf – volume: 6 start-page: 355 year: 1997 end-page: 385 ident: b32 article-title: A survey of augmented reality publication-title: Presence: Teleoperat Virt Environ – volume: 67 start-page: 361 year: 2023 end-page: 378 ident: b9 article-title: A review of digital twin-driven machining: From digitization to intellectualization publication-title: J Manuf Syst – volume: 80 year: 2023 ident: b23 article-title: An AR-assisted Deep Reinforcement learning-based approach towards mutual-cognitive safe human-robot interaction publication-title: Robot Comput-Integr Manuf – volume: 78 year: 2022 ident: b34 article-title: A review of robotic assembly strategies for the full operation procedure: Planning, execution and evaluation publication-title: Robot Comput-Integr Manuf – year: 2020 ident: b31 article-title: Automation systems and integration–Digital Twin framework for manufacturing–Part 1: Overview and general principles – volume: 58 year: 2023 ident: b38 article-title: An empirical study of an MR-enhanced kinematic prototyping approach for articulated products publication-title: Adv Eng Inform – volume: 75 year: 2022 ident: b36 article-title: Vision-based holistic scene understanding towards proactive human–robot collaboration publication-title: Robot Comput-Integr Manuf – volume: 55 year: 2023 ident: b37 article-title: Enabling automated facility maintenance from articulated robot Collision-Free designs publication-title: Adv Eng Inform – start-page: 1 year: 2023 end-page: 13 ident: b24 article-title: Toward programming a collaborative robot by interacting with its digital twin in a mixed reality environment publication-title: Int. J. Hum.–Comput. Interact. – start-page: 1 year: 2022 end-page: 6 ident: b16 article-title: Gesture based symbiotic robot programming for agile production publication-title: 2022 IEEE 9th international conference on computational intelligence and virtual environments for measurement systems and applications – start-page: 1 year: 2018 end-page: 7 ident: b4 article-title: Development of robot programming system through the use of augmented reality for assembly tasks publication-title: ISR 2018; 50th international symposium on robotics – start-page: 2293 year: 2016 end-page: 2300 ident: b13 article-title: Intuitive instruction of industrial robots: Semantic process descriptions for small lot production publication-title: 2016 IEEE/RSJ international conference on intelligent robots and systems – volume: 53 start-page: 72 year: 2018 end-page: 80 ident: b14 article-title: Skill-based instruction of collaborative robots in industrial settings publication-title: Robot Comput-Integr Manuf – start-page: 1 year: 2019 end-page: 8 ident: b17 article-title: Spatially situated end-user robot programming in augmented reality publication-title: 2019 28th IEEE international conference on robot and human interactive communication – reference: . – volume: 61 year: 2020 ident: b22 article-title: Augmented reality-assisted robot programming system for industrial applications publication-title: Robot Comput-Integr Manuf – start-page: 1 year: 2021 end-page: 16 ident: b21 article-title: A closed-loop brain-computer interface with augmented reality feedback for industrial human-robot collaboration publication-title: Int J Adv Manuf Technol – volume: 28 start-page: 87 year: 2012 end-page: 94 ident: b3 article-title: Recent progress on programming methods for industrial robots publication-title: Robot Comput-Integr Manuf – volume: 51 start-page: 66 year: 2018 end-page: 71 ident: b5 article-title: Survey on human-robot interaction for robot programming in industrial applications publication-title: Ifac-PapersOnline – volume: 61 start-page: 696 year: 2021 end-page: 711 ident: b7 article-title: Systematic literature review on augmented reality in smart manufacturing: Collaboration between human and computational intelligence publication-title: J Manuf Syst – start-page: 1 year: 2019 end-page: 8 ident: b27 article-title: Combining interactive spatial augmented reality with head-mounted display for end-user collaborative robot programming publication-title: 2019 28th IEEE international conference on robot and human interactive communication – volume: 22 start-page: 4950 year: 2022 ident: b26 article-title: Digital twin for human–robot interactions by means of industry 4.0 enabling technologies publication-title: Sensors – volume: 71 start-page: 25 year: 2022 end-page: 28 ident: b30 article-title: Digital twin-enabled advance execution for human-robot collaborative assembly publication-title: CIRP Ann – volume: 139 year: 2022 ident: b8 article-title: Augmented-reality-assisted timber drilling with smart retrofitted tools publication-title: Autom Constr – start-page: 3934 year: 2011 end-page: 3939 ident: b29 article-title: Intuitive industrial robot programming through incremental multimodal language and augmented reality publication-title: 2011 IEEE international conference on robotics and automation – volume: Vol. 1 start-page: 696 year: 2020 end-page: 703 ident: b2 article-title: Industrial robot programming methods: A scoping review publication-title: 2020 25th IEEE international conference on emerging technologies and factory automation – volume: 62 start-page: 199 year: 2022 ident: 10.1016/j.jmsy.2024.04.016_b1 article-title: A futuristic perspective on human-centric assembly publication-title: J Manuf Syst doi: 10.1016/j.jmsy.2021.11.001 – volume: Vol. 1 start-page: 696 year: 2020 ident: 10.1016/j.jmsy.2024.04.016_b2 article-title: Industrial robot programming methods: A scoping review – volume: 76 start-page: 155 year: 2018 ident: 10.1016/j.jmsy.2024.04.016_b18 article-title: Intuitive robot programming using augmented reality publication-title: Procedia CIRP doi: 10.1016/j.procir.2018.02.028 – volume: 22 start-page: 4950 issue: 13 year: 2022 ident: 10.1016/j.jmsy.2024.04.016_b26 article-title: Digital twin for human–robot interactions by means of industry 4.0 enabling technologies publication-title: Sensors doi: 10.3390/s22134950 – start-page: 3934 year: 2011 ident: 10.1016/j.jmsy.2024.04.016_b29 article-title: Intuitive industrial robot programming through incremental multimodal language and augmented reality – year: 2020 ident: 10.1016/j.jmsy.2024.04.016_b31 – start-page: 1 year: 2018 ident: 10.1016/j.jmsy.2024.04.016_b4 article-title: Development of robot programming system through the use of augmented reality for assembly tasks – volume: 67 start-page: 361 year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b9 article-title: A review of digital twin-driven machining: From digitization to intellectualization publication-title: J Manuf Syst doi: 10.1016/j.jmsy.2023.02.010 – year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b33 article-title: Multimodal human–robot interaction for human-centric smart manufacturing: A survey publication-title: Adv Intell Syst – start-page: 1 year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b24 article-title: Toward programming a collaborative robot by interacting with its digital twin in a mixed reality environment publication-title: Int. J. Hum.–Comput. Interact. doi: 10.1080/10447318.2023.2221599 – volume: 61 start-page: 696 year: 2021 ident: 10.1016/j.jmsy.2024.04.016_b7 article-title: Systematic literature review on augmented reality in smart manufacturing: Collaboration between human and computational intelligence publication-title: J Manuf Syst doi: 10.1016/j.jmsy.2020.10.017 – year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b35 article-title: A collaborative intelligence-based approach for handling human-robot collaboration uncertainties publication-title: CIRP Ann doi: 10.1016/j.cirp.2023.04.057 – volume: 53 start-page: 72 year: 2018 ident: 10.1016/j.jmsy.2024.04.016_b14 article-title: Skill-based instruction of collaborative robots in industrial settings publication-title: Robot Comput-Integr Manuf doi: 10.1016/j.rcim.2018.03.008 – start-page: 1 year: 2019 ident: 10.1016/j.jmsy.2024.04.016_b17 article-title: Spatially situated end-user robot programming in augmented reality – volume: 81 year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b6 article-title: A state-of-the-art survey on Augmented Reality-assisted digital twin for futuristic human-centric industry transformation publication-title: Robot Comput-Integr Manuf doi: 10.1016/j.rcim.2022.102515 – volume: 11 start-page: 431 year: 2017 ident: 10.1016/j.jmsy.2024.04.016_b15 article-title: Flexible programming tool enabling synergy between human and robot publication-title: Procedia Manuf doi: 10.1016/j.promfg.2017.07.131 – start-page: 11612 year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b28 article-title: Skill-based robot programming in mixed reality with ad-hoc validation using a force-enabled digital twin – volume: 64 start-page: 424 year: 2022 ident: 10.1016/j.jmsy.2024.04.016_b11 article-title: Industry 5.0 and society 5.0—Comparison, complementation and co-evolution publication-title: J Manuf Syst doi: 10.1016/j.jmsy.2022.07.010 – volume: 51 start-page: 66 issue: 11 year: 2018 ident: 10.1016/j.jmsy.2024.04.016_b5 article-title: Survey on human-robot interaction for robot programming in industrial applications publication-title: Ifac-PapersOnline doi: 10.1016/j.ifacol.2018.08.236 – volume: 76 year: 2022 ident: 10.1016/j.jmsy.2024.04.016_b19 article-title: AR-assisted digital twin-enabled robot collaborative manufacturing system with human-in-the-loop publication-title: Robot Comput-Integr Manuf doi: 10.1016/j.rcim.2022.102321 – volume: 78 year: 2022 ident: 10.1016/j.jmsy.2024.04.016_b34 article-title: A review of robotic assembly strategies for the full operation procedure: Planning, execution and evaluation publication-title: Robot Comput-Integr Manuf doi: 10.1016/j.rcim.2022.102366 – volume: 75 year: 2022 ident: 10.1016/j.jmsy.2024.04.016_b36 article-title: Vision-based holistic scene understanding towards proactive human–robot collaboration publication-title: Robot Comput-Integr Manuf doi: 10.1016/j.rcim.2021.102304 – ident: 10.1016/j.jmsy.2024.04.016_b39 – start-page: 2293 year: 2016 ident: 10.1016/j.jmsy.2024.04.016_b13 article-title: Intuitive instruction of industrial robots: Semantic process descriptions for small lot production – start-page: 1838 year: 2018 ident: 10.1016/j.jmsy.2024.04.016_b20 article-title: Robot programming through augmented trajectories in augmented reality – volume: 61 year: 2020 ident: 10.1016/j.jmsy.2024.04.016_b22 article-title: Augmented reality-assisted robot programming system for industrial applications publication-title: Robot Comput-Integr Manuf doi: 10.1016/j.rcim.2019.101820 – volume: 28 start-page: 87 issue: 2 year: 2012 ident: 10.1016/j.jmsy.2024.04.016_b3 article-title: Recent progress on programming methods for industrial robots publication-title: Robot Comput-Integr Manuf doi: 10.1016/j.rcim.2011.08.004 – volume: 58 year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b38 article-title: An empirical study of an MR-enhanced kinematic prototyping approach for articulated products publication-title: Adv Eng Inform doi: 10.1016/j.aei.2023.102203 – start-page: 1 year: 2021 ident: 10.1016/j.jmsy.2024.04.016_b21 article-title: A closed-loop brain-computer interface with augmented reality feedback for industrial human-robot collaboration publication-title: Int J Adv Manuf Technol – start-page: 520 year: 2018 ident: 10.1016/j.jmsy.2024.04.016_b40 article-title: Intuitive constraint-based robot programming for robotic assembly tasks – volume: 139 year: 2022 ident: 10.1016/j.jmsy.2024.04.016_b8 article-title: Augmented-reality-assisted timber drilling with smart retrofitted tools publication-title: Autom Constr doi: 10.1016/j.autcon.2022.104272 – start-page: 1 year: 2019 ident: 10.1016/j.jmsy.2024.04.016_b27 article-title: Combining interactive spatial augmented reality with head-mounted display for end-user collaborative robot programming – start-page: 1 year: 2022 ident: 10.1016/j.jmsy.2024.04.016_b16 article-title: Gesture based symbiotic robot programming for agile production – volume: 6 start-page: 355 issue: 4 year: 1997 ident: 10.1016/j.jmsy.2024.04.016_b32 article-title: A survey of augmented reality publication-title: Presence: Teleoperat Virt Environ doi: 10.1162/pres.1997.6.4.355 – volume: 80 year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b23 article-title: An AR-assisted Deep Reinforcement learning-based approach towards mutual-cognitive safe human-robot interaction publication-title: Robot Comput-Integr Manuf doi: 10.1016/j.rcim.2022.102471 – ident: 10.1016/j.jmsy.2024.04.016_b10 doi: 10.1145/3371382.3378300 – start-page: 1 year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b12 article-title: Hiding task-oriented programming complexity: an industrial case study publication-title: Int J Comput Integr Manuf – start-page: 1 year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b25 article-title: HA R 2 bot: a human-centered augmented reality robot programming method with the awareness of cognitive load publication-title: J Intell Manuf – volume: 71 start-page: 25 issue: 1 year: 2022 ident: 10.1016/j.jmsy.2024.04.016_b30 article-title: Digital twin-enabled advance execution for human-robot collaborative assembly publication-title: CIRP Ann doi: 10.1016/j.cirp.2022.03.024 – volume: 55 year: 2023 ident: 10.1016/j.jmsy.2024.04.016_b37 article-title: Enabling automated facility maintenance from articulated robot Collision-Free designs publication-title: Adv Eng Inform doi: 10.1016/j.aei.2022.101820 |
| SSID | ssj0012402 |
| Score | 2.4423304 |
| Snippet | Efficient and natural programming strategies play a crucial role in enabling human-guided robotic assembly to adapt quickly to dynamic tasks. The combination... |
| SourceID | crossref elsevier |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 676 |
| SubjectTerms | Augmented reality Digital twin Human–robot interaction Robot programming Robotic assembly |
| Title | Enhancing human-guided robotic assembly: AR-assisted DT for skill-based and low-code programming |
| URI | https://dx.doi.org/10.1016/j.jmsy.2024.04.016 |
| Volume | 74 |
| WOSCitedRecordID | wos001237856600001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1878-6642 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0012402 issn: 0278-6125 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3Pb9MwFLbKxgEO0_iljTHkA7cqk5s4scOtYp0GSNOEiihcQvwjW0qaTk07yo0_nec4yaxtTOyAVEWtm9ht39fnz85730PoDZUSljcs9FTMYIGS0dDjoVaAZekzkfqaC1EXm2AnJ3wyiU97vd9tLsxlwcqSr9fxxX81NbSBsU3q7D3M3XUKDfAcjA5HMDsc_8nwo_LcaGiUZ7b-nne2yhWwysVczGtx1qrSM1HUQk_DTx68NIZW_cNxHXFY_ciLwjNzW63h2i_mPz2T9t4Gcs3aqe4moYXBViZPwiY-Vo4UuvEqVqvg66oD0rdzbf3MaZp3YUG5DQGAd9Zd4xe7R_tRuzsUPr2KpGocmQ8rVcOkXK_LqOM2IxY5M3BkiwrdcO52n2F6MJ1Vvw7MQLVI7eAWJe1rM1wXd9iGtE0T00di-kgIPAbRA7TpszAG1745fD-afOjuRJm7T_U-XfMdmsQrGyN4_ZPcTm4cwjLeRluNYfDQIuQJ6unyKXrs6E8-Q987rGAXK7jBCm6x8hY7SMGHYwxIwQ5SMCAFt0jBDlKeo89Ho_G7Y68pueHJgJCll6ZEiZhkkuiUaB5R7ksVBBz-0kZokEeaxoJFsch8rgQDNq4J0RlVcHKQyix4gTbKeal3EBZMAldmkYAlB1WwOvIZJWnEgc9rRZjYRYP2t0pko0dvyqIUyd-ttIv63TUXVo3lzrPD1gRJwyctT0wAUXdc9_Jeo-yhR1egf4U2louV3kcP5eUyrxavGzj9AcDTl84 |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Enhancing+human-guided+robotic+assembly%3A+AR-assisted+DT+for+skill-based+and+low-code+programming&rft.jtitle=Journal+of+manufacturing+systems&rft.au=Yin%2C+Yue&rft.au=Zheng%2C+Pai&rft.au=Li%2C+Chengxi&rft.au=Wan%2C+Ke&rft.date=2024-06-01&rft.issn=0278-6125&rft.volume=74&rft.spage=676&rft.epage=689&rft_id=info:doi/10.1016%2Fj.jmsy.2024.04.016&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_jmsy_2024_04_016 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0278-6125&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0278-6125&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0278-6125&client=summon |