Object Detection and Text Recognition for Immersive Augmented Reality Training in Laser Powder Bed Fusion
Professional Training for laser powder bed fusion equipment operation typically is time consuming and expensive for end-users in metal Additive Manufacturing (AM). This study proposes a practical solution by leveraging Hyperskill software to develop a immersive training program compatible with Augme...
Saved in:
| Published in: | Procedia computer science Vol. 232; pp. 913 - 923 |
|---|---|
| Main Authors: | , , , , , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
Elsevier B.V
2024
|
| Subjects: | |
| ISSN: | 1877-0509, 1877-0509 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | Professional Training for laser powder bed fusion equipment operation typically is time consuming and expensive for end-users in metal Additive Manufacturing (AM). This study proposes a practical solution by leveraging Hyperskill software to develop a immersive training program compatible with Augmented Reality (AR) devices. The program incorporates the YOLOv7 object detection algorithm and the CRAFT(Character Region Awareness for Text detection) Four-stage text recognition algorithm, seamlessly bridging the gap between reality and simulation. Through a human subjects study, we demonstrate the effectiveness and viability of the AR program, showcasing its capacity to deliver real-time, comprehensive training in metal AM processes. This approach offers a balanced and efficient solution for improving professional training in the field of metal AM. |
|---|---|
| AbstractList | Professional Training for laser powder bed fusion equipment operation typically is time consuming and expensive for end-users in metal Additive Manufacturing (AM). This study proposes a practical solution by leveraging Hyperskill software to develop a immersive training program compatible with Augmented Reality (AR) devices. The program incorporates the YOLOv7 object detection algorithm and the CRAFT(Character Region Awareness for Text detection) Four-stage text recognition algorithm, seamlessly bridging the gap between reality and simulation. Through a human subjects study, we demonstrate the effectiveness and viability of the AR program, showcasing its capacity to deliver real-time, comprehensive training in metal AM processes. This approach offers a balanced and efficient solution for improving professional training in the field of metal AM. |
| Author | Jiao, Yecheng Li, Bingbing Li, Yuanchen Fuh, Jerry Yuan, Yizhuo Zhang, Hongji Wang, Yiqin Lu, Wenfeng |
| Author_xml | – sequence: 1 givenname: Hongji surname: Zhang fullname: Zhang, Hongji organization: Department of Mechanical Engineering, National University of Singapore, Singapore 119077, Singapore – sequence: 2 givenname: Yecheng surname: Jiao fullname: Jiao, Yecheng organization: Department of Mechanical Engineering, National University of Singapore, Singapore 119077, Singapore – sequence: 3 givenname: Yizhuo surname: Yuan fullname: Yuan, Yizhuo organization: Department of Mechanical Engineering, National University of Singapore, Singapore 119077, Singapore – sequence: 4 givenname: Yuanchen surname: Li fullname: Li, Yuanchen organization: Department of Mechanical Engineering, National University of Singapore, Singapore 119077, Singapore – sequence: 5 givenname: Yiqin surname: Wang fullname: Wang, Yiqin organization: Department of Mechanical Engineering, National University of Singapore, Singapore 119077, Singapore – sequence: 6 givenname: Wenfeng surname: Lu fullname: Lu, Wenfeng organization: Department of Mechanical Engineering, National University of Singapore, Singapore 119077, Singapore – sequence: 7 givenname: Jerry surname: Fuh fullname: Fuh, Jerry organization: Department of Mechanical Engineering, National University of Singapore, Singapore 119077, Singapore – sequence: 8 givenname: Bingbing surname: Li fullname: Li, Bingbing email: bingbing.li@csun.edu organization: Department of Mechanical Engineering, National University of Singapore, Singapore 119077, Singapore |
| BookMark | eNqFkNFOwjAUhhuDiYg8gTd9gc22G1t34QWiKAkJxuB107VnpAu0pB0ob28BL4wX2qT5m_Z8Jz3fNepZZwGhW0pSSmhx16Zb71RIGWF5SmhKKnqB-pSXZUJGpOr9OF-hYQgtiSvjvKJlH5lF3YLq8CN0MYyzWFqNl_DZ4TdQbmXN6bJxHs82G_DB7AGPd6sN2A50rJFr0x3w0ktjjV1hY_FcBvD41X3oGA-xaLoLsccNumzkOsDwOwfoffq0nLwk88XzbDKeJyrLeZeoPJOUKa4lyeIuCPCqoVKzIq_ViHFdlEqXnDNC66Yos7KppaoYIUrVLD5lA1Sd-yrvQvDQCGU6eZyii59cC0rEUZtoxUmbOGoThIqoLbLZL3brzUb6wz_U_ZmCONbegBdBGbAKtPFRqtDO_Ml_AX2Si8M |
| CitedBy_id | crossref_primary_10_1016_j_jmsy_2024_06_007 |
| Cites_doi | 10.1002/amp2.10130 10.1016/j.addma.2016.03.001 10.3390/s22166246 10.1002/amp2.10129 10.1515/9781580468619 10.1162/neco.1989.1.4.541 10.1016/j.compedu.2019.103778 10.1016/j.ssaho.2023.100532 10.1016/j.jmsy.2021.08.009 |
| ContentType | Journal Article |
| Copyright | 2024 |
| Copyright_xml | – notice: 2024 |
| DBID | 6I. AAFTH AAYXX CITATION |
| DOI | 10.1016/j.procs.2024.01.091 |
| DatabaseName | ScienceDirect Open Access Titles Elsevier:ScienceDirect:Open Access CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 1877-0509 |
| EndPage | 923 |
| ExternalDocumentID | 10_1016_j_procs_2024_01_091 S1877050924000917 |
| GroupedDBID | --K 0R~ 0SF 1B1 457 5VS 6I. 71M AACTN AAEDT AAEDW AAFTH AAIKJ AALRI AAQFI AAXUO ABMAC ABWVN ACGFS ACRPL ADBBV ADEZE ADNMO ADVLN AEXQZ AFTJW AGHFR AITUG AKRWK ALMA_UNASSIGNED_HOLDINGS AMRAJ E3Z EBS EJD EP3 FDB FNPLU HZ~ IXB KQ8 M41 M~E NCXOZ O-L O9- OK1 P2P RIG ROL SES SSZ 9DU AAYWO AAYXX ACVFH ADCNI AEUPX AFPUW AIGII AKBMS AKYEP CITATION ~HD |
| ID | FETCH-LOGICAL-c348t-c43a12c8da03da060e89f1ad264bc528d67cd788201bf6737fbac9200ccb27cd3 |
| ISICitedReferencesCount | 1 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001196800600091&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1877-0509 |
| IngestDate | Sat Nov 29 03:08:01 EST 2025 Tue Nov 18 22:17:37 EST 2025 Sat Jan 11 15:48:49 EST 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Object Detection Immersive Augmented Reality Training Text Recognition Metal Additive Manufacturing |
| Language | English |
| License | This is an open access article under the CC BY-NC-ND license. |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c348t-c43a12c8da03da060e89f1ad264bc528d67cd788201bf6737fbac9200ccb27cd3 |
| OpenAccessLink | https://dx.doi.org/10.1016/j.procs.2024.01.091 |
| PageCount | 11 |
| ParticipantIDs | crossref_citationtrail_10_1016_j_procs_2024_01_091 crossref_primary_10_1016_j_procs_2024_01_091 elsevier_sciencedirect_doi_10_1016_j_procs_2024_01_091 |
| PublicationCentury | 2000 |
| PublicationDate | 2024 2024-00-00 |
| PublicationDateYYYYMMDD | 2024-01-01 |
| PublicationDate_xml | – year: 2024 text: 2024 |
| PublicationDecade | 2020 |
| PublicationTitle | Procedia computer science |
| PublicationYear | 2024 |
| Publisher | Elsevier B.V |
| Publisher_xml | – name: Elsevier B.V |
| References | Ungureanu, Bogo, Galliani, Sama, Duan, Meekhof, Stühmer, Cashman, Tekin, Schönberger (bib0014) 2020 Benjamin Brown. The total economic impact™ of mixed reality using microsoft hololens 2. Al-Ansi, Jaboob, Garad, Al-Ansi (bib0009) 2023; 8 Maloney, Cong, Li (bib0008) 2022 UTEP. “the w . m . keck center for 3d innovation. Retrieved from LeCun, Boser, Denker, Henderson, Howard, Hubbard, Jackel (bib0015) 1989; 1 Palomino, Bian, Salcedo, Navarro, Gopalaiah, Otis, Li (bib0011) 2022 . Go, Hart (bib0005) 2016; 10 J Kirkpatrick. The kirkpatrick four levels: A fresh look after 55 years 1959-2014. Retrieved from information@kirkpatrickpartners.com, 2014. Redmon, Divvala, Girshick, Farhadi (bib0002) 2016 Li, Bian, Wu, Donovan, Li (bib0010) 2022; 22 Baek, Lee, Han, Yun, Lee (bib0003) 2019 2023. Bian, Li, Fu, Ren, Wu, Li, Li (bib0017) 2021; 61 J Kirkpatrick. The kirkpatrick four levels: A fresh look after 55 years 1959-2014. Retrieved from information@ kirkpatrickpartners.com, 2014. Radianti, Majchrzak, Fromm, Wohlgenannt (bib0001) 2020; 147 Kim, Donovan, Ren, Bian, Wu, Purawat, Manzo, Altintas, Li, Li (bib0012) 2022; 4 Donovan, Kim, Manzo, Ren, Bian, Wu, Purawat, Helvajian, Wheaton, Li, Li (bib0013) 2022; 4 Bian, Lin, Li, Fu, Jiang, Wu, Hang, Li (bib0016) 2021 Radianti (10.1016/j.procs.2024.01.091_bib0001) 2020; 147 Baek (10.1016/j.procs.2024.01.091_bib0003) 2019 Bian (10.1016/j.procs.2024.01.091_bib0016) 2021 Go (10.1016/j.procs.2024.01.091_bib0005) 2016; 10 Ungureanu (10.1016/j.procs.2024.01.091_bib0014) 2020 Palomino (10.1016/j.procs.2024.01.091_bib0011) 2022 Kim (10.1016/j.procs.2024.01.091_bib0012) 2022; 4 Redmon (10.1016/j.procs.2024.01.091_bib0002) 2016 10.1016/j.procs.2024.01.091_bib0004 10.1016/j.procs.2024.01.091_bib0007 10.1016/j.procs.2024.01.091_bib0018 10.1016/j.procs.2024.01.091_bib0006 Li (10.1016/j.procs.2024.01.091_bib0010) 2022; 22 LeCun (10.1016/j.procs.2024.01.091_bib0015) 1989; 1 Donovan (10.1016/j.procs.2024.01.091_bib0013) 2022; 4 Bian (10.1016/j.procs.2024.01.091_bib0017) 2021; 61 Al-Ansi (10.1016/j.procs.2024.01.091_bib0009) 2023; 8 Maloney (10.1016/j.procs.2024.01.091_bib0008) 2022 |
| References_xml | – volume: 4 start-page: e10130 year: 2022 ident: bib0013 article-title: Smart connected worker edge platform for smart manufacturing: Part 2—implementation and on-site deployment case study publication-title: Journal of Advanced Manufacturing and Processing – volume: 1 start-page: 541 year: 1989 end-page: 551 ident: bib0015 article-title: Backpropa-gation applied to handwritten zip code recognition publication-title: Neural computation – volume: 147 year: 2020 ident: bib0001 article-title: A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda publication-title: Computers & Education – reference: UTEP. “the w . m . keck center for 3d innovation. Retrieved from – reference: , 2023. – start-page: 554 year: 2021 end-page: 567 ident: bib0016 article-title: Real-time object detection for smart connected worker in 3d printing publication-title: Computational Science–ICCS 2021: 21st International Conference – reference: J Kirkpatrick. The kirkpatrick four levels: A fresh look after 55 years 1959-2014. Retrieved from information@kirkpatrickpartners.com, 2014. – reference: Benjamin Brown. The total economic impact™ of mixed reality using microsoft hololens 2. – reference: . – volume: 8 year: 2023 ident: bib0009 article-title: Analyzing augmented reality (ar) and virtual reality (vr) recent development in education publication-title: Social Sciences & Humanities Open – year: 2022 ident: bib0011 article-title: Ai-powered augmented reality training for metal additive manufacturing publication-title: 2022 International Solid Freeform Fabrication Symposium – volume: 4 start-page: e10129 year: 2022 ident: bib0012 article-title: Smart connected worker edge platform for smart manufacturing: Part 1—architecture and platform design publication-title: Journal of Advanced Manufacturing and Processing – volume: 61 start-page: 66 year: 2021 end-page: 76 ident: bib0017 article-title: Machine learning-based real-time monitoring system for smart connected worker to improve energy efficiency publication-title: Journal of Manufacturing Systems – year: 2020 ident: bib0014 article-title: Hololens 2 research mode as a tool for computer vision research publication-title: arXiv preprint – start-page: 779 year: 2016 end-page: 788 ident: bib0002 article-title: You only look once: Unified, real-time object detection publication-title: Proceedings of the IEEE conference on computer vision and pattern recognition – start-page: 15 year: 2022 ident: bib0008 article-title: The cumulative effects of an nsf-funded additive manufacturing course at three large state universities and their surrounding communities publication-title: Proceedings of the ASEE's 129th Annual Conference Exposition (ASEE 2022) – volume: 10 start-page: 76 year: 2016 end-page: 87 ident: bib0005 article-title: A framework for teaching the fundamentals of additive manufacturing and enabling rapid innovation publication-title: Additive Manufacturing – reference: J Kirkpatrick. The kirkpatrick four levels: A fresh look after 55 years 1959-2014. Retrieved from information@ kirkpatrickpartners.com, 2014. – volume: 22 year: 2022 ident: bib0010 article-title: Affordable artificial intelligence-assisted machine supervision system for the small and medium-sized manufacturers publication-title: Sensors – start-page: 9365 year: 2019 end-page: 9374 ident: bib0003 article-title: Character region awareness for text detection publication-title: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition – ident: 10.1016/j.procs.2024.01.091_bib0004 – start-page: 15 year: 2022 ident: 10.1016/j.procs.2024.01.091_bib0008 article-title: The cumulative effects of an nsf-funded additive manufacturing course at three large state universities and their surrounding communities – volume: 4 start-page: e10130 issue: 4 year: 2022 ident: 10.1016/j.procs.2024.01.091_bib0013 article-title: Smart connected worker edge platform for smart manufacturing: Part 2—implementation and on-site deployment case study publication-title: Journal of Advanced Manufacturing and Processing doi: 10.1002/amp2.10130 – volume: 10 start-page: 76 year: 2016 ident: 10.1016/j.procs.2024.01.091_bib0005 article-title: A framework for teaching the fundamentals of additive manufacturing and enabling rapid innovation publication-title: Additive Manufacturing doi: 10.1016/j.addma.2016.03.001 – start-page: 9365 year: 2019 ident: 10.1016/j.procs.2024.01.091_bib0003 article-title: Character region awareness for text detection – volume: 22 issue: 16 year: 2022 ident: 10.1016/j.procs.2024.01.091_bib0010 article-title: Affordable artificial intelligence-assisted machine supervision system for the small and medium-sized manufacturers publication-title: Sensors doi: 10.3390/s22166246 – volume: 4 start-page: e10129 issue: 4 year: 2022 ident: 10.1016/j.procs.2024.01.091_bib0012 article-title: Smart connected worker edge platform for smart manufacturing: Part 1—architecture and platform design publication-title: Journal of Advanced Manufacturing and Processing doi: 10.1002/amp2.10129 – ident: 10.1016/j.procs.2024.01.091_bib0006 doi: 10.1515/9781580468619 – volume: 1 start-page: 541 issue: 4 year: 1989 ident: 10.1016/j.procs.2024.01.091_bib0015 article-title: Backpropa-gation applied to handwritten zip code recognition publication-title: Neural computation doi: 10.1162/neco.1989.1.4.541 – volume: 147 year: 2020 ident: 10.1016/j.procs.2024.01.091_bib0001 article-title: A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda publication-title: Computers & Education doi: 10.1016/j.compedu.2019.103778 – volume: 8 issue: 1 year: 2023 ident: 10.1016/j.procs.2024.01.091_bib0009 article-title: Analyzing augmented reality (ar) and virtual reality (vr) recent development in education publication-title: Social Sciences & Humanities Open doi: 10.1016/j.ssaho.2023.100532 – start-page: 779 year: 2016 ident: 10.1016/j.procs.2024.01.091_bib0002 article-title: You only look once: Unified, real-time object detection – volume: 61 start-page: 66 year: 2021 ident: 10.1016/j.procs.2024.01.091_bib0017 article-title: Machine learning-based real-time monitoring system for smart connected worker to improve energy efficiency publication-title: Journal of Manufacturing Systems doi: 10.1016/j.jmsy.2021.08.009 – year: 2022 ident: 10.1016/j.procs.2024.01.091_bib0011 article-title: Ai-powered augmented reality training for metal additive manufacturing – ident: 10.1016/j.procs.2024.01.091_bib0018 doi: 10.1515/9781580468619 – year: 2020 ident: 10.1016/j.procs.2024.01.091_bib0014 article-title: Hololens 2 research mode as a tool for computer vision research publication-title: arXiv preprint – ident: 10.1016/j.procs.2024.01.091_bib0007 – start-page: 554 year: 2021 ident: 10.1016/j.procs.2024.01.091_bib0016 article-title: Real-time object detection for smart connected worker in 3d printing |
| SSID | ssj0000388917 |
| Score | 2.3151057 |
| Snippet | Professional Training for laser powder bed fusion equipment operation typically is time consuming and expensive for end-users in metal Additive Manufacturing... |
| SourceID | crossref elsevier |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 913 |
| SubjectTerms | Immersive Augmented Reality Training Metal Additive Manufacturing Object Detection Text Recognition |
| Title | Object Detection and Text Recognition for Immersive Augmented Reality Training in Laser Powder Bed Fusion |
| URI | https://dx.doi.org/10.1016/j.procs.2024.01.091 |
| Volume | 232 |
| WOSCitedRecordID | wos001196800600091&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources (ISSN International Center) customDbUrl: eissn: 1877-0509 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0000388917 issn: 1877-0509 databaseCode: M~E dateStart: 20100101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3NT9swFLc62GGXjX1pbIB82K2LlDppbB_RNAQSY0jrJDhF8YvLUqEUlZahHfZP7B_ee_4I1YoQm8ShaerYdeX3i9_Lr--DsfcABeUlrxMBgv5mHIrESItPrRbfbKpgXIArNiGPjtTJiT7u9X7HWJirc9m26vpaXzyoqLENhU2hs_8g7u5LsQHPUeh4RLHj8V6C_2KIWsGNZG5DGfC27o9wDyYT0TsLBe_CA0dak-vQ7uLMJeekWEVvmI9C6QjiQw5R0836x9MftUuoWPf3FpdRnMGudfEGCDXnok5VIvpBta4Q0_vT9mzSdI47TeW42lOL4AlK1JUJ87zsafPz-2IaWw-d5wFdo87LfIW4YSpXQ2jcjqukTCgJjVdIt7SFbVoEHtRvtNpHsAadrX3M8oo68MzEhJQRUG52kbscrb4-2F95tr_SrDQpedViF_mIrQs51OQn-PnXDXFH6XO0q-Tc_cyYzcr5Da7MdbvFs2TFjDbY0_D4wXc9bJ6znm1fsGextAcPO_1L1ngU8Q5FHFHECUV8CUUcUcQ7FPEORTygiEcU8ablDkXco4gjirhH0Sv2be_T6ON-EqpyJJDlap5AnlUDAaqu0gxfRWqVHg-qGi1rA0Oh6kJCLRVZlmZMVZDGpgKNdyiAEXgpe83W2mlr3zCupCkyGCpjpMp1BkqbKgUjZSVSsCLfZCKuXAkhZT1VTjkvo2_ipHTLXdJyl-mgxOXeZB-6QRc-Y8vd3YsokjLcGd6YLBFEdw18-78D37En9MnzeFtsbT5b2G32GK7mzeVsx4HtD4TKqkk |
| linkProvider | ISSN International Centre |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Object+Detection+and+Text+Recognition+for+Immersive+Augmented+Reality+Training+in+Laser+Powder+Bed+Fusion&rft.jtitle=Procedia+computer+science&rft.au=Zhang%2C+Hongji&rft.au=Jiao%2C+Yecheng&rft.au=Yuan%2C+Yizhuo&rft.au=Li%2C+Yuanchen&rft.date=2024&rft.pub=Elsevier+B.V&rft.issn=1877-0509&rft.eissn=1877-0509&rft.volume=232&rft.spage=913&rft.epage=923&rft_id=info:doi/10.1016%2Fj.procs.2024.01.091&rft.externalDocID=S1877050924000917 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1877-0509&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1877-0509&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1877-0509&client=summon |