A multimodal educational robots driven via dynamic attention
With the development of artificial intelligence and robotics technology, the application of educational robots in teaching is becoming increasingly popular. However, effectively evaluating and optimizing multimodal educational robots remains a challenge. This study introduces Res-ALBEF, a multimodal...
Saved in:
| Published in: | Frontiers in neurorobotics Vol. 18; p. 1453061 |
|---|---|
| Main Author: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
Switzerland
Frontiers Media S.A
31.10.2024
|
| Subjects: | |
| ISSN: | 1662-5218, 1662-5218 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | With the development of artificial intelligence and robotics technology, the application of educational robots in teaching is becoming increasingly popular. However, effectively evaluating and optimizing multimodal educational robots remains a challenge.
This study introduces Res-ALBEF, a multimodal educational robot framework driven by dynamic attention. Res-ALBEF enhances the ALBEF (Align Before Fuse) method by incorporating residual connections to align visual and textual data more effectively before fusion. In addition, the model integrates a VGG19-based convolutional network for image feature extraction and utilizes a dynamic attention mechanism to dynamically focus on relevant parts of multimodal inputs. Our model was trained using a diverse dataset consisting of 50,000 multimodal educational instances, covering a variety of subjects and instructional content.
The evaluation on an independent validation set of 10,000 samples demonstrated significant performance improvements: the model achieved an overall accuracy of 97.38% in educational content recognition. These results highlight the model's ability to improve alignment and fusion of multimodal information, making it a robust solution for multimodal educational robots. |
|---|---|
| AbstractList | With the development of artificial intelligence and robotics technology, the application of educational robots in teaching is becoming increasingly popular. However, effectively evaluating and optimizing multimodal educational robots remains a challenge.
This study introduces Res-ALBEF, a multimodal educational robot framework driven by dynamic attention. Res-ALBEF enhances the ALBEF (Align Before Fuse) method by incorporating residual connections to align visual and textual data more effectively before fusion. In addition, the model integrates a VGG19-based convolutional network for image feature extraction and utilizes a dynamic attention mechanism to dynamically focus on relevant parts of multimodal inputs. Our model was trained using a diverse dataset consisting of 50,000 multimodal educational instances, covering a variety of subjects and instructional content.
The evaluation on an independent validation set of 10,000 samples demonstrated significant performance improvements: the model achieved an overall accuracy of 97.38% in educational content recognition. These results highlight the model's ability to improve alignment and fusion of multimodal information, making it a robust solution for multimodal educational robots. IntroductionWith the development of artificial intelligence and robotics technology, the application of educational robots in teaching is becoming increasingly popular. However, effectively evaluating and optimizing multimodal educational robots remains a challenge.MethodsThis study introduces Res-ALBEF, a multimodal educational robot framework driven by dynamic attention. Res-ALBEF enhances the ALBEF (Align Before Fuse) method by incorporating residual connections to align visual and textual data more effectively before fusion. In addition, the model integrates a VGG19-based convolutional network for image feature extraction and utilizes a dynamic attention mechanism to dynamically focus on relevant parts of multimodal inputs. Our model was trained using a diverse dataset consisting of 50,000 multimodal educational instances, covering a variety of subjects and instructional content.Results and discussionThe evaluation on an independent validation set of 10,000 samples demonstrated significant performance improvements: the model achieved an overall accuracy of 97.38% in educational content recognition. These results highlight the model's ability to improve alignment and fusion of multimodal information, making it a robust solution for multimodal educational robots. With the development of artificial intelligence and robotics technology, the application of educational robots in teaching is becoming increasingly popular. However, effectively evaluating and optimizing multimodal educational robots remains a challenge.IntroductionWith the development of artificial intelligence and robotics technology, the application of educational robots in teaching is becoming increasingly popular. However, effectively evaluating and optimizing multimodal educational robots remains a challenge.This study introduces Res-ALBEF, a multimodal educational robot framework driven by dynamic attention. Res-ALBEF enhances the ALBEF (Align Before Fuse) method by incorporating residual connections to align visual and textual data more effectively before fusion. In addition, the model integrates a VGG19-based convolutional network for image feature extraction and utilizes a dynamic attention mechanism to dynamically focus on relevant parts of multimodal inputs. Our model was trained using a diverse dataset consisting of 50,000 multimodal educational instances, covering a variety of subjects and instructional content.MethodsThis study introduces Res-ALBEF, a multimodal educational robot framework driven by dynamic attention. Res-ALBEF enhances the ALBEF (Align Before Fuse) method by incorporating residual connections to align visual and textual data more effectively before fusion. In addition, the model integrates a VGG19-based convolutional network for image feature extraction and utilizes a dynamic attention mechanism to dynamically focus on relevant parts of multimodal inputs. Our model was trained using a diverse dataset consisting of 50,000 multimodal educational instances, covering a variety of subjects and instructional content.The evaluation on an independent validation set of 10,000 samples demonstrated significant performance improvements: the model achieved an overall accuracy of 97.38% in educational content recognition. These results highlight the model's ability to improve alignment and fusion of multimodal information, making it a robust solution for multimodal educational robots.Results and discussionThe evaluation on an independent validation set of 10,000 samples demonstrated significant performance improvements: the model achieved an overall accuracy of 97.38% in educational content recognition. These results highlight the model's ability to improve alignment and fusion of multimodal information, making it a robust solution for multimodal educational robots. |
| Author | Jianliang, An |
| AuthorAffiliation | 2 Industrial Fundamentals Teaching Department, Hebei Vocational University of Industry and Technology, Shijiazhuang , Hebei , China 1 College of Education, Hebei Normal University , Hebei , China |
| AuthorAffiliation_xml | – name: 1 College of Education, Hebei Normal University , Hebei , China – name: 2 Industrial Fundamentals Teaching Department, Hebei Vocational University of Industry and Technology, Shijiazhuang , Hebei , China |
| Author_xml | – sequence: 1 givenname: An surname: Jianliang fullname: Jianliang, An |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/39544850$$D View this record in MEDLINE/PubMed |
| BookMark | eNpVkV1LHDEUhkNRqm77B3pR5rI3u-bkayZQKCKtCoI39jokJ4mNzExsMrPgv--suxW9yiF5eN4k7xk5GvMYCPkCdMN5p8_j6PK0YZSJDQjJqYIP5BSUYmvJoDt6M5-Qs1ofKVVMye4jOeFaCtFJekq-XzTD3E9pyN72TfAz2inlcZlLXuy18SVtw9hsk23882iHhI2dpjDuqE_kONq-hs-HdUV-__p5f3m9vr27urm8uF2jYHRaRwegI1c2ihYVw8DaEFv0nZXLHagKzgnswFqO1FNwqHirJIISniNK5Ctys_f6bB_NU0mDLc8m22ReNnJ5MLZMCftgqNMBKOciUhROghYKGKMxaNBOLxEr8mPveprdEDwuLym2fyd9fzKmP-Yhbw2AVFQDLIZvB0PJf-dQJzOkiqHv7RjyXA0H1nWsbRVf0K9vw15T_v__ArA9gCXXWkJ8RYCaXcnmpWSzK9kcSub_ALJ3m2g |
| Cites_doi | 10.1016/j.ifacol.2022.04.212 10.1016/j.jvcir.2023.103830 10.1038/s42256-020-0156-7 10.1155/2022/8393612 10.1201/9781003034087-3 10.1016/j.patrec.2020.12.010 10.1016/j.engappai.2021.104178 10.1186/s40561-022-00192-z 10.1109/SCISISIS50064.2020.9322760 10.3390/computers12020044 10.3233/JIFS-189224 10.1109/TMI.2022.3147640 10.1080/17517575.2019.1600040 10.1109/ACCESS.2023.3275012 10.1002/rrq.455 10.1007/s40745-022-00444-2 10.1109/TCDS.2020.2965985 10.1155/2022/5747647 10.1109/CVPRW59228.2023.00545 10.4018/978-1-7998-6690-9.ch008 10.1109/ICRA48891.2023.10161404 10.1109/FG47880.2020.00141 10.1145/3395035.3425201 10.1088/1741-2552/ac1ab3 10.3390/bdcc3020028 10.1016/j.compedu.2023.104827 10.1109/ACCESS.2023.3297887 10.1007/978-3-030-78462-1_15 10.3390/s23239482 10.1016/j.system.2021.102691 10.1007/s10489-021-02916-z 10.3389/fnbot.2023.1338104 10.3390/computers13040102 10.1109/CVPR46437.2021.00973 10.1177/00368504211021192 10.1016/j.ins.2019.07.023 10.1109/ACCESS.2024.3377448 10.3233/JIFS-189062 10.1109/CVPR46437.2021.00819 10.1155/2022/9402195 10.1109/TSMC.2021.3096974 |
| ContentType | Journal Article |
| Copyright | Copyright © 2024 Jianliang. Copyright © 2024 Jianliang. 2024 Jianliang |
| Copyright_xml | – notice: Copyright © 2024 Jianliang. – notice: Copyright © 2024 Jianliang. 2024 Jianliang |
| DBID | AAYXX CITATION NPM 7X8 5PM DOA |
| DOI | 10.3389/fnbot.2024.1453061 |
| DatabaseName | CrossRef PubMed MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Directory of Open Access Journals |
| DatabaseTitle | CrossRef PubMed MEDLINE - Academic |
| DatabaseTitleList | PubMed MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 3 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1662-5218 |
| ExternalDocumentID | oai_doaj_org_article_0b9e10334f0c4b519461220fe919b9aa PMC11560911 39544850 10_3389_fnbot_2024_1453061 |
| Genre | Journal Article |
| GroupedDBID | --- 29H 2WC 53G 5GY 5VS 88I 8FE 8FH 9T4 AAFWJ AAKPC AAYXX ABUWG ACGFS ADBBV ADDVE ADMLS ADRAZ AEGXH AENEX AFFHD AFKRA AFPKN ALMA_UNASSIGNED_HOLDINGS AOIJS ARCSS AZQEC BAWUL BBNVY BCNDV BENPR BHPHI BPHCQ CCPQU CITATION CS3 DIK DWQXO E3Z F5P GNUQQ GROUPED_DOAJ GX1 HCIFZ HYE KQ8 LK8 M2P M48 M7P M~E O5R O5S OK1 OVT PGMZT PHGZM PHGZT PIMPY PQGLB PQQKQ PROAC RNS RPM TR2 ACXDI C1A IAO IEA IHR IPNFZ ISR NPM RIG 7X8 PUEGO 5PM |
| ID | FETCH-LOGICAL-c420t-fb119f36af47c62ce27ef7cd8a585006ebb4c81aa3c0d01bc63765c164d3cc5c3 |
| IEDL.DBID | DOA |
| ISICitedReferencesCount | 0 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001356562700001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1662-5218 |
| IngestDate | Mon Nov 10 04:30:27 EST 2025 Tue Nov 04 02:05:05 EST 2025 Fri Sep 05 10:24:02 EDT 2025 Wed Feb 19 02:03:07 EST 2025 Sat Nov 29 03:48:51 EST 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | dynamic attention mechanism educational VVG19 multimodal robot ALBEF |
| Language | English |
| License | Copyright © 2024 Jianliang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c420t-fb119f36af47c62ce27ef7cd8a585006ebb4c81aa3c0d01bc63765c164d3cc5c3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 Reviewed by: Tao Han, Hubei Normal University, China Fei Yan, Changchun University of Science and Technology, China Edited by: Xianmin Wang, Guangzhou University, China |
| OpenAccessLink | https://doaj.org/article/0b9e10334f0c4b519461220fe919b9aa |
| PMID | 39544850 |
| PQID | 3128827763 |
| PQPubID | 23479 |
| ParticipantIDs | doaj_primary_oai_doaj_org_article_0b9e10334f0c4b519461220fe919b9aa pubmedcentral_primary_oai_pubmedcentral_nih_gov_11560911 proquest_miscellaneous_3128827763 pubmed_primary_39544850 crossref_primary_10_3389_fnbot_2024_1453061 |
| PublicationCentury | 2000 |
| PublicationDate | 2024-10-31 |
| PublicationDateYYYYMMDD | 2024-10-31 |
| PublicationDate_xml | – month: 10 year: 2024 text: 2024-10-31 day: 31 |
| PublicationDecade | 2020 |
| PublicationPlace | Switzerland |
| PublicationPlace_xml | – name: Switzerland |
| PublicationTitle | Frontiers in neurorobotics |
| PublicationTitleAlternate | Front Neurorobot |
| PublicationYear | 2024 |
| Publisher | Frontiers Media S.A |
| Publisher_xml | – name: Frontiers Media S.A |
| References | Pang (B29) 2022; 2022 Lin (B23) 2024; 3 Zeng (B48) 2021 Allen-Zhu (B2) 2019 Cheng (B5) 2022; 2022 Lin (B21) 2022; 2022 Ye (B46) 2023; 23 Wang (B38) 2019; 505 Dey (B6) 2021; 143 Ptak (B30) 2024; 12 Xu (B40) 2020; 39 Li (B19) 2023 Tong (B35) 2023; 93 Effati (B9) 2023; 12 Sun (B34) 2021; 40 Deyzel (B7) 2023 Braud (B4) 2020; 13 Robinson (B32) 2023 Lin (B22) 2022; 104 Liang (B20) 2023; 201 Yağcı (B41) 2022; 9 Ossai (B28) 2019; 3 Yan (B43) 2022; 52 Wang (B39) 2021; 15 Ng (B26) 2020; 2 Li (B18) 2021 Van Amsterdam (B37) 2022; 41 Yan (B42) 2021; 100 Yoshizawa (B47) 2020 Fan (B11) 2024 González Ybarra (B12) 2022; 57 Tozadore (B36) 2020 Rajangam (B31) 2021 Khilji (B16) 2021 Lazaro (B17) 2021 Ortega (B27) 2021; 18 Elgajiji (B10) 2015 Ionescu (B14) 2022; 55 Bera (B3) 2020 Mamatnabiyev (B24) 2024; 13 Yang (B44) 2021; 104 Zhao (B49) 2023; 11 Ding (B8) 2021; 52 Jing (B15) 2021 Ye (B45) 2021 Hong (B13) 2024; 17 Ai (B1) 2023; 11 Minoli (B25) 2020 Sarker (B33) 2023; 10 |
| References_xml | – volume: 55 start-page: 313 year: 2022 ident: B14 article-title: Assembly: a web-based multi-robot programming and simulation tool publication-title: IFAC-PapersOnLine doi: 10.1016/j.ifacol.2022.04.212 – volume: 93 start-page: 103830 year: 2023 ident: B35 article-title: Rethinking pascal-voc and ms-coco dataset for small object detection publication-title: J. Vis. Commun. Image Represent doi: 10.1016/j.jvcir.2023.103830 – volume: 2 start-page: 161 year: 2020 ident: B26 article-title: Predicting the state of charge and health of batteries using data-driven machine learning publication-title: Nat. Mach. Intell doi: 10.1038/s42256-020-0156-7 – volume: 2022 start-page: 8393612 year: 2022 ident: B5 article-title: Construction of sports training management information system using ai action recognition publication-title: Sci. Progr doi: 10.1155/2022/8393612 – year: 2023 ident: B19 publication-title: Exploring the use of extended reality for user experience design in product-service systems – start-page: 31 volume-title: Blockchain-enabled Fog and Edge Computing: Concepts, Architectures and Applications year: 2020 ident: B25 article-title: “Blockchain concepts, architectures, and smart city applications in fog and edge computing environments,” doi: 10.1201/9781003034087-3 – volume: 143 start-page: 67 year: 2021 ident: B6 article-title: Customized vgg19 architecture for pneumonia detection in chest x-rays publication-title: Pattern Recognit. Lett doi: 10.1016/j.patrec.2020.12.010 – year: 2019 ident: B2 article-title: “What can resnet learn efficiently, going beyond kernels?” publication-title: Advances in Neural Information Processing Systems – volume: 100 start-page: 104178 year: 2021 ident: B42 article-title: Emotion space modelling for social robots publication-title: Eng. Appl. Artif. Intell doi: 10.1016/j.engappai.2021.104178 – volume: 9 start-page: 11 year: 2022 ident: B41 article-title: Educational data mining: prediction of students' academic performance using machine learning algorithms publication-title: Smart Learn. Environ doi: 10.1186/s40561-022-00192-z – start-page: 1 volume-title: 2020 Joint 11th International Conference on Soft Computing and Intelligent Systems and 21st International Symposium on Advanced Intelligent Systems (SCIS-ISIS) year: 2020 ident: B47 article-title: “Deep learning method for estimating perplexion in learners by educational support robots,” doi: 10.1109/SCISISIS50064.2020.9322760 – volume: 12 start-page: 44 year: 2023 ident: B9 article-title: A performance study of cnn architectures for the autonomous detection of COVID-19 symptoms using cough and breathing publication-title: Computers doi: 10.3390/computers12020044 – volume: 40 start-page: 2265 year: 2021 ident: B34 article-title: Svm-based global vision system of sports competition and action recognition publication-title: J. Intell. Fuzzy Syst doi: 10.3233/JIFS-189224 – volume: 41 start-page: 1677 year: 2022 ident: B37 article-title: Gesture recognition in robotic surgery with multimodal attention publication-title: IEEE Trans. Med. Imaging doi: 10.1109/TMI.2022.3147640 – volume: 15 start-page: 530 year: 2021 ident: B39 article-title: An improved anti-quantum MST3 public key encryption scheme for remote sensing images publication-title: Enter. Inf. Syst doi: 10.1080/17517575.2019.1600040 – volume: 11 start-page: 46541 year: 2023 ident: B49 article-title: A hybrid deep learning-based intelligent system for sports action recognition via visual knowledge discovery publication-title: IEEE Access doi: 10.1109/ACCESS.2023.3275012 – volume: 57 start-page: 983 year: 2022 ident: B12 article-title: “Because we have lived it”: chicanx/latinx youth multimodal literacies in youth participatory action research publication-title: Read. Res. Q doi: 10.1002/rrq.455 – volume: 10 start-page: 1473 year: 2023 ident: B33 article-title: Machine learning for intelligent data analysis and automation in cybersecurity: current and future prospects publication-title: Ann. Data Sci doi: 10.1007/s40745-022-00444-2 – start-page: 9694 year: 2021 ident: B18 article-title: “Align before fuse: vision and language representation learning with momentum distillation,” publication-title: Advances in Neural Information Processing Systems – volume: 13 start-page: 416 year: 2020 ident: B4 article-title: Robot multimodal object perception and recognition: synthetic maturation of sensorimotor learning in embodied systems publication-title: IEEE Trans. Cogn. Dev. Syst doi: 10.1109/TCDS.2020.2965985 – volume: 2022 start-page: 5747647 year: 2022 ident: B29 article-title: Design of national sports action feature extraction system based on convolutional neural network publication-title: Sci. Progr doi: 10.1155/2022/5747647 – year: 2023 ident: B7 article-title: “One-shot skeleton-based action recognition on strength and conditioning exercises,” publication-title: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition doi: 10.1109/CVPRW59228.2023.00545 – start-page: 145 volume-title: Handbook of Research on Deep Learning-Based Image Analysis Under Constrained and Unconstrained Environments year: 2021 ident: B31 article-title: “Performance analysis of vgg19 deep learning network based brain image fusion,” doi: 10.4018/978-1-7998-6690-9.ch008 – start-page: 6160 volume-title: 2023 IEEE International Conference on Robotics and Automation (ICRA) year: 2023 ident: B32 article-title: “A deep learning human activity recognition framework for socially assistive robots to support reablement of older adults,” doi: 10.1109/ICRA48891.2023.10161404 – start-page: 644 volume-title: 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020) year: 2020 ident: B3 article-title: “How are you feeling? Multimodal emotion learning for socially-assistive robot navigation,” doi: 10.1109/FG47880.2020.00141 – year: 2020 ident: B36 article-title: “Multimodal fuzzy assessment for robot behavioral adaptation in educational children-robot interaction,” publication-title: Companion Publication of the 2020 International Conference on Multimodal Interaction doi: 10.1145/3395035.3425201 – volume: 18 start-page: 0460e year: 2021 ident: B27 article-title: Deep learning multimodal fnirs and eeg signals for bimanual grip force decoding publication-title: J. Neural Eng doi: 10.1088/1741-2552/ac1ab3 – start-page: 41 volume-title: Analysis of Medical Modalities for Improved Diagnosis in Modern Healthcare year: 2021 ident: B16 article-title: “Healfavor: a chatbot application in healthcare,” – volume: 3 start-page: 28 year: 2019 ident: B28 article-title: A data-driven machine learning approach for corrosion risk assessment–a comparative study publication-title: Big Data Cogn. Comput doi: 10.3390/bdcc3020028 – year: 2015 ident: B10 article-title: “A multimodal robotic communication system for students with profound and multiple disabilities,” publication-title: The International J. Engineering and Information Technology (IJEIT) – volume: 201 start-page: 104827 year: 2023 ident: B20 article-title: A robot-based digital storytelling approach to enhancing efl learners multimodal storytelling ability and narrative engagement publication-title: Comput. Educ doi: 10.1016/j.compedu.2023.104827 – volume: 11 start-page: 78984 year: 2023 ident: B1 article-title: Exploration of digital transformation of government governance under the information environment publication-title: IEEE Access doi: 10.1109/ACCESS.2023.3297887 – start-page: 206 volume-title: Human-Computer Interaction. Theory, Methods and Tools: Thematic Area, HCI 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24-29, 2021, Proceedings, Part I 23 year: 2021 ident: B17 article-title: “A review of multimodal interaction in intelligent systems,” doi: 10.1007/978-3-030-78462-1_15 – year: 2024 ident: B11 article-title: “Improving clip training with language rewrites,” publication-title: Advances in Neural Information Processing Systems – volume: 23 start-page: 9482 year: 2023 ident: B46 article-title: Dynamic and real-time object detection based on deep learning for home service robots publication-title: Sensors doi: 10.3390/s23239482 – volume: 104 start-page: 102691 year: 2022 ident: B22 article-title: Enhancing EFL vocabulary learning with multimodal cues supported by an educational robot and an iot-based 3D book publication-title: System doi: 10.1016/j.system.2021.102691 – volume: 52 start-page: 9406 year: 2022 ident: B43 article-title: Framework for identifying and visualising emotional atmosphere in online learning environments in the covid-19 era publication-title: Appl. Intell doi: 10.1007/s10489-021-02916-z – volume: 17 start-page: 1338104 year: 2024 ident: B13 article-title: Education robot object detection with a brain-inspired approach integrating faster r-CNN, yolov3, and semi-supervised learning publication-title: Front. Neurorobot doi: 10.3389/fnbot.2023.1338104 – volume: 13 start-page: 102 year: 2024 ident: B24 article-title: A holistic approach to use educational robots for supporting computer science courses publication-title: Computers doi: 10.3390/computers13040102 – volume: 3 start-page: 40 year: 2024 ident: B23 article-title: Neural radiance fields convert 2D to 3D texture publication-title: Appl. Sci. Biotechnol. J. Adv. Res – year: 2021 ident: B15 article-title: “Locate then segment: a strong pipeline for referring image segmentation,” publication-title: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition doi: 10.1109/CVPR46437.2021.00973 – volume: 104 start-page: 00368504211021192 year: 2021 ident: B44 article-title: Comparison of deep learning-based methods in multimodal anomaly detection: a case study in human-robot collaboration publication-title: Sci. Prog doi: 10.1177/00368504211021192 – volume: 505 start-page: 294 year: 2019 ident: B38 article-title: Multilevel similarity model for high-resolution remote sensing image registration publication-title: Inf. Sci doi: 10.1016/j.ins.2019.07.023 – volume: 12 start-page: 44262 year: 2024 ident: B30 article-title: Iso-compatible personal temperature measurement using visual and thermal images with facial region of interest detection publication-title: IEEE Access doi: 10.1109/ACCESS.2024.3377448 – year: 2021 ident: B48 article-title: Multi-grained vision language pre-training: aligning texts with visual concepts publication-title: arXiv preprint arXiv:2111.08276 – volume: 39 start-page: 5871 year: 2020 ident: B40 article-title: Retracted: research on sports action recognition system based on cluster regression and improved isa deep network publication-title: J. Intel. Fuzzy Syst doi: 10.3233/JIFS-189062 – year: 2021 ident: B45 article-title: “Linguistic structures as weak supervision for visual scene graph generation,” publication-title: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition doi: 10.1109/CVPR46437.2021.00819 – volume: 2022 start-page: 9402195 year: 2022 ident: B21 article-title: Design of a professional sports competition adjudication system based on data analysis and action recognition algorithm publication-title: Sci. Progr doi: 10.1155/2022/9402195 – volume: 52 start-page: 4286 year: 2021 ident: B8 article-title: Leveraging multimodal semantic fusion for gastric cancer screening via hierarchical attention mechanism publication-title: IEEE Trans. Syst. Man, Cyber. Syst doi: 10.1109/TSMC.2021.3096974 |
| SSID | ssj0062658 |
| Score | 2.3112776 |
| Snippet | With the development of artificial intelligence and robotics technology, the application of educational robots in teaching is becoming increasingly popular.... IntroductionWith the development of artificial intelligence and robotics technology, the application of educational robots in teaching is becoming increasingly... |
| SourceID | doaj pubmedcentral proquest pubmed crossref |
| SourceType | Open Website Open Access Repository Aggregation Database Index Database |
| StartPage | 1453061 |
| SubjectTerms | ALBEF dynamic attention mechanism educational multimodal robot Neuroscience VVG19 |
| Title | A multimodal educational robots driven via dynamic attention |
| URI | https://www.ncbi.nlm.nih.gov/pubmed/39544850 https://www.proquest.com/docview/3128827763 https://pubmed.ncbi.nlm.nih.gov/PMC11560911 https://doaj.org/article/0b9e10334f0c4b519461220fe919b9aa |
| Volume | 18 |
| WOSCitedRecordID | wos001356562700001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 1662-5218 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0062658 issn: 1662-5218 databaseCode: DOA dateStart: 20070101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 1662-5218 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0062658 issn: 1662-5218 databaseCode: M~E dateStart: 20070101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre – providerCode: PRVPQU databaseName: Biological Science Database customDbUrl: eissn: 1662-5218 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0062658 issn: 1662-5218 databaseCode: M7P dateStart: 20230101 isFulltext: true titleUrlDefault: http://search.proquest.com/biologicalscijournals providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 1662-5218 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0062658 issn: 1662-5218 databaseCode: BENPR dateStart: 20230101 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: Publicly Available Content Database customDbUrl: eissn: 1662-5218 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0062658 issn: 1662-5218 databaseCode: PIMPY dateStart: 20230101 isFulltext: true titleUrlDefault: http://search.proquest.com/publiccontent providerName: ProQuest – providerCode: PRVPQU databaseName: Science Database customDbUrl: eissn: 1662-5218 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0062658 issn: 1662-5218 databaseCode: M2P dateStart: 20230101 isFulltext: true titleUrlDefault: https://search.proquest.com/sciencejournals providerName: ProQuest |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3Pa9swFH6sPw7dYXTtfnjdggu7FRPZsiIJdmlGygZrMGOD9CQkWWI5zB5J2r9_T1ISkjLYpRdhbBnL35Pf-x5--gTwUXKKn582ReWCqLbVvNCspoUeMWowAeC6jSKu3_h0KmYz2exs9RVqwpI8cAJuSIx0JaG09sTWBvlGjTG5It7JUhqpIzVC1rNJppIPRpbORFoigymYHPrO9KFwsqrRMzBkyeVeGIpq_f-imI8rJXdCz80pvFhzxvw6jfUlPHPdGTzfURI8h0_XeSwN_N232NNtqjbweNHjoJZ5uwhuLX-Y67xNm9DnQVkz1jq-gp83kx-fvxTrjREKW1dkVXhTltLTkfY1t6PKuoo7z20rNJJ_fHtnTG1FqTW1pCWlsSN0I8xiZtRSa5mlr-Gw6zv3FnJKJDeGeOO4w3ta4bQxTArpGQlK7BlcbXBSf5L-hcK8IaCqIqoqoKrWqGYwDlBuewbt6ngCLarWFlX_s2gGlxtDKJzr4QeG7lx_v1QUg6moOLrEDN4kw2wfRSXDTJORDMSeyfbGsn-lm_-KetplWE2OTv_dU4z-Ak4CIim8vYfD1eLefYBj-7CaLxcDOOAzMYCj8WTafB_EOYvtbdWElmN71Hy9be7-ApAI8wo |
| linkProvider | Directory of Open Access Journals |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+multimodal+educational+robots+driven+via+dynamic+attention&rft.jtitle=Frontiers+in+neurorobotics&rft.au=Jianliang%2C+An&rft.date=2024-10-31&rft.issn=1662-5218&rft.eissn=1662-5218&rft.volume=18&rft_id=info:doi/10.3389%2Ffnbot.2024.1453061&rft.externalDBID=n%2Fa&rft.externalDocID=10_3389_fnbot_2024_1453061 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1662-5218&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1662-5218&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1662-5218&client=summon |