Flexible coding scheme for robotic arm control driven by motor imagery decoding
Objective. Brain computer interface (BCI) technology is an innovative way of information exchange, which can effectively convert physiological signals into control instructions of machines. Due to its spontaneity and device independence, the motor imagery (MI) electroencephalography (EEG) signal is...
Saved in:
| Published in: | Journal of neural engineering Vol. 19; no. 5 |
|---|---|
| Main Authors: | , , , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
01.10.2022
|
| ISSN: | 1741-2552, 1741-2552 |
| Online Access: | Get more information |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | Objective. Brain computer interface (BCI) technology is an innovative way of information exchange, which can effectively convert physiological signals into control instructions of machines. Due to its spontaneity and device independence, the motor imagery (MI) electroencephalography (EEG) signal is used as a common BCI signal source to achieve direct control of external devices. Several online MI EEG-based systems have shown potential for rehabilitation. However, the generalization ability of the current classification model of MI tasks is still limited and the real-time prototype is far from widespread in practice.Approach. To solve these problems, this paper proposes an optimized neural network architecture based on our previous work. Firstly, the artifact components in the MI-EEG signal are removed by using the threshold and threshold function related to the artifact removal evaluation index, and then the data is augmented by the empirical mode decomposition (EMD) algorithm. Furthermore, the ensemble learning (EL) method and fine-tuning strategy in transfer learning (TL) are used to optimize the classification model. Finally, combined with the flexible binary encoding strategy, the EEG signal recognition results are mapped to the control commands of the robotic arm, which realizes multiple degrees of freedom control of the robotic arm.Main results. The results show that EMD has an obvious data amount enhancement effect on a small dataset, and the EL and TL can improve intra-subject and inter-subject model evaluation performance, respectively. The use of a binary coding method realizes the expansion of control instructions, i.e. four kinds of MI-EEG signals are used to complete the control of 7 degrees of freedom of the robotic arm.Significance. Our work not only improves the classification accuracy of the subject and the generality of the classification model while also extending the BCI control instruction set.Objective. Brain computer interface (BCI) technology is an innovative way of information exchange, which can effectively convert physiological signals into control instructions of machines. Due to its spontaneity and device independence, the motor imagery (MI) electroencephalography (EEG) signal is used as a common BCI signal source to achieve direct control of external devices. Several online MI EEG-based systems have shown potential for rehabilitation. However, the generalization ability of the current classification model of MI tasks is still limited and the real-time prototype is far from widespread in practice.Approach. To solve these problems, this paper proposes an optimized neural network architecture based on our previous work. Firstly, the artifact components in the MI-EEG signal are removed by using the threshold and threshold function related to the artifact removal evaluation index, and then the data is augmented by the empirical mode decomposition (EMD) algorithm. Furthermore, the ensemble learning (EL) method and fine-tuning strategy in transfer learning (TL) are used to optimize the classification model. Finally, combined with the flexible binary encoding strategy, the EEG signal recognition results are mapped to the control commands of the robotic arm, which realizes multiple degrees of freedom control of the robotic arm.Main results. The results show that EMD has an obvious data amount enhancement effect on a small dataset, and the EL and TL can improve intra-subject and inter-subject model evaluation performance, respectively. The use of a binary coding method realizes the expansion of control instructions, i.e. four kinds of MI-EEG signals are used to complete the control of 7 degrees of freedom of the robotic arm.Significance. Our work not only improves the classification accuracy of the subject and the generality of the classification model while also extending the BCI control instruction set. |
|---|---|
| AbstractList | Objective. Brain computer interface (BCI) technology is an innovative way of information exchange, which can effectively convert physiological signals into control instructions of machines. Due to its spontaneity and device independence, the motor imagery (MI) electroencephalography (EEG) signal is used as a common BCI signal source to achieve direct control of external devices. Several online MI EEG-based systems have shown potential for rehabilitation. However, the generalization ability of the current classification model of MI tasks is still limited and the real-time prototype is far from widespread in practice.Approach. To solve these problems, this paper proposes an optimized neural network architecture based on our previous work. Firstly, the artifact components in the MI-EEG signal are removed by using the threshold and threshold function related to the artifact removal evaluation index, and then the data is augmented by the empirical mode decomposition (EMD) algorithm. Furthermore, the ensemble learning (EL) method and fine-tuning strategy in transfer learning (TL) are used to optimize the classification model. Finally, combined with the flexible binary encoding strategy, the EEG signal recognition results are mapped to the control commands of the robotic arm, which realizes multiple degrees of freedom control of the robotic arm.Main results. The results show that EMD has an obvious data amount enhancement effect on a small dataset, and the EL and TL can improve intra-subject and inter-subject model evaluation performance, respectively. The use of a binary coding method realizes the expansion of control instructions, i.e. four kinds of MI-EEG signals are used to complete the control of 7 degrees of freedom of the robotic arm.Significance. Our work not only improves the classification accuracy of the subject and the generality of the classification model while also extending the BCI control instruction set.Objective. Brain computer interface (BCI) technology is an innovative way of information exchange, which can effectively convert physiological signals into control instructions of machines. Due to its spontaneity and device independence, the motor imagery (MI) electroencephalography (EEG) signal is used as a common BCI signal source to achieve direct control of external devices. Several online MI EEG-based systems have shown potential for rehabilitation. However, the generalization ability of the current classification model of MI tasks is still limited and the real-time prototype is far from widespread in practice.Approach. To solve these problems, this paper proposes an optimized neural network architecture based on our previous work. Firstly, the artifact components in the MI-EEG signal are removed by using the threshold and threshold function related to the artifact removal evaluation index, and then the data is augmented by the empirical mode decomposition (EMD) algorithm. Furthermore, the ensemble learning (EL) method and fine-tuning strategy in transfer learning (TL) are used to optimize the classification model. Finally, combined with the flexible binary encoding strategy, the EEG signal recognition results are mapped to the control commands of the robotic arm, which realizes multiple degrees of freedom control of the robotic arm.Main results. The results show that EMD has an obvious data amount enhancement effect on a small dataset, and the EL and TL can improve intra-subject and inter-subject model evaluation performance, respectively. The use of a binary coding method realizes the expansion of control instructions, i.e. four kinds of MI-EEG signals are used to complete the control of 7 degrees of freedom of the robotic arm.Significance. Our work not only improves the classification accuracy of the subject and the generality of the classification model while also extending the BCI control instruction set. |
| Author | Zhao, Xuefei Zhao, Mengyuan Liu, Quan Ai, Qingsong Chen, Kun Ma, Li |
| Author_xml | – sequence: 1 givenname: Qingsong surname: Ai fullname: Ai, Qingsong – sequence: 2 givenname: Mengyuan surname: Zhao fullname: Zhao, Mengyuan – sequence: 3 givenname: Kun surname: Chen fullname: Chen, Kun – sequence: 4 givenname: Xuefei surname: Zhao fullname: Zhao, Xuefei – sequence: 5 givenname: Li surname: Ma fullname: Ma, Li – sequence: 6 givenname: Quan surname: Liu fullname: Liu, Quan |
| BookMark | eNpNjE1LAzEYhINUsK3ePeboZW2S3eTdHKVYKxR60XPJx7t1JZtoshX77y1UxNMM88zMjExiikjILWf3nLXtgkPDKyGlWBjXNkZfkOlfNPnnr8islHfGag6aTcl2FfC7twGpS76Pe1rcGw5Iu5RpTjaNvaMmDycax5wC9bn_wkjtkQ5pPHX6wewxH6nH8_6aXHYmFLz51Tl5XT2-LNfVZvv0vHzYVK5u5FgZQI21B2k7a5nTrVWyawBqCxIaZR2g6GqvWtVJYNJr4FI5xsFza1otxJzcnX8_cvo8YBl3Q18chmAipkPZCaUVY1AzKX4AfotU8Q |
| CitedBy_id | crossref_primary_10_1007_s11571_024_10100_5 crossref_primary_10_1088_1741_2552_ad5fbd crossref_primary_10_1109_TNSRE_2023_3308778 crossref_primary_10_1016_j_neucom_2024_128577 crossref_primary_10_3390_brainsci15020124 crossref_primary_10_1088_1741_2552_acd95d |
| ContentType | Journal Article |
| Copyright | 2022 IOP Publishing Ltd. |
| Copyright_xml | – notice: 2022 IOP Publishing Ltd. |
| DBID | 7X8 |
| DOI | 10.1088/1741-2552/ac84a9 |
| DatabaseName | MEDLINE - Academic |
| DatabaseTitle | MEDLINE - Academic |
| DatabaseTitleList | MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | no_fulltext_linktorsrc |
| Discipline | Anatomy & Physiology |
| EISSN | 1741-2552 |
| GroupedDBID | --- 1JI 4.4 53G 5B3 5GY 5VS 5ZH 7.M 7.Q 7X8 AAGCD AAJIO AAJKP AATNI ABHWH ABJNI ABQJV ABVAM ACAFW ACGFS ACHIP ADEQX AEFHF AEINN AENEX AFYNE AKPSB ALMA_UNASSIGNED_HOLDINGS AOAED ASPBG ATQHT AVWKF AZFZN CEBXE CJUJL CRLBU CS3 DU5 EBS EDWGO EMSAF EPQRW EQZZN F5P IHE IJHAN IOP IZVLO KOT LAP M45 N5L N9A P2P PJBAE RIN RO9 ROL RPA SY9 W28 XPP |
| ID | FETCH-LOGICAL-c345t-a7e9e3d75bfbb0c98b65f4773b75746bc7e2f3d686f5705d97156c017d1ba8922 |
| IEDL.DBID | 7X8 |
| ISICitedReferencesCount | 7 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000851279200001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1741-2552 |
| IngestDate | Fri Sep 05 07:44:15 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 5 |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c345t-a7e9e3d75bfbb0c98b65f4773b75746bc7e2f3d686f5705d97156c017d1ba8922 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| PQID | 2696007305 |
| PQPubID | 23479 |
| ParticipantIDs | proquest_miscellaneous_2696007305 |
| PublicationCentury | 2000 |
| PublicationDate | 2022-10-01 |
| PublicationDateYYYYMMDD | 2022-10-01 |
| PublicationDate_xml | – month: 10 year: 2022 text: 2022-10-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationTitle | Journal of neural engineering |
| PublicationYear | 2022 |
| SSID | ssj0031790 |
| Score | 2.4041326 |
| Snippet | Objective. Brain computer interface (BCI) technology is an innovative way of information exchange, which can effectively convert physiological signals into... |
| SourceID | proquest |
| SourceType | Aggregation Database |
| Title | Flexible coding scheme for robotic arm control driven by motor imagery decoding |
| URI | https://www.proquest.com/docview/2696007305 |
| Volume | 19 |
| WOSCitedRecordID | wos000851279200001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1JSwMxFA5qPXhxq-JOBPEWmsk6OUkRiwepHlR6K9kGCs6MTqvQf2-STuvBi-B1yISQ5C3fe1_eA-BKs1wTj13AJoyhYG8pMtJh5KiglMS8TeLmvD7I4TAfjdRTG3CbtrTKpU5MitrVNsbIe0SoVEod85v3DxS7RsXsattCYx10aHBlIqVLjlZZBBqrTy0eRGYouM6kTVMGweqtvvW0zZlWv1Rxsi-Dnf-ubBdst54l7C-uwh5Y89U-6PargKrLObyGieuZguhd8DiIdTDNm4e2jsYLBozrSw-DBwub2tRhCqibErZEduiaqBShmcNwsmHMpIylL-bQ-cX_B-BlcPd8e4_a1grIUsZnSEuvPHWSm8IYbFVuBC-YlNRILpkwVnpSUCdyUXCJuVMy4DwbpNdlRueKkEOwUdWVPwKQEy2EKhS2RjJOsVY0M1IH7CuczrA6BpfLbRuHqxvzEbry9ed0_LNxJ38Ycwq2SHx6kIh0Z6BTBPH052DTfs0m0-Yinfw3ZbC2pA |
| linkProvider | ProQuest |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Flexible+coding+scheme+for+robotic+arm+control+driven+by+motor+imagery+decoding&rft.jtitle=Journal+of+neural+engineering&rft.au=Ai%2C+Qingsong&rft.au=Zhao%2C+Mengyuan&rft.au=Chen%2C+Kun&rft.au=Zhao%2C+Xuefei&rft.date=2022-10-01&rft.issn=1741-2552&rft.eissn=1741-2552&rft.volume=19&rft.issue=5&rft_id=info:doi/10.1088%2F1741-2552%2Fac84a9&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1741-2552&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1741-2552&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1741-2552&client=summon |