Deep Learning Based Inter-subject Continuous Decoding of Motor Imagery for Practical Brain-Computer Interfaces

Inter-subject transfer learning is a long-standing problem in brain-computer interfaces (BCIs) and has not yet been fully realized due to high inter-subject variability in the brain signals related to motor imagery (MI). The recent success of deep learning-based algorithms in classifying different b...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Frontiers in neuroscience Jg. 14; S. 918
Hauptverfasser: Roy, Sujit, Chowdhury, Anirban, McCreadie, Karl, Prasad, Girijesh
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Lausanne Frontiers Research Foundation 30.09.2020
Frontiers Media S.A
Schlagworte:
Adaptation
adaptive learning
Algorithms
Bayesian analysis
brain-computer interface (BCI)
Calibration
Classification
Competition
convolutional neural network (CNN)
Datasets
Deep learning
Discriminant analysis
EEG
electroencephalography (EEG)
Feedback
Interfaces
Mental task performance
motor imagery
Neural networks
Neuroscience
Transfer learning
ISSN:1662-453X, 1662-4548, 1662-453X
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Inter-subject transfer learning is a long-standing problem in brain-computer interfaces (BCIs) and has not yet been fully realized due to high inter-subject variability in the brain signals related to motor imagery (MI). The recent success of deep learning-based algorithms in classifying different brain signals warrants further exploration to determine whether it is feasible for the inter-subject continuous decoding of MI signals to provide contingent neurofeedback which is important for neurorehabilitative BCI designs. In this paper, we have shown how a convolutional neural network (CNN) based deep learning framework can be used for inter-subject continuous decoding of MI related electroencephalographic (EEG) signals using the novel concept of Mega Blocks for adapting the network against inter-subject variabilities. These Mega Blocks have the capacity to repeat a specific architectural block several times such as one or more convolutional layers in a single Mega Block. The parameters of such Mega Blocks can be optimized using Bayesian hyperparameter optimization. The results, obtained on the publicly available BCI competition IV-2b dataset, yields an average inter-subject continuous decoding accuracy of 71.49% (kappa=0.42) and 70.84% (kappa =0.42) for two different training methods such as adaptive moment estimation (Adam) and stochastic gradient descent (SGDM) respectively in 7 out of 9 subjects. Our results show for the first time that it is feasible to use CNN based architectures for inter-subject continuous decoding with a sufficient level of accuracy for developing calibration-free MI-BCIs for practical purposes.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
This article was submitted to Brain Imaging Methods, a section of the journal Frontiers in Neuroscience
Edited by: Amit Konar, Jadavpur University, India
Reviewed by: Yu Zhang, Stanford University, United States; Seong-Whan Lee, Korea University, South Korea
ISSN:1662-453X
1662-4548
1662-453X
DOI:10.3389/fnins.2020.00918