Deep Learning Based Inter-subject Continuous Decoding of Motor Imagery for Practical Brain-Computer Interfaces

Inter-subject transfer learning is a long-standing problem in brain-computer interfaces (BCIs) and has not yet been fully realized due to high inter-subject variability in the brain signals related to motor imagery (MI). The recent success of deep learning-based algorithms in classifying different b...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Frontiers in neuroscience Ročník 14; s. 918
Hlavní autori: Roy, Sujit, Chowdhury, Anirban, McCreadie, Karl, Prasad, Girijesh
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Lausanne Frontiers Research Foundation 30.09.2020
Frontiers Media S.A
Predmet:
Adaptation
adaptive learning
Algorithms
Bayesian analysis
brain-computer interface (BCI)
Calibration
Classification
Competition
convolutional neural network (CNN)
Datasets
Deep learning
Discriminant analysis
EEG
electroencephalography (EEG)
Feedback
Interfaces
Mental task performance
motor imagery
Neural networks
Neuroscience
Transfer learning
ISSN:1662-453X, 1662-4548, 1662-453X
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Inter-subject transfer learning is a long-standing problem in brain-computer interfaces (BCIs) and has not yet been fully realized due to high inter-subject variability in the brain signals related to motor imagery (MI). The recent success of deep learning-based algorithms in classifying different brain signals warrants further exploration to determine whether it is feasible for the inter-subject continuous decoding of MI signals to provide contingent neurofeedback which is important for neurorehabilitative BCI designs. In this paper, we have shown how a convolutional neural network (CNN) based deep learning framework can be used for inter-subject continuous decoding of MI related electroencephalographic (EEG) signals using the novel concept of Mega Blocks for adapting the network against inter-subject variabilities. These Mega Blocks have the capacity to repeat a specific architectural block several times such as one or more convolutional layers in a single Mega Block. The parameters of such Mega Blocks can be optimized using Bayesian hyperparameter optimization. The results, obtained on the publicly available BCI competition IV-2b dataset, yields an average inter-subject continuous decoding accuracy of 71.49% (kappa=0.42) and 70.84% (kappa =0.42) for two different training methods such as adaptive moment estimation (Adam) and stochastic gradient descent (SGDM) respectively in 7 out of 9 subjects. Our results show for the first time that it is feasible to use CNN based architectures for inter-subject continuous decoding with a sufficient level of accuracy for developing calibration-free MI-BCIs for practical purposes.
Bibliografia:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
This article was submitted to Brain Imaging Methods, a section of the journal Frontiers in Neuroscience
Edited by: Amit Konar, Jadavpur University, India
Reviewed by: Yu Zhang, Stanford University, United States; Seong-Whan Lee, Korea University, South Korea
ISSN:1662-453X
1662-4548
1662-453X
DOI:10.3389/fnins.2020.00918