Conference proceeding
Multimodal fNIRS-EEG Classification Using Deep Learning Algorithms for Brain-Computer Interfaces Purposes
Advances in Neuroergonomics and Cognitive Engineering, v 953
01 Jan 2020
Featured in Collection : UN Sustainable Development Goals @ Drexel
Abstract
The development of brain-computer interface (BCI) systems has received considerable attention from neuroscientists in recent years. BCIs can serve as a means of communication and for the restoration of motor function for patients with motor disorders. An essential part of the design of a BCI is correctly classifying the brain signals, historically collected using electroen-cephalography (EEG). However, recent studies have shown more robust classification results when EEG is combined with other neuroimaging methods such as fNIRS. Conventional classification methods need a priori feature preprocessing to train the model; such feature selection is a difficult and heavily studied problem. By using deep neural networks (DNN), in which recordings can be fed directly to the algorithm for training, we avoid the need for feature selection. In this study, the capabilities of DNNs in the classification of the hybrid EEG-fNIRS recordings of motor imagery (MI) and mental workload (MWL) tasks are investigated. A five-layer fully connected network is used for classification. This study makes use of two open-source meta-datasets collected at the Technische Universitat Berlin. The first dataset includes brain activity recordings of 26 healthy participants during three cognitive tasks: (1) n-back (0-, 2- and 3-back), (2) discrimination/selection response task (DSR) and (3) word generation (WG) tasks. The second dataset, motor imagery, consists of left and right-hand motor imagery tasks, each for 29 healthy participants. Our results show that classification accuracy is considerably higher for multimodal recordings when compared to EEG or fNIRS recordings alone. The proposed algorithm improves classification performance relative to a conventional support vector machine (SVM), reaching 90% average accuracy for both tasks, 8% higher than SVM performance. These results demonstrate the feasibility of achieving strong classification performance using multimodal BCI and deep learning.
Metrics
Details
- Title
- Multimodal fNIRS-EEG Classification Using Deep Learning Algorithms for Brain-Computer Interfaces Purposes
- Creators
- Marjan Saadati - George Mason UniversityJill Nelson - George Mason UniversityHasan Ayaz - Drexel University
- Contributors
- H Ayaz (Editor) - Drexel University
- Publication Details
- Advances in Neuroergonomics and Cognitive Engineering, v 953
- Conference
- AHFE 2019 International Conference on Neuroergonomics and Cognitive Engineering, and the AHFE International Conference on Industrial Cognitive Ergonomics and Engineering Psychology (Washington, District of Columbia, United States, 24 Jul 2019–28 Jul 2019)
- Series
- Advances in Intelligent Systems and Computing; 953
- Publisher
- Springer Nature
- Number of pages
- 12
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- School of Biomedical Engineering, Science, and Health Systems
- Web of Science ID
- WOS:000502759200021
- Scopus ID
- 2-s2.0-85067651231
- Other Identifier
- 991019169711904721
UN Sustainable Development Goals (SDGs)
This publication has contributed to the advancement of the following goals:
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Collaboration types
- Domestic collaboration
- Web of Science research areas
- Computer Science, Artificial Intelligence
- Neurosciences