A novel SSVEP-BCI approach combining visual detection and tracking for dynamic target selection

This paper presents a brain-computer interface (BCI) approach for dynamic pedestrian selection. The experimental paradigm is based on steady-state visual evoked potential (SSVEP) and visual detection and tracking. In this study, we collected a few videos of driving environment containing multiple pe...

Full description

Saved in:
Bibliographic Details
Published in:2021 IEEE 2nd International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE) pp. 722 - 726
Main Authors: Fan, Pengbo, Liu, Yadong, Zhou, Zongtan, Liu, Yaru, Liang, Xinbin, Tang, Jingsheng, Yu, Yang
Format: Conference Proceeding
Language:English
Published: IEEE 26.03.2021
Subjects:
Brain-computer interface (BCI)
Brain-computer interfaces
Heuristic algorithms
multiple dynamic target selection
Object detection
object detection and tracking
steady-state visually evoked potential (SSVEP)
Target tracking
Time factors
Videos
Visualization
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents a brain-computer interface (BCI) approach for dynamic pedestrian selection. The experimental paradigm is based on steady-state visual evoked potential (SSVEP) and visual detection and tracking. In this study, we collected a few videos of driving environment containing multiple pedestrians, and used the object detection algorithm named YOLOv4-tiny and the multi-object tracking algorithm named Deep-SORT to detect and track pedestrians. In the experiment, these videos are presented on the screen, with flicker stimuli at different fixed frequency superimposed on pedestrian targets. Then subjects selected pedestrian targets according to the prompts. Six subjects (five males, one female) participated in the experiment. Their average response time of SSVEP in offline experiments is 1.98s, in online experiments, the average accuracy is 92.5% and the average ITR is 46.81bits/min. The results show the feasibility and effectiveness of using SSVEP-BCI to select dynamic targets in real environments. Object detection and tracking algorithms can detect and track targets in other categories, therefore, this paradigm can also be applied in other scenarios.
DOI:10.1109/ICBAIE52039.2021.9390035