The motor-based brain–computer interface is widely used in the exoskeleton reconstruction of patients with muscle weakness and to enhance the operating experience of somatosensory game customers through the combination of actions and electroencephalography signals. However, the recognition algorithms in traditional motor-based brain–computer interfaces have problems such as “brain–computer interface blindness” (recognition accuracy is less than 70%) and “one person one model.” In this study, a regularized long short-term memory algorithm and a hardware platform for gesture recognition by using the motor-based brain–computer interface are proposed. Experimental results show that the gesture recognition accuracy rate based on the motor brain–computer interface is up to 95.69%, which is significantly better than that of other algorithms. The proposed model enhances the applicability and generalization ability of the brain–computer interface, for which the practicability and effectiveness are verified.
AnumanchipalliGKChartierJChangEF (2019) Speech synthesis from neural decoding of spoken sentences. Nature568(7753): 493–498.
2.
BergerH (1933) Ber das elektrenkephalogramm des menschen.IX. European Archives of Psychiatry and Clinical Neuroscience98(1): 251–254.
3.
ChenLWangZWangG (2017) Application of LSTM network in short-term power load forecasting under the framework of deep learning. Electric Power Information and Communication Technology15(5): 8–11.
4.
ChengMGaoXGaoS, et al. (2002) Design and implementation of a brain-computer interface with high transfer rates. IEEE Transactions on Biomedical Engineering49: 1181–1186.
5.
ChoiJ-BHanM-SSongB-K (2019) The effects of motor imagery combined with neuromuscular electrical stimulation on using transcranial magnetic stimulation in stroke patients. Korean Magnetics Society24(4): 763–769.
6.
CuiTT (2019) Research and system implementation of brain-computer interface combined with deep learning. M.S Thesis, Chongqing University of Posts and Telecommunications, China.
7.
DonchinESpencerKM (2000) The mental prosthesis: assessing the speed of a P300-based brain-computer interface. IEEE Transactions on Rehabilitation Engineering8(2): 174–179.
8.
FeiGBoHGaoXR, et al. (2008) A brain–computer interface using motion-onset visual evoked potential. Journal of Neural Engineering5(4): 477–485.
9.
GaoSKWangYGaoX, et al. (2014) Visual and auditory brain–computer interfaces. IEEE Transactions on Bio Medical Engineering61(5): 1436–1447.
10.
GuoYNWangQHuangS, et al. (2014) Hand gesture recognition system using single mixture source separation and flexible neural trees. Journal of Vibration and Control20(9): 1333–1342.
11.
GuoDZhouWGLiAY, et al. (2019) Hierarchical recurrent deep fusion using adaptive clip summarization for sign language translation. IEEE Transactions on Image Processing: a Publication of the IEEE Signal Processing Society29: 1575–1590.
12.
HillNJSchalkGFeltonEA, et al. (2013) Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface a general method for assessing brain--computer interface performance and its limitations evaluation of a modified fitts law BCI target acquisition task in able and motor disabled individuals adaptive Laplacian filtering for sensorimotor rhythm-based brain--computer interfaces. Journal of Neural Engineering10(4): 046003.
13.
HintonGESalakhutdinovR (2006) Reducing the dimensionality of data with neural networks. Science313(5786): 504–507.
14.
JiaGLamH-KLiaoJ, et al. (2020) Classification of electromyographic hand gesture signals using machine learning techniques. Neurocomputing401: 236–248.
15.
KuangYY (2019) Research on brain-computer interface technology based on motor imagination. M.S Thesis, North University of China, China.
16.
LinY (2015) Stimulation-assisted EEG signal feature enhancement method and hybrid brain-computer interface. PhD Thesis, Shanghai Jiaotong University, China.
17.
LiFFeiJ (2019) Gesture recognition algorithm based on image information fusion in virtual reality. Personal and Ubiquitous Computing23: 487–497.
18.
LeeAChoYAJinSA, et al. (2020) Enhancement of surgical hand gesture recognition using a capsule network for a contactless interface in the operating room. Computer Methods and Programs in Biomedicine190: 105385.
19.
LiMZhuWZhangM, et al. (2017) The novel recognition method with optimal wavelet packet and LSTM based recurrent neural network. In: IEEE international conference on mechatronics and automation, Takamatsu, 6–9 Auguest. 2017. Takamatsu, Japan WA: IEEE Computer Society, 584589.
20.
LiQSFangZGShenMW, et al. (2002) Gesture recognition technology and its application in human-computer interaction. Ergonomics1: 27–29.
21.
MasonSGBashashatiAFatourechiM, et al. (2007) A comprehensive survey of brain interface technology designs. Annals of Biomedical Engineering35(2): 137–169.
22.
MillerKJHermesDStaffNP (2020) The current state of electrocorticography-based brain-computer interfaces. Neurosurgical Focus49(1): E2.
23.
MuhammadAKRigDAIversenHK, et al. (2020) Review on motor imagery based BCI systems for upper limb post-stroke neurorehabilitation: from designing to application. Computers in Biology and Medicine123: 103843.
24.
PfurtschellerGLopes da SilvaFH (1999) Event-related EEG/MEG synchronization and desynchronization: basic principles. Clinical Neurophysiology110(11): 1842–1857.
25.
QiC (2014) The Comparative Study of Chinese Sign Language Actions. M.A Thesis, Dalian University of Technology, China.
26.
QuilesECandelaCKurogiG, et al. (2020) Low-cost robotic guide based on a motor imagery brain–computer interface for arm assisted rehabilitation. International Journal of Environmental Research and Public Health17(3): 699.
27.
ShiW-TLyuZ-JTangS-T, et al. (2018) A bionic hand controlled by hand gesture recognition based on surface EMG signals: a preliminary study. Biocybernetics and Biomedical Engineering38(1): 126–135.
28.
SimantoSKhawzaIUddinA, et al. (2017) Evidence of variabilities in eeg dynamics during motor imagery-based multiclass brain–computer interface. IEEE Transactions on Neural Systems & Rehabilitation Engineering26(2): 371–382.
29.
TjandrasaHSupenoD (2016) Classification of EEG signals using single channel independent component analysis, power spectrum, and linear discriminant analysis. In: SohPJWooLW, et al. (eds). Advances in Machine Learning and Signal Processing. Lecture Notes in Electrical Engineering. Cham, Switzerland: Springer, pp. 259–268.
30.
WangWQ (2018) Research on brain-computer interface control system based on motor imagination. M.S Thesis, Harbin University of Science and Technology, China.
31.
WangYCaiZ-XZhouY-R, et al. (2009) Constrained optimization evolutionary algorithm. Journal of Software20(1): 11–29.
32.
WolpawJRMcfarlandDJNeatGW, et al. (1993) An EEG-based brain-computer interface for cursor control. Electroencephalography & Clinical Neurophysiology78(3): 252–259.
33.
WuDLionelPKindermansP-J, et al. (2016) Deep dynamic neural networks for multimodal gesture segmentation and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence38(8): 1583–1597.
34.
YangLCLiBMLiGL, et al. (2005) A review of brain-computer interface technology. Acta Electronica Sinica33(7): 1234–1241.
35.
ZhaoZY (2019) Research on the algorithm of brain-computer interface system for motor imagination based on convolutional neural network. M.S Thesis, Shandong Normal University, China.
