Application of PSO-RBF neural network in gesture recognition of continuous surface EMG signals

Abstract

In view of the fact that independent gesture recognition cannot fully meet the natural, convenient and effective needs of actual human-computer interaction, this paper analyzes the current research status of gesture recognition based on EMG signal, and considers the practical application value of EMG signal processing in prosthetic limb control, mobile device manipulation and sign language recognition. Therefore, in this paper, the particle swarm optimization (PSO) algorithm is used to optimize the center value and the width value of the radial basis function in the RBF neural network. And the author uses the EMG signal acquisition device and the electrode sleeve to collect the four-channel continuous EMG signals generated by eight consecutive gestures. Then, the author performs noise reduction and active segment detection based on the summation, and extracts the well-known 5 time domain features. Finally, the data obtained are normalized and divided into training set and test set to train and test the classifier. Simulation experiments show that the RBF neural network which optimizes the center value and width value of radial basis functions via particle swarm optimization algorithm achieves a high recognition rate in continuous gesture recognition.

Keywords

Particle swarm optimization RBF neural network electromyogram signal continuous gesture

Get full access to this article

View all access options for this article.

References

Lee ,

M.O.

Kim ,

Kang ,

Park and

Choi , Knit band sensor for myoelectric control of surface EMG-based prosthetic hand, IEEE Sensors Journal 18(20) (2018), 8578–8586.

J.X.

Qi ,

G.Z.

Jiang ,

G.F.

Li ,

Sun and

Tao , Intelligent human-computer interaction based on surface EMG gesture recognition, IEEE Access 7 (2019), 61378–61387. DOI: 10.1109/ACCESS.2019.2914728

Farina ,

Jiang ,

Rehbaum ,

Holobar ,

Graimann ,

Dietl and

Aszmann , The extraction of neural information from the surface EMG for the control of upper-limb prostheses: Emerging avenues and challenges, IEEE Transactions on Neural Systems & Rehabilitation Engineering 22(4) (2014), 797–809.

Zhang ,

Chen ,

Li ,

Lantz ,

Wang and

J.H.

Yang , A framework for hand gesture recognition based on accelerometer and EMG sensors, IEEE Transactions on Systems Man and Cybernetics – Part A Systems and Humans 41(6) (2011), 1064–1076.

G.F.

Li ,

J.H.

Li ,

Z.J.

Ju ,

Sun and

J.Y.

Kong , A novel feature extraction method for machine learning based on surface electromyography from healthy brain, Neural Computing and Applications (2019), DOI: 10.1007/s00521-019-04147-3

Tan ,

Sun ,

G.F.

Li ,

G.Z.

Jiang ,

D.S.

Chen and

H.H.

Liu , Research on gesture recognition of smart data fusion features in the IoT, Neural Computing and Applications (2019). DOI: 10.1007/s00521-019-04023-0

Jiang ,

Jiang and

Wang , A hybrid approach of rough set and case-based reasoning to remanufacturing process planning, Journal of Intelligent Manufacturing 30(1) (2019), 19–32. DOI: 10.1007/s10845-016-1231-0

A.D.

Vigotsky ,

Halperin ,

G.J.

Lehman ,

G.S.

Trajano and

T.M.

Vieira , Interpreting signal amplitudes in surface electromyography studies in sport and rehabilitation sciences, Frontiers in Physiology 8(985) (2018), 1–15.

Z.Y.

Lu ,

Chen ,

Li ,

Zhang and

Zhou , A hand gesture recognition framework and wearable gesture-based interaction prototype for mobile devices, IEEE Transactions on Human-Machine Systems 44(2) (2014), 293–299.

10.

Sun ,

C.Q.

Li ,

G.F.

Li ,

G.Z.

Jiang ,

H.H.

Liu ,

Z.G.

Zheng and

W.N.

Shu , Gesture recognition based on kinect and sEMG signal fusion, Mobile Networks and Applications 23(4) (2018), 797–805. DOI: 10.1007/s11036-018-1008-0

11.

W.T.

Cheng ,

Sun ,

G.F.

Li ,

G.Z.

Jiang and

H.H.

Liu , Jointly network: A network based on CNN and RBM for gesture recognition, Neural Computing & Applications 31(Supplement 1) (2019), 309–323.

12.

G.R.

Naik ,

D.K.

Kumar and

Palaniswami , Signal processing evaluation of myoelectric sensor placement in low-level gestures: Sensitivity analysis using independent component analysis, Expert Systems 31(1) (2014), 91–99.

13.

G.R.

Naik and

H.T.

Nguyen , Nonnegative matrix factorization for the identification of EMG finger movements: Evaluation using matrix analysis, IEEE Journal of Biomedical and Health Informatics 19(2) (2015), 478–485.

14.

J.B.

Hu ,

Sun ,

G.F.

Li ,

G.Z.

Jiang and

Tao , Probability analysis for grasp planning facing the field of medical robotics, Measurement 141 (2019), 227–234.

15.

Lopes ,

Simão ,

Mendes ,

Safeea ,

Afonso and

Neto , Hand/arm gesture segmentation by motion using IMU and EMG sensing, Procedia Manufacturing 11 (2017), 107–113.

16.

H.P.

Gupta ,

H.S.

Chudgar ,

Mukherjee ,

Dutta and

Sharma , A continuous hand gestures recognition technique for human-machine interaction using accelerometer and gyroscope sensors, IEEE Sensors Journal 16(16) (2016), 6425–6432.

17.

C.C.

Li ,

G.F.

Li ,

G.Z.

Jiang ,

D.S.

Chen and

H.H.

Liu , Surface EMG data aggregation processing for intelligent prosthetic action recognition, Neural Computing and Applications (2018). DOI: 10.1007/s00521-018-3909-z

18.

M.A.

Oskoei and

H.S.

Hu , Myoelectric control systems–-A survey, Biomedical Signal Processing and Control 2(4) (2017), 275–294.

19.

G.F.

Li ,

L.L.

Zhang ,

Sun and

J.Y.

Kong , Towards the sEMG hand: Internet of things sensors and haptic feedback application, Multimedia Tools and Applications (2018). DOI: 10.1007/s11042-018-6293-x

20.

J.F.S.

Lin ,

V.r

Joukov and

Kulic , Human motion segmentation by data point classification, Engineering in Medicine & Biology Society IEEE, 2014, pp. 9–13.

21.

H.B.

Xie ,

Guo ,

S.W.

Bai and

Dokos , Hybrid soft computing systems for electromyographic signals analysis: A review, BioMedical Engineering OnLine 13(8) (2014), 1–19.

22.

J.K.

Basu ,

Bhattacharyya and

T.H.

Kim , Use of artificial neural network in pattern recognition, International Journal of Software Engineering and Its Applications 4(2) (2010), 23–34.

23.

J.X.

Qi ,

G.Z.

Jiang ,

G.F.

Li ,

Sun and

Tao , Surface EMG hand gesture recognition system based on PCA and GRNN, Neural Computing and Applications (2019), DOI: 10.1007/s00521-019-04142-8

24.

Ali and

K.A.

Smith , On learning algorithm selection for classification, Applied Soft Computing 6(2) (2006), 119–138.

25.

G.F.

Li ,

Wu ,

G.Z.

Jiang ,

Xu and

H.H.

Liu , Dynamic gesture recognition in the internet of things, IEEE Access 7 (2019), 23713–23724. DOI: 10.1109/ACCESS.2018.2887223

26.

Hamedi ,

S.H.

Salleh ,

Astaraki ,

A.M.

Noor and

A.R.A.

Harris , Comparison of Multilayer Perceptron and Radial Basis Function Neural Networks for EMG-Based Facial Gesture Recognition, The 8th International Conference on Robotic, Vision, Signal Processing & Power Applications 291 (2014), 285–294.

27.

Raj ,

Rejith and

K.S.

Sivanandan . Real time identification of human forearm kinematics from surface EMG signal using artificial neural network models, Procedia Technology 25 (2016), 44–51.

28.

Koçer and

A.E.

Tümer , Classifying neuromuscular diseases using artificial neural networks with applied autoregressive and cepstral analysis, Neural Computing and Applications 28(1) (2017), 945–952.

29.

Naseri ,

Heidari ,

Baghfalaki ,

Gheibi ,

Batle ,

Farouk and

Habibi , A new secure quantum watermarking scheme, Optik 139 (2017), 77–86.

30.

Abdolmaleky ,

Naseri ,

Batle ,

Farouk and

Gong , H. Red-Green-Blue multi-channel quantum representation of digital images, Optik 128 (2017), 121–132.

31.

Heidari ,

Naseri ,

Gheibi ,

Baghfalaki ,

M.R.

Pourarian and

Farouk , A new quantum watermarking based on quantum wavelet transforms, Communications in theoretical Physics 67(6) (2017), 732.

32.

Batle ,

Ciftja ,

Naseri ,

Ghoranneviss ,

Farouk and

Elhoseny , Equilibrium and uniform charge distribution of a classical two-dimensional system of point charges with hard-wall confinement, Physica Scripta 92(5) (2017), 055801.

33.

Naseri,

Mosayeb , et al. “A scheme for secure quantum communication network with authentication using GHZ-like states and cluster states controlled teleportation.” Quantum Information Processing 14.11 (2015), 4279–4295.

34.

Farouk ,

Batle ,

Elhoseny ,

Naseri ,

Lone ,

Fedorov and

Abdel-Aty , Robust general N user authentication scheme in a centralized quantum communication network via generalized GHZ states, Frontiers of Physics 13(2) (2018), 130306.

35.

Farouk ,

Zakaria ,

Megahed and

F.A.

Omara , A generalized architecture of quantum secure direct communication for N disjointed users with authentication, Scientific Reports 5 (2015), 16080.

36.

Batle ,

Naseri ,

Ghoranneviss ,

Farouk ,

Alkhambashi and

Elhoseny , Shareability of correlations in multiqubit states: Optimization of nonlocal monogamy inequalities, Physical Review A 95(3) (2017), 032123.

37.

X.T.

Jiang ,

L.K.

Merhi ,

Z.G.

Xiao and

Menon , Exploration of force myography and surface electromyography in hand gesture classification, Medical Engineering & Physics 41 (2017), 63–73.

38.

L.P.

Maneski ,

Topalovic and

Jovicic , Stimulation map for control of functional grasp based on multi-channel EMG recordings, Medical Engineering & Physics 38(11) (2016), 1251–1259.

39.

Englehart ,

Hudgins and

P.A.

Parker . A wavelet based continuous classification scheme for multifunction Myoelectric control, IEEE Transactions on Bio-medical Engineering 48(3) (2001), 302–311.

40.

J.M.

Hahne ,

Graimann and

K.R.

Muller , Spatial filtering for robust myoelectric control, IEEE Transactions on Biomedical Engineering 59(5) (2012), 1436–1443.

41.

Azami ,

Sanei and

Mohammadi , A novel signal segmentation method based on standard deviation and variable threshold, International Journal of Computer Applications 34(2) (2011), 27–34.

42.

A.C.

Tsai ,

J.J.

Luh and

T.T.

Lin , A novel STFT-ranking feature of multi-channel EMG for motion pattern recognition, Expert Systems with Applications 42(7) (2015), 3327–3341.

43.

R.N.

Khushaba ,

Kodagoda ,

Takruri and

Dissanayake , Toward improved control of prosthetic fingers using surface electromyogram (EMG) signals, Expert Systems with Applications 39(12) (2012), 10731–10738.

44.

Phinyomark ,

Phukpattaranont and

Limsakul , Feature reduction and selection for EMG signal classification, Expert Systems with Applications 39(8) (2012), 7420–7431.

45.

F.D.

Farfán ,

J.C.

Politti and

C.J.

Felice , Evaluation of EMG processing techniques using information theory, Biomedical Engineering Online 9(1) (2010), 72–72.

46.

M.I.

Ibrahimy ,

M.R.

Ahsan and

O.O.

Khalifa , Design and optimization of Levenberg-Marquardt based neural network classifier for EMG signals to identify hand motions, Measurement Science Review 13(3) (2013), 142–151.

47.

Jiang ,

G.F.

Li ,

Sun ,

J.Y.

Kong and

Tao , Gesture recognition based on skeletonization algorithm and CNN with ASL database, Multimedia Tools and Applications (2018). DOI: 10.1007/s11042-018-6748-0

48.

Subasi , Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders, Computers in Biology and Medicine 43(5) (2013), 576–586.

49.

B.W.

Luo ,

Sun ,

G.F.

Li ,

D.S.

Chen and

Z.J.

Ju , Decomposition algorithm for depth image of human health posture based on brain health, Neural Computing and Applications (2019). DOI: 10.1007/s00521-019-04141-9

50.

Das ,

A.K.

Jena ,

Nayak ,

Naik and

H.S.

Behera , A novel PSO based back propagation learning-MLP (PSO-BP-MLP) for classification, Smart Innovation, Systems and Technologies 1 (2015), 333–344.

51.

G.F.

Li ,

Jiang ,

Y.L.

Zhou ,

G.Z.

Jiang ,

J.Y.

Kong and

Manogaran , Human lesion detection method based on image information and brain signal, IEEE Access 7 (2019), 11533–11542. DOI: 10.1109/ACCESS.2019.2891749.

52.

Marinia and

Walczakb , Particle swarm optimization (PSO). A tutorial, Chemometrics and Intelligent Laboratory Systems 149(15) (2015), 153–165.

53.

Garg , A hybrid PSO-GA algorithm for constrained optimization problems, Applied Mathematics and Computation 274(1) (2016), 292–305.

54.

M.A.

Suliman ,

A.M.

Alrashdi and

Ballal , SNR estimation in linear systems with gaussian matrices, IEEE Signal Processing Letters 24(12) (2017), 2757398.

55.

A.S.

Stordal and

H.A.

Karlsen , Large sample properties of the adaptive Gaussian mixture filter, Monthly Weather Review 145(7) (2017), 2533–2553.

56.

Bouquet ,

Jabloun and

Ravier , Legendre polynomial modeling of time-varying delay applied to surface EMG signals-Derivation of the appropriate time-dependent CRBs, Signal Processing 114 (2015), 34–44.

57.

G.F.

Li ,

J.Y.

Kong ,

J.T.

Yang ,

X.C.

Huang and

Hou , Genetic algorithm and its application research, prospect in mechanical optimization design, Dynamics of Continuous Discrete and Impulsive Systems-Series A-Mathematical Analysis 13 (2006), 1446–1453.

58.

M.C.

Yu ,

G.F.

Li ,

Jiang ,

G.Z.

Jiang ,

Tao and

D.S.

Chen , Hand medical monitoring system based on machine learning and optimal EMG feature set, Personal and Ubiquitous Computing (2019). DOI 10.1007/s00779-019-01285-2

59.

Jiang ,

G.F.

Li ,

Sun ,

J.Y.

Kong ,

Tao and

D.S.

Chen , Grip strength forecast and rehabilitative guidance based on adaptive neural fuzzy inference system using sEMG, Personal and Ubiquitous Computing (2019). DOI: 10.1007/s00779-019-01268-3

60.

Sun ,

J.B.

Hu ,

G.F

Li ,

G.Z

Jiang ,

H.G.

Xiong ,

Tao ,

Z.J.

Zheng and

Jiang , Gear reducer optimal design based on computer multimedia simulation, The Journal of Supercomputing (2018). DOI: 10.1007/s11227-018-2255-3

61.

Jiang ,

Z.J.

Zheng ,

G.F.

Li ,

Sun ,

J.Y.

Kong ,

G.Z.

Jiang ,

H.G.

Xiong ,

Tao ,

Xu ,

H.H.

Liu and

Z.J.

Ju , Gesture recognition based on binocular vision, Cluster Computing (2018). DOI: 10.1007/s10586-018-1844-5

62.

Li ,

Sun ,

G.F.

Li ,

J.Y.

Kong ,

G.Z.

Jiang ,

Tao ,

Xu and

H.H.

Liu , Gesture recognition based on modified adaptive orthogonal matching pursuit algorithm, Cluster Computing 22(Suppl 1) (2019), 503–512. DOI: 10.1007/s10586-017-1231-7