Sage Journals: Discover world-class research

Abstract

Motion estimation from surface electromyogram (sEMG) signals has been studied extensively over the past decades. Nevertheless, it is challenging for novel subjects to adapt to a trained estimation model since sEMG signals inherently contain user-dependent features that interfere with the estimation model and reduce the estimation accuracy. To achieve accurate motion estimation, a strategy of correlated components analysis-based random forest regressor (CorrCA-RFG) was proposed. The proposed CorrCA-RFG firstly uses CorrCA to extract user-independent features related to motion among multiple subjects, and obtain the projection vectors from sEMG data to the motion-dependent feature space. Then, the RFG is trained by the user-independent sEMG features and establishes the estimation model. To validate the effectiveness of the proposed CorrCA-RFG, this strategy was tested on a public dataset and an experimental study and compared to three methods, namely random forest regressor (RFG), canonical components analysis-based random forest regressor (CCA-RFG), and a convolutional neural network (CNN). For both cases, the estimation performance of the CorrCA-RFG outperformed the other three methods. These results demonstrate that the proposed CorrCA-RFG enables robust motion estimation by extracting user-independent sEMG features.

Keywords

Surface electromyogram (sEMG)motion estimation user-independent features correlated components analysis (CorrCA)

Introduction

The surface electromyogram (sEMG) signals detected by surface electrodes are the representation of the electric potential field generated by the muscle fiber contraction,¹ which is non-invasive and contains the essential information on human motion.^2,3 Continuous motion estimation from sEMG is effective to ensure accuracy and safety in many emerging applications such as human-robot-interaction (HRI), robotic systems for rehabilitation, assistance, and performance enhancement.^4–6

However, due to the user-dependent nature of sEMG signals mainly affected by factors of the subcutaneous tissue and the physiological cross-sectional area of the muscle^7,8 the measured sEMG signals are individual varying differently from different users even performing the same motion. The user-dependent nature of sEMG leads to user-dependent estimation models^9–11 which have less generalization and should be retrained for a new user. The retraining process is laborious and time-consuming, which hinders the application of sEMG-based HRI for commercial robotic devices.^12–15

To address these issues, many efforts have been made to improve the generalization of the estimation models in cross users. Firstly, some studies extended the size and diversity (more training users) of the training data to enhance the generalization ability of machine learning models,¹⁶ such as random forest regression (RFG) and support vector regression (SVR), which is costly. In these methods, the generalization performance heavily depended on the training dataset. Secondly, deep learning and transfer learning methods have been implemented to estimate human motion. Deep learning methods have the ability to automatically learn features that can share similar distributions across various subjects.^17,18 Yang et al.¹⁹ proposed a novel convolutional neural network (CNN) structure with the capacity of generalization to estimate wrist movement, in which the CNN contains a large number of parameters. Bao et al.²⁰ designed a two-stream CNN with a complexity structure for supervised domain adaptation to reduce the domain shift effect. Transfer learning aims to explore the knowledge from the source domain and use the knowledge to a target domain.²¹ To estimate the elbow torque based on sEMG signals, Jiang et al.²² proposed a correlation-based data weighting scheme based on transfer learning, which is unsupervised in the modeling stage. However, the above methods require a large dataset or high computational cost.

To further improve the generalization of the estimation models, some researchers have begun to use user-independent sEMG features to establish the estimation models.^23,24 The user-independent sEMG features were related to the motion with strong correlations among multiple users. Especially, they possibly share similar distributions across different subjects who perform the same motion. Therefore, the user-independent features are beneficial for improving the generalization. Some studies applied canonical components analysis (CCA) to extract the user-independent features and built generalized models based on these features to estimate the cross-user motion. Khushaba²⁵ applied CCA to project different users’ data onto a unified-style space to overcome individual differences. Xue et al.²⁶ used CCA to extract the inherent user-independent properties of sEMG signals and applied optimal transport to further reduce the discrepancies between the transformed features from the training and testing set. In their studies, the CCA requires the canonical projection vectors to be orthogonal, which is not a reasonable assumption for the sEMG analysis. In addition, the estimation performance of CCA-based methods depends on the chosen expert set whose choosing standard has not been well defined and is usually given based on subjective experience.

In this study, we focused on extracting user-independent features without any expert sets and building a new estimation strategy for improving the performance of continuous motion estimation from sEMG signals. Since correlated components analysis (CorrCA) can help extract components that are maximally correlated among subjects, we firstly used the CorrCA to extract the user-independent sEMG features. In addition, RFG can achieve excellent prediction performance using a smaller dataset compared to the other machine learning methods.²⁷ Based on the above advantages of the CorrCA and RFG, we propose a new estimation strategy: CorrCA-RFG. Firstly, a single set of linear projections are yielded from multiple subjects’ sEMG signals using CorrCA. Projection vectors can transform all subjects’ datasets into the same space to obtain user-independent features. Then these extracted features are applied to construct an RFG model to estimate human motion. To validate the effectiveness of the proposed method, we tested the CorrCA-RFG for estimating the knee angles in both a public dataset²⁸ and an own experimental study. The main contribution of this study is to provide a new strategy, namely CorrCA-RFG, from the viewpoint of extracting the user-independent sEMG features for the generalization of sEMG-based continuous motion estimation across multiple subjects.

The remainder of this paper is organized as follows. Section 2 presents the proposed CorrCA-RFG strategy. Section 3 describes the experimental study and the public dataset and presents results both on the experiment and public dataset. Section 4 and 5 give the discussion and conclusion of this study, respectively.

Methods

In this section, the CorrCA-RFG strategy is firstly described in details, as shown in Figure 1. Secondly, the processing of sEMG signals, sEMG features extraction and the performance measurement are introduced, respectively.

Figure 1.

The designed CorrCA-RFG strategy for user-independent sEMG-based motion estimation.

Correlated correlation analysis

The CorrCA tries to identify a single set of linear projections which can maximize the correlation among the $N$ subjects. In other words, it can be employed to extract similar motion activity from sEMG signals in multiple subjects. Given data matrices, $x_{i}^{j} \in R^{D}$ , where a right hand subscript $i = 1, \dots, N$ enumerates the subjects, a right hand superscript $j = 1, \dots, T$ enumerates the number of samples, and $D$ denotes the number of feature dimensions.

The goal of CorrCA is to seek a projection vector $w \in R^{D}$ ,6

z_{i}^{j} = w^{T} x_{i}^{j},

(1)

where $z_{i}^{j}$ denotes the $j$ th projection of subject $i$ .

To seek the projection vector, inter-subject correlation (ISC) was required maximum and defined as,

ρ = \frac{1}{N - 1} \frac{Σ_{i = 1}^{N} Σ_{k = 1, k \neq i}^{N} Σ_{j = 1}^{T} (z_{i}^{j} - {\bar{z}}_{i}) (z_{k}^{j} - {\bar{z}}_{k})}{Σ_{i = 1}^{N} Σ_{j = 1}^{T} (z_{i}^{j} - {\bar{z}}_{i}) (z_{i}^{j} - {\bar{z}}_{i})},

(2)

where ${\bar{z}}_{i} = \frac{1}{T} Σ_{j = 1}^{T} z_{i}^{j}$ .

Inserting (1) into (2) gives the following equation,

ρ = \frac{1}{N - 1} \frac{w^{T} p_{b} w}{w^{T} p_{w} w},

(3)

where $p_{b}$ and $p_{w}$ represent the between-subject covariance and within-subject covariance, respectively.

p_{b} = Σ_{j = 1}^{T} Σ_{i = 1}^{N} Σ_{k = 1, k \neq i}^{N} (x_{i}^{j} - {\bar{x}}_{i}) (x_{k}^{j} - {\bar{x}}_{k})^{T},

(4)

p_{w} = Σ_{j = 1}^{T} Σ_{i = 1}^{N} (x_{i}^{j} - {\bar{x}}_{i}) (x_{i}^{j} - {\bar{x}}_{i})^{T}

(5)

where ${\bar{x}}_{i} = \frac{1}{T} Σ_{j = 1}^{T} x_{i}^{j}$ .

To maximize the ISC, differentiation of (3) with respect to the projection vector $w$ and setting to zero yields the following eigenvalue equation,

p_{b} w = ρ p_{w} w

(6)

Supposing $p_{w}$ is invertible, $w$ is the eigenvector of matrix $p_{w}^{- 1} p_{b}$ with eigenvalue $ρ$ . The optimal projection can be obtained from the eigenvector of $p_{w}^{- 1} p_{b}$ with the largest eigenvalue. More details about CorrCA can be get in Parra et al.²⁹

CorrCA-RFG strategy

Taking advantage of the CorrCA for multiple subjects analysis, in this paper, we proposed the CorrCA-RFG strategy for sEMG-based motion estimation in cross-subject shown in Figure 1. Specifically, to reject noise and unimportant sEMG signals for each subject,³⁰ sEMG features were firstly extracted per each channel according to the gait cycle. Secondly, the features from different subjects in the same channel were concatenated into matrices, $x_{k} \in R^{T \times D \times N}$ , where $T$ , $D$ , and $N$ represent the number of samples, feature dimensions, and the number of subjects, respectively. Thirdly, for each channel, based on these concatenated matrices, feature projection vector $w_{k}$ which maximized the correlation between subjects was obtained by CorrCA. The projection vectors can transform the sEMG features of all subjects into the same space. Finally, all of the transformed features were applied as training data to train an RFG model. For novel subjects, the proposed CorrCA-RFG strategy could improve the motion estimation performance without reconstructing the RFG model. Their features only need to be transformed into the same spaces as the training features by the obtained projection vectors.

Signal processing

A Butterworth band-pass filter (10–500 Hz) was applied to pre-process the sEMG signals before extracting sEMG features.^31,32 Next, the pre-processed sEMG signals were normalized using the maximum amplitude. Then, an overlapping time window with a sliding window was applied to extract features from the normalized signals. To ensure the same number of feature samples over a gait cycle for all subjects, in this study, we proposed that sEMG features were extracted by segmenting with the gait cycle. Assuming $TW$ and $SW$ are time window length and sliding window length, respectively.

T W = G L \times 5 % S W = G L \times 2 %

(7)

where $GL$ denotes the length of one gait cycle.

Feature extraction

In each time window, 12 time-domain features and 2 frequency-domain features were extracted from each of the six sEMG channels. Specifically, the time-domain features consist of integrated EMG, mean absolute value, mean, root mean square, variance, kurtosis, skewness, zero crossing, slop sign change, and auto-regressive model coefficients. The frequency-domain features include median frequency and mean frequency.³³ For each channel, the extracted features were concatenated into a single vector as one sample, $x_{ik}$ , where $i$ represents the $i$ -th subject, and $k$ denotes the $k$ -th channel.

Performance measurement

The normal root-mean-squared error (NRMSE) and correlation coefficient (CC) criteria were considered to assess the estimation performance. The NRMSE represents the errors between the measurement and the estimation. The CC represents the match between the measurement and the estimation. The values of NRMSE and CC are close to 0 and 1, respectively, which indicates good estimation performance. The NRMSE is defined as:

NRMSE = \frac{\sqrt{\frac{1}{n} {Σ_{i = 1}^{n} (y_{i} - {\hat{y}}_{i})}^{2}}}{y_{\max} - y_{\min}}

(8)

where $n$ denotes the total number of samples. $y$ and $\hat{y}$ represent the measured and estimated angles. $y_{\max}$ and $y_{\min}$ are the maximum and minimum values of the measured angles.

The CC is defined as:

CC = \frac{C_{y \hat{y}}}{σ_{y} σ_{\hat{y}}}

(9)

where $C_{y \hat{y}}$ denotes the covariance between the measured and estimated angles. $σ_{y}$ and $σ_{\hat{y}}$ represent the standard deviation of measured and estimated angles respectively.

Experiments and results

This section presents the comparison results among the proposed CorrCA-RFG, conventional RFG, CCA-RFG, and CNN for knee angles estimation in both a public dataset and an experimental study. In the conventional RFG, the original sEMG features directly were fed into the RFG to train the model. In the CCA-RFG, for each subject, the CCA was used to extract the training features correlated with the expert features from the original sEMG features.²⁵ Then, these extracted training features were fed into the RFG. A leave-one-subject-out cross-validation method was applied for cross validation. Specifically, one subject was picked as a novel subject for testing each time. Data from all remaining subjects were used for training.

Data acquisition

In this paper, a public subject dataset and an experimental study were applied to validate and analyze the proposed CorrCA-RFG strategy.

Public subject dataset

In the public datasets, gait data of 10 healthy subjects (all males) running on a treadmill at speeds of 2 m/s contains marker trajectories, ground reaction forces and moments, and sEMG signals. Totally 54 reflective markers were placed on each subject, whose positions were collected with 100 Hz using 8 Vicon MX40+ cameras. A Delsys Bagnoli System was used to measure the sEMG signals from 10 muscles: soleus, lateral gastrocnemius, medial gastrocnemius, tibialis anterior, biceps femoris long head, vastus medialis, vastus lateralis, rectus femoris, gluteus maximus, and gluteus medius. More details about the public dataset were provided in Hamner and Delp.²⁸ In this study, to be consistent with our experimental study, only six-sEMG signals mainly related to knee flexion/extension were used, including biceps femoris (BF), lateral gastrocnemius (LG), medial gastrocnemius (MG), semitendinosus (ST), vastus lateral (VL), and vastus medial (VM).

Experimental study

In the experimental study, 12 healthy subjects (8 males and 4 females; Age: 23.83 ± 3.24; Weight: 66.83 ± 11.28 kg; Height: 172.67 ± 7.36 cm) were recruited to perform walking experiments on a treadmill. All of them knew the process and signed the informed consent before experiments. The experiments were proved by the local ethics committee of Nankai University.

Each subject was asked to walk for 1 min at the speed of 1.25 m/s per trial. Totally 11 trials were performed on each subject while leaving 3 min rest at the interval to avoid muscle fatigue. During the experiments, knee angle signals and sEMG signals were recorded by the device shown in Figure 2. The experimental study measured knee angle signals and sEMG signals of 12 subjects walking on a treadmill by the experiment device shown in Figure 2. Knee angle signals were recorded with 2 inertial measurement units (IMUs) with a data acquisition frequency of 100 Hz. Simultaneously, sEMG signals from 6 muscles, motioned above, were collected by the Delsys Bagnoli system with a sampling rate of 5 kHz.

Figure 2.

Experimental setup: (a) schematic diagram of the experimental setup and (b) photograph of the experiment.

Estimation results on the public dataset

We first tested the proposed CorrCA-RFG in the public dataset and compared its results to the other three methods. The mean values of NRMSE and CC were presented in Table 1, which showed that:

Across all subjects, the NRMSE values of CorrCA-RFG were lower than the RFG on 7 out of the 10 subjects. Meanwhile, the CC values of CorrCA-RFG were higher than the RFG on 6 out of the 10 subjects, suggesting the proposed CorrCA was effective.

The CorrCA-RFG outperformed CCA-RFG (lower NRMSE values and higher CC values) on 9 out of the 10 subjects, suggesting that the CorrCA could be more effective than CCA.

The NRMSE values of CorrCA-RFG were lower than the CNN on 7 out of the CNN. And the CC values of CorrCA-RFG were higher than CNN on 8 out of the 10 subjects, suggesting that the CorrCA-RFG could be more effective than CNN.

Table 1.

Evaluation criteria of the accuracy of knee angles estimated by CorrCA-RFG, RFG, CCA-RFG, and CNN for each subject on the public dataset.

Subject	NMRSE (%)				CC (%)
	CorrCA-RFG	RFG	CCA-RFG	CNN	CorrCA-RFG	RFG	CCA-RFG	CNN
S1	17.23 ± 0.48	19.78 ± 0.64	24.90 ± 0.53	21.88 ± 4.55	81.90 ± 0.99	75.02 ± 1.93	59.04 ± 2.17	76.13 ± 16.89
S2	18.09 ± 0.47	20.18 ± 0.85	20.05 ± 0.45	19.65 ± 8.75	80.83 ± 1.14	76.76 ± 1.87	76.34 ± 0.92	72.40 ± 35.57
S3	19.55 ± 1.77	18.47 ± 0.69	25.51 ± 0.76	23.32 ± 2.35	75.63 ± 2.40	77.01 ± 2.04	56.73 ± 1.47	69.74 ± 4.14
S4	21.57 ± 1.49	22.03 ± 0.85	22.81 ± 0.92	28.11 ± 2.39	67.20 ± 3.33	67.85 ± 2.33	63.52 ± 2.69	60.62 ± 5.00
S5	20.63 ± 1.52	18.07 ± 0.85	22.66 ± 0.78	21.97 ± 8.15	75.62 ± 1.79	79.53 ± 1.57	63.56 ± 3.13	70.18 ± 35.52
S6	18.29 ± 0.55	20.45 ± 0.80	22.13 ± 0.53	21.72 ± 7.06	80.91 ± 0.80	75.00 ± 1.95	69.56 ± 1.70	73.45 ± 23.83
S7	19.85 ± 0.58	21.88 ± 1.23	20.76 ± 0.53	19.67 ± 2.90	77.12 ± 1.09	72.05 ± 3.03	74.58 ± 1.54	79.20 ± 6.59
S8	21.57 ± 0.55	23.67 ± 1.07	23.60 ± 0.91	18.53 ± 2.28	73.39 ± 1.50	70.85 ± 3.87	70.23 ± 1.74	83.20 ± 6.98
S9	23.42 ± 0.71	22.25 ± 0.87	21.86 ± 0.46	20.13 ± 6.19	65.09 ± 1.73	68.73 ± 2.05	66.88 ± 2.20	75.56 ± 21.81
S10	25.21 ± 0.68	25.23 ± 1.20	40.21 ± 1.10	21.88 ± 3.95	58.00 ± 2.80	52.47 ± 3.87	−7.71 ± 3.06	66.39 ± 17.53

The case with the highest estimation performance for each subject is shown in bold.

Figure 3 showed the distribution of the evaluation criteria of the knee angles estimation across all subjects (N = 10) for these four methods. Outliers of NRMSE or CC existed in RFG, CorrCA-RFG, and CNN rather than in CorrCA-RFG, suggesting that the estimation of the CorrCA-RFG were more stable. The Kruskal-Wallis test was also used to determine if differences between the proposed CorrCA-RFG and the other three methods. The NRMSE values of CorrCA-RFG significantly decreased compared to these of CCA-RFG and CNN ( $p =$ 0.000 and $p =$ 0.039). The CC values of CorrCA-RFG significantly increased compared to these of RFG, CCA-RFG, and CNN ( $p =$ 0.002, $p =$ 0.000, and $p =$ 0.039). All the above results showed that the proposed CorrCA-RFG outperformed the other three methods on the public dataset.

Figure 3.

Distribution of the evaluation criteria of the knee angles estimation across all subjects (N = 10, on public dataset) for the CorrCA-RFG, RFG, CCA-RFG, and CNN. (a) The distribution of NRMSE values for each method. (b) The distribution of CC values for each method. The box plots show the distribution of quartiles and outliers. Asterisks indicate statistical significance based on the Kruskal-Wallis test. p-value: *, <0.05.

Estimation results on experimental study

We also tested the CorrCA-RFG on the experimental study and compared its performance with the other three methods. Knee angles estimated by CorrCA-RFG, RFG, CCA-RFG, and CNN is illustrated in Figure 4. The estimation profile by CorrCA-RFG is closer to reference angles calculated from IMUs. The CCA-RFG has the least smooth angles estimation profile, with sudden deviations and spikes.

Figure 4.

Normalized knee angles of subject-11 on the experimental study. Dashed and solid lines are reference and estimated angles, averaged across 183 strides during the subject walking.

For each subject, the average NRMSE values and CC values were presented in Table 2, which showed that:

Across all subjects, the NRMSE values of the CorrCA-RFG were lower than the CorrCA-RFG on all subjects. Meanwhile, CC values of CorrCA-RFG were higher than the RFG on 11 out of the 12 subjects, suggesting again the proposed CorrCA was effective.

The CorrCA-RFG outperformed CCA-RFG (lower NRMSE values and higher CC values) on all subjects, suggesting that the CorrCA could be more effective than CCA.

The CorrCA-RFG outperformed CNN (lower NRMSE values and higher CC values) on all subjects, indicating that the CorrCA-RFG could be more effective than CNN.

Table 2.

Evaluation criteria of the accuracy of knee angles estimated by CorrCA-RFG, RFG, CCA-RFG, and CNN for each subject on the experimental study.

Subject	NMRSE (%)				CC (%)
	CorrCA-RFG	RFG	CCA-RFG	CNN	CorrCA-RFG	RFG	CCA-RFG	CNN
S1	15.00 ± 0.41	17.74 ± 0.42	30.57 ± 0.60	24.81 ± 5.19	82.29 ± 0.84	79.34 ± 0.86	4.37 ± 4.39	52.36 ± 30.99
S2	15.04 ± 0.23	15.15 ± 0.32	19.91 ± 0.16	24.11 ± 6.79	86.52 ± 0.36	86.05 ± 0.62	77.04 ± 0.29	63.81 ± 24.07
S3	20.81 ± 0.62	21.18 ± 0.18	34.48 ± 0.13	28.76 ± 6.73	78.88 ± 0.71	74.03 ± 0.42	16.49 ± 0.51	61.92 ± 6.82
S4	15.27 ± 0.21	17.09 ± 0.39	25.63 ± 0.32	27.79 ± 9.04	85.99 ± 0.46	83.69 ± 0.59	47.75 ± 1.37	49.94 ± 34.52
S5	18.52 ± 0.30	18.61 ± 0.29	21.76 ± 0.25	34.97 ± 13.23	82.63 ± 0.44	80.97 ± 0.50	61.15 ± 0.41	32.70 ± 42.37
S6	18.66 ± 0.48	23.32 ± 0.33	29.73 ± 0.31	27.63 ± 5.40	75.74 ± 0.42	73.37 ± 0.92	14.63 ± 1.14	41.52 ± 35.93
S7	19.48 ± 0.35	19.56 ± 0.28	24.91 ± 0.11	28.84 ± 6.18	72.96 ± 0.97	73.23 ± 0.88	49.85 ± 0.50	33.77 ± 41.50
S8	16.96 ± 0.28	17.42 ± 0.41	26.33 ± 0.16	35.99 ± 11.32	82.19 ± 0.50	80.22 ± 0.67	45.61 ± 0.29	31.41 ± 50.96
S9	17.74 ± 0.62	20.08 ± 0.34	31.01 ± 0.26	30.06 ± 8.11	81.61 ± 1.45	74.06 ± 0.99	22.09 ± 1.30	44.29 ± 45.56
S10	17.98 ± 0.31	21.52 ± 0.45	21.33 ± 0.17	25.44 ± 6.43	78.39 ± 0.69	73.59 ± 0.82	64.60 ± 0.58	62.27 ± 26.94
S11	14.76 ± 0.29	17.67 ± 0.37	33.42 ± 0.21	25.42 ± 7.57	88.51 ± 0.32	82.92 ± 0.39	−1.23 ± 2.16	66.64 ± 31.90
S12	18.04 ± 0.65	23.77 ± 0.82	24.57 ± 0.59	34.02 ± 8.26	76.70 ± 1.13	64.44 ± 2.16	57.81 ± 1.10	52.80 ± 6.78
Avg	17.42 ± 1.97	19.43 ± 2.56	26.97 ± 4.65	28.99 ± 8.71	81.03 ± 4.55	77.16 ± 5.92	38.35 ± 24.96	49.45 ± 34.82

The case with the highest estimation performance for each subject is shown in bold.

Figure 5 displayed the distribution of the evaluation criteria of the estimation of knee angles across all subjects of experimental study for the four methods. The NRMSE and CC values of CorrCA-RFG distributed more centrally and closely to 17% and 80%, respectively, suggesting that the estimation of CorrCA-RFG were more robust across all subjects. The NRMSE and CC values of CCA-RFG distributed widely, indicating that the CCA-RFG was unstable. Outliers appeared on NRMSE values (RFG and CNN) and CC values (CNN) was associated with the unstableness of the methods. The Kruskal-Wallis test was also conducted to identify differences in NRMSE and CC between the proposed CorrCA-RFG and the other three methods in the experimental study. The NRMSE values of CorrCA-RFG had statistically significant differences with respect to RFG ( $p =$ 0.000), CCA-RFG ( $p =$ 0.000), and CNN ( $p =$ 0.000). The CC values of CorrCA-RFG significantly increased compared to the other three methods (RFG, $p =$ 0.000; CCA-RFG, $p =$ 0.000; CNN, $p =$ 0.000). All the above results indicated that the proposed CorrCA-RFG also outperformed the other three methods in the experimental study.

Figure 5.

Distribution of the evaluation criteria of the knee angles estimation across all subjects (N = 12, on experimental study) for the CorrCA-RFG, RFG, CCA-RFG, and CNN. (a) The distribution of NRMSE values for each method. (b) The distribution of CC values for each method. The box plots show the distribution of quartiles and outliers. Asterisks indicate statistical significance based on the Kruskal-Wallis test. p-value: *, <0.05.

It is worth noting that for a small number of subjects (both in the public dataset and the experimental study), the CorrCA did not improve the estimation performance. Some possible reasons are discussed in the next Section.

Discussion

In this paper, we have provided a new strategy from the viewpoint of extracting the user-independent sEMG features, namely CorrCA-RFG, for the generalization of sEMG-based continuous motion estimation over cross subjects. Although the CorrCA has been used to analyze electroencephalogram (EEG) signals recorded from multiple subjects or multiple channels,^29,34,35 there are no studies of the effectiveness of the CorrCA on sEMG signals. The CorrCA can transfer the features from multiple subjects into the same space with any expert sets. To validate the effectiveness of the proposed CorrCA-RFG, it was tested both on a public dataset and an experimental study. We evaluated the CorrCA-RFG in terms of two criteria, namely NRMSE and CC, and compared it to other three methods: RFG, CCA-RFG and CNN. The estimation results presented in Figures 3 to 5 and Tables 1 and 2 indicated that the proposed CorrCA-RFG could improve the estimation performance compared to RFG, CCA-RFG or CNN. In addition, the distributions of NRMSE and CC values of the CorrCA-RFG were more centrally than that of the other three methods, suggesting that results of the CorrCA-RFG were more robust.

To qualitatively compare the sEMG features before and after CorrCA, a nonlinear dimensionality reduction technique called $t -$ distributed stochastic neighbor embedding ( $t -$ SNE)³⁶ was used. As mentioned in the last Section, trials from one subject and combined trials from the remaining subjects were used as the test set and train set, respectively. The $t -$ SNE visualizations of subject 5 in the public dataset and subject 1 in our experimental study were shown in Figure 6, where the red and cyan dots represent the testing and training set, respectively. In Figure 6, the left presents the sEMG features before CorrCA and the right after CorrCA. It can be observed that the features (both training features and testing features) after CorrCA are distributed more closely than that before CorrCA in the training set. Moreover, after CorrCA, the testing features could be scattered closer to the training features, which demonstrated that discrepancies between testing features and training features were reduced. The above results suggested that the distribution of the testing features was more similar to training features’ after CorrCA. This is the main reason that the proposed CorrCA-RFG can improve estimation performance in cross-subject evaluation.

Figure 6.

$t -$ SNE visualization of subject 5 from the public dataset and subject 1 from the experimental study before and after CorrCA: (a) the public dataset and (b) the experimental study. Red dots: testing set; cyan dots: training set.

The NRMSE and CC values of CCA-RFG distributed more widely than these of CorrCA-RFG and the RFG (shown in Figures 3 and 5), indicating that the estimation performance of CCA-RFG was worse than that of CorrCA-RFG, even the RFG. The main reason may be that the CorrCA yields a single set of linear projections from multiple subjects to transfer their sEMG features into the same space, whereas the CCA computed a different set of projection vectors for each subject to transfer the sEMG features into different spaces. Features from different spaces possibly share different distributions across different subjects. In addition, due to the limitation of CCA to find the projection vector only between two data matrices, an expert set should be selected to yield the projection vectors for multiple subjects. However, how to choose the expert set has not been well defined and is usually given based on experience.

The comparison between the CorrCA-RFG and CNN showed that the estimation performance of CNN is unstable. High uncertainties possibly exist in the training process of CNN, which leads to the learned features not always sharing a similar distribution.

This paper has proposed a CorrCA-RFG for the generalization of sEMG-based motion estimation over cross subjects, which has two desirable beneficial properties: (1) it extracts user-independent sEMG features among multiple subjects directly without any expert sets; and (2) it does not need any information from the new subjects. Knee angles estimation on the public dataset and the own experimental study verified the effectiveness of the CorrCA-RFG.

However, the CorrCA-RFG still has some limitations. It actually degrade the estimation accuracy for a small number of subjects from the public dataset or the experimental study. It is possible that motion-dependent components in sEMG signals may become more complex with some specific subjects and can not be adequately extracted by CorrCA for these subjects. For these specific subjects, the projection vectors obtained from different subjects may even cause the concept shift among transformed features. This could be one of the reasons why the proposed CorrCA-RFG could improve the estimation performance on most but not all subjects in the public dataset and the experimental study. Another possible reason may be that some outliers were in these subjects.³⁷ The CorrCA-RFG could not deal with these outliers.

Conclusion

This study focused on improving the accuracy of human joint angle estimation for more robust practical applications with respect to user-dependent influence. For this purpose, it provides a new strategy, namely CorrCA-RFG, from the viewpoint of extracting the user-independent sEMG features without any expert sets. The proposed strategy was respectively evaluated with a public dataset (containing 10 healthy subjects) and an experimental study (containing 12 healthy subjects). The results both of the public dataset and the experimental study show that the proposed CorrCA-RFG outperforms the other three compared methods, including RFG, CCA-RFG, and CNN. These results indicate the proposed estimation strategy has significant potential benefits over the current estimation models for joint angle estimation with robotic devices in practice.

Footnotes

Declaration of conflicting interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the National Natural Science Foundation of China (U1913208, 61873135) and the Chinese fundamental research funds for the central universities.

ORCID iD

Song Zhang

References

Farina

Stegeman

Merletti

Biophysics of the generation of EMG signals. In: Merletti

Farina

(eds) Surface electromyography: physiology, engineering, and applications. Hoboken, NJ: John Wiley and Sons Inc, 2016, pp.30–53.

Cavanagh

Komi

PV.

Electromechanical delay in human skeletal muscle under concentric and eccentric contractions. Eur J Appl Physiol 1979; 42(3): 159–163.

Gui

Liu

Zhang

A practical and adaptive method to achieve EMG-based torque estimation for a robotic exoskeleton. IEEE/ASME Trans Mechatron 2019; 24(2): 483–494.

Fleischer

Hommel

A human-exoskeleton interface utilizing electromyography. IEEE Trans Robot 2008; 24(4): 872–882.

Feleke

Guan

A review on EMG-based motor intention prediction of continuous human upper limb motion for human-robot collaboration. Biomed Signal Process Control 2019; 51: 113–127.

Xiong

Zhang

Zhao

, et al. Deep learning for EMG-based human-machine interaction: a review. IEEE/CAA J Autom Sinica 2021; 8(3): 512–533.

Nordander

Willner

Hansson

, et al. Influence of the subcutaneous fat layer, as measured by ultrasound, skinfold calipers and BMI, on the EMG amplitude. Eur J Appl Physiol 2003; 89(6): 514–519.

Merletti

Botter

Troiano

, et al. Technology and instrumentation for detection and conditioning of the surface electromyographic signal: state of the art. Clin Biomech 2009; 24(2): 122–134.

Zhang

Hou

, et al. SEMG-based continuous estimation of joint angles of human legs by using BP neural network. Neurocomputing 2012; 78(1): 139–148.

10.

Jiang

Vujaklija

Rehbaum

, et al. Is accurate mapping of EMG signals on kinematics needed for precise online myoelectric control? IEEE Trans Neural Syst Rehabil Eng 2014; 22(3): 549–558.

11.

Ding

Han

Zhao

Continuous estimation of human multijoint angles from sEMG using a state-space model. IEEE Trans Neural Syst Rehabil Eng 2017; 25(9): 1518–1528.

12.

Mugnosso

Zenzeri

Hughes

CML

, et al. Coupling robot-aided assessment and surface electromyography (sEMG) to evaluate the effect of muscle fatigue on wrist position sense in the flexion-extension plane. Front Hum Neurosci 2019; 13: 396.

13.

Liu

Sheng

Zhang

, et al. Towards zero retraining for myoelectric control based on common model component analysis. IEEE Trans Neural Syst Rehabil Eng 2016; 24(4): 444–454.

14.

Stival

Michieletto

Pagello

Online subject-independent modeling of semg signals for the motion of a single robot joint. In: 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob), UTown, Singapore, pp.1110–1116, 2016. New York, NY: IEEE.

15.

Orabona

Castellini

Caputo

, et al. Model adaptation with least-squares SVM for adaptive hand prosthetics. In: 2009 IEEE international conference on robotics and automation, Kobe, Japan, 2009, pp.2897-2903. New York, NY: IEEE.

16.

Alkan

Günay

Identification of EMG signals using discriminant analysis and SVM classifier. Expert Syst Appl 2012; 39(1): 44–47.

17.

Zanghieri

Benatti

Burrello

, et al. Robust real-time embedded EMG recognition framework using temporal convolutional networks on a multicore IoT processor. IEEE Trans Biomed Circuits Syst 2020; 14(2): 244–256.

18.

Chen

Cao

, et al. Feasibility Study of advanced neural networks applied to sEMG-Based force estimation. Sensors 2018; 18(10): 3226.

19.

Yang

Liu

, et al. Decoding simultaneous Multi-DOF wrist movements from raw EMG signals using a convolutional neural network. IEEE Trans Human-Machine Syst 2019; 49(5): 411–420.

20.

Bao

Zaidi

SAR

Xie

, et al. Inter-subject domain adaptation for CNN-based wrist kinematics estimation using sEMG. IEEE Trans Neural Syst Rehabil Eng 2021; 29: 1068–1078.

21.

Pan

Yang

A survey on Transfer Learning. IEEE Trans Knowl Data Eng 2010; 22(10): 1345–1359.

22.

Jiang

Bardizbanian

Dai

, et al. Data management for transfer learning approaches to elbow EMG-torque modeling. IEEE Trans Biomed Eng 2021; 68(8): 2592–2601.

23.

Matsubara

Morimoto

Bilinear modeling of EMG signals to extract user-independent features for multiuser myoelectric interface. IEEE Trans Biomed Eng 2013; 60(8): 2205–2213.

24.

Kim

Chung

Kim

Subject-independent sEMG pattern recognition by using a muscle source activation model. IEEE Robot Autom Lett 2020; 5(4): 5175–5180.

25.

Khushaba

RN.

Correlation analysis of electromyogram signals for multiuser myoelectric interfaces. IEEE Trans Neural Syst Rehabil Eng 2014; 22(4): 745–755.

26.

Xue

Wang

, et al. Multiuser gesture recognition using sEMG signals via canonical correlation analysis and optimal transport. Comput Biol Med 2021; 130: 104188.

27.

Dey

Yoshida

Foerster

, et al. Continuous prediction of joint angular positions and moments: A potential control strategy for active knee-ankle prostheses. IEEE Trans Med Robot Bionics 2020; 2(3): 347–355.

28.

Hamner

Delp

SL.

Muscle contributions to fore-aft and vertical body mass center accelerations over a range of running speeds. J Biomech 2013; 46: 780–787.

29.

Parra

Haufe

Dmochowski

JP.

Correlated components analysis—Extracting reliable dimensions in multivariate data. arXiv preprint arXiv: 1801.08881, 2018.

30.

Phinyomark

Limsakul

Phukpattaranont

A novel feature extraction for robust EMG pattern recognition. J. Comput 2009; 1(1): 71–80.

31.

Georgakis

Stergioulas

Giakas

Fatigue analysis of the surface EMG signal in isometric constant force contractions using the averaged instantaneous frequency. IEEE Trans Biomed Eng 2003; 50(2): 262–265.

32.

Restrepo-Agudelo

Roldan-Vasco

Ramirez-Arbelaez

, et al. Improving surface EMG burst detection in infrahyoid muscles during swallowing using digital filters and discrete wavelet analysis. J Electromyogr Kinesiol 2017; 35: 1–8.

33.

Wei

Dai

Wong

, et al. Surface-electromyography-based gesture recognition by multi-view deep learning. IEEE Trans Biomed Eng 2019; 66(10): 2964–2973.

34.

Zhang

Yin

, et al. Two-stage frequency recognition method based on correlated component analysis for SSVEP-based BCI. IEEE Trans Neural Syst Rehabil Eng 2019; 26(7): 1314–1323.

35.

Poulsen

Kamronn

Dmochowski

, et al. EEG in the classroom: synchronised neural recordings during video presentation. Sci Rep 2017; 7: 43916.

36.

van der Maaten

Hinton

. Visualizing data using t-SNE. J Mach Learn Res 2008; 9: 2579–2605.

37.

Transfer learning for brain-computer interfaces: A Euclidean space data alignment approach. IEEE Trans Biomed Eng 2020; 67(2): 399–410.

Robust motion estimation with user-independent sEMG features extracted by correlated components analysis

Abstract

Keywords

Introduction

Methods

Correlated correlation analysis

CorrCA-RFG strategy

Signal processing

Feature extraction

Performance measurement

Experiments and results

Data acquisition

Public subject dataset

Experimental study

Estimation results on the public dataset

Estimation results on experimental study

Discussion

Conclusion

Footnotes

Declaration of conflicting interests

Funding

ORCID iD

References