Abstract
Sparse decomposition has excellent adaptability and high flexibility in describing arbitrary complex signals based on redundant and over-complete dictionary, thus having the advantage of being free from the limitations of traditional signal processing methods such as wavelet and fast Fourier transform being imposed by orthogonal basis. Sparse decomposition provides an effective approach for feature extraction of intricate vibration signals collected from rotating machinery. Self-learning over-complete dictionary and pre-defined over-complete dictionary are the two dictionary construction modes of sparse decomposition. Normally, the former mode owns the virtues of much more adaptive and flexible than the latter one, and several kinds of classical self-learning over-complete dictionary methods have been arising in recent years.
Keywords
Introduction
Sparse decomposition (SD) is a relative new signal processing method which could capture the essential feature of the analyzed signal without the premise of orthogonal basis expansion, and it has been attracted more and more attention in the area of mechanical fault diagnosis. Dictionary construction is one of the key steps of SD, and there are two ways to construct the over-complete dictionary: pre-defined dictionary and self-learning dictionary. Normally, the pre-defined dictionary SD method has the shortcomings of needing prior knowledge of the analyzed signal and the self-learning dictionary SD method has the disadvantage of poor interference robustness. To solve the above-mentioned problems, a large amount of literatures have been arising in recent years. A hierarchical discriminating SD method was proposed in Jiao et al.,
1
which could isolate the interferences effectively. In order to address the same above-mentioned problems, a parametric impulsive dictionary based on Laplace wavelets is designed for impulsive fault feature extraction of rolling bearing in Sun et al.,
2
which has better feature extraction performance. The traditional orthogonal matching pursuit method was improved and an adapted dictionary-free orthogonal matching pursuit (ADOMP) method was proposed in Huang et al.,
3
which has the advantages of flexibility and noise robustness, and the adapted dictionary orthogonal matching pursuit method presented potential advantages in early weak fault feature extraction of rolling bearing. An improved variational mode decomposition (VMD) method was proposed in Li et al.,
4
which overcame the shortcomings of VMD in reasonable selection of algorithm parameters. Besides, the improved VMD was combined with adaptive sparse code shrinkage de-noising and used in fault diagnosis of rotating machinery. To overcome the difficulty of fault identification in planet bearing due to the intricate kinematics and multiple modulation effects, a classification method based on dictionary learning was introduced in Zhao et al.,
5
which has the virtues of avoiding the feature design requirement in common intelligent diagnosis method. To alleviate the drawback of pursuit efficiency of optimal atom in SD, a new SD method based on time-frequency spectrum segmentation was proposed in Yan et al.,
6
and the higher decomposition efficiency and better approximation precision of the proposed method were verified by conduction of simulations and experiments. The empirical wavelet transform was improved based on the idea of SD and the sparsity-guided empirical wavelet transform method was proposed and used in fault feature extraction of rolling bearing,
7
and the effectiveness of the proposed method was verified by single and multiple bearing fault signals. A new SD signal processing method based on multi-scale chirplet was proposed in fault diagnosis of gearbox vibration signals,
8
and the feasibility of the proposed method was validated by both simulations and experiments. A novel intelligent fault diagnosis method of rolling bearing was proposed by combining SD with neighborhood preserving deep extreme learning machine in Li et al.
9
A supervised feature extraction method named supervised regularized sparse filtering was proposed in feature extraction of rotating machinery which provided a new way for optimizing the solution of sparsity.
10
Considering the sparsity of impact force, an enhanced sparse regularization method based on reweighted
Although a large number of rolling bearing fault diagnosis methods based on SD have been arising as stated above, most of them are pre-defined dictionary SD methods which have the drawback of lack of flexibility. Besides, most of the self-learned SD methods own the disadvantage of low computational efficiency. In this article, an improved
This article is organized as follows. The basic theory of traditional KSVD is presented in section “Traditional KSVD.” The theory and details of the proposed method are presented in section “Improved KSVD.” The simulation and experiment verifying the feasibility and effectiveness of the proposed method are carried out in sections “Simulation” and “Experiment,” respectively. Besides, the analyzed experimental results using the Autogram method are also presented in section “Experiment” to prove the advantage of the proposed method. Conclusions obtained from the above results are presented in section “Conclusion”.
Traditional KSVD
KSVD could be regarded as the extension of
The purpose of KSVD algorithm is to find the dictionary
where
Equation (2) could be rewritten as follows
Finding the global optimal dictionary
Sparse coding
First, set an initialized dictionary
where
Dictionary updating
The updating of dictionary
In equation (5), it is only to adjust
The main steps of traditional KSVD are shown as follows:
Step 1: Initialization
Set the initialization matrix
Step 2: Sparse coding
Solve
Step 3: Dictionary updating Define the used sample set Calculate the residual error Restrict Decompose Update
Step 4: Output
The learned dictionary
Improved KSVD
The traditional KSVD uses optimal matching pursuit to solve the sparse coefficients approximately in the stage of sparse coding, and equation (2) is used as the object function due to the reason that the sparsity of the sparse coefficients is unknown. So the accuracy of the reconstructed signal is determined by the set residual error
In the stage of sparse coding, the self-adaptive matching pursuit (SAMP)
14
is used instead of optimal matching pursuit in improved KSVD method. Because the sparsity of the sparse coefficients is not known, it could be described adaptively by changing the step length. Besides, the iteration termination conditions of SAMP are stricter than optimal matching pursuit the latter is determined by the setting iteration number and the residual error
Furthermore, the
where
The
The main steps of improved KSVD are as follows:
Step 1: Initialization
Set the initialization matrix
Step 2: Sparse coding
Solve
Input: Sensing matrix
The main steps of sparse coding are as follows:
Calculate the correlation coefficients
Update the supporting set
Calculate and obtain the sparse signal
Select the largest absolute value among
Update the residual error
If there is
Reconstruct the sparse signal
Output the reconstructed sparse signal
Step 3: Dictionary updating Define the used sample set Calculate the residual error Restrict Decompose Update the iteration number as
Step 4: Output
The learned dictionary
Simulation
First, the outer race fault simulation of rolling bearing is carried out. The local pitting of inner race or outer race is often manifested as the early weak fault of rolling bearing. In the section, the rolling bearing fault model whose mathematical equation can be expressed as equation (7)16,17 is used to verify the feasibility of the proposed method.
The time-domain waveform of the simulation signal of rolling bearing outer race fault is shown in Figure 1 from which the impulsive characteristic is evident, and the time interval between each shock is the reciprocal of FCF of

Simulation signal of rolling bearing outer race fault.

Simulation noised signal of rolling bearing outer race fault.
Before applying the improved KSVD as introduced in section “Improved KSVD” on the noised signal, the noised signal should be segmented into several training samples to increase the training efficiency and the length of each training sample is set as 64 point empirically, and the overlap rate between each sample is 0 to avoid the reuse of training signals. The number of the learned dictionary atoms is set as 256 points (256 points are enough to reflect a complete impact characteristic when rolling bearing fails) and the length of each dictionary atom is also set as 256 points for calculation efficiency. When the iteration number is chosen as 4, the matching speed is highest with higher accuracy through repeated verification, so the iteration number is set as 4. Apply the improved KSVD on the signal as shown in Figure 2, and there are a total of 256 dictionary atoms being learned. Here, part of the learned dictionary atoms is shown in Figure 3. Then, reconstruct the analyzed signal using the learned dictionary atoms, and the last reconstructed signal is shown in Figure 4; it is evident that the impulsive components are extracted successfully by the proposed method. Apply the envelope demodulation spectral analysis on the reconstructed signal, and the result is shown in Figure 5 from which the outer race FCF with its harmonics is extracted successfully. Since the proposed method is mainly developed from the traditional KSVD method, the traditional KSVD and the proposed method are compared. As analyzed above, the early failure of rolling bearing is manifested as periodic impacts. Therefore, the reconstruction accuracy of the fault signal is important. It is the extraction of the occurred impacts which we should focus on. So kurtosis of the reconstructed signal (KRS) could be used as a good indicator reflecting the de-noising effectiveness between the traditional KSVD and the proposed method. Add different levels of white noise into the simulation signal as shown in Figure 1 and the SNR varies from −10 to 2 dB, and the KRS using the traditional KSVD and the proposed method is shown in Figure 6 from which the advantages of proposed method over the traditional KSVD method are evident.

Part of the learned dictionary atoms using the improved KSVD method on the signal as shown in Figure 2.

The reconstructed outer race fault signal using the learned dictionary atoms.

The envelope demodulation spectral analysis result of the signal as shown in Figure 4.

The kurtosis of reconstructed signal using the proposed method and the traditional KSVD.
Besides, the Autogram
18
is also used as comparison, which is a new and effective rolling bearing signal processing method. Envelope analysis is one of the most advantageous methods for rolling element bearing diagnostics, but finding a suitable frequency band for demodulation has been a substantial challenge for a long time. Introduction of the spectral kurtosis (SK) and Kurtogram mostly solved this problem, but in situations where SNR is very low or in the presence of non-Gaussian noise, these methods will fail. This major drawback may noticeably decrease their effectiveness, and the goal of Autogram is to solve the above-mentioned problem. Vibration signals from rolling element bearings exhibit high levels of second-order cyclostationarity, especially in the presence of localized faults. The autocovariance function of a second-order cyclostationary signal is periodic and the proposed method, named Autogram, takes advantage of this property to enhance the conventional Kurtogram. The Autogram computes the kurtosis of the unbiased autocorrelation of the squared envelope of the demodulated signal, rather than the kurtosis of the filtered time signal. The analysis result of the simulation signal using the Autogram method is presented to verify the advantage of the proposed method. Figure 7 is the analysis result of the noised simulation signal as shown in Figure 2 using Autogram. The key parameters such as center frequency and bandwidth of band-pass filter could be obtained based on Figure 7: center frequency

The analysis result of the signal as shown in Figure 2 using the Autogram method.
The simulation of rolling bearing inner race fault model is same as outer race fault: Set the inner race FCF as

Simulation signal of rolling bearing inner race fault.

Simulation noised signal of rolling bearing inner race fault.

Part of the learned dictionary atoms using the improved KSVD method on the signal as shown in Figure 9.

The reconstructed inner race fault signal using the learned dictionary atoms.

The envelope demodulation spectral analysis result of the signal as shown in Figure 11.

The analysis result of the signal as shown in Figure 10 using the Autogram method.
Experiment
In most of the relevant literatures relating to rolling bearing fault diagnosis, the defective bearings with typical simulated or seeded damages are used in bearing diagnosis research. These damages are mature faults and evident which are less capable to discover the nature degradation of rolling bearing in early stage. In order to validate our proposed method and truly reflect the real natural degradation, accelerated fatigue test of rolling bearing is carried out in this article. Refer to Wang et al. 19 for the details and processes of the test. In Wang et al., 19 the data at 2297th minute are taken as the data of early weak fault stage of rolling bearing. In this article, the proposed method could identify the fault feature much earlier than the method used in Wang et al. 19 to avoid the occurrence of sudden catastrophic accidents, and the data at 2290th minute are analyzed using the proposed method. Note that because the experiment is conducted in the case of accelerated bearing run-to-failure condition, even 1 min earlier will make significant difference.
The time-domain waveform of the data at 2290th minute is shown in Figure 14 from which no impulsive characteristic could be identified due to the interference of strong background noise. Apply the envelope demodulation spectral analysis on the signal as shown in Figure 14, and the corresponding result is presented in Figure 15; the spectral lines are chaotic and the inner race FCF could not be extracted. These further prove that the traditional envelope demodulation spectral analysis is not fit for early weak fault diagnosis of rolling bearing. Before applying improved KSVD on the signal as shown in Figure 14, divide the raw signal into segments with 256 points per each segment first. Then, the dictionary is initialized by choosing 256 segments randomly as columns, which is the same as the simulation case.

The time-domain waveform of the data at 2290th minute of the accelerated fatigue test of rolling bearing.

The envelope demodulation spectral of the signal as shown in Figure 14.
Parts of the learned dictionary atoms are presented in Figure 16. Same as the ideology presented in simulation, construct the signal using the learned dictionary atoms, and the corresponding reconstructed bearing early weak fault signal is shown in Figure 17. Finally apply the envelope demodulation spectral analysis method on the signal as shown in Figure 17, and the obtained result is shown in Figure 18 from which the inner race FCF of the test bearing is extracted successfully. To further illustrate the high effectiveness of the improved KSVD in fault feature extraction of rolling bearing early weak fault, the analysis results of the original signal displayed in Figure 14 using other methods are presented.
First, same as simulation signal, the analysis result of signal as shown in Figure 14 using Autogram is presented in Figure 19, from which the inner race FCF could not be identified, and the advantage of the proposed method over Autogram is further verified.
The second method being used as comparison is the traditional KSVD method. Sparse extraction of impulse by adaptive dictionary (SpaEIAD) being proposed by Chen et al. 20 is a successful application of traditional KSVD-based de-noising method, and the analysis result of signal as shown in Figure 14 using SpaEIAD is shown in Figure 20. It could be observed that although impulses are extracted and noise level is decreased, the noise is still strong by being compared with Figure 17. Envelope demodulation spectral analysis is also applied on the de-noised signal as shown in Figure 20 to validate whether the inner race FCF could be detected or not, and the result is shown in Figure 21 from which the advantage of the improved KSVD over SpaEIAD is verified.

Part of the learned dictionary atoms using the improved KSVD method on the signal as shown in Figure 14.

The reconstructed bearing early weak fault signal using the learned dictionary atoms.

The envelope demodulation spectral of the signal as shown in Figure 17.

The analysis result of the signal as shown in Figure 14 using the Autogram method.

The analysis result of the signal as shown in Figure 14 using the SpaEIAD method.

The envelope demodulation spectral of the signal as shown in Figure 20.
Conclusion
Early weak fault diagnosis of rolling element bearing is a difficult and hot study area. Aiming at the difficult problem of extracting early weak fault features of rolling bearings and the potential of sparse representation self-learning dictionary method in early weak fault diagnosis of rolling bearings, this article proposes an improved KSVD method based on traditional KSVD method, in which the matching pursuit algorithm used in the construction of traditional KSVD sparse dictionary is changed to sparse adaptive matching pursuit algorithm.
The effectiveness and advantage of the proposed method are verified through simulation first. The improved KSVD method could extract the fault feature of rolling early weak fault successfully, and this virtue is verified by the rolling bearing simulation signals interfered by strong noise. Besides, the accuracy of signal reconstruction based on the proposed method is higher than that based on traditional KSVD method, and it is verified by comparing the kurtosis of the signals obtained by traditional KSVD and improved KSVD methods.
Subsequently, the accelerated fatigue test of rolling bearing was carried out and the early weak fault signal of the test was used to testify the effectiveness and advantage of the proposed further. Besides, the traditional KSVD and Autogram method are also applied on the early weak fault signal of the test and used as comparison to verify the advantage of the proposed method.
Footnotes
Handling Editor: Christos Anagnostopoulos
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The research was supported by the National Natural Science Foundation (Approved Grant No. U1804141) and the Key Science and Technology Research Project of the Henan Province (Approved Grant No. 192102210105).
