Next Article in Journal
How the Choice of Distance Measure Influences the Detection of Prior-Data Conflict
Next Article in Special Issue
Fault Feature Extraction of Hydraulic Pumps Based on Symplectic Geometry Mode Decomposition and Power Spectral Entropy
Previous Article in Journal
Gaze Information Channel in Cognitive Comprehension of Poster Reading
Previous Article in Special Issue
An Entropy-Based Car Failure Detection Method Based on Data Acquisition Pipeline
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Signal Separation Method Based on Improved Sparse Non-Negative Matrix Factorization

1
College of Mechanical & Electrical Engineering, Beijing University of Chemical Technology, Chao Yang District, Beijing 100029, China
2
Beijing Key Laboratory of High-end Mechanical Equipment Health Monitoring and Self-Recovery, Beijing University of Chemical Technology, Beijing 100029, China
*
Authors to whom correspondence should be addressed.
Entropy 2019, 21(5), 445; https://doi.org/10.3390/e21050445
Submission received: 5 March 2019 / Revised: 7 April 2019 / Accepted: 26 April 2019 / Published: 28 April 2019
(This article belongs to the Special Issue Entropy-Based Fault Diagnosis)

Abstract

:
In order to separate and extract compound fault features of a vibration signal from a single channel, a novel signal separation method is proposed based on improved sparse non-negative matrix factorization (SNMF). In view of the traditional SNMF failure to perform well in the underdetermined blind source separation, a constraint reference vector is introduced in the SNMF algorithm, which can be generated by the pulse method. The square wave sequences are constructed as the constraint reference vector. The output separated signal is constrained by the vector, and the vector will update according to the feedback of the separated signal. The redundancy of the mixture signal will be reduced during the constantly updating of the vector. The time–frequency distribution is firstly applied to capture the local fault features of the vibration signal. Then the high dimension feature matrix of time–frequency distribution is factorized to select local fault features with the improved SNMF method. Meanwhile, the compound fault features can be separated and extracted automatically by using the sparse property of the improved SNMF method. Finally, envelope analysis is used to identify the feature of the output separated signal and realize compound faults diagnosis. The simulation and test results show that the proposed method can effectively solve the separation of compound faults for rotating machinery, which can reduce the dimension and improve the efficiency of algorithm. It is also confirmed that the feature extraction and separation capability of proposed method is superior to the traditional SNMF algorithm.

1. Introduction

The analysis methods based on a vibration signal have been diffusely used in the fault diagnosis of mechanical equipment [1,2], because the vibration signal usually contains the main information of the operating state about the equipment [3,4]. However, the observed signals of mechanical equipment are often non-stationary [5,6], and accompanied with multiple fault characteristics at the same time in real engineering [7,8]. Moreover, the coupling of fault features also increases the difficulty of compound faults diagnosis [9,10]. Therefore, it is of great significance for the normal operation of mechanical equipment and healthy system management to separate out multiple source signals and extract compound fault features effectively from vibration signals [11,12].
A transform domain decomposition method [13] is usually used to achieve the separation of multiple source components, such as empirical mode decomposition (EMD) [14], local mean decomposition (LMD), and variational mode decomposition (VMD). Non-negative matrix factorization (NMF), as a new feature extraction algorithm, gives physical meaning regarding the decomposition form and result, which overcomes the defects of traditional algorithms, has been diffusely used in the fields of digital images processing [15], biomedical engineering [16], machine learning [17,18], computer vision [19], information retrieval [20], hyperspectral unmixing [21,22], and etc.
With the deepness of research, the NMF algorithm is focused on the blind source separation (BSS) problem [23]. Compared with independent component analysis (ICA) and sparse component analysis (SCA), the NMF algorithm requires fewer constraints, faster convergence, and higher decomposition efficiency [24,25]. However, when the number of observed signals collected by the sensor is less than the number of fault sources, that is, the underdetermined blind source separation problem [26], the NMF algorithm cannot be performed directly, and the improper selection of the loss function about the NMF algorithm also increases the difficulty of signal separation [27]. Hence, how to choose the loss function of the NMF algorithm to realize the underdetermined blind source separation is a major problem to be solved urgently. During the past decade, there has been an increasing interest in the relationship between compound faults diagnosis of mechanical equipment and the development of certain BSS [28], including ICA, SCA, and NMF. Many investigators proposed approaches based on EMD, ensemble empirical mode decomposition (EEMD), VMD, and other algorithms to expand the source signal into multiple virtual channels and selected appropriate components according to relevant information for the underdetermined blind source separation problem [29,30]. For example, Hao et al. [31] introduced a method combining with the intrinsic characteristic-scale decomposition (ICD) and SCA algorithm to realize compound faults diagnosis with single channel signal. Jiang et al. [32] also introduced a method of the EMD-ICA algorithm to separate the end member spectra with a single mixed pixel spectrum. Wang et al. [33] proposed a novel approach of EEMD-ICA algorithm to separate the compound faults. Tang et al. [34] developed a technique based on VMD-ICA algorithm to achieve the underdetermined blind source separation of bearings. In addition, some scholars are committed to the study of NMF algorithm for blind source separation problem. Mirzaei et al. [35] put forward a model on the basis of the Bayesian NMF that achieves the BSS problem of reverberant audio signals. Abdali et al. [36] used the regularized NMF method to realize the BSS problem of music signals with a single channel. Canadas et al. [37] adopted a method of frequency domain clustering non-negative matrix factorization to bring about the separation and extraction of cardiopulmonary signals. Meanwhile, with the popularity of artificial intelligence, the combination of deep learning [38] and the NMF algorithm is also becoming a research hotspot. For example, Nie et al. [39] combined the NMF algorithm and deep learning to achieve speech separation.
The theory of the NMF algorithm has achieved a lot of remarkable results from the proposed, covering a wide range of applications, but still has some room for improvement. In addition, the method based on non-negative matrix factorization is a new field to solve the underdetermined blind source separation problem in the compound faults diagnosis of rotating machinery. The objective function of the traditional NMF algorithm has a single constraint condition, and the signal generated by the actual fault is poorly applied. The data is often redundant after factorization by the algorithm, and the coupling fault features cannot be effectively separated.
Therefore, in this paper, the compound fault features of rolling bearing can be separated and extracted by using the advantage of the improved sparse non-negative matrix factorization. The time–frequency distribution is firstly applied to describe the instant component of vibration signals by combining the time with frequency information in a two-dimensional representation [40]. Typical time–frequency distribution methods include the wavelet transform (WT), the short-time Fourier transform (STFT), the Wigner-Ville distribution and the Hilbert-Huang transform, etc. The short-time Fourier transform is chosen because of its local capacity and simple principle, which makes fault diagnosis much easier and more reliable [41]. According to the feature information of the signal, the constraint reference vectors are constructed by the pulse method. The square wave sequences with the same length as the test signal are generated as the constraint reference vectors. By introducing appropriate reference constraints on the basis of the sparse non-negative matrix factorization (SNMF) algorithm, the improved SNMF method can improve the processing ability of the SNMF algorithm and reduce the procedure of source signals and noise features detected. With the improved SNMF method, the high dimension feature matrix of time–frequency distribution is factorized to select local fault features. Furthermore, according to the sparse property of improved SNMF, the proposed method can accomplish the separation of the compound fault features automatically.
The remaining sections are organized as follows: Section 2 describes the fundamental principle of NMF algorithm. In Section 3, the improved SNMF algorithm is introduced. The separation of compound fault signals based on the proposed method is presented in Section 4. The simulation and test signals are discussed to evaluate the proposed method in Section 5. Finally, the conclusions are summarized in Section 6.

2. Principle of Non-Negative Matrix Factorization

Matrix factorization is an effective means for large-scale data processing and analysis. The NMF algorithm can be represented as follows: Given a non-negative matrix V R + m × n , the algorithm constructs approximate factorizations of the form with a product of two non-negative matrices W R + m × r and H R + r × n [42], namely:
V m × n W m × r H r × n
where m is the dimension of the matrix V m × n , and n is the number of samples. The parameter r is generally chosen as r < m n / ( m + n ) and is called reduced rank, thus the product W m × r H r × n can be considered as a compressed form of the data V m × n . Varieties of optimization algorithms about loss function were proposed for improving the efficiency of the algorithm, since the NMF algorithm has been put forward. Traditionally, the loss function is represented:
D ( V | | W H ) = V W H 2 s . t . W , H > 0 .
The NMF algorithm for the loss function of Equation (2) can be regarded as the following optimization problem:
min V W H F 2 = i j [ v i j ( W H ) i j ] 2 .
The optimization problem in Equation (3) is convex with respect to W and H respectively. However, it is non-convex about the matrices W and H simultaneously. Therefore, the above problem can deal with an iterative multiplicative updated algorithm until the objective function converges to some constant value. The updated rules are presented:
w i k w i k ( V H T ) i k ( W H H T ) i k , h i k h i k i ( W T V ) k j ( W T W H ) k j .
Later, the objective function is defined based on the KL divergence, namely:
min D ( V | | W H ) = i j [ v i j log v i j ( W H ) i j v i j + ( W H ) i j ] s . t . W , H > 0 ,
So, the update rules are given to obtain W and H:
w i k w i k j h k j v i j ( W H ) i j u h k u , h k j h k j i w i k v i j ( W H ) i j v w v k .

3. Basic Principle

3.1. Sparse Non-Negative Matrix Factorization

In this section, the basic description of sparseness is discussed.
The idea of “sparse coding” is a sparse representation scheme that can effectively represent typical data vectors with only a few units. In other word, the sparse representation scheme actually means that most of the representation units are close to zero, and only a very small part takes significantly non-zero values.
Currently, there are many functions for measuring the sparseness of data. A normalized scale should have such a feature: The sparsest vector with only a component being non-zero and other components being zero should have a sparseness of one; the least sparsest vector with all elements equal should have a sparseness of zero.
The sparsity degree function [43] in this paper is based on the L 1 norm namely:
s p a r s e n e s s ( x ) = n ( | x i | ) / x i 2 n 1 ,
where n is the dimension of the vector x . This function takes a value of 1 if and only if the vector x contains a non-zero element, and takes a value of 0 if and only if all elements are equal, otherwise the values can be smoothly distributed between the two extremes.
The illustration of different degrees of sparseness are shown in Figure 1, displaying the sparseness of different levels. Each bar indicates the value of one element. Where the leftmost is at low levels of sparseness, all the elements are substantially equal. The rightmost is at high levels, and most coefficients are zero except for a few non-zero elements.
For the choice of constraint terms, whether it is the sparsity of the constraint W, or the sparsity of the constraint H, or the sparsity of both constraints depends on the specific application in question. Since the base matrix W contains the feature information of the original data, the sparseness constraint on W may improve the convenience of storage and calculation, but it may cause the base feature to be missing. Therefore, the coefficient matrix H is usually constrained effectively, which can effectively enhance the feature of the base matrix W .
The SNMF method based on the L1 norm constraint is derived from Hoyer’s non-negative sparse coding method [44], which combines the Euclidean distance with the norm constraint to form the objective function.
min D ( V | | W H ) = V W H F 2 + λ H 1 s . t . W , H > 0 , a i = 1 ,
where λ is a regularization parameter, which is used to balance sparseness and reconstruction error. a i is the ith line of V.
The updated rules are determined by:
W i k W i k / i k W i k 2 H k j H k j ( W T V ) k j ( W T W H ) k j + λ W i k W i k η ( ( W H V ) H T ) i k ,
where η is the step size of iteration.
Similarly, we can also obtain the objective function, combining the generalized KL (Kullback–Leibler) divergence with the norm constraint,
min D ( V | | W H ) = i j [ v i j log v i j ( W H ) i j v i j + ( W H ) i j ] + λ k j H k j s . t . W , H > 0 , i W i k = 1 .
The updated rules are determined by:
W i k W i k j V i j H k j l W i l H l j j H k j W i k W i k / i W i k
H k j H k j i V i j W i k l W i l H l j 1 + λ .

3.2. Improved Sparse Non-Negative Matrix Factorization

In this section, it is shown how to improve sparseness in the SNMF framework.
By comparing the Euclidean distance and KL divergence functions respectively, the L1 norm is added as the objective function of the sparse constraint term. The convergence of two different objective functions and the certainty of the solution are also analyzed and proved strictly by scholars [45], which provides a solid mathematical theoretical basis for its solution process. However, the solution process based on KL divergence is a multiplicative rule completely, which can reduce the computational complexity and guarantee the process of iteration better [46].
Therefore, the objective function based on KL divergence is chosen as the algorithm. Meanwhile, in order to improve the processing ability of the sparse non-negative matrix factorization algorithm, lower the dimension of the problem, and reduce the redundancy of the information after decomposition, we introduce a constraint reference vector r = ( r 1 , r 2 , . , r n ) T (where n is the sample length) based on the traditional algorithm. The vector contains the feature information of the objective function proposed, and the information can be changed according to the source signal. This paper uses the mean square to measure the error between reference vectors, namely:
ε ( y , r ) = E { ( y r ) 2 } .
When y is completely closed to the source signal, ε ( y , r ) has a minimum value. When ε ( y , r ) satisfies Equation (14), the output result y is the desired source signal,
g ( y ) = ε ( y , r ) ξ 0
where ξ is the threshold value. Using g ( y ) as the feasibility constraint of Equation (10), the solution of the algorithm can be projected onto the feasibility constraint function. Therefore, the problem of the improved SNMF algorithm can be summarized as follows:
min D ( V | | W H ) = i j [ v i j log v i j ( W H ) i j v i j + ( W H ) i j ] + λ k j H k j s . t . W , H > 0 , i W i k = 1 , p ( y ) = E { y 2 } 1 = 0
where p ( y ) is the limiting constraint of the objective function, and y is the solution vector.
The steps of Algorithm 1 are as follows:
Algorithm 1: Improved Sparse Non-Negative Matrix Factorization
Step 1. Initialize non-negative matrices W and H randomly
Step 2. Extract the constraint reference vector r with the feature of the source signal
Step 3. Calculate the initial value of the objective function from Equation (15)
Step 4. According to Equations (11) and (12), update the matrices W and H alternately and iteratively
Step 5. If the objective function converges, the iteration is stopped, and the matrices W and H are outputted; otherwise, steps (3) and (4) are performed cyclically
The biggest advantage of the improved SNMF method is that the vector is added as a constraint reference, which constrains the objective function and can be generated adaptively according to the source signal, and the redundant component after decomposition is reduced.

4. Signal Separation Method Based on Improved SNMF

Based on the above analysis, a separation method of compound fault signals with improved sparse non-negative matrix factorization is put forward for the bearings in rotating machinery. The implementation steps Algorithm 2 are summarized as follows:
Algorithm 2: Signal Separation Method Based on Improved SNMF
Step 1. The method of short-time Fourier transform (STFT) is applied to the original vibration signal to obtain a high-dimensional feature matrix that characterizes local information.
Step 2. Take the energy value of the feature matrix to satisfy the input matrix of improved SNMF.
Step 3. Use the improved SNMF algorithm to reduce the dimension, and get the base matrix W and the coefficient matrix H.
Step 4. The base matrix W and the coefficient matrix H are reconstructed in a low-dimensional space, and the time–frequency information is transformed into the time domain by using an inverse time Fourier transform (ISTFT) to obtain a reconstructed waveform of the feature component.
Step 5. The reconstructed signal is selected for envelope spectrum analysis to extract the fault feature of the bearing.
The flow chart is shown in Figure 2.

5. Verification with Simulation and Experiment

5.1. Simulation Analysis

In order to verify the effectiveness of the proposed method, the following model was used to simulate compound faults of a rolling bearing:
s ( t ) = e 2 π g f n ( t T ) sin ( 2 π f n 1 g 2 ( t T ) )
S ( t ) = A [ s 1 ( t ) , s 2 ( t ) ] T
where, g = 0.1 is the damping coefficient, s 1 ( t ) and s 2 ( t ) are composed of the following two feature parameters: The natural frequencies are 3000 Hz and 5000 Hz respectively, the characteristic frequencies are taken as 63 Hz and 173 Hz, the sampling frequency is 100 kHz, and the analysis points are taken as 0.5 s time segments. A = [0.8147, 0.9058] is a mixed matrix generated randomly. The mixed signal S(t) is obtained by Equation (17). The waveform and the envelope spectrum of the mixed signal are shown in Figure 3.
According to the feature information of the simulated signal, the constraint reference signals were constructed by the pulse method. The square wave sequences with the same length as the mixed signal were generated as the constraint reference signals. The waveform and the partial enlargement of the reference signals are shown in Figure 4.
For the mixed simulation signal, the proposed method was used for analysis. Firstly, the feature matrix X was obtained by STFT, and the time–frequency distribution is shown in Figure 5. Secondly, the energy value of the feature matrix was obtained as the input matrix of the improved SNMF. Thirdly, the energy-value matrix was decomposed by the improved SNMF algorithm to obtain the base matrix W and the coefficient matrix H. Finally, the matrix W and H were reconstructed in the subspace, and the inverse short-time Fourier transform was used to transform them into the time domain, getting separated signals.
By introducing the constraint reference signals, two sets of separated signals were obtained, which indicated that the feature information in the two sets of separated signals was rich, and described the source signal better. The envelope spectra of separated signals are shown in Figure 6.
It can be seen from Figure 6 that the two characteristic components, 63 Hz and 173 Hz, included in the source signal can be separated by the proposed method. Therefore, from the analysis of simulation signal, it can be concluded that the proposed method can effectively separate the source signal from the mixed signals, and the characteristic frequency of the source signal can also be extracted in the envelope spectrum, which verifies the effectiveness of the proposed method.
In order to verify the advantages of the proposed method, it is compared with the traditional SNMF algorithm using the model of KL-divergence. When the reference vector is not been introduced as a constraint term, some redundant signal components (s3, s4, s5, s6) are obtained as the Figure 7 shows. It can be seen from the Figure 7 that the spectrogram is disorganized. In order to illustrate quantitatively the advantages of the reference vector, the optimal two sets of signals in the Figure 7 were compared with the separated signals in Figure 6 and used to define the following Equation (18) to quantify the gains of the proposed approach. The SNRs (signal to noise ratio) of two methods are shown in Table 1.
S N R = lg r = 1 3 A F r 2 i = 1 N A i 2 r = 1 3 A F r 2
where N is the sampling length, A F r is the amplitude of the first three-order characteristic frequency, and A i is the amplitude of the frequency domain signal.
According to Figure 7 and Table 1, the proposed approach has better separation and noise reduction effects.

5.2. Experiment and Discussion

In this section, the measured compound fault signals of bearing are taken as the research object to verify the effectiveness of the proposed method. The defects of 0.5 mm width and 0.15 mm depth were machined artificially on the outer ring and rolling elements of the bearing. The type of cylindrical roller bearing was NTN N204. During the experiment, the vibration signal in the vertical direction was collected by the acceleration sensor placed on the bearing housing. The experimental platform of the rotating machine and the fault bearing are shown in Figure 8. The sampling frequency was 100 kHz and the sampling time was 10s. The motor speed was set to 900 rpm, and the rolling bearing components were calculated according to the bearing structural parameters (Table 2) and the equations in references [47,48]. The theoretical characteristic frequency is shown in Table 3.
The compound fault signals collected were used for analysis, and the analysis points were taken as 1s time segments randomly. The waveform and the envelope spectrum at 900 rpm are shown in Figure 9.
The impact pulse component can be seen clearly from the time domain waveform, indicating that the bearing had failed, but the feature of period time is not obvious, and the useful state information of the bearing could not be obtained. In the envelope spectrum, the defect feature of outer race and rolling element was submerged by the noise component, and it was difficult to identify. The peak appearing at the frequency of about 6 Hz (first peak) in the spectrum, and the frequency value was close to the characteristic frequency of the cage, that is, the revolving frequency of the rolling element, so the peak was caused by the impact of the rolling elements.
According to the feature information of the experimental signal, the constraint reference signals were constructed by the pulse method. The square wave sequences with the same length as the experimental signal were generated as the constraint reference signals. The waveform and the partial enlargement of the reference signals are shown in Figure 10.
According to the proposed method, the original signal was subjected to short-time Fourier transform to obtain a feature matrix X, and the time–frequency distribution is shown in Figure 11. The energy value of the feature matrix was obtained as an input matrix of the improved SNMF, then the energy-value matrix was decomposed by the improved SNMF algorithm to obtain the base matrix W and the coefficient matrix H. Finally, the matrix W and H were reconstructed in the subspace, and the inverse short-time Fourier transform was used to transform them into the time domain, getting reconstructed signals.
Two sets of separated signals could be obtained by introducing a constrained reference vector, which indicated that the feature information in the two sets of separated signals was rich, and the source signal contained two fault components. The envelope spectra of separated signals are shown in Figure 12.
It is obvious that two source signal components were obtained by the proposed method, which corresponded to a fault characteristic frequency of the outer race and the rolling element respectively, and they were consistent with the theoretical characteristic values. Meanwhile, their higher harmonic components were also extracted clearly. In addition, the cage frequency (6 Hz) and its higher harmonic components appear in the Figure 12b, and the sidebands of the fault characteristic frequency were distributed by the cage frequency, which was consistent with the feature of the rollers failure. Therefore, the results show that the proposed method could effectively separate the fault source signal from the mixed signals, and the fault characteristic frequency could also be extracted in the envelope spectrum, which verified the effectiveness of the proposed method in the field of compound fault diagnosis of bearings.

5.3. Comparison with Traditional Method

In order to verify the advantages of the proposed method in the field of compound faults diagnosis of bearings, it was compared with the traditional SNMF algorithm using the model of KL-divergence. The experimental data at 900 rpm was selected to illustrate this. The energy value of the feature matrix obtained by the short-time Fourier transform, and the traditional SNMF algorithm was used to reduce the dimension. The matrix W and H were reconstructed in the subspace, selecting the reconstructed signal as the separated signal (f1 and f2), and the envelope spectra are shown in Figure 13.
It can be seen from Figure 13 that the compound fault signals were not separated effectively using the traditional SNMF algorithm based on KL-divergence. The fault feature of outer race was almost extracted, and the fault feature of rolling element was submerged. In addition, the cage characteristic frequency (6 Hz) could only be obtained in the Figure 13b, failing to describe the fault source signal accurately. The proposed method can extract and separate the fault features of the rollers and the outer race effectively. Comparing Figure 13 and Figure 12, it can be seen that since the improved SNMF algorithm enhances the local features and sparsity of the fault component, and reduce the redundant information of the reconstructed signal, the source signal can be separated, and the feature can be extracted. The unique advantages of the proposed method in the field of compound fault diagnosis of bearings have been proved.

6. Conclusions

The feature of compound fault signals in rotating machinery is weak, and the source signals of the compound fault are difficult to separate from the mixture signal. Aiming to solve these problems, a blind source separation method with single channel based on the improved SNMF was proposed. The square wave sequences with the feature information were constructed as the constraint reference vector into the objective function of the traditional SNMF algorithm, to reduce the redundancy of the decomposed data. STFT was applied to obtain a high-dimensional feature matrix. Considering the high dimensional feature matrix after the STFT, the improved SNMF is adopted to select local feature from time–frequency distribution, and it can lower the dimension of the problem. Meanwhile, according to the local learning ability of the improved SNMF algorithm, the compound fault features can be separated effectively, and the redundant component after decomposition is reduced on the basis of effective data reduction. The simulation and test results show that the proposed method can effectively separate the feature of compound faults for roller bearing. Compared with the traditional SNMF, the feature extraction and separation capability of the proposed method is superior to the traditional SNMF. Therefore, the proposed method is of great significance for the compound faults diagnosis of rotating machinery and has certain engineering application value. Considering the impact of initialization about the improved SNMF, this paper only initialized randomly to test the performance of the algorithm. The optimized initialization will be studied in the future.

Author Contributions

H.W. conceived and designed the experiments. M.W., J.L. and L.S. carried out the experiments and collected the date under the supervision of H.W. M.W. analyzed the data and wrote the paper. H.W., L.S. and Y.H. reviewed and edited the manuscript.

Funding

This work is partially supported by the National Natural Science Foundation of China (Grant Nos. 51675035 and 51805022).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Cui, L.L.; Wang, J.; Lee, S.C. Matching Pursuit of an Adaptive Impulse Dictionary for Bearing Fault Diagnosis. J. Sound. Vib. 2014, 333, 2840–2862. [Google Scholar]
  2. Wang, Z.J.; Wang, J.Y.; Du, W.H. Research and Application of Improved Adaptive MOMEDA Fault Diagnosis Method. Measurement 2019. [Google Scholar] [CrossRef]
  3. Cui, L.L.; Jin, Z.; Huang, J.F.; Wang, H.Q. Fault severity classification and size estimation for ball bearings based on vibration mechanism. IEEE Access 2019. [Google Scholar] [CrossRef]
  4. Wang, Z.J.; Zhou, J.; Wang, J.Y.; Du, W.H. A novel Fault Diagnosis Method of Gearbox Based on Maximum Kurtosis Spectral Entropy Deconvolution. IEEE Access 2019, 7, 29520–29532. [Google Scholar] [CrossRef]
  5. Li, Y.; Kang, D.; He, G.; Jiao, X. Non-stationary vibration feature extraction method based on sparse decomposition and order tracking for gearbox fault diagnosis. Measurement 2018, 124, 453–469. [Google Scholar] [CrossRef]
  6. Li, Z.X.; Królczyk, G.M. Multifault Detection, Diagnosis, and Prognosis for Rotating Machinery. Int. J. Rotating Mach. 2018. [Google Scholar] [CrossRef]
  7. Song, L.Y.; Wang, H.Q.; Chen, P. Step-by-step Fuzzy Diagnosis Method for Equipment Based on Symptom Extraction and Trivalent Logic Fuzzy Diagnosis Theory. IEEE T. Fuzzy Syst. 2018, 26, 3467–3478. [Google Scholar] [CrossRef]
  8. Cui, L.L.; Yao, T.C.; Zhang, Y. Application of pattern recognition in gear faults based on the matching pursuit of a characteristic waveform. Measurement 2017, 104, 212–222. [Google Scholar] [CrossRef]
  9. Pan, H.; Yu, Y.; Xin, L. Symplectic geometry mode decomposition and its application to rotating machinery compound fault diagnosis. Mech. Syst. Signal. Process. 2019, 114, 189–211. [Google Scholar] [CrossRef]
  10. Huang, R.; Liao, Y.; Zhang, S.; Li, W.H. Deep Decoupling Convolutional Neural Network for Intelligent Compound Fault Diagnosis. IEEE Access 2019, 7, 1848–1858. [Google Scholar] [CrossRef]
  11. Cui, L.L.; Wang, X.; Xu, Y.G.; Jiang, H.; Zhou, J.P. A novel Switching Unscented Kalman Filter method for remaining useful life prediction of rolling bearing. Measurement 2019, 135, 678–684. [Google Scholar] [CrossRef]
  12. Wang, H.Q.; Wang, P.X.; Song, L.Y.; Ren, B.Y.; Cui, L.L. A Novel Feature Enhancement Method based on Improved Constraint Model of Online Dictionary Learning. IEEE Access 2019, 7, 17599–17607. [Google Scholar] [CrossRef]
  13. Xu, Y.G.; Tian, W.K.; Zhang, K.; Ma, C.Y. Application of an enhanced fast kurtogram based on empirical wavelet transform for bearing fault diagnosis. Meas. Sci. Technol. 2019, 30, 035001. [Google Scholar] [CrossRef]
  14. Bin, G.F.; Gao, J.J.; Li, X.J.; Dhillon, B.S. Early fault diagnosis of rotating machinery based on wavelet packets - Empirical mode decomposition feature extraction and neural network. Mech. Syst. Signal. Process. 2012, 27, 696–711. [Google Scholar] [CrossRef]
  15. Lu, Y.; Yuan, C.; Zhu, W.; Li, X. Structurally Incoherent Low-Rank Nonnegative Matrix Factorization for Image Classification. IEEE T. Image Process 2018, 27, 5248–5260. [Google Scholar] [CrossRef]
  16. Tolic, D.; Antulov-Fantulin, N.; Kopriva, I. A Nonlinear Orthogonal Non-Negative Matrix Factorization Approach to Subspace Clustering. Pattern Recogn. 2017, 16, 313–318. [Google Scholar]
  17. Zhang, B.; Zhang, S.; Li, W.H. Bearing performance degradation assessment using long short-term memory recurrent network. Comput. Ind. 2019, 106, 14–29. [Google Scholar] [CrossRef]
  18. Song, L.Y.; Wang, H.Q.; Chen, P. Vibration-Based Intelligent Fault Diagnosis for Roller Bearings in Low-Speed Rotating Machinery. IEEE Trans. Instrum. Meas. 2018, 67, 1887–1899. [Google Scholar] [CrossRef]
  19. Sun, F.; Xu, M.; Hu, X.; Jiang, X. Graph Regularized and Sparse Nonnegative Matrix Factorization with Hard Constraints for Data Representation. Neurocomputing 2016, 173, 233–244. [Google Scholar] [CrossRef]
  20. Cui, L.L.; Li, B.B.; Ma, J.F.; Jin, Z. Quantitative trend fault diagnosis of a rolling bearing based on Sparsogram and Lempel-Ziv. Measurement 2018, 128, 410–418. [Google Scholar] [CrossRef]
  21. Lu, X.; Wu, H.; Yuan, Y.; Yan, P.; Li, X. Manifold regularized sparse NMF for hyperspectral unmixing. IEEE Trans. Comput. Imaging 2013, 51, 2815–2826. [Google Scholar] [CrossRef]
  22. Christos, G.T.; Rontogiannis, A.A.; Berberidis, K. Distributed Blind Hyperspectral Unmixing via Joint Sparsity and Low-Rank Constrained Non-Negative Matrix Factorization. IEEE Trans. Comput. Imaging 2017, 3, 160–174. [Google Scholar]
  23. Hao, Y.S.; Song, L.Y.; Wang, M.Y.; Cui, L.L.; Wang, H.Q. Underdetermined Source Separation of Bearing Faults Based on Optimized Intrinsic Characteristic-Scale Decomposition and Local Non-Negative Matrix Factorization. IEEE Access 2019, 7, 11427–11435. [Google Scholar] [CrossRef]
  24. Li, X.; Cui, G.; Dong, Y. Graph Regularized Non-Negative Low-Rank Matrix Factorization for Image Clustering. IEEE Trans. Cybern. 2017, 47, 3840–3853. [Google Scholar] [CrossRef]
  25. Yang, Y.S.; Ming, A.B.; Zhang, Y.Y.; Zhu, Y.S. Discriminative non-negative matrix factorization (DNMF) and its application to the fault diagnosis of diesel engine. Mech. Syst. Signal. Process. 2017, 95, 158–171. [Google Scholar] [CrossRef]
  26. Cui, L.L.; Wang, X.; Wang, H.Q.; Wu, N. Improved Fault Size Estimation Method for Rolling Element Bearings Based on Concatenation Dictionary. IEEE Access 2019, 7, 22710–22718. [Google Scholar] [CrossRef]
  27. Jing, S.; Wang, Z.H.; Sun, F.M.; Li, H.J. Sparse Dual Graph-regularized NMF for Image Co-clustering. Neurocomputing 2018, 96, 218–231. [Google Scholar]
  28. Xie, J.W.; Douglas, P.K.; Wu, Y.N. Decoding the encoding of functional brain networks: An fMRI classification comparison of non-negative matrix factorization (NMF), independent component analysis (ICA), and sparse coding algorithms. J. Neurosci. Meth. 2017, 282, 1–9. [Google Scholar] [CrossRef]
  29. Chen, Y.; Zhang, H.; Liu, R. Soft Orthogonal Non-negative Matrix Factorization with Sparse Representation: Static and Dynamic. Neurocomputing 2018, 25, 231:242. [Google Scholar] [CrossRef]
  30. Lv, Y.; Yuan, R.; Song, G.B. Multivariate empirical mode decomposition and its application to fault diagnosis of rolling bearing. Mech. Syst. Signal. Process. 2016, 81, 219–234. [Google Scholar] [CrossRef]
  31. Hao, Y.S.; Song, L.Y.; Cui, L.L.; Wang, H.Q. A three-dimensional geometric features-based SCA algorithm for compound faults diagnosis. Measurement 2019, 134, 480–491. [Google Scholar] [CrossRef]
  32. Jiang, X.; Wu, F.; Yu, H. Mixed pixel decomposition of mineral spectrum based on EMD-ICA method. Opt. Spectrosc. 2015, 119, 893–898. [Google Scholar] [CrossRef]
  33. Wang, H.Q.; Li, R.T.; Tang, G. A compound fault diagnosis for rolling bearings method based on blind source seperation and ensenmble empirical mode decomposition. PLoS ONE 2014, 9, 1–13. [Google Scholar]
  34. Tang, G.; Luo, G.G.; Zhang, W. Underdetermined Blind Source Separation with Variational Mode Decomposition for Compound Roller Bearing Fault Signals. Sensors 2016, 16, 897. [Google Scholar] [CrossRef]
  35. Mirzaei, S.; Hamme, H.V.; Norouzi, Y. Under-determined reverberant audio source separation using Bayesian Non-negative Matrix Factorization. Speech Commun. 2016, 81, 129–137. [Google Scholar] [CrossRef] [Green Version]
  36. Abdali, S.; NaserSharif, B. Non-negative matrix factorization for speech/music separation using source dependent decomposition rank, temporal continuity term and filtering. Biomed. Signal Process. Control 2017, 36, 168–175. [Google Scholar] [CrossRef]
  37. Canadas-Quesada, F.J.; Ruiz-Reyes, N.; Carabias-Orti, J. A non-negative matrix factorization approach based on spectro-temporal clustering to extract heart sounds. Appl. Acoust. 2017, 125, 7–19. [Google Scholar] [CrossRef]
  38. Wang, H.Q.; Li, S.; Song, L.Y. A novel convolutional neural network based fault recognition method via image fusion of multi-vibration-signals. Comput. Ind. 2019, 105, 182–190. [Google Scholar] [CrossRef]
  39. Nie, S.; Liang, S.; Liu, W.; Zhang, X.; Tao, J. Deep Learning Based Speech Separation via NMF-style Reconstructions. IEEE/ACM Trans. Audio Speech Lang. Process. 2018, 28, 15–27. [Google Scholar] [CrossRef]
  40. Wang, J.; Cui, L.L.; Wang, H.Q.; Chen, P. Improved complexity based on time-frequency analysis in bearing quantitative diagnosis. Adv. Mech. Eng. 2013, 1–11. [Google Scholar] [CrossRef]
  41. Gao, H.; Lin, L.; Chen, X. Feature extraction and recognition for rolling element bearing fault utilizing short-time fourier transform and non-negative matrix factorization. Chin. J. Mech. Eng. 2015, 28, 96–105. [Google Scholar] [CrossRef]
  42. Lee, D.D.; Seung, H.S. Learning the parts of objects by non-negative matrix factorization. Nature 1999, 401, 788–791. [Google Scholar] [CrossRef] [PubMed]
  43. Wang, S.; Jing, P.; Wei, L. Discriminative separable nonnegative matrix factorization by structured sparse regularization. Signal Process. 2016, 120, 620–626. [Google Scholar] [CrossRef]
  44. Hoyer, P.O. Non-negative matrix factorization with sparseness constraints. J. Mach. Learn Res. 2004, 5, 1457–1469. [Google Scholar]
  45. Lee, D.D.; Seung, H.S. Algorithms for non-negative matrix factorization. Adv. Neural Inf. Proces. Syst. 2000, 13, 556–562. [Google Scholar]
  46. Nguyen, D.N.; Tu, B.H. Fast Parallel Randomized Algorithm for Nonnegative Matrix Factorization with KL Divergence for Large Sparse Datasets. arXiv 2016, arXiv:1604.04026. [Google Scholar] [CrossRef]
  47. Cui, L.L.; Huang, J.F.; Zhang, F.B.; Chu, F.L. HVSRMS localization formula and localization law: Localization diagnosis of a ball bearing outer ring fault. Mech. Syst. Signal. Process. 2019, 120, 608–629. [Google Scholar] [CrossRef]
  48. Wang, H.Q.; Ren, B.Y.; Song, L.Y.; Cui, L.L. A Novel Weighted Sparse Representation Classification Strategy based on Dictionary Learning for Rotating Machinery. IEEE Trans. Instrum. Meas. 2019. [Google Scholar] [CrossRef]
Figure 1. Illustration of various degrees of sparseness.
Figure 1. Illustration of various degrees of sparseness.
Entropy 21 00445 g001
Figure 2. Flowchart of compound faults diagnosis.
Figure 2. Flowchart of compound faults diagnosis.
Entropy 21 00445 g002
Figure 3. The simulated signal: (a) The waveform of signal; (b) the envelope spectrum of signal.
Figure 3. The simulated signal: (a) The waveform of signal; (b) the envelope spectrum of signal.
Entropy 21 00445 g003
Figure 4. The reference signals of the simulated signal: (a) The waveform of reference signal 1; (b) the partial enlargement of reference signal 1; (c) the waveform of reference signal 2; (d) the partial enlargement of reference signal 2.
Figure 4. The reference signals of the simulated signal: (a) The waveform of reference signal 1; (b) the partial enlargement of reference signal 1; (c) the waveform of reference signal 2; (d) the partial enlargement of reference signal 2.
Entropy 21 00445 g004
Figure 5. Time–frequency distribution of simulation signals.
Figure 5. Time–frequency distribution of simulation signals.
Entropy 21 00445 g005
Figure 6. Envelope spectra of separated signals with the improved sparse non-negative matrix factorization (SNMF): (a) Envelope spectrum of s1; (b) envelope spectrum of s2.
Figure 6. Envelope spectra of separated signals with the improved sparse non-negative matrix factorization (SNMF): (a) Envelope spectrum of s1; (b) envelope spectrum of s2.
Entropy 21 00445 g006
Figure 7. Envelope spectra of separated signals with the traditional SNMF: (a) Envelope spectrum of s3; (b) envelope spectrum of s4; (c) envelope spectrum of s5; (d) envelope spectrum of s6.
Figure 7. Envelope spectra of separated signals with the traditional SNMF: (a) Envelope spectrum of s3; (b) envelope spectrum of s4; (c) envelope spectrum of s5; (d) envelope spectrum of s6.
Entropy 21 00445 g007
Figure 8. Experimental platform and fault bearing: (a) Experimental platform; (b) fault bearing.
Figure 8. Experimental platform and fault bearing: (a) Experimental platform; (b) fault bearing.
Entropy 21 00445 g008
Figure 9. The vibration signal of compound faults at 900 rpm: (a) The waveform of signal; (b) the envelope spectrum of signal.
Figure 9. The vibration signal of compound faults at 900 rpm: (a) The waveform of signal; (b) the envelope spectrum of signal.
Entropy 21 00445 g009
Figure 10. The reference signals of experimental signal: (a) The waveform of reference signal 3; (b) the partial enlargement of reference signal 3; (c) the waveform of reference signal 4; (d) the partial enlargement of reference signal 4.
Figure 10. The reference signals of experimental signal: (a) The waveform of reference signal 3; (b) the partial enlargement of reference signal 3; (c) the waveform of reference signal 4; (d) the partial enlargement of reference signal 4.
Entropy 21 00445 g010
Figure 11. Time–frequency distribution of the collected signal.
Figure 11. Time–frequency distribution of the collected signal.
Entropy 21 00445 g011
Figure 12. Envelope spectra of separated signals with the proposed method: (a) Envelope spectrum of outer-race fault; (b) envelope spectrum of roller fault.
Figure 12. Envelope spectra of separated signals with the proposed method: (a) Envelope spectrum of outer-race fault; (b) envelope spectrum of roller fault.
Entropy 21 00445 g012
Figure 13. Envelope spectra of separated signals with the SNMF method: (a) Envelope spectrum of f1; (b) envelope spectrums of f2.
Figure 13. Envelope spectra of separated signals with the SNMF method: (a) Envelope spectrum of f1; (b) envelope spectrums of f2.
Entropy 21 00445 g013
Table 1. SNRs of two methods (dB).
Table 1. SNRs of two methods (dB).
The improved SNMF−0.2527−0.3421
The traditional SNMF−0.8484 (Figure 7c)−1.6449 (Figure 7d)
Table 2. Structure parameters of NTN N204 bearing.
Table 2. Structure parameters of NTN N204 bearing.
Bearing TypeNTN N204
Inner Diameter20 mm
External Diameter47 mm
Roller Diameter6.5 mm
Width14 mm
Number of Rollers10
Contact angle0 rad
Table 3. Fault characteristic frequencies.
Table 3. Fault characteristic frequencies.
Fault typesouter racerollercage
Characteristic frequencies60 Hz74 Hz6 Hz

Share and Cite

MDPI and ACS Style

Wang, H.; Wang, M.; Li, J.; Song, L.; Hao, Y. A Novel Signal Separation Method Based on Improved Sparse Non-Negative Matrix Factorization. Entropy 2019, 21, 445. https://doi.org/10.3390/e21050445

AMA Style

Wang H, Wang M, Li J, Song L, Hao Y. A Novel Signal Separation Method Based on Improved Sparse Non-Negative Matrix Factorization. Entropy. 2019; 21(5):445. https://doi.org/10.3390/e21050445

Chicago/Turabian Style

Wang, Huaqing, Mengyang Wang, Junlin Li, Liuyang Song, and Yansong Hao. 2019. "A Novel Signal Separation Method Based on Improved Sparse Non-Negative Matrix Factorization" Entropy 21, no. 5: 445. https://doi.org/10.3390/e21050445

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop