Next Article in Journal
Direct Calculation of the Group Velocity for Two-Dimensional Complex, Composite and Periodic Structures Using a Wave and Finite Element Scheme
Next Article in Special Issue
Convolutional Neural Networks for Automated Rolling Bearing Diagnostics in Induction Motors Based on Electromagnetic Signals
Previous Article in Journal
Segmentation of Brain Tumors from MRI Images Using Convolutional Autoencoder
Previous Article in Special Issue
Short-Time/-Angle Spectral Analysis for Vibration Monitoring of Bearing Failures under Variable Speed
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fusion Method and Application of Several Source Vibration Fault Signal Spatio-Temporal Multi-Correlation

College of Energy and Power Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210000, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(10), 4318; https://doi.org/10.3390/app11104318
Submission received: 29 March 2021 / Revised: 20 April 2021 / Accepted: 20 April 2021 / Published: 11 May 2021
(This article belongs to the Special Issue Bearing Fault Detection and Diagnosis)

Abstract

:
Combined with other signal processing methods, related algorithms are widely used in the diagnosis and identification of rotor faults. In order to solve the problem that the vibration signal of a single sensor is too single, a new multi-source vibration signal fusion method is proposed. This method explores the correlation between vibration sensors at different locations by using multiple cross-correlations of spatial locations. First, wavelet noise reduction and linear normalization are used to process the original data. Then, the signal energy correlation function between the sensors is established, and the adaptive weight is obtained. Finally, the data fusion result is obtained. Taking rotor bearing and gear failures at different speeds as an example, the data of three vibration sensors at different positions are fused using the spatio-temporal multiple correlation fusion method (STMF). Through the intelligent fault diagnosis method stacked auto encoder (SAE), compared with single sensor data, average weighted fusion data and neural network fusion data, STMF method can reach a diagnosis accuracy of more than 94% at 700 rpm, 900 rpm and 1100 rpm. It is concluded that the result of the STMF method is more effective and superior.

1. Introduction

With the development of the information age, the reliability requirements of mechanical equipment are getting higher and higher [1]. Rotating parts of mechanical equipment, such as shafts, gears and bearings, are prone to shaft cracks, gear breaks and bearing wear and other dangerous hazards [2]. In order to ensure the safe and reliable operation of the equipment, it is particularly important to obtain fault sources and fault data in time, and perform an accurate and effective fault diagnosis.
Signal correlation function was widely used in rotor system fault diagnosis—many scholars have done research in this area. A diesel engine fault warning method based on the correlation analysis of the envelope of cylinder head vibration signal was proposed [3,4,5], and a correlation analysis was proven to be able to better reflect the fault state of the unit. A maximum correlation kurtosis deconvolution algorithm (MCKD) was used to process generator stator vibration signals, and the extraction effect of fault signal characteristic frequency was improved [6]. S. Janjarasjitt et al. [7] proposed a partial correlation integral algorithm, and used the size index calculated by the algorithm to successfully predict the faults of rolling bearings in rotating machinery. M. Rahmatian et al. [8] used the obtained ground current signal for feature selection based on cross-correlation technology. Then, they used these functions to perform fault detection on the four-layer multiplier perceptron artificial neural network (ANN) training, and obtain a good diagnosis. Hong et al. [9] proposed a method for gearbox fault feature extraction based on empirical mode decomposition (EMD) and multi-fractal detrended cross-correlation analysis (MFDCCA), which can successfully achieve better fault diagnosis accuracy.
The fault information obtained by a single sensor is single, while multiple different sensors can obtain fault information from multiple angles. Sensor data from multiple locations or different angles are also used to extract unsupervised features in the frequency domain and detect engine failures in industrial environments [10,11]. In addition, multi-sensor systems can simultaneously detect sensors or deal with faults through Bayesian networks, and quantify the reliability of sensor data through network weights [12,13]. Hua et al. [14] proposed a conversion method that converts vibration signals from multiple sensors into images. Using experimental data compared with other methods, they found that this method has higher recognition accuracy and faster convergence speed. For gearbox failures of multi-source signals, Zhi et al. [15] proposed a new tensor classifier, called the core flexible displaceable convex hull-based tensor (KFDCH-TM), which used wavelet packet transform (WPT) from multiple sources. The feature tensor extracted from the source signal is used to diagnose gearbox faults through KFDCH-TM.
With the development of fault diagnosis and signal processing technology, signal fusion technology is constantly updated and optimized. In the traditional multimodal sensor fusion method, data fusion can be achieved by manually extracting the features of multimodal sensors and simply connecting the growth vectors [16,17,18]. Research on multi-mode sensor fusion using deep learning networks for fault diagnosis has only begun to appear in recent years. S.Ma et al. [19] proposed a deep-coupled auto encoder network for vibration and acoustic sensor data fusion to realize the fault diagnosis of gears and bearings. S.Ma et al. [20] constructed a deep-coupling restricted Boltzmann machine for data fusion of vibration and acoustic emission sensors in order to diagnose tool faults. S. Hao et al. [21] proposed a multi-sensor fusion algorithm using the CNN-LSTM network to monitor bearing faults. Hui et al. [22] used a DCNN-based two-way vibration signal data fusion method for the health status recognition of planetary gearboxes. Due to the possibility of misclassification, more vibration signal fusion needs to be considered. In addition, the sensor installation location to reduce the redundancy of fusion data was studied [23,24].
The proposed multi-vibration sensor signal fusion method can be used for different rotor faults. Based on the established multi-sensor spatial position correlation model and signal energy correlation model, the time deviation and adaptive weights of different sensors are estimated to achieve the different adaptive fusion of faults. The fault diagnosis method of SAE is used to classify the fused fault data. Compared with the data classification results of unfused single sensor data and other fusion methods, the results show the superiority of the fusion method.
The main innovations are as follows:
(1)
A model of spatial correlation of multiple vibration sensors is proposed;
(2)
Propose a method of spatial and temporal multi-correlation fusion of vibration sensors;
(3)
The proposed method can handle different types of rotor faults and can effectively implement fault diagnosis.
The organization of the rest of this article is as follows: The second part introduces the basic wavelet noise reduction theory, linear normalization method and Hilbert–Huang transform. The fourth part verifies the STMF method and the comparative analysis with other fusion methods, which verifies the superiority of the STMF method. The fifth part is the conclusion. The overall framework and ideas of the content in the article are shown in Figure 1. First, wavelet denoising was performed on the original fault data and a linear normalization method was used to standardize the data. Then, the data are fused and the weight is determined by the correlation of the multi-sensor spatial position coordinates and the energy correlation of each sensor. Finally, the SAE method was used to intelligently diagnose faults with the fusion fault data.

2. Introduction to Basic Theory

2.1. Wavelet Noise Reduction

Using wavelet change threshold method to reduce raw signal noise, its advantage is that the noise can be basically suppressed, and the characteristic information of the original signal is better preserved.
Wavelet transform is to decompose a signal into a series of superposition of wavelet functions (or fitting of wavelet functions of different scales and times) [25]. These wavelet functions are all obtained by a mother wavelet after translation and scale expansion [26,27,28,29]. It takes a function called mother wavelet as the position τ, and the signal was measured x(t) as the inner product under different scales α, namely:
W T x α , τ = 1 α + x t φ t τ σ d t
where α is called the scale factor, and α > 0, which is to stretch the basic wavelet function. While τ reflects the displacement, whose value can be positive or negative. Both α and τ are continuous variables. The frequency domain corresponding to Equation (1) is expressed as:
W T x α , τ = α 2 π + x ω ψ α ω e + j ω τ d ω
The obtained original single fault signal is obtained by wavelet transformation to obtain ω j , k , then, ω j , k is obtained through the process of threshold transformation, and finally, the noise-reduced fault signal is obtained by the method of wavelet reconstruction.
The process of wavelet threshold noise reduction is shown in Figure 2.

2.2. Linear Normalization

Many dimensionality removal methods were listed in the literature [30], including standardization method, extreme value method, linear ratio method, normalization method, vector normalization method and power coefficient method. Each method has its advantages and disadvantages. This paper combines the extremum processing method in the literature [31] to reduce dimensionality the fusion signal. Linear transformation is performed on the fused data to map it to [0,1]. The results of normalization are as follows:
X = X min X max X min X
where X′ is the normalized result, minX and maxX are the minimum and maximum values in the sample. The data after normalization does not have dimensions, but the data of each sensor is mapped to [0,1], which will not change the trend and regularity between the data before normalization.

2.3. Hilbert–Huang Transform

The Hilbert–Huang transform (HHT) is used to draw the envelope spectrum of the test vibration signal, which can more easily view the fault characteristics of each component.
The main content of Hilbert–Huang transformation consists of two parts. The first part is empirical mode decomposition (EMD), which was proposed by Huang; the second part is Hilbert spectrum analysis (HSA). The HHT of the signal x(t) is as follows:
x = 1 π + x τ t τ d τ = 1 π + x t τ τ d τ = x t × 1 π t
The HHT is equivalent to an interesting filter, in which the amplitude of the spectral components remains unchanged, but their phases are shifted by one [32,33]. Its unit impulse response is 1/πt.
The inverse of the HHT is as follows:
x t = x t × 1 π t
The HHT has the following properties:
(1)
The signal x(t) and its HHT energy spectrum and amplitude spectrum are the same, but the phase spectrum is different.
(2)
Signal x(t) and x t are orthogonal to each other, namely:
+ x t x t d t = 0
(3)
If you perform x(t) twice using HHT, you will get -x(t), namely x t = x t .

3. Multi-Sensors Spatio-Temporal Multi-Correlation Fusion Analysis

3.1. Spatial Correlation Analysis

Literature [34] pointed out that when measuring the same signal source, different sensors would affect the consistency of space and time, which resulted in time delay and direction error. Elimination of time deviation can ensure the synchronization of data measured by heterogeneous sensors. Figure 3 shows a schematic diagram of measuring the same signal source with heterogeneous sensors.
Where S(t) is the measured signal source, X(t), Y(t), Z(t) are the signals measured, respectively by the three sensors. It can be seen from the figure that the propagation speed is different and there is a time deviation due to the different distances between the sensors and the same signal source. In order to eliminate the influence of time deviation, it is necessary to study the spatial correlation between sensors. The space coordinate system was established with the signal source as the origin, and three sensor spatial coordinates were obtained. The relationship between the signal source and the position parameters of the three sensors is shown in Table 1.
The established signal source and sensor position distribution diagram is shown in Figure 4. Assume that there is only translation, not rotation, between the three sensors. In the space coordinate system, the position coordinates of the sensors are known. The direction distance of X, Y, Z can be regarded as the X coordinate, Y coordinate and Z coordinate of the three sensors. The spatial coordinates of three sensors are established to find out the spatial position correlation.
The spatial coordinate matrix of the three sensors is:
X 1 X 2 X 3 Y 1 Y 2 Y 3 Z 1 Z 2 Z 3 = 0 a 2 a 3 b 1 0 b 3 c 1 c 2 c 3
The coordinate transformation relationship between sensor 1 and sensor 2 and between sensor 1 and sensor 3. The position distribution of signal sources and sensors is shown in Figure 4.
X 1 Y 1 Z 1 = X 2 Y 2 Z 2 + a 2 b 1 c 1 c 2 ,   X 1 Y 1 Z 1 = X 3 Y 3 Z 3 + a 3 b 1 b 3 c 1 c 3
Equation (8) is used to unify the spatial information of the three sensors into the coordinate system of sensor 1, which can eliminate the time deviation between different sensors.

3.2. Time Deviation Correlation

Multi-sensor data fusion requires timely synchronization. According to the above spatial coordinate relation, the influence of spatial position between the two sensors is eliminated and the data synchronization is realized. Spatial position correlation is used to estimate the time deviation between two sensors [35]. Taking sensor 1 as reference, the time deviation between sensor 1 and sensor 2, and the time deviation between sensor 1 and sensor 3 are,= respectively expressed as follows:
τ 1 = 1 3 X 2 X 1 X 1 + Y 2 Y 1 Y 1 + Z 2 Z 1 Z 1 ,   τ 2 = 1 3 X 3 X 1 X 1 + Y 3 Y 1 Y 1 + Z 3 Z 1 Z 1
In the above equations, τ 1 and τ 2 were, respectively, the time deviation between sensor 1 and sensor 2, and the time deviation between sensor 1 and sensor 3. Substitute Equation (8) into Equation (9) to obtain:
τ 1 = 1 3 a 2 X 1 + b 1 Y 1 + c 2 c 1 Z 1 , τ 2 = 1 3 a 3 X 1 + b 3 b 1 Y 1 + c 3 c 1 Z 1

3.3. Temporal Correlation Analysis

The above formula is used to combine the signal with the time deviation to obtain the synchronization signals x(t), y(t + τ1) and z(t + τ2) of the three sensors. x(t), y(t + τ1) and z(t + τ2) signals are deterministic signals with limited energy, so the correlation coefficient between x(t) and y(t + τ1), x(t) and z(t + τ2) is defined as:
d x y = n = 0 x t y t + τ 1 n = 0 x 2 t n = 0 y 2 t + τ 1 = R x y E x E y
d x z = n = 0 x t z t + τ 2 n = 0 x 2 t n = 0 z 2 t + τ 2 = R x z E x E z
where the denominator E x E y was the square root of the normalized energy product of the signals x(t) and y(t + τ1), and the denominator E x E y was the square root of the normalized energy product of the signals x(t) and z(t + τ2). It can be seen from the formula that the power of the denominator energy is a constant, so the size of the correlation coefficient is determined by the numerator. Rxy is correlation function of the signal x(t) and y (t + τ1). It can be obtained d x y 1 according to Schwartz’s inequality, when the two signals are completely equal, the numerator is equal to 1, d x y = 1 ; when the two signals are not completely equal, d x y < 1 ; when the two signals are completely unrelated d x y = 0 . In other words, d x y can be used to describe the degree of similarity between two signals.
The correlation function of vibration signals describes the correlation of two sample functions at different moments, which reflects the close relationship between two random vibration signal waveforms when they move on the time coordinate [36]. The cross correlation function of discrete random vibration signals is expressed as:
R x y t = 1 N m t = 1 N m x t y t + m m = 1 , 2 , , k
where N is the number of sampling points, and the size of the cross-correlation function directly reflected the correlation between the two signals and it was a measure of waveform similarity.

3.4. Signal Fusion Based on Spatio-Temporal Multiple Cross-Correlation and Correlation Function

Multiple sensors with the same accuracy are used to measure different parts of the same object, and the effectiveness of the information collected may be inconsistent. It is obviously inappropriate to distribute the weight of the sensor according to a precision characteristic when an unexpected situation occurs in it, such as a large difference between the collected data and the actual situation, or damage leading to a complete failure. Since the correlation function of vibration signals is a measure of waveform similarity, it can also be seen as the support of one signal to another. Therefore, this support is used as the basis for weight assignment, that is, data fusion based on the starting point of the correlation function weighting method [37]. The implementation steps of the method in this section are shown in Figure 5.
In the fusion of traditional weighting algorithms, the most difficult thing is to determine the weight. Generally, the weighted average method is used to directly fuse the data of various sensors, which is not strict enough. On the contrary, the weighted value adjustment based on multiple cross-correlation functions is more accurate.
In this method, the accuracy of the sensor and the influence of random factors are taken into account to connect any signal with other signals. The greater the correlation, the greater the weight assigned, and vice versa. In general, the more accurate the information reflecting the target state, the higher the degree of support. The energy of the correlation signal is used to represent the correlation degree; that is, the higher the energy, the higher the correlation degree. The energy of discrete signals x(t) and y(t + τ1) is calculated by the following formula:
E x y = i = 1 n R x y i 2
Assuming that the energy of the signal obtained by performing the cross-correlation operation of each signal is Eij, the total correlation energy of the signal collected by the sensor i and the signal collected by other sensors can be expressed as:
E i = j = 1 , j i n E i j
When the weight pi is proportional to the energy of the correlation function, there were:
p 1 : p 2 : : p n = E 1 : E 2 : : E n p 1 + p 2 + + p n = 1
Signals x1, x2, …, xi from the same fault source acquired by different sensors, the different weights of each signal can be obtained from the above formula, so the final fusion result X can be obtained as:
X = p 1 x 1 + p 2 x 2 + + p i x i

4. Experimental Verification

The fault data obtained by a single sensor are not comprehensive. Multiple different sensors can obtain fault information from different angles, which is more conducive to enhancing the characteristics of the fault and improving the effect of fault diagnosis.
The time offset obtained by correlating the spatial positions of multiple sensors with the energy of multiple sensors is correlated to obtain the fusion data. In order to verify the effectiveness of the fusion method, SAE [38] deep learning method in the vibration test bench was used to compare and verify the original single data (OSD), average weighted fusion (AWF), neural network fusion (NNF) and STMF methods, and the superiority of STMF method is highlighted.

4.1. Experimental Device and Fault Setting

The test equipment and instruments are all placed in the open workshop, so the noise is very close to the actual situation, and the obtained fault data is an approximate simulation of the actual fault. In the signals of multiple sensors, the time deviation is eliminated, the linear normalization is processed, the correlation function is used to obtain the adaptive weight, and the test data are used for verification. One motor, two three-direction acceleration sensors (sensor 1 and sensor 2) and one unidirectional acceleration sensor (sensor 3) are used in the experiment. The sampling frequency in the experiment was 25.6 Khz. As shown in Figure 6, Figure 6a is the composition of the test bench and Figure 6b is the position arrangement and coordinate axis of the three sensors. The gearbox contains two gears: planetary and solar. Specific gear parameters are shown in Table 2. The speed of the drive motor is 0~1500 rpm, the transmission ratio of the reducer is 3, and the output speed of the reducer is 0~4500 rpm. HRB6206 deep groove ball bearing specific parameters are shown in Table 3.
The types of bearing faults are shown in Figure 7, including 0.6 mm cracks in the inner ring and 0.6 mm cracks in the outer ring of the bearing. The gear fault types are shown in Figure 8, including planetary gear crack fault (1.2 mm, 3.6 mm), planetary gear pitting fault (3.6 mm), and planetary gear wear fault (1.2 mm, 3.6 mm). Taking the center position of the bottom of the bearing seat as the origin, the spatial coordinate system is established. The establishment of the space coordinate system of the test bench is shown in the red line part of Figure 6b. Sensor 1 and sensor 2 are respectively placed on the left and right bearing seats in Figure 6a, as shown in Figure 6b for specific positions. The coordinates are [0,0,20] and [40,0,20]. Sensor 3 is placed at the spatial coordinates [15,0,0] in centimeters. Unit of measurement: cm.
Various fault data obtained through experiments can be used to obtain time domain graphs of different faults through signal processing methods, but only the time domain graphs cannot see the difference of different faults.
Therefore, the time domain signal is mapped to the frequency domain through the HHT, and then the envelope spectrum of different faults is obtained, which can clearly see the difference of different faults. According to the test data at 1300 rpm, the planetary gear crack fault (3.6 mm) and wear fault (3.6 mm), 0.6 mm cracks in the inner ring and 0.6 mm cracks in the outer ring of the bearing, and the time domain diagrams and frequency domain envelope spectra of the four faults are shown in Figure 9. Among them, the horizontal axes of the time domain sampling point graph reveal the number of sampling points, the horizontal axes of the frequency domain envelope spectrogram reveal frequency (Hz), and the longitudinal axes of both reveal the amplitude (mv).
According to the calculation formula of theoretical gear failure frequency and bearing failure frequency combined with the component layout of the test bench, the failure frequencies of these four types of failures can be obtained as: 21.67 Hz, 21.67 Hz, 53.4 Hz and 159.64 Hz. In Figure 9, the actual fault frequencies corresponding to the four types of faults are 18.36 Hz, 18.36 Hz, 55.08 Hz and 164.9 Hz. The theoretical fault frequency and the actual fault frequency are closely within the allowable range, so the data obtained by the test can be used normally.

4.2. Analysis of Test Results

The maximum speed that the test motor can reach is 1500 rpm, and different motor speeds are set in the test, which are 700 rpm, 900 rpm, 1100 rpm, 1300 rpm. Among them, 1300 rpm is the rotation speed closest to the resonance frequency of the motor.
The test working conditions are set to observe whether the fault results will change differently here. The test condition of 1500 rpm is too dangerous, so there is no need to set it. The SAE fault diagnosis method is used to compare and verify the original data and fusion data of each working condition. In addition, the traditional AWF and NNF methods are compared with the STMF method, which highlights the superiority of STMF data.
When the fault data are verified, the fault type has normal data (n), bearing fault, planetary gear fault. The types of bearing faults are included 0.6 mm cracks in the inner ring (nq0.6) and 0.6 mm cracks in the outer ring of the bearing (wq0.6). The types of planetary gear fault include planetary gear crack 1.2 mm fault (dlw), planetary gear crack 3.6 mm fault (xlw), planetary gear pitting fault 3.6 mm (6ds), planetary gear wear 1.2 mm fault (xms), planetary gear wear 3.6 mm fault (dms). In Figure 10, Figure 11, Figure 12 and Figure 13, the dimension1 of the horizontal coordinate refers to the fault feature 1 after dimensionality reduction, and the dimension 2 of the longitudinal coordinate refers to the fault feature 2 after dimensionality reduction.
(1)
700 rpm test conditions
Under the working condition of 700 rpm, the classification results of the above eight types of faults using different methods are shown in Figure 10.
The OSD, AWF, NNF and STMF data were verified by the fault diagnosis method of SAE. It can be seen that, when the motor speed is 700 rpm, only three types of fault in the original data of a single sensor are well separated in OSD, while the other five types of fault are all mixed together, and the classification effect is poor. In comparison, the classification effect of the data obtained by the AWF is better. However, the clusters of each type of failure do not aggregate well. Compared with the first two kinds of data, the data of NNF are easier to be classified and clustered.
The proposed STMF method can determine the weight in the case of direct correlation analysis of real-time data, without any prior knowledge of sensor measurement data and the influence of some external factors, which is easy to implement. The fault diagnosis classification graph obtained by the STMF method is not only good for each type of fault, but also for the compactness of each type of fault.
(2)
900 rpm test conditions
Under the working condition of 900 rpm, the classification results of the above eight types of faults using different methods are shown in Figure 11.
The classification effect of OSD is average, and several types of faults are clustered together under the working condition of 900 rpm. The aggregation degree of each fault in the AWF method is relatively poor, and the classification results of several faults are not very good; only xms and nq0.6 are separated from other faults. In NNF, the four types of fault classification results of planetary gear cracks (1.2 mm and 0.6 mm) and wear and bearing inner ring cracks of 0.6 mm are poor, all of which will affect the accuracy of the final fault diagnosis.
In STMF fault diagnosis, in addition to large cracks in the planetary gear and poor normal classification, other faults are well classified, and the aggregation effect of each fault is also excellent, which greatly improves the accuracy of fault diagnosis.
It can be seen from Figure 11 that under the working condition of 1100 rpm, the diagnosis effect of the original fault data is poor; only the faults xms and wq0.6 are separated from other faults, and the other faults have poor diagnosis effect, which is inferior to the NNF method. The classification effect is similar. AWF has a better diagnostic effect for each type of fault, but the aggregation of individual faults is poor, which makes each type of fault appear discrete.
(3)
1100 rpm test conditions
Under the working condition of 1100 rpm, the classification results of the above eight types of faults using different methods are shown in Figure 12.
Based on the classification of the original data, the classification effect of the NNF method is better. The fault data classification effect obtained by the STMF method is the best. Not only can the various types of faults be separated, but the aggregation degree of each type of fault is also better, which reflects the strong dynamic adaptability of the STMF method and greatly improves the accuracy of fault diagnosis.
(4)
1300 rpm test conditions
Under the working condition of 1300 rpm, the classification results of the above eight types of faults using different methods are shown in Figure 13.
Under the working condition of 1300 rpm, in the original data, only n is separated, and the other fault data are divided into two piles and mixed together. In the fault diagnosis of AWF and NNF, only nq0.6 and xms can be separated from other faults, and the rest are grouped together. In general, the fault diagnosis effects of OSD, AWF and NNF are not very satisfactory, resulting in several types of faults that cannot be separated.
In the effect diagram of STMF diagnosis, although each type of fault looks relatively discrete, all types of faults have been separated. In contrast, the fault diagnosis effect of OSD, AWF and NNF is better, but the aggregation effect of each type of fault needs to be improved.
In order to highlight the effectiveness of the STMF method, in addition to comparing the single sensor raw data, the traditional AWF data and the fault diagnosis classification graph of the NNF data, the fault diagnosis accuracy and the variance of the accuracy of each method are also counted. The establishment of the fault diagnosis accuracy and variance of each working condition and fusion method are shown in Table 4.
It can be seen from Table 4 that under different speed conditions, the data obtained by the STMF method has the highest accuracy in the SAE fault diagnosis, and the accuracy of the diagnosis is very stable, so the variance of the diagnosis accuracy is very small, which is represented by a thin pink bar in Figure 14.
In comparison, the diagnostic accuracy of OSD, AWF, and NNF data is lower than that of the STMF method. The accuracy of data diagnosis of the NNF method is higher than that of AWF and OSD, but the accuracy variance is the largest among several methods. Yes, the stability is poor. Figure 12 shows the test times and accuracy graphs of several other methods.
In particular, the first natural frequency of the test system is 1500 rpm. In the test, when the rotation speed is 1300 rpm, the noise and vibration amplitude of the entire test bench are very high, which is close to the first natural frequency range of the test system, which results in the loss of the accuracy of the signal collection of the faulty parts. Under the working condition of 1300 rpm, the fault diagnosis rate of various methods is low, but STMF can be compared with other signal fusion methods to highlight the superiority of the fusion method.
The STMF method has good dynamic adaptability because it is a weight distribution for the correlation analysis of real-time data. For any signal measured by any sensor, its weight will change with the support of other signals, so it has good dynamic adaptability. STMF method removes the noise from the original data through the wavelet transform method, which leads to the weight distribution of the method not beingaffected by the relevant noise, but only related to the support degree of other signals obtained by the measured useful signal. Therefore, the proposed method has good anti-interference performance.
In Figure 14, the diagnostic accuracy of STMF data is the most stable under different speed conditions, and the overall accuracy of OSD is low. The fault diagnosis accuracy and volatility of AWF and NNF will vary with speed conditions. In short, the STMF method has good adaptability and accuracy.

5. Conclusions

Multiple sensors are used to obtain fault information from different angles, which greatly makes up for the deficiency of single sensor information. The information fusion of different sensors and different angles is complementary to each other, which provides a good data basis for fault diagnosis.
A multi-correlation spatiotemporal fusion method is proposed by linearizing the original data of each sensor. The spatial position correlation and time synchronization of different sensors are established, and the adaptive weights are obtained by combining the signal energy correlation. The output fusion data greatly improve the accuracy of fault diagnosis.
Compared with the OSD method, AWF method and NNF method, the STMF method has great advantages in fault diagnosis accuracy and accuracy fluctuation under different velocity conditions, and the STMF method can reach a diagnosis accuracy of more than 94% at 700 rpm, 900 rpm and 1100 rpm, which provides an effective method for the development of fault diagnosis.

Author Contributions

Conceptualization, L.C. and S.L.; methodology L.C. and S.L.; software, L.C.; validation, L.C. and R.D.; formal analysis, L.C. and J.L.; investigation S.L.; resources S.L.; data curation K.X.; writing—original draft preparation L.C.; writing—review and editing L.C.; visualization L.C.; supervision R.D.; project administration S.L. and X.L.; funding acquisition L.C., J.L. and S.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key Research and Development Program of China (2018YFB2003300), the National Natural Science Foundation of China (51975276) and the Major National Science and Technology Projects (2017-IV-0008-0045).

Institutional Review Board Statement

There are no relevant statements for this research.

Informed Consent Statement

Not applicable.

Data Availability Statement

No new data was created or analyzed in this study. Data sharing does not apply to this article.

Acknowledgments

Thanks to my mentor and team for this research, which was funded by the National Key Research and Development Program of China (2018YFB2003300), the National Natural Science Foundation of China (51975276), and the Major National Science and Technology Projects (2017-IV-0008-0045).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Lei, Y. Intelligent Fault Diagnosis and Remaining Useful Life Prediction of Rotating Machinery; Xi’an Jiao Tong University Press: Xi’an, Shaanxi, China, 2017. [Google Scholar]
  2. Wang, J.; Li, S.; Han, B.; An, Z.; Xin, Y.; Weiwei, Q.; Wu, Q. Construction of a batch-normalized auto encoder network and its application in mechanical intelligent fault diagnosis. Meas. Sci. Technol. 2019, 30, 14. [Google Scholar] [CrossRef]
  3. He, Y.-L.; Wang, K.; Zhong, H.; Meng, Y.; Wang, X.; Tang, G. Enhanced detection of generator characteristic vibration signal based on maximum correlation kurtosis deconvolution algorithm. J. N. China Electr. Power Univ. 2017, 44, 67–73, 89. [Google Scholar]
  4. Fan, Z.; Wang, L.; Zhao, Z.; Mao, Z. Research on Diesel Engine Fault Early Warning Method Based on Correlation Analysis of Cylinder Head Vibration Signal Envelope. J. Beijing Univ. Chem. Technol. 2018, 45, 76–81. [Google Scholar]
  5. Gao, H.B.; Ouyang, G.Y. Diesel engine misfire fault detection based on cylinder head vibration signal analysis. Automot. Engine 2005, 1, 32–34. [Google Scholar]
  6. Cheng, Y.; Chen, B.; Mei, G.; Wang, Z.; Zhang, W. A novel blind deconvolution method and its application to fault identification. J. Sound Vib. 2019, 460, 114900. [Google Scholar] [CrossRef]
  7. Janjarasjitt, S.; Ocak, H.; Loparo, K.A. Bearing condition diagnosis and prognosis using applied nonlinear dynamical analysis of machine vibration signal. J. Sound Vib. 2008, 317, 112–126. [Google Scholar] [CrossRef]
  8. Rahmatian, M.; Vahidi, B.; Ghanizadeh, A.J.; Gharehpetian, G.B.; Alehosseini, H.A. Insulation failure detection in transformer winding using cross-correlation technique with ANN and k-NN regression method during impulse test. Int. J. Electr. Power Energy Syst. 2013, 53, 209–218. [Google Scholar] [CrossRef]
  9. Liu, H.; Zhang, J.; Cheng, Y.; Lu, C. Fault diagnosis of gearbox using empirical mode decomposition and multi-fractal detrended cross-correlation analysis. J. Sound Vib. 2016, 385, 350–371. [Google Scholar] [CrossRef]
  10. Zhan, L.; Ruo, C.; Bao, Z. Research on the data-level fusion algorithm of similar multi-sensor adaptive weight estimation. J. Lanzhou Univ. Technol. 2006, 32, 78–82. [Google Scholar]
  11. Chopr, P.; Yadav, S.K. Fault detection and classification by unsupervised feature extraction and dimensionality reduction. Complex Intell. Syst. 2015, 1, 25–33. [Google Scholar] [CrossRef] [Green Version]
  12. Maltseff, P.A.; Winter, S. Systems, Methods and Devices for Collecting Data from Wireless Sensor Nodes. U.S. Patent No. 7,978,639, 12 July 2011. [Google Scholar]
  13. Krishnamoorthy, G.; Ashok, P.; Tesar, D. Simultaneous sensor and process fault detection and isolation in multiple-input-multiple-output systems. IEEE Syst. J. 2017, 9, 335–349. [Google Scholar] [CrossRef]
  14. Wang, H.; Li, S.; Song, L.; Cui, L. A novel convolutional neural network based fault recognition method via image fusion of multi-vibration-signals. Comput. Ind. 2019, 105, 182–190. [Google Scholar] [CrossRef]
  15. He, Z.; Shao, H.; Cheng, J.; Yang, Y.; Xiang, J. Kernel flexible and displaceable convex hull based tensor machine for gearbox fault intelligent diagnosis with multi-source signals. Measurement 2020, 163, 107965. [Google Scholar] [CrossRef]
  16. Zhang, Y.; Li, S.; Hu, Y.; Guo, H.; Lei, Y. The multi-correlation acoustic source identification study of a type combine harvester. J. Vib. Meas. Diagn. 2013, 33, 66–69. [Google Scholar]
  17. Pan, G.; Li, S.; Zhu, Y. A Time-Frequency Correlation Analysis Method of Time Series Decomposition Derived from Synchrosqueezed S Transform. Appl. Sci. 2019, 9, 777. [Google Scholar] [CrossRef] [Green Version]
  18. Xiao, F. A Novel Evidence Theory and Fuzzy Preference Approach-Based Multi-Sensor Data Fusion Technique for Fault Diagnosis. Sensors 2017, 17, 2504. [Google Scholar] [CrossRef] [Green Version]
  19. Ma, M.; Sun, C.; Chen, X. Deep coupling auto encoder for fault diagnosis with multimodal sensory data. IEEE Trans. Ind. Inform. 2018, 14, 1137–1145. [Google Scholar] [CrossRef]
  20. Ma, M.; Sun, C.; Chen, X.; Zhang, X.; Yan, R. A Deep Coupled Network for Health State Assessment of Cutting Tools Based on Fusion of Multisensory Signals. IEEE Trans. Ind. Inform. 2019, 15, 6415–6424. [Google Scholar] [CrossRef]
  21. Hao, S.; Ge, F.-X.; Li, Y.; Jiang, J. Multi sensor Bearing Fault Diagnosis Based on One-dimensional Convolutional Long Short-Term Memory Networks. Measurement 2020, 159, 107802. [Google Scholar] [CrossRef]
  22. Chen, H.; Hu, N.; Cheng, Z.; Zhang, L.; Zhang, Y. A deep convolutional neural network based fusion method of two-direction vibration signal data for health state identification of planetary gearboxes. Measurement 2019, 146, 268–278. [Google Scholar] [CrossRef]
  23. Jiang, Z.; Jia, Q.-S.; Guan, X. Optimization of sensor location for improving wind power prediction accuracy. In Proceedings of the 2017 13th IEEE Conference on Automation Science and Engineering (CASE), Xi’an, China, 20–23 August 2017. [Google Scholar]
  24. Mednikov, V. Method and Sensor Arrangement for Determining the Position and/or Change of Position of a Measured Object Relative to a Sensor. U.S. Patent No. 8,476,896, 2 July 2013. [Google Scholar]
  25. Chen, W.; Li, J.; Wang, Q.; Han, K. Fault feature extraction and diagnosis of rolling bearings based on wavelet thresholding denoising with CEEMDAN energy entropy and PSO-LSSVM. Measurement 2021, 172, 108901. [Google Scholar] [CrossRef]
  26. Purashotham, V.; Narayanan, S.; Prasad, S.A.N. Multi-fault diagnosis of rolling bearing elements using wavelet analysis and hidden Markov model based fault recognition. NDT E Int. 2005, 38, 654–664. [Google Scholar] [CrossRef]
  27. Shao, R.; Hu, W.; Wang, Y.; Qi, X. The fault feature extraction and classification of gear using principal component analysis and kernel principal component analysis based on the wavelet packet transform. Measurement 2014, 54, 118–132. [Google Scholar] [CrossRef]
  28. Wang, Y.; He, Z.; Zi, Y. Enhancement of signal denoising and multiple fault signatures detecting in rotating machinery using dual-tree complex wavelet transform. Mech. Syst. Signal Process. 2010, 24, 119–137. [Google Scholar] [CrossRef]
  29. Zhang, X.; Wang, J.; Liu, Z.; Wang, J. Weak feature enhancement in machinery fault diagnosis using empirical wavelet transform and an improved adaptive bistable stochastic resonance. ISA Trans. 2019, 84, 283–295. [Google Scholar] [CrossRef] [PubMed]
  30. Ya, G.; Ping, Y. Analysis of the properties of linear dimensionless methods. Stat. Res. 2008, 2, 93–100. [Google Scholar]
  31. Macêdo, D.; Zanchettin, C.; Oliveira, A.L.I.; Ludermir, T. Enhancing batch normalized convolutional networks using displaced rectifier linear units: A systematic comparative study. Expert Syst. Appl. 2019, 124, 271–281. [Google Scholar] [CrossRef]
  32. Ondra, V.; Severb, I.A.; Schwingshackl, C.W. Identification of complex non-linear modes of mechanical systems using the Hilbert-Huang transform from free decay responses. J. Sound Vib. 2021, 495, 115912. [Google Scholar] [CrossRef]
  33. Mahata, S.; Shakya, P.; Babu, N.R. A robust condition monitoring methodology for grinding wheel wear identification using Hilbert Huang transform. Precis. Eng. 2021, 70, 77–91. [Google Scholar] [CrossRef]
  34. Li, S.; Cheng, Y.; Wang, H.; Gao, S. Time offset calibration distributed multi-sensor multi-target tracking algorithm. J. Northwestern Poly Tech. Univ. 2020, 38, 797–805. [Google Scholar] [CrossRef]
  35. Timothy, G.C.; Francesca, M. Spatial correlation robust inference with errors in location or distance. J. Econom. 2006, 140, 76–96. [Google Scholar]
  36. Zhou, C.; Xi, C.; Pang, J.; Lin, Y. Ambient noise data selection based on the asymmetry of cross-correlation functions for near surface applications. J. Appl. Geophys. 2018, 159, 803–813. [Google Scholar] [CrossRef]
  37. Ma, Z.; Gu, C.; Wang, J.; Zeng, M.; Chao, G.; Jian, W. Research on fault diagnosis method of rolling bearing based on cross-correlation function. J. Appl. Basic Sci. Eng. 2017, 25, 646–655. [Google Scholar]
  38. Wang, Y.; Yang, H.; Yuan, X.; Shardt, Y.A.W.; Yang, C.; Gui, W. Deep learning for fault-relevant feature extraction and fault classification with stacked supervised auto-encoder. J. Process Control 2020, 92, 79–89. [Google Scholar] [CrossRef]
Figure 1. The overall framework and ideas of the content.
Figure 1. The overall framework and ideas of the content.
Applsci 11 04318 g001
Figure 2. The process of wavelet threshold noise reduction.
Figure 2. The process of wavelet threshold noise reduction.
Applsci 11 04318 g002
Figure 3. Different types of sensors measure the same signal source.
Figure 3. Different types of sensors measure the same signal source.
Applsci 11 04318 g003
Figure 4. Position distribution of signal sources and sensors.
Figure 4. Position distribution of signal sources and sensors.
Applsci 11 04318 g004
Figure 5. Steps of the fusion method.
Figure 5. Steps of the fusion method.
Applsci 11 04318 g005
Figure 6. Test Bench.
Figure 6. Test Bench.
Applsci 11 04318 g006
Figure 7. Bearing fault.
Figure 7. Bearing fault.
Applsci 11 04318 g007
Figure 8. Gear failure.
Figure 8. Gear failure.
Applsci 11 04318 g008
Figure 9. Time domain and envelope spectrum graphs with signals of different health conditions.
Figure 9. Time domain and envelope spectrum graphs with signals of different health conditions.
Applsci 11 04318 g009
Figure 10. Comparison of eight types of fault classification results under 700 rpm.
Figure 10. Comparison of eight types of fault classification results under 700 rpm.
Applsci 11 04318 g010
Figure 11. Comparison of eight types of fault classification results under 900 rpm.
Figure 11. Comparison of eight types of fault classification results under 900 rpm.
Applsci 11 04318 g011
Figure 12. Comparison of eight types of fault classification results under 1100 rpm.
Figure 12. Comparison of eight types of fault classification results under 1100 rpm.
Applsci 11 04318 g012
Figure 13. Comparison of eight types of fault classification results under 1300 rpm.
Figure 13. Comparison of eight types of fault classification results under 1300 rpm.
Applsci 11 04318 g013
Figure 14. Accuracy difference diagram under different speed conditions.
Figure 14. Accuracy difference diagram under different speed conditions.
Applsci 11 04318 g014
Table 1. Spatial location parameters of three different sensors.
Table 1. Spatial location parameters of three different sensors.
Sensor 1Sensor 2Sensor 3
X distance0a2a3
Y distanceb10b3
Z distancec1c2c3
Table 2. Parameters of gear.
Table 2. Parameters of gear.
GearNumber of TeethModulus (mm)Engagement Angle (deg.)Material
Sun gear55220S45C
Planetary gear75220S45C
Table 3. The basic parameters of deep groove ball bearings.
Table 3. The basic parameters of deep groove ball bearings.
ParametersInner Ring DiameterOuter Ring DiameterRolling Body DiameterPitch DiameterNumber of Rolling Elements
Value30 mm62 mm9.6 mm46 mm9
Table 4. SAE handles the fault classification accuracy rate of different data.
Table 4. SAE handles the fault classification accuracy rate of different data.
Working ConditionFusion MethodTotal SampleTraining SamplesTesting SampleAccuracy
700 rpmOSD2004016074.20% ± 2.52%
AWF90.65% ± 0.71%
NNF93.15% ± 2.65%
STMF95.59% ± 0.07%
900 rpmOSD2004016084.97% ± 1.67%
AWF84.10% ± 1.09%
NNF90.25% ± 2.30%
STMF94.48% ± 0.36%
1100 rpmOSD2004016082.57% ± 1.88%
AWF93.15% ± 2.65%
NNF90.25% ± 2.02%
STMF94.79% ± 0.24%
1300 rpmOSD2004016080.67% ± 1.66%
AWF82.37% ± 2.90%
NNF83.97% ± 3.77%
STMF86.17% ± 0.30%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Cheng, L.; Lu, J.; Li, S.; Ding, R.; Xu, K.; Li, X. Fusion Method and Application of Several Source Vibration Fault Signal Spatio-Temporal Multi-Correlation. Appl. Sci. 2021, 11, 4318. https://doi.org/10.3390/app11104318

AMA Style

Cheng L, Lu J, Li S, Ding R, Xu K, Li X. Fusion Method and Application of Several Source Vibration Fault Signal Spatio-Temporal Multi-Correlation. Applied Sciences. 2021; 11(10):4318. https://doi.org/10.3390/app11104318

Chicago/Turabian Style

Cheng, Longhuan, Jiantao Lu, Shunming Li, Rui Ding, Kun Xu, and Xianglian Li. 2021. "Fusion Method and Application of Several Source Vibration Fault Signal Spatio-Temporal Multi-Correlation" Applied Sciences 11, no. 10: 4318. https://doi.org/10.3390/app11104318

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop