Next Article in Journal
Sensing System for Plegic or Paretic Hands Self-Training Motivation
Next Article in Special Issue
Probabilistic Seismic Response Prediction of Three-Dimensional Structures Based on Bayesian Convolutional Neural Network
Previous Article in Journal
A Novel Analytical Modeling Approach for Quality Propagation of Transient Analysis of Serial Production Systems
Previous Article in Special Issue
Bridge Digital Twinning Using an Output-Only Bayesian Model Updating Method and Recorded Seismic Measurements
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Unsupervised Tunnel Damage Identification Method Based on Convolutional Variational Auto-Encoder and Wavelet Packet Analysis

1
School of Civil Engineering, Tongji University, Shanghai 200092, China
2
Key Laboratory of Geotechnical and Underground Engineering of Ministry of Education, School of Civil Engineering, Tongji University, Shanghai 200092, China
3
China Shipbuilding NDRI Engineering Co., Ltd., Shanghai 200090, China
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(6), 2412; https://doi.org/10.3390/s22062412
Submission received: 2 March 2022 / Revised: 17 March 2022 / Accepted: 18 March 2022 / Published: 21 March 2022

Abstract

:
Finding a low-cost and highly efficient method for identifying subway tunnel damage can greatly reduce catastrophic accidents. At present, tunnel health monitoring is mainly based on the observation of apparent diseases and vibration monitoring, which is combined with a manual inspection to perceive the tunnel health status. However, these methods have disadvantages such as high cost, short working time, and low identification efficiency. Thus, in this study, a tunnel damage identification algorithm based on the vibration response of in-service train and WPE-CVAE is proposed, which can automatically identify tunnel damage and give the damage location. The method is an unsupervised novelty detection that requires only sufficient normal data on healthy structure for training. This study introduces the theory and implementation process of this method in detail. Through laboratory model tests, the damage of the void behind the tunnel wall is designed to verify the performance of the algorithm. In the test case, the proposed method achieves the damage identification performance with a 96.25% recall rate, 86.75% hit rate, and 91.5% accuracy. Furthermore, compared with the other unsupervised methods, the method performance and noise immunity are better than others, so it has a certain practical value.

1. Introduction

Subway tunnels are the lifeblood of urban rail transit and are essential for residents to travel. Finding a low-cost and efficient method for identifying structural damage is the key to maintaining the safety of subway tunnels and the premise of ensuring normal urban traffic [1,2]. Therefore, this study proposes a new unsupervised novelty detection method to identify tunnel damage using the dynamic responses of in-service trains collected by onboard sensors.
At present, tunnel health monitoring is mainly based on the observation of apparent diseases such as water leakage, settlement, and deformation, such as high-definition photography, laser scanning, radar, and other technologies, and combined with the inspection to grasp the health status of the tunnel [3]. However, these methods generally have high costs and short operating time (only 3 to 4 h in the morning), making it difficult to meet the increasingly stringent requirements of subway tunnel operation and maintenance [4]. The damage identification method based on structural vibration monitoring can identify non-apparent diseases such as structural stiffness degradation and the void behind the tunnel, but, generally, fixed sensors can only be arranged in the vulnerable part of the tunnel to realize automatic monitoring of the tunnel [5]. Because the subway tunnel is deeply buried underground and the stratum parameters are complex, this method lacks effective damage indicators and is expensive. Therefore, there are still many difficulties in application [4].
Given the limitations of the existing health monitoring technology, Yang et al. [6,7,8] proposed a method to obtain the bridge vibration mode and identify the structural damage by using the dynamic response of the vehicle when driving on the bridge, which provides a new idea for structural health monitoring. This method has significant advantages such as high mobility, high efficiency, low cost, and continuous testing, and does not require road closures and standstill operations [9]. Hence, vehicle-mounted vibration-based track condition monitoring is widely used in railway track and track bed detection, tunnel health monitoring, and other fields [10,11,12]. Sweden has developed a Rolling Stiffness Measuring Vehicle (RSMV) that can measure the dynamic stiffness of railway tracks [10]. Germany has also developed high-speed ICE-S measuring trains that measure track geometry and vehicle dynamic response [11,12]. Xie [13] and Li et al. [4] proposed a novel method to identify the tunnel damage by using the dynamic response of the subway trains in service and proposed a damage indicator based on the wavelet packet energy change rate and the damage indicator based on the spectral kurtosis change rate. They established a simplified one-dimensional numerical model, refined three-dimensional numerical model, and simple laboratory model tests to verify the damage indicators, and discussed the influence of vehicle speed and load. The results show that the proposed damage indicators can effectively locate the damage of the tunnel structure and has good robustness.
Although the damage identification method based on the dynamic response of the moving vehicle can solve the difficulties of the traditional monitoring method, the method is still in the experimental research stage and is not mature. A large amount of the dynamic response data of in-service trains has a low signal-to-noise ratio and strong randomness. In addition, there is also a lack of effective damage indicators. It is difficult to effectively identify tunnel damage using conventional signal processing methods [13].
With the improvement of computer technology on software and hardware, the increase in data storage capacity, and the reduction in cost, data-driven structural health monitoring (SHM) has attracted more and more attention in the engineering field [14,15]. Compared with traditional methods, SHM based on deep learning and data-driven has the following advantages: (1) Automatic damage identification; (2) Joint training of all parameters with high accuracy; (3) It is suitable for large datasets with high efficiency [15]. At present, data-driven SHM is mainly divided into two directions: vision-based and vibration-based SHM [16]. The former is to essentially process the data of structural deformation, such as displacement, crack, corrosion, and other apparent diseases, which are mainly represented by images or videos. The latter uses the vibration response data measured by the accelerometer deployed on the structure to detect internal and invisible damage. Most of the researchers treat the damage detection tasks in a supervised manner, which can be viewed as a pattern recognition problem in nature, using deep learning methods such as CNN [17,18,19] and LSTM [20]. Chen et al. [21] proposed a new pavement transverse crack detection model based on time–frequency analysis and CNN, and a good recognition performance was achieved by analyzing the measured data. This supervised method requires labeled data in all structural health and damage scenarios to learn [17]. However, it is sometimes difficult to obtain data in all possible damage scenarios, which are rare in practical applications [22].
In contrast, unsupervised learning can avoid such shortcomings, including K-means, K-NN, Auto-Encoder, and its improvement [22,23,24]. Chalapathy et al. [22] developed a deep learning technique for novelty detection based on an unsupervised CNN for structural damage about loose bolts on a bridge model. Ma et al. [23] presented a damage detection method based on a variational auto-encoder for representation extraction and applied it to bridge damage identification under a moving vehicle, and its accuracy was proved by the numerical simulation and in-lab experiment [23]. Li et al. [24] proposed an unsupervised damage detection method based on convolutional auto-encoders and conducts field experiments on the PSC-I bridge to test the accuracy and robustness of the method. Cha et al. [25,26] proposed an unsupervised deep learning method for detecting structural damage with a deep auto-encoder with a one-class of support vector machines, which was verified by steel bridge experiments. However, the major disadvantage of these unsupervised deep learning methods is that they remain inferior in identifying the damage type and degree and detecting low levels of damage [27].
To effectively identify tunnel damage from in-service train dynamic response data, a novel unsupervised deep learning damage identification method is proposed in this study. The method uses the CAVE model to identify whether there is damage and then uses the wavelet packet energy relative entropy to obtain the approximate area of the damage location. The novelties and contributions of this study are as follows.
(1) A convolutional variational autoencoder model (CVAE) based on in-service train dynamic response is developed to detect the tunnel damage with low cost and high efficiency.
(2) A damage-sensitive indicator (TDIWPE) based on the relative entropy of wavelet packet energy is developed to identify tunnel damage locations.
(3) A laboratory model that can be automatically controlled is designed and the damage of the void behind the tunnel wall is simulated, and a large amount of experimental data is collected to test the algorithm.
(4) By analyzing the experimental data and comparing with other methods, we show that the proposed method has better recognition accuracy and noise immunity.
The remainder of this paper is arranged as follows. Section 2 introduces the unsupervised method of tunnel damage identification. Section 3 introduces the automated model test system and uses the model test data to train the neural network to verify the effectiveness of the proposed method. Section 4 discusses the comparison between different methods and robustness against noise. Eventually, Section 5 presents the conclusion of this study.

2. Methodology

2.1. Method Overview

As shown in Figure 1, the tunnel damage identification method uses the onboard accelerometer to collect the vibration response of the in-service subway train and then identifies the damage of the tunnel structure by analyzing acceleration data. The theoretical basis can be found in the literature [4], which has been also verified by numerical simulation and experiments tests.
To monitor the health status of the tunnel in approximately real-time and identify the abnormality of the tunnel when the subway train is in service normally, this study adopts the CVAE model and indicator TDIWPE to solve the modeling problem. The framework of the proposed damage identification method is shown in Figure 2. The proposed method includes three parts: (1) Raw data preprocessing: After wavelet packet decomposition (WPD) and noise reduction, the wavelet packet energy of each slice is calculated and normalized; (2) Model training: Using the processed data as the learning sample of the model, train and optimize the established CVAE model; (3) Damage identification: The samples are input into the trained CVAE model, and the damage index TDIWPE of the input and output data is calculated. By comparing the Root Mean Square Error (RMSE) and the damage threshold, it is determined whether there is any damage in the tunnel, and the section where the damage is located is given by TDIWPE.

2.2. CVAE

Variational Auto-encoders (VAE) is a model proposed by Kingma et al. [28], which improves the latent variables of the auto-encoder. The essence of the variational autoencoder is a deep Bayesian network, which is a combination of statistics and neural networks. Compared with Auto-encoders (AE), the core idea of VAE is that the latent variables z are forced to satisfy a specific distribution, such as the standard normal distribution. Considering its independence constraint on latent variables, VAE may be a better feature extraction method.
The CVAE used in this study is to replace the fully connected layer of the VAE with a convolutional layer and a pooling layer, where the encoder and decoder are convolutional neural networks (CNN). In this way, the spatial information of the two-dimensional input data can be preserved, and the network learning ability and computational efficiency can be greatly improved.
Figure 3 shows the architecture diagram of the CVAE model and shows the expression of the loss function. Conv2D denotes a two-dimensional convolution layer. The two parameter vectors μ and σ , represent the mean and variance of the hidden variable, respectively, so that each element of the hidden variable obeys the corresponding normal distribution N ( μ x , σ x 2 ) . The network adopts the technique of resampling and introduces Gaussian noise ε ~ N ( 0 , I ) .
The latent variables z is obtained by:
z = μ + σ ε
where represents the Hadamard operator, which represents element-wise multiplication.
The goal of CVAE is to maximize the evidence lower bound (ELBO), which can be expressed as:
E L B O = E z ~ q ( z | x ) [ log p ( x | z ) ] K L [ q ( z | x ) p ( z ) ]
where E z ~ q ( z | x ) [ ] is a mathematical expectation calculator; K L [ ] represents the Kullback–Leibler (KL) divergence that measures the difference between two distributions. For more details on ELBO, please refer to the literature [29].
After simplification, the loss function of the network can be expressed as the following equation [28].
L * ( θ ) = K L [ q ( z | x ) p ( z ) ] + ζ L ( x , y ; θ )
The loss function contains two parts that are reconciled by the hyperparameter ζ. The first part is the hidden layer loss, which represents the difference between the predicted distribution q ( z | x ) of the encoder output hidden variable and the actual prior distribution p ( z ) , which can be represented by KL divergence. After simplification, KL is calculated as follows:
K L [ q ( z | x ) p ( z ) ] = ( q ( z | x ) log q ( z | x ) p ( z ) ) d z = ( q ( z | x ) log q ( z | x ) q ( z | x ) log p ( z ) ) d z = 1 2 i = 1 N ( σ i 2 + μ i 2 1 log σ i 2 )
The second part is the reconstruction loss, which represents the difference between the input data and the output data. Generally, the Root Mean Square Error (RMSE) is used, which is calculated according to Formula (5).
R M S E = 1 n i = 1 n ( y i y ^ i ) 2
To assess whether the data contain anomalies, a damage threshold is set as the criterion. When the RMSE is greater than this threshold, the damage is considered to be present. According to the research of Ren et al., it is assumed that RMSE obeys the normal distribution N(μr, σr), and the upper confidence limit is introduced as the damage threshold. The calculation formula is as follows:
L 1 α = μ r + Z 1 α σ r
where L1−α represents the upper confidence limit, μr and σr represent the mean and standard deviation of the reconstruction loss RMSE, respectively. The confidence level of Z1−α is the upper limit of the one-sided confidence interval of 1−α. From statistical knowledge, Z1−α can be calculated as follows:
Z 1 α = t 1 α ( n 1 ) n
In this model, α = 0.05 is preferable, which means that the RMSE is within the one-sided 95% confidence interval (where the RMSE is non-negative), and the sample data can be considered to be normal. Otherwise, the data can be considered abnormal, indicating that the tunnel may be damaged.

2.3. Relative Entropy of Wavelet Packet Energy

To identify the location of tunnel damage, a damage indicator TDIWPE based on relative entropy of wavelet packet energy is proposed in this study. The raw signal is divided into several slices, and TDIWPE between the input and output of the CVAE in each slice is calculated to determine whether the slice signal is abnormal, and then we will obtain the damage location.
The indicator calculation process is shown in Figure 2. The raw signal x ( t ) is firstly decomposed by the j-layer wavelet packet, and the wavelet packet coefficient d j , k ( t ) of the j-th layer can be expressed by Equation (8). Noise can also be filtered by discarding wavelet coefficients of some frequency bands.
D = { d j , k ( t ) , k = 1 , 2 , , 2 j , j = 1 , 2 , N }
Then, the wavelet coefficients are divided into equal-length segment slices, each slice has a length of 𝑙 sampling points, and the translation length is (slice overlap length), then the wavelet coefficients d i , j , k ( t ) of each slice are expressed as follow:
D = { d i , j , k ( t ) , k = 1 , 2 , , 2 j , j = 1 , 2 , N , i = 1 , 2 , M }
The energy spectrum based on the wavelet packet in each slice can be obtained, and it is normalized as a vector:
P i , j = [ p i , j , 1 p i , j , 2 p i , j , 2 j ]
where p i , j , k represents the ratio of the wavelet energy of the k-th frequency band of the i-th slice to the total energy of this slice, which can be calculated as follows:
p i , j , k = e i , j , k E i , j = e i , j , k k = 1 2 j e i , j , k
e i , j , k = t = ( i 1 ) × l i n c + 1 ( i 1 ) × l i n c + l | d i , j , k ( t ) | 2
Then, the indicator TDIWPE of the i-th slice can be defined as Equation (13).
T D I W P E ( i ) = k = 1 2 j p i , j , k D ln ( p i , j , k D p i , j , k H )
where the superscript D represents the train vibration response on the tunnel damage, and H represents the signal on the tunnel healthy.
Finally, according to the train speed, the slices are corresponding to the sections of the tunnel space domain.
S = v × t
where S is a distance of train running; v represents train speed, and t represents time.
In each slice, the TDIWPE(i) can measure the difference between the energy distribution of the signal on healthy and damage scenarios. The closer the energy distribution is, the more the relative entropy tends to 0, and vice versa. Therefore, the TDIWPE can reflect whether the signal is abnormal, and then can find out which slice the damage is in.
To facilitate the quantification of the damage indicator, it is defined that the slice whose TDIWPE is greater than 20% of the average value of each slice in the sample, may have “damage”, and other slices are considered healthy.

3. Experimental Validations

To validate the proposed tunnel damage identification method, model experiments were performed in the laboratory to obtain experimental datasets for method training and performance evaluation. The model test was conducted to verify the feasibility of the tunnel damage detection method based on the vibration response of the in-service train. Furthermore, it was expected that the effectiveness of the proposed method in processing monitoring data would be verified. Due to the limited experimental conditions, we simplified the model significantly.

3.1. Experimental Test

3.1.1. Laboratory Physical Modeling System

Considering the laboratory space, prototype size (taking Jinan subway tunnel as the prototype), model manufacture, and other factors, it was assumed that the geometric similarity coefficient Cl = 1/30, the elastic modulus coefficient CE = 1/30, and the acceleration similarity coefficient was 1. At the same time, the model did not consider the effects of primary and secondary springs of the train, track fasteners, and groundwater. The structure and field photos of the test system are shown in Figure 4, including the sand box, tunnel, vehicle, power traction, automatic control, and data acquisition system. The key parameters of the model are shown in Table 1.
The tunnel structure and track plates are fabricated using photosensitive resin 3D printing technology. The outer diameter of the actual tunnel is 6.2 m, and the lining thickness is 0.3 m. Bolts were used to assemble the lining segments, including one standard part-I (SPI, arc 48° × width 10 cm), two standard parts-II (SPII, arc 96° × width 10cm), and a bottom part (BP), as shown in Figure 5. The track is made of two smooth metal strips, reducing the effects of track irregularities.
The sandbox was made of steel. The inner walls of the sandbox were covered with 25 cm thick polystyrene foam boards to absorb vibrational waves and prevent wave reflections that affect the vibrational modes of the structure. Although sand cannot accurately represent the complex real ground, it is useful for controlling boundary conditions and repeatable tests. The sand was compacted during the experiment.
Regardless of the primary and secondary suspension springs of the train, the vehicle was divided into three compartments, which were equipped with wireless sensors and mass. The wireless sensor was fastened with bolts in the middle of the vehicle to collect the vertical acceleration. The sensor sampling frequency was 4000 Hz, with the resolution being 0.2 μg, the measuring range 2 g, and the weight 136 g. Under standard conditions, the vehicle speed and total mass (load and sensor) were 0.9 m/s and 5.08 kg. A stepper motor and tracks pulled the vehicle reciprocating at a constant speed on the track on the track. The test system was automatically controlled by a program to ensure uniform vehicle speed.

3.1.2. Damage Setup

The tunnel damage was caused by structural material degradation and the external environment. Concrete carbonation, erosion, and spalling reduce lining stiffness, causing tunnel deformation and cracking, leading to water leakage. Soil movement, soil erosion, and surface overloading lead to tunnel subsidence and dislocation, which can lead to tunnel damage.
As shown in Figure 5, the 3D-printed cavity is a parabolic hollow shell of different sizes made of photosensitive resin, which was placed in the soil behind the bottom of the tunnel to simulate the effect of different volumes of the cavity. The void size and position on the tunnel are shown in Figure 5b. To reduce the test workload, four damage levels were set, and the volumes were 566 cm3, 331.7 cm3, 447 cm3, and 166.4 cm3, respectively.

3.1.3. Test Conditions

Due to the limitations of test materials and equipment, the standard working condition was set as the healthy working condition, with the train speed being 0.9 m/s, and the total mass of the vehicle, load, and sensor being 5.08 kg. In each case, the vehicle reciprocated runs in the tunnel, taking a single trip (from left to right) as a valid sample, and each sample was about 3 s long. As shown in Figure 6, the total length of the tunnel was 3 m, with 30 rings. Among them, 24 rings were analyzed as the effective length and divided into 8 segments. Then, the void damage was placed on the 14th ring, which is on the 4th segment. The test conditions are shown in Table 2. Lastly, 2000 samples were collected repeatedly in Case 0, and 500 samples in each of the other four damage cases.

3.2. Data Preprocessing

Figure 7 shows the collected vehicle’s vertical acceleration of Case 0 and 3. However, it is difficult to directly identify the damage through the time domain signal because of noise. Therefore, we used deep learning methods to solve this problem. According to the method described in Section 2.3, the original data were converted into a WPE distribution map by using the wavelet packet analysis, which was used as the input sample of the deep learning network. The sym4 wavelet basis function was used, and the number of decomposition layers was 8.
The calculation result is shown in Figure 8. The x-axis in the figure represents the time, and the time window length was 0.25 s, indicating that the time resolution was 0.25 s. The y-axis represents the frequency with a frequency resolution of 7.8 Hz. Each point in the figure represents the ratio of the energy of this frequency band to the sum of the energy of all frequency bands in this time period. The signal energy was mainly concentrated in two frequency ranges, 35.16–144.5 Hz and 261.7–425.8 Hz. Comparing the images of Case 0 and 3, certain subtle differences are observed in the red box in the time period of 1~1.5 s and frequency range of 35.16–144.5 Hz, indicating potential damage in this area. However, other frequency bands are still very noisy, which can affect the damage identification.
As an unsupervised model, the training set samples only selected the test data without tunnel damage and used the K-fold verification method to train the neural network. The partition of the dataset is shown in Table 3.

3.3. CVAE Model Establishing and Training

To select the optimal parameters of the model, first, some initial parameters were set as reference models based on experience, and then the grid search method was used for optimization. The optimized network model structure and parameters are shown in Table 4. The input layer of the model is the normalized WPE distribution map of the train acceleration response data. The size of the input layer is a tensor of 1@18 × 96, where 1 represents one channel, and 18 × 96 represents the size of the map. The algorithm was implemented using Python3.9 and TensorFlow 2.5 and trained on a computer with NVIDIA GTX 1060(GPU) and Intel i7-7700K(CPU).

3.4. Damage Identification

3.4.1. Performance Evaluation Metric

Table 5 presents the confusion matrix for evaluating the detection performance of the method. Based on this matrix, the evaluation metric can be defined as the Equations (15)–(17).
H i t   r a t e = T H T H + F N × 100 %
R e c a l l   r a t e = T N T N + F H × 100 %
A c c u r a c y = T N + T H T N + F N + T H + F N × 100 %
where the hit rate is calculated as the percentage of void samples correctly detected; recall rate is calculated as the percentage of correctly identified healthy samples; accuracy is a measure of overall performance.

3.4.2. Void Identification

Through try and error, hyper-parameters of CVAE were determined using training and validation data. The RMSE results of part of the training set and test set are shown in Figure 9. The damage threshold L0.95 is 7.589 × 10−4, which was calculated from the training set results according to Equation (6). When the RMSE is less than this threshold, it means that the tunnel is in a normal state, and when it is greater than this threshold, it is considered that the sample is abnormal, that the tunnel may be damaged. The results show that the RMSE of the test set (healthy) is almost all below the damage threshold, and the recall rate is about 96.25%. At the same time, the hit rate is 86.75%, and overall accuracy is 91.5%. As can be seen from the figure, when the void volume behind the tunnel wall is very small, the accuracy of the model to identify abnormalities is low. When the void volume becomes larger, its RMSE value gradually increases and exceeds the damage threshold, and the recognition effect is also significantly improved.
Sample-A is randomly selected from the test set as an example, and the damage location is given by the TDIWPE. As shown in Figure 10, the TDIWPE (4) is the largest, which is 0.28, while the average value is 0.196. The results suggest that there may be a void in segment 4. The results of this example verify the effectiveness of the proposed method.

4. Discussion

4.1. Compared with Other Unsupervised Methods

Experiments show that the method proposed in this study has the advantages of high efficiency, low cost, and strong feasibility. This section compares the proposed method to other unsupervised methods such as Convolutional Auto-Encoder (CAE), Variational Auto-Encoder (VAE), K-means, and Gaussian Mixture Model (GMM). At the same time, the effects of different decomposition methods such as WPD and variational modal decomposition (VMD) are also compared. The identification effects of each model are shown in Table 6.
Comparing the first three methods in the table, the identification accuracy of the model using WPD and VMD methods in each test set is higher than that of the model without any data preprocessing method, and the effect of the WPD-CVAE model is slightly better than that of the VMD-CVAE model. This is because the VMD method only decomposes the vibration amplitude, and the redundant time dimension information is retained, which will generate more random errors when calculating the RMSE, resulting in identification errors. The WPE distribution map obtained by WPD is also compressed in the time dimension, which not only discards some redundant information, but also improves the calculation speed of the model.
When the preprocessing method is WPD, by comparing the identification accuracy of CVAE, CAE, VAE, K-means, and GMM models, it can be found that the CVAE model has the highest identification accuracy in each test set combining the advantages of convolutional layers and variational autoencoders. The conventional K-means and GMM models have low accuracy, and can only identify whether there is an abnormality, but cannot identify the damage location, so they have certain limitations in practical applications. The results show that the proposed method has more superiority for damage detection than other unsupervised methods.

4.2. Noise Immunity

Due to the influence of the test environment and the measurement error, noise is inevitably generated during the measurement process, which pollutes the original data. So, it will inevitably affect the recognition effect of the detection algorithm. To test the robustness of the proposed algorithm, White Gaussian Noise (WGN) in dBW of different power is injected into the raw data [30]. Figure 11 shows the GWN of 0, 10, 20, and 30 dBW, respectively.
As shown in Table 7, taking Case 3 as an example, the hit rate, recall rate, and accuracy rate of both methods decrease with the increase in noise power. In addition, the results also show that the noise immunity of WPD-CVAE is better than that of VMD-CVAE.

5. Conclusions

In this study, we propose a novel automatic detection algorithm for damage localization based on the dynamic response of in-service trains, which has the advantages of high efficiency, low cost, and strong practicability. The proposed method uses CVAE to extract damage-sensitive features, determines whether there is damage, and then uses TDIWPE to identify the location of the damage. Then, the accuracy and reliability of the proposed method are verified by laboratory tests of the vehicle–track–tunnel–soil coupled vibration model. Finally, the effects of different damage identification methods and noise levels are compared. The following results were obtained:
(1) The proposed method is completely unsupervised and does not require data under various damage scenarios to train the network, which is generally difficult to obtain in practical applications.
(2) An automatic control test system was designed, and the four levels of the void behind the tunnel wall was simulated. The effectiveness of the method is validated by analyzing more than 4500 data samples collected automatically. In the test case, the proposed method achieves a better void identification performance than other unsupervised methods with a 96.25% recall rate, 86.75% hit rate, and 91.5% accuracy.
(3) Compared with VMD-CVAE model, the proposed method fully utilizes the advantages of WPD, CNN, and VAE methods, with higher accuracy and stronger noise immunity.
However, the main disadvantage of this unsupervised method is the inability to identify the damage type and accurately assess the damage extent. Moreover, because the tunnel structure is deeply buried in the ground, the stratum is complex, and the signal-to-noise ratio is low, the quality and quantity of the data will also greatly affect the recognition effect of the model.
Therefore, future work needs to study supervised learning methods that make the best of the manual label of damage information, which can automatically identify the damage type and degree. At the same time, it is necessary to verify the effectiveness of the proposed method through field tests, and accumulate huge amounts and high-quality monitoring data for further research work.

Author Contributions

Conceptualization, Y.Z., H.L.; methodology, Y.Z.; validation, Y.Z.; formal analysis, X.X.; investigation, Y.Z., H.L.; resources, X.X.; data curation, Y.Z., H.L.; writing—original draft preparation, Y.Z.; writing—review and editing, X.X., B.Z.; visualization, Y.Z.; project administration, X.X., B.Z.; funding acquisition, X.X. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key R&D Program of China, grant number 2019YFC0605100 and 2019YFC0605103, National Natural Science Foundation of China, grant 51778476, 51978431, and 52038008, and Shanghai Science and Technology Development Funds, grant 20DZ1202004.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ou, J. Research and practice of smart sensor networks and health monitoring systems for civil infrastructures in mainland China. Bull. Natl. Nat. Sci. Found. China 2005, 19, 8–12. [Google Scholar]
  2. Bao, Y.; Chen, Z.; Wei, S.; Xu, Y.; Tang, Z.; Li, H. The state of the art of data science and engineering in structural health monitoring. Engineering 2019, 5, 234–242. [Google Scholar] [CrossRef]
  3. Liu, Z.; Liu, P.; Zhou, C.; Huang, Y.; Zhang, L. Structural Health Monitoring of Underground Structures in Reclamation Area Using Fiber Bragg Grating Sensors. Sensors 2019, 19, 2849. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Li, H.; Xie, X.; Zhang, Y.; Wang, Q. Theoretical, Numerical, and Experimental Study on the Identification of Subway Tunnel Structural Damage Based on the Moving Train Dynamic Response. Sensors 2021, 21, 7197. [Google Scholar] [CrossRef]
  5. Xie, X.; Zhang, D.; Huang, H. Data Analysis of Shield Tunnel Deformation from Real-Time Monitoring with Wireless Sensing Network. In Geoshanghai International Conference; Springer: Singapore, 2018; pp. 392–401. [Google Scholar]
  6. Yang, Y.; Yau, J. Vehicle-Bridge Interaction Element for Dynamic Analysis. J. Struct. Eng. 1997, 123, 1512–1518. [Google Scholar] [CrossRef]
  7. Yang, Y.B.; Chen, W.F. Extraction of Bridge Frequencies from a Moving Test Vehicle by Stochastic Subspace Identification. J. Bridge Eng. 2016, 21, 04015053. [Google Scholar] [CrossRef]
  8. Yang, Y.; Peng, Z.; Zhang, W.; Meng, G. Parameterised time-frequency analysis methods and their engineering applications: A review of recent advances. Mech. Syst. Signal Pr. 2019, 119, 182–221. [Google Scholar] [CrossRef]
  9. Yeong-bin, Y.; Zhi-lu, W.; Kang, S.; Hao, X. Research Progress on Bridge Indirect Measurement and Monitoring from Moving Vehicle Response. China J. Highw. Transp. 2021, 34, 1–12. [Google Scholar]
  10. Berggren, E. Railway Track Stiffness: Dynamic Measurements and Evaluation for Efficient Maintenance. Ph.D. Thesis, KTH Royal Institute of Technology, Stockholm, Sweden, 2009. [Google Scholar]
  11. Quirke, P.; Cantero, D.; OBrien, E.J.; Bowe, C. Drive-by detection of railway track stiffness variation using in-service vehicles. Proc. Inst. Mech. Engineers. Part F J. Rail Rapid Transit 2017, 231, 498–514. [Google Scholar] [CrossRef] [Green Version]
  12. Kratochwille, R. ICE-S Vehicle reaction measurement and track geometry measurement on the same measuring train Results of the comparison of the two different track inspection methods. In Proceedings of the IMechE Stephenson Conference for Railways, London, UK, 21-23 April 2015; p. C1408/068. [Google Scholar]
  13. Zhang, Y.L.; Xie, X.Y.; Li, H.Q.; Zhou, B. Tunnel damage identification method based on relative entropy of wavelet packet energy: An experimental verification. IOP Conf. Ser. Earth Environ. Sci. 2020, 570, 032034. [Google Scholar] [CrossRef]
  14. Azimi, M.; Eslamlou, A.D.; Pekcan, G. Data-driven structural health monitoring and damage detection through deep learning: State-of-the-art review. Sensors 2020, 20, 2778. [Google Scholar] [CrossRef] [PubMed]
  15. Zhao, R.; Yan, R.; Chen, Z.; Mao, K.; Wang, P.; Gao, R.X. Deep learning and its applications to machine health monitoring. Mech. Syst. Signal Pr. 2019, 115, 213–237. [Google Scholar] [CrossRef]
  16. Salehi, H.; Burgueño, R. Emerging artificial intelligence methods in structural engineering. Eng. Struct. 2018, 171, 170–189. [Google Scholar] [CrossRef]
  17. Cha, Y.J.; Choi, W.; Suh, G.; Mahmoudkhani, S.; Büyüköztürk, O. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Comput. Aided Civ. Infrastruct. Eng. 2018, 33, 731–747. [Google Scholar] [CrossRef]
  18. Hung, D.V.; Hung, H.M.; Anh, P.H.; Thang, N.T. Structural damage detection using hybrid deep learning algorithm. J. Sci. Technol. Civ. Eng. STCE-NUCE 2020, 14, 53–64. [Google Scholar] [CrossRef] [Green Version]
  19. Atha, D.J.; Jahanshahi, M.R. Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection. Struct. Health Monit. 2018, 17, 1110–1128. [Google Scholar] [CrossRef]
  20. Sony, S.; Gamage, S.; Sadhu, A.; Samarabandu, J. Vibration-Based Multiclass Damage Detection and Localization Using Long Short-Term Memory Networks. In Structures; Elsevier: Amsterdam, The Netherlands, 2022; Volume 35, pp. 436–451. [Google Scholar]
  21. Chen, C.; Seo, H.; Zhao, Y. A novel pavement transverse cracks detection model using WT-CNN and STFT-CNN for smartphone data analysis. Int. J. Pavement Eng. 2021, 1–13. [Google Scholar] [CrossRef]
  22. Chalapathy, R.; Menon, A.K.; Chawla, S. Robust, deep and inductive anomaly detection. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases; Springer: Cham, Switzerland, 2017; pp. 36–51. [Google Scholar]
  23. Ma, X.; Lin, Y.; Nie, Z.; Ma, H. Structural damage identification based on unsupervised feature-extraction via Variational Auto-encoder. Measurement 2020, 160, 107811. [Google Scholar] [CrossRef]
  24. Lee, K.; Jeong, S.; Sim, S.; Shin, D.H. Field experiment on a PSC-I bridge for convolutional autoencoder-based damage detection. Struct. Health Monit. 2021, 20, 1627–1643. [Google Scholar] [CrossRef]
  25. Wang, Z.; Cha, Y. Automated damage-sensitive feature extraction using unsupervised convolutional neural networks. In Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems; International Society for Optics and Photonics: Denver, CO, USA, 2018; p. 105981J. [Google Scholar]
  26. Cha, Y.; Wang, Z. Unsupervised novelty detection–based structural damage localization using a density peaks-based fast clustering algorithm. Struct. Health Monit. 2018, 17, 313–324. [Google Scholar] [CrossRef]
  27. Wang, Z.; Cha, Y. Unsupervised deep learning approach using a deep auto-encoder with a one-class support vector machine to detect damage. Struct. Health Monit. 2021, 20, 406–425. [Google Scholar] [CrossRef]
  28. Kingma, D.P.; Welling, M. Auto-encoding variational bayes. arXiv 2013, arXiv:1312.6114. [Google Scholar]
  29. Xu, H.; Chen, W.; Zhao, N.; Li, Z.; Bu, J.; Li, Z.; Liu, Y.; Zhao, Y.; Pei, D.; Feng, Y. Unsupervised anomaly detection via variational auto-encoder for seasonal kpis in web applications. In Proceedings of the 2018 World Wide Web Conference, Geneva, Switzerland, 23–27 April 2018; pp. 187–196. [Google Scholar]
  30. Jia, H.; Zhang, Z.; Liu, H.; Dai, F.; Liu, Y.; Leng, J. An approach based on expectation-maximization algorithm for parameter estimation of Lamb wave signals. Mech. Syst. Signal Pr. 2019, 120, 341–355. [Google Scholar] [CrossRef]
Figure 1. The proposed tunnel damage detection method.
Figure 1. The proposed tunnel damage detection method.
Sensors 22 02412 g001
Figure 2. Framework of the proposed tunnel damage detection method.
Figure 2. Framework of the proposed tunnel damage detection method.
Sensors 22 02412 g002
Figure 3. Architecture of CVAE model.
Figure 3. Architecture of CVAE model.
Sensors 22 02412 g003
Figure 4. The model and the test system in the laboratory.
Figure 4. The model and the test system in the laboratory.
Sensors 22 02412 g004
Figure 5. The shape and placement of the voids: (a) 3D-printed void, (b) void size and position.
Figure 5. The shape and placement of the voids: (a) 3D-printed void, (b) void size and position.
Sensors 22 02412 g005
Figure 6. Damage Setup.
Figure 6. Damage Setup.
Sensors 22 02412 g006
Figure 7. Original signal of the vehicle in modelling test.
Figure 7. Original signal of the vehicle in modelling test.
Sensors 22 02412 g007
Figure 8. Wavelet packet energy spectrum.
Figure 8. Wavelet packet energy spectrum.
Sensors 22 02412 g008
Figure 9. Void identification using CVAE.
Figure 9. Void identification using CVAE.
Sensors 22 02412 g009
Figure 10. Identify void position using TDIWPE taking sample-A as an example.
Figure 10. Identify void position using TDIWPE taking sample-A as an example.
Sensors 22 02412 g010
Figure 11. Synthetic WGN of different power.
Figure 11. Synthetic WGN of different power.
Sensors 22 02412 g011
Table 1. Key physical parameters of the model.
Table 1. Key physical parameters of the model.
ComponentsParametersValue
SandDepth (m)0.9
Density ( kg · m 3 )1510
TunnelExternal diameter (m)0.3
Length (m)3
Depth of tunnel (m)0.2
Ring width (m)0.1
Lining thickness (m)0.01
Density of photosensitive resin ( kg · m 3 )1150
Tensile modulus (MPa)2779
Poisson’s ratio0.42
SandboxLength × width × height (m)3 × 1.5 × 1
Polystyrene foam boardThickness (m)0.25
VehicleLength × width × height (m)0.3 × 0.15 × 0.12
Speed ( m · s 1 )0.9
Weight (kg)5.08
TrackLength × width × height (m)3 × 0.004 × 0.004
SensorLength × width × height (m)0.04 × 0.04 × 0.05
Measuring range (g)2
Sampling frequency (Hz)4000
Weight (kg)0.136
Resolution (μg)0.2
Table 2. Test conditions.
Table 2. Test conditions.
Case 01234
Void/cm3-166.4331.7447566
Table 3. Datasets partition.
Table 3. Datasets partition.
Datasets ConditionCaseNumber of Testing Sets
TrainingHealthy01280
ValidationHealthy0320
TestHealthy0400
Voids1100
Voids2100
Voids3100
Voids4100
Table 4. Parameters of CVAE.
Table 4. Parameters of CVAE.
BlocksLayersParametersOutput
EncoderInput1@18 × 961@18 × 96
Conv2D32@3 × 332@18 × 96
Conv2D32@3 × 332@18 × 96
MaxPooling3 × 33 × 3
Conv2D16@3 × 316@6 × 32
Parameter
resampling
σ (Conv2D)4@3 × 34@6 × 32
μ (Conv2D)4@3 × 34@6 × 32
Hidden = μ + σ × εσε = 0.01σε = 0.01
DecoderConv2D16@3 × 316@6 × 32
UpSampling3 × 33 × 3
Conv2D4@3 × 34@18 × 96
Conv2D4@3 × 34@18 × 96
Output (Conv2D)1@3 × 31@18 × 96
RegularizationL2 (1 × 10−6)
OptimizerNadam
Batchs24
Epochs150
Table 5. The confusion matrix.
Table 5. The confusion matrix.
Sample NumberPrediction
NormalVoid
Ground truthNormalTrue normal (TN)False hit (FH)
VoidFalse normal (FN)True hit (TH)
Table 6. Testing accuracy of different methods (%).
Table 6. Testing accuracy of different methods (%).
Data Decomposition
Methods in Preprocessing
Machine
Learning Methods
Recall RateHit RateAccuracy
WPDCVAE96.2586.7591.5
VMDCVAE92.7584.2589
CVAE88.7581.585.13
WPDVAE90.582.2586.38
WPDCAE85.2580.7583
WPDK-means7878.7578.38
WPDGMM82.2579.580.88
Table 7. Performance comparison under different noise power (%).
Table 7. Performance comparison under different noise power (%).
Noise Power (dBW)WPD-CVAEVMD-CVAE
Recall RateHit RateAccuracyRecall RateHit RateAccuracy
095.7584.590.1391.58387.25
1095.2583.2589.2590.7581.7586.25
2093.7582.7588.2589.580.585
3092.258287.138879.2583.63
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zhang, Y.; Xie, X.; Li, H.; Zhou, B. An Unsupervised Tunnel Damage Identification Method Based on Convolutional Variational Auto-Encoder and Wavelet Packet Analysis. Sensors 2022, 22, 2412. https://doi.org/10.3390/s22062412

AMA Style

Zhang Y, Xie X, Li H, Zhou B. An Unsupervised Tunnel Damage Identification Method Based on Convolutional Variational Auto-Encoder and Wavelet Packet Analysis. Sensors. 2022; 22(6):2412. https://doi.org/10.3390/s22062412

Chicago/Turabian Style

Zhang, Yonglai, Xiongyao Xie, Hongqiao Li, and Biao Zhou. 2022. "An Unsupervised Tunnel Damage Identification Method Based on Convolutional Variational Auto-Encoder and Wavelet Packet Analysis" Sensors 22, no. 6: 2412. https://doi.org/10.3390/s22062412

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop