Next Article in Journal
Detection of Salmonella Enterica in Egg Yolk by PCR on a Microfluidic Disc Device Using Immunomagnetic Beads
Next Article in Special Issue
Corrosion-Induced Mass Loss Measurement under Strain Conditions through Gr/AgNW-Based, Fe-C Coated LPFG Sensors
Previous Article in Journal
Development of a Resonant Microwave Sensor for Sediment Density Characterization
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Data-Driven Damage Identification Framework Based on Transmissibility Function Datasets and One-Dimensional Convolutional Neural Networks: Verification on a Structural Health Monitoring Benchmark Structure

1
Department of Engineering Mechanics, Hohai University, Nanjing 210098, China
2
School of Aeronautics and Astronautics, Faculty of Vehicle Engineering and Mechanics, State Key Laboratory of Structural Analysis for Industrial Equipment, Dalian University of Technology, Dalian 116024, China
3
Department of Civil and Environmental Engineering, Northwestern University, Chicago, IL 60626, USA
4
Center for Nonlinear Systems, Kaunas University of Technology, Studentu 50-146, LT-51368 Kaunas, Lithuania
5
Institute of Fluid-Flow Machinery, Polish Academy of Sciences, 80-231 Gdansk, Poland
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(4), 1059; https://doi.org/10.3390/s20041059
Submission received: 13 January 2020 / Revised: 8 February 2020 / Accepted: 13 February 2020 / Published: 15 February 2020
(This article belongs to the Special Issue Innovative Sensors for Civil Infrastructure Condition Assessment)

Abstract

:
Vibration-based data-driven structural damage identification methods have gained large popularity because of their independence of high-fidelity models of target systems. However, the effectiveness of existing methods is constrained by critical shortcomings. For example, the measured vibration responses may contain insufficient damage-sensitive features and suffer from high instability under the interference of random excitations. Moreover, the capability of conventional intelligent algorithms in damage feature extraction and noise influence suppression is limited. To address the above issues, a novel damage identification framework was established in this study by integrating massive datasets constructed by structural transmissibility functions (TFs) and a deep learning strategy based on one-dimensional convolutional neural networks (1D CNNs). The effectiveness and efficiency of the TF-1D CNN framework were verified using an American Society of Civil Engineers (ASCE) structural health monitoring benchmark structure, from which dynamic responses were captured, subject to white noise random excitations and a number of different damage scenarios. The damage identification accuracy of the framework was examined and compared with others by using different dataset types and intelligent algorithms. Specifically, compared with time series (TS) and fast Fourier transform (FFT)-based frequency-domain signals, the TF signals exhibited more significant damage-sensitive features and stronger stability under excitation interference. The utilization of 1D CNN, on the other hand, exhibited some unique advantages over other machine learning algorithms (e.g., traditional artificial neural networks (ANNs)), particularly in aspects of computation efficiency, generalization ability, and noise immunity when treating massive, high-dimensional datasets. The developed TF-1D CNN damage identification framework was demonstrated to have practical value in future applications.

1. Introduction

As an important topic in the field of structural health monitoring, vibration-based data-driven structural damage identification has been attracting increasing research interest in recent years [1,2,3,4,5]. Typically, the implementation of data-driven methods relies on surrogate models, rather than high-fidelity models, constructed based only on output responses obtained by different types of sensor array [6,7,8]. Thus, the major drawbacks of traditional model-based methods, in particular their data acquisition processes that are often computationally prohibitive, can be effectively prevented by using data-driven methods, the application of which is particularly suitable for online health monitoring under structural operational states. Along with the rapid developments in sensor technology and computational capacity, two key aspects are deemed crucial for data-driven damage identification methods: massive datasets consisting of structural dynamic responses associated with damage information and intelligent algorithms that can perform accurate and efficient extraction of damage features.
A number of intelligent algorithms, such as the Bayesian method [9], genetic algorithms (GAs) [10], k-nearest neighbor (kNN) [11], support vector machines (SVMs) [12,13,14,15,16], and artificial neural networks (ANNs) [17,18,19,20,21,22,23], have been used in structural damage detection. Benefiting from the rapid developments in artificial intelligence theory and computer technology, the concept of deep learning shows paramount importance in engineering applications [24]. The convolution neural network (CNN), one of the most widespread deep learning models, has been demonstrated as a promising tool for identifying structural damage [25,26,27,28,29]. Compared with other machine learning methods, CNN, with its sparse connection and weight sharing features, has unique advantages in aspects of computation efficiency, generalization ability, and noise immunity, particularly in the processing of massive, high-dimensional datasets. In recent years, one-dimensional convolutional neural networks (1D CNNs) were adopted by many scholars for damage identification. Ince et al. [30] proposed a 1D CNN-based early fault detection system for motor condition monitoring. Zhang et al. [31] proposed a fault diagnosis model based on 1D CNN, using wide kernels in the first convolutional layer to extract features and suppress high frequency noise. That method was tested in a motor driving mechanical system and compared with another method based on a deep neural network (DNN). Abdeljaber and Avci et al. [32,33] used 1D CNNs to automatically extract damage-sensitive features in acceleration signals measured from the Qatar University Grandstand Simulator to achieve real-time damage detection. Abdeljaber et al. [34] proposed an enhanced CNN-based approach that requires a reduced amount of measurement sets subject only to undamaged or fully damaged cases. The method was verified using experimental data from the American Society of Civil Engineers (ASCE) structural health monitoring benchmark structure.
Compared with extensive investigations concentrating on intelligent algorithms, relatively limited studies have focused on data selection and comparisons for data-driven damage identification methods. The time series (TS) is a typical data type adopted by deep learning algorithms. However, TSs contain highly redundant information, distributed over a wide frequency range, but with insufficient signal features directly associated with structural damage. Frequency-domain responses obtained normally by conducting fast Fourier transform (FFT) belong to another category of commonly used signals that contain typical vibration characteristics. However, the damage sensitivity of FFT-based signals is still limited, particularly when dealing with minor damage. Furthermore, a crucial drawback of both the TS and FFT-based signals is their high instability under interference from excitations, mostly of a random nature. In common engineering, practice excitations are extremely difficult to control well, so the interference on both TS and FFT-based signals from the excitations is severe and unavoidable, whereby the damage-related information contained in the signals is severely submerged.
Compared with traditional TS and FFT data, transmissibility functions (TFs) contain significant damage-sensitive features and are inherently independent of excitation interference. Devriendt et al. [35,36,37,38] proposed several methods for modal parameter identification using TFs. Johnson et al. [39] discussed the validity of TFs in detecting, locating, and quantifying damage in linear and nonlinear structures. Kong et al. [40] constructed damage indices based on the transmissibility characteristics of a vehicle-bridge coupled (VBC) system. Caccese et al. [41] verified the sensitivity of TFs in detecting bolt loosening in experiments. Zhu et al. [42] developed a spring-mass damping model with multiple degrees of freedom for performing damage sensitivity analysis based on TF signals. Feng et al. [43] verified the feasibility and sensitivity of TFs in damage detection in subway tunnels using numerical simulation. Zhou et al. [44] combined TFs with correlation analysis and conducted damage detection in cantilever beam and ASCE benchmark structures.
While both exhibit potential advantages in structural health monitoring, the TF data and CNN model have rarely been integrated in damage identification tasks. To address this drawback, this study presents a novel damage identification framework, wherein massive datasets consisting of a large number of TF signals are constructed and used as inputs to a 1D CNN model designed to extract signal features in an adaptive and efficient manner. Relying on the TF-1D CNN framework, structural damage in an ASCE benchmark structure are identified with satisfactory accuracy and noise immunity.
The rest of this paper is organized as follows. Section 2 introduces the fundamental theories of TFs and the 1D CNN; Section 3 describes the establishment process of the TF-1D CNN structural damage identification framework, including the construction of massive TF datasets and the design of the structure of the 1D CNN model; Section 4 introduces the implementation of the TF-1D CNN framework in damage identification in an ASCE structural health monitoring benchmark structure; Section 5 presents a comparison study related to the examination of damage detection accuracy under combinations of different data types and intelligent algorithms. Some important conclusions are drawn in Section 6.

2. Fundamental Theories

2.1. One-Dimensional Convolutional Neural Networks (1D CNNs): Convolution and Pooling

In general, CNNs include convolutional (CONV) layers, pooling layers, and fully connected layers, where the CONV layers conduct convolution operations to the input data to extract feature maps; the pooling layers down-sample the feature maps to highlight the extracted features while achieving data dimensionality reduction and the extracted features are then classified by the fully connected layers.
The CONV layers, including a set of filters (kernels) with learnable weights, undertake the major computational task in CNNs. The filters and inputs have the same depth. Specifically, in a 1D CONV layer, the forward propagation (FP) can be expressed by:
g i = f [ n = 1 N c o n v 1 D ( w i , n   , a n ) + b i ] ,
where g i is the calculation result of the ith filter; a is the input data of size 1 × N a × N ;   w i is the weight matrix of the ith filter, the size of which is 1 × N w × N ; b i and f are the bias of the ith filter and the activation function, respectively.
The pooling layers down-sample the feature maps extracted by the CONV layers, where Max pooling is the commonly used strategy, expressed as:
p i ( j ) = m a x ( j 1 ) × m < k j × m ( a i ( k ) )
where a i ( k ) is the kth element of the ith feature map input into the pooling layer and p i ( j ) is the jth element of the ith feature map output by the pooling layer. The size of the pooling layer filter is 1 × m .
The fully connected layers then classify the feature maps extracted by the CONV and the pooling layers to obtain the original output data, which is then normalized using the SoftMax function to calculate the probability distribution of the input samples located in different categories. The SoftMax function is defined as:
p k = e ( x k ) e ( j = 1 N e ( x j ) ) ,
where p k is the probability of the input sample within the kth classification and x is the original output data.

2.2. Transmissibility Function (TF)

A TF is defined as the ratio of two sets of dynamic responses in the frequency domain:
T i j ( ω ) = X i ( ω ) X j ( ω )   ,
where T i j ( ω ) is the TF and X i ( ω ) and X j ( ω ) are the Fourier transforms of the dynamic responses at the ith and jth degree of freedom (DOF), respectively.
For a linear dynamic system, the frequency response, X ( ω ) , can be expressed as
X ( ω ) = H ( ω ) F ( ω ) ,
where
H ( ω ) = ( K ω 2 M + i ω C ) 1 .
In the above equation, F ( ω ) is the excitation; H ( ω ) is the frequency response function (FRF) matrix; and K, M, and C are the stiffness, mass, and damping matrices of the system.
In particular, subject to a single excitation or multiple uncorrelated random excitations at the same spectral density level, a TF can be estimated as [45,46]:
T i j = G i j G j j = h ¯ j * h ¯ i h ¯ j * h ¯ j ,
where G i j is the cross-spectral density of the responses at DOF i and j; G j j is the auto-spectral density of the response at DOF j; h ¯ is the reduced row entries of the FRF matrix, H, corresponding to the DOFs where the excitations are located; (*) represents the complex conjugate transpose. From Equation (7), it can be deduced that a TF can be represented as a function of the FRF matrix, which contains rich information about structural dynamic characteristics, but without any involvement of the influence of excitation.

3. Construction of the TF-1D CNN Damage Identification Framework

The damage identification framework in the present study was established by integrating the advantages of both TF datasets and CNN algorithms. Relying on a great number of structural dynamic response measurements, a massive TF dataset could be constructed as the input to a 1D CNN model, the structure of which was sophisticatedly designed to perform adaptive damage feature extractions and noise suppression.

3.1. Construction of Massive TF Datasets

Dynamic responses are extracted from a target structure and then categorized into reference and non-reference responses. The TFs are then calculated using the reference and non-reference pairs. In the present study, dynamic responses in both x and y directions were extracted from the structure (according to a given coordinate system). Assuming there were 2n non-reference dynamic responses and two reference responses, the TFs were then constructed as
{ T x i R = G ( a x i , R x ) G ( R x , R x ) T y i R = G ( a y i , R y ) G ( R y , R y ) ,   i = 1 , 2 , , n ,
where T x i R and T y i R are the TFs; R x and R y are the reference responses; a x i and a y i are the non-reference responses; G ( a x i , R x ) and G ( a y i , R y ) represent the cross-spectral density between the reference and non-reference responses; and G ( R x , R x ) and G ( R y , R y ) are the auto-spectral density of the reference responses.

3.2. Construction of the 1D CNN Model

The 1D CNN model was constructed to include two CONV layers, two max pooling layers, and two fully connected layers, as shown in Figure 1. The CONV layers 1 and 2 included 32 and 64 filters, respectively, with the filter size of 1 × 5 × N (where the filter depth, N, is equal to that of the input of the layer). The size of the filters in the pooling layers was 1 × 5 . A total of 1024 neurons were included in the first layer of the fully connected layers. Rectified Linear Unit (ReLU) was adopted as the activation function in CONV layers 1, 2, and fully connected layer 1, expressed as:
f ( x ) = m a x ( 0 , x ) .
As stated, the second layer of the fully connected layers consisted of the original outputs of the 1D CNN.
As an illustration, Figure 2 presents the constructed damage identification framework based on the responses of a target structure. The TFs were constructed as the functions of non-reference and reference signals along the x and y directions (as introduced in Section 3.1) and were then treated as the inputs of the 1D CNN model, on which basis a damage pattern recognition process was realized. In real applications, a massive amount of TF data must be collected to represent the dynamic characteristics of engineering structures (normally with complex geometric and physical properties) and, on the other hand, to provide sufficiently large datasets for the training of deep learning models. Therefore, a massive dataset, including a large number of structural dynamic responses, was constructed under various combinations of excitations and damage scenarios, as introduced in the following sections.

4. Damage Identification in the ASCE Benchmark Structure

4.1. Numerical Model

The ASCE structural health monitoring benchmark structure (Figure 3) [47] is a four-story frame structure at 3.6 m in height and 2.5 m in both length and width. Each layer of the structure consists of 9 columns, 8 braces, and 1 floor panel, including 4 slabs and 12 floor beams. The weights of individual slabs of the first (bottom) to the fourth (top) floor panel are 800, 600, 600, and 400 kg, respectively. The 120-DOF finite element (FE) model of the structure was used in this paper, as shown in Figure 4a. Note that equal horizontal displacements and rotations (referring to the z axis) are associated with the FE nodes in the same layer. Structural damage was introduced in terms of stiffness reduction of the braces of the structure. The excitation consists of two concentrated forces along the x and y directions, respectively, exerted simultaneously on the first floor, located at the positions as shown in Figure 4b. The excitations are in terms of white Gaussian noise, where the magnitude variations of the two concentrated forces are uncorrelated. In the following study, the durations of all excitations were 10 s, with a power and sampling frequency of 30 dbw and 1000 Hz, respectively.

4.2. Dynamic Response Analysis

With the aim of examining the sensitivity and stability of different dynamic response types, two simple damage scenarios were first introduced into the structure, where scenarios 1 and 2 correspond to a 10% stiffness reduction of braces A and B in the ASCE benchmark structure, respectively, as presented in Figure 4a. Two different Gaussian white noise excitations (denoted as excitation 1 and 2), with specific parameters as introduced in Section 4.1, were applied on the structure. Dynamic accelerations in the forms of TS and FFT-based signals were captured from point a, as marked in Figure 4a. TFs were constructed based on the acceleration responses captured at both a and b, in accordance with Equation (8), where the signal at b is treated as the reference response.
Under a given excitation (i.e., excitation 1), three types of signals corresponding to different damage scenarios are presented in Figure 5. The variations in TS and FFT-based signals subject to different damage scenarios are barely recognizable, as shown in Figure 5a,b, respectively. More specifically, the TS signals contain a large amount of data under the current sampling frequency. However, the information included in the signals is considered redundant and poorly relevant to damage features. On the other hand, the FFT-based signals can reflect typical dynamic characteristics of the structure, such as natural frequencies, as indicated by the peak values in Figure 5b. However, the damage-associated features contained in the signals are still difficult to identify. In contrast, apparently high sensitivity to damage can be observed in the TF signals, as shown in Figure 5c, where both magnitudes and phases of the TF signals exhibit distinct variations under different damage scenarios.
Signal stability was then examined under different excitations with the same damage scenario, i.e., damage scenario 1. From Figure 6a,b, it is observed that both TS and FFT-based signals show severe instability subject to excitation variations. It should be realized that, in real applications, stochastic excitation is usually unavoidable due to environmental factors, implying that the signal instabilities of the TS and FFT-based signals under random excitations are difficult to prevent. The TF signals, on the other hand, possess inherent independence and thus outstanding stability, subject to the excitation influence, which can be clearly observed from the minimal signal disturbance, as shown in Figure 6c. Such a feature is considered to have important merit that makes TFs ideal signal types for damage identification in practical applications.
To further examine the sensitivity of the TF signals to structural damage, a series of TF signals were calculated under a given excitation, subject to different degrees of damage severity, by introducing stiffness reductions in brace A and B, respectively, ranging from 5% to 50%, with an interval of 5%. The calculated TF signals are presented in Figure 7a,b, corresponding to damage in brace A and B, respectively. Approximately linear increases in the TF magnitude, along with the increase of the degree of stiffness reduction, can be seen in Figure 7. These observations demonstrate the capacity of TF signals to identify and differentiate structural damage over a wide range of severity degrees.

4.3. Damage Identification Using the TF-1D CNN Framework

In the subsequent study, a number of damage scenarios were identified by using the established TF-1D CNN framework. The damage scenarios were introduced into the benchmark structure in terms of 10% stiffness reduction of a single brace. Because there were 32 braces in this structure, a total of 32 damage scenarios and one non-damage scenario were taken into account. Considering the symmetry of the structure, damage associated with the braces on the same side of the same layer, such as that marked in red on the first layer shown in Figure 8, was considered equivalent.
Acceleration responses were extracted from the structure, where two reference responses were extracted at the midpoint of the top floor along the x and y directions, respectively, as shown in Figure 9a. The non-reference responses were extracted at four points on each floor, at the positions shown in Figure 9b. The non-reference and reference responses along the same (x or y) direction were used to calculate the TF signals. Therefore, 16 TF signals could be constructed under a given excitation.
To construct a massive TF dataset, one hundred sets of white Gaussian noise excitations were applied on the structure. Each set of excitations was applied in all the 32 damage scenarios and the non-damage scenario. Acceleration dynamic responses were extracted from the structure. In total, 3300 data samples were generated by combinations of the 100 excitations and 33 damage (non-damage) scenarios. It can be calculated that each sample included 2 reference responses and 16 non-reference responses, on which basis 16 TF signals could be calculated. The total number of TF signals was 52,800, included in the 3300 samples to be used in subsequent analysis. Because the damage in two braces on the same side of a given layer was equivalent, as already explained, only 16 damage scenarios and the non-damage scenario were labeled. Moreover, 50% of the data in the dataset was used as the training set for the 1D CNN model and the other 50% was used as the testing set to examine the accuracy of the model.
Next, the 1D CNN model was trained and tested using the constructed TF dataset. The accuracy of damage identification as examined using the test set was calculated to be 100%. One of the key reasons for the high accuracy of damage identification was that the 1D CNN model could perform adaptive extraction of the features in the TF signals that characterized structural damage. The output layer (fully connected layer 2) played the role of a classifier, and thus the feature vector (defined as Y) obtained from fully connected layer 1 was regarded as the extracted feature from the TFs by the 1D CNN model. Y was then by treated by t-Distributed Stochastic Neighbor Embedding (t-SNE) technology, which visualizes high-dimensional data by giving each datapoint a location in a two- or three-dimensional map [48]. The visualization results are shown in Figure 10, where each color represents a damage (or non-damage) scenario. It can be seen that the features extracted from TFs by using 1D CNN show a significant tendency to cluster and can be easily distinguished to be associated accurately with their corresponding structural health states. It can be concluded from the visualization results that significant damage-associated features were included in the TF signals and, on the other hand, the 1D CNN is capable of extracting damage features contained in a TF signal with high accuracy and efficiency.

4.4. Noise Effect Analysis

To verify the robustness of the TF-1D CNN method under the influence of noise, different noise levels were added to the acceleration responses in the test set. The noisy TFs were then input into the 1D CNN model to examine the accuracy of damage identification. The noise level was estimated according to the signal-to-noise ratio (SNR), defined by the formula:
SNR ( dB ) = 20 log 10 A s i g n a l A n o i s e ,
where A s i g n a l and A n o i s e are the root mean squares of clean acceleration response and noise, respectively. In accordance with Equation (10), it should be noted that smaller SNR values correspond to larger noise levels. The noise immunity was tested using eight SNR levels equal to 10, 15, 20, 25, 30, 35, 40, and 50 dB, respectively. The accuracy of damage identification under different noise levels is presented in Table 1. Similarly, the feature vectors extracted by 1D CNN from data containing different noise levels were visualized by applying the t-SNE technique, as shown in Figure 11. It can be seen that with SNR exceeding 35 dB, the features extracted from the noisy data are well clustered and can be distinguished to indicate corresponding structural health states correctly. Under a SNR of 30 dB, a small number of features are classified in incorrect categories, implying the occurrence of possibly false alarms of the damage scenarios. Under SNRs equal to 25 and 20 dB, the difficulty in distinguishing categories of samples increases. However, the identification accuracy shows satisfactory stability under different noise levels and exhibits strong resistance to the influence of a large level of noise influence. Further analysis is provided in the comparison study shown subsequently.

5. Comparison Study

5.1. Comparison of TS- and FFT-Based 1D CNN Methods

To compare the performance of different response types in damage identification, TS- and FFT-based responses were captured from the structure at the positions where the non-reference responses for the TF signals were captured. Thus, both TS and FFT datasets, including a great number of signals, could be obtained and treated as inputs of the constructed 1D CNN model. Under a noise-free environment, the damage recognition accuracy of the TS-1D CNN and FFT-1D CNN frameworks were 11.33% and 45.70%, respectively. The t-SNE [48] technique was used to visualize the feature extraction results, as shown in Figure 12.
Subject to different noise levels, the damage identification accuracy of the TS-1D CNN and FFT-1D CNN frameworks are shown in Table 2. The results were visualized as shown in Figure 13 and Figure 14, respectively.
By referring to the damage identification results based on the TF-1D CCN framework, as shown in Section 4, the TS- and FFT-1D CNN frameworks were not able to produce comparative accuracy in damage identification, with or without the influence of noise. This finding could be attributed to the low damage sensitivity and high vulnerability to excitation interference of both the TS and FFT signals. From the presented results, the unique advantages of the TF signals in damage identification can be clearly seen.

5.2. Comparison with the TF-ANN Method

Subsequently, comparisons of different intelligent algorithms in damage identification were conducted. A traditional three-layer ANN was constructed as a counterpart to the 1D CNN model to conduct damage identification based on the TF datasets, defined as the TF-ANN framework. In detail, note that each TF signal was a one-dimensional vector with the length of 1000 and the 16 TF signals in each sample were connected end to end to constitute a one-dimensional vector (with the length of 16,000) used as the input data of the ANN. The hidden layer of the ANN was composed of 1024 neurons and the output layer was the same as that of the 1D CNN, where a one-dimensional vector was used to label different damage scenarios.
The damage identification accuracy of the TF-1D CNN and TF-ANN frameworks, both under noisy environments, were compared, as presented in Table 3. It can be seen that the 1D CNN had clearly stronger accuracy and robustness in damage identification than the traditional ANN. More specifically, under conditions with relatively low levels of noise interference, the accuracy of the TF-ANN was considered high and stable, though the TF-1D CNN exhibits even higher accuracy in feature extraction. With the increase in the noise level, particularly under a SNR smaller than 35 dB, the accuracy of both the CNN and ANN decreased. However, the accuracy of the ANN decreased in a much more drastic way that could easily lead to the failure of damage identification. On the other hand, 1D CNN well maintained its high accuracy of damage recognition well, with satisfactory immunity to noise influence, until a significantly large noise level was encountered.

6. Conclusions

A vibration-based data-driven structural damage identification framework was established by integrating massive datasets composed of TFs and a 1D CNN model. By performing damage identification tasks in the ASCE structural health monitoring benchmark structure, the effectiveness and efficiency of the proposed method was demonstrated. The strong capacity of the method in damage identification is attributed mainly to the following.
Compared with traditional TS and FFT-based data, the TF data contains more significant damage-associated features, and, more importantly, the TF data shows inherent independence from the influence of excitation, giving rise to high stability of the method in damage identification, especially under random excitation conditions. That advantage can be clearly observed from the comparison results obtained based on the TF-, TS- and FFT-1D CNN frameworks.
The 1D CNN model is capable of extracting damage features in massive TF datasets in an adaptive manner, with high efficiency and strong noise immunity. Compared with the traditional ANN, the 1D CNN is able to learn more robust signal features and possesses stronger generalization ability. This conclusion is supported by the comparison results based on the TF-1D CNN and TF-ANN frameworks.
A future study would be valuable to validate the reliability of the proposed damage identification framework by considering various factors, for example, more complex structural forms, the impact of the number and locations of the captured dynamic responses, and possible improvement of the 1D CNN model for enhanced feature extraction and noise suppression. In particular, intelligent optimization methods, such as Bayesian optimization, could be used in hyperparameter selection for the 1D CNN model to achieve further improved damage identification results. Further, more comprehensive comparison studies considering other types of feature- or Artificial Intelligence (AI)-based methods can be conducted in future work.

Author Contributions

Conceptualization, M.R., M.C., and W.O.; methodology, T.L., H.X., and M.C.; software, T.L.; validation, M.R. and W.O.; formal analysis, H.X. and M.R.; investigation, T.L. and H.X.; resources, M.C.; data curation, T.L.; writing—original draft preparation, T.L. and H.X.; writing—review and editing, H.X. and M.C.; visualization, H.X. and W.O.; supervision, M.R.; project administration, M.C. and W.O.; funding acquisition, M.C. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Key R&D Program of China (2018YFF0214700) and the Transportation Science Research Project of Jiangsu Province (No.2019Z02).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Schwabacher, M. A survey of data-driven prognostics. In Proceedings of the Infotech@ Aerospace Conferences, Arlington, Virginia, 26–29 September 2005; p. 7002. [Google Scholar] [CrossRef] [Green Version]
  2. Cavadas, F.; Smith, I.F.; Figueiras, J. Damage detection using data-driven methods applied to moving-load responses. Mech. Syst. Sig. Process. 2013, 39, 409–425. [Google Scholar] [CrossRef] [Green Version]
  3. Worden, K.; Manson, G. The application of machine learning to structural health monitoring. Philos. Trans. R. Soc. A 2006, 365, 515–537. [Google Scholar] [CrossRef] [PubMed]
  4. Tibaduiza, D.-A.; Torres-Arredondo, M.-A.; Mujica, L.; Rodellar, J.; Fritzen, C.-P. A study of two unsupervised data driven statistical methodologies for detecting and classifying damages in structural health monitoring. Mech. Syst. Sig. Process. 2013, 41, 467–484. [Google Scholar] [CrossRef]
  5. Bodeux, J.-B.; Golinval, J.-C. Modal identification and damage detection using the data-driven stochastic subspace and ARMAV methods. Mech. Syst. Sig. Process. 2003, 17, 83–89. [Google Scholar] [CrossRef]
  6. Kang, I.; Schulz, M.J.; Kim, J.H.; Shanov, V.; Shi, D. A carbon nanotube strain sensor for structural health monitoring. Smart Mater. Struct. 2006, 15, 737. [Google Scholar] [CrossRef]
  7. Majumder, M.; Gangopadhyay, T.K.; Chakraborty, A.K.; Dasgupta, K.; Bhattacharya, D.K. Fibre Bragg gratings in structural health monitoring—Present status and applications. Sens. Actuators A 2008, 147, 150–164. [Google Scholar] [CrossRef]
  8. Cho, S.; Yun, C.-B.; Lynch, J.P.; Zimmerman, A.T.; Spencer, B.F., Jr.; Nagayama, T. Smart wireless sensor technology for structural health monitoring of civil structures. Steel Struct. 2008, 8, 267–275. [Google Scholar]
  9. Cantero-Chinchilla, S.; Chiachío, J.; Chiachío, M.; Chronopoulos, D.; Jones, A. A robust Bayesian methodology for damage localization in plate-like structures using ultrasonic guided-waves. Mech. Syst. Sig. Process. 2019, 122, 192–205. [Google Scholar] [CrossRef] [Green Version]
  10. Vakil-Baghmisheh, M.-T.; Peimani, M.; Sadeghi, M.H.; Ettefagh, M.M. Crack detection in beam-like structures using genetic algorithms. Appl. Soft Comput. 2008, 8, 1150–1160. [Google Scholar] [CrossRef]
  11. Tripathi, G.; Anowarul, H.; Agarwal, K.; Prasad, D.K. Classification of Micro-Damage in Piezoelectric Ceramics Using Machine Learning of Ultrasound Signals. Sensors 2019, 19, 4216. [Google Scholar] [CrossRef] [Green Version]
  12. Oh, C.K.; Sohn, H. Damage diagnosis under environmental and operational variations using unsupervised support vector machine. J. Sound Vib. 2009, 325, 224–239. [Google Scholar] [CrossRef]
  13. Gui, G.; Pan, H.; Lin, Z.; Li, Y.; Yuan, Z. Data-driven support vector machine with optimization techniques for structural health monitoring and damage detection. KSCE J. Civ. Eng. 2017, 21, 523–534. [Google Scholar] [CrossRef]
  14. Pan, H.; Azimi, M.; Yan, F.; Lin, Z. Time-frequency-based data-driven structural diagnosis and damage detection for cable-stayed bridges. J. Bridge Eng. 2018, 23, 04018033. [Google Scholar] [CrossRef]
  15. Liu, R.; Yang, B.; Zhang, X.; Wang, S.; Chen, X. Time-frequency atoms-driven support vector machine method for bearings incipient fault diagnosis. Mech. Syst. Sig. Process. 2016, 75, 345–370. [Google Scholar] [CrossRef]
  16. Hu, Q.; He, Z.; Zhang, Z.; Zi, Y. Fault diagnosis of rotating machinery based on improved wavelet package transform and SVMs ensemble. Mech. Syst. Sig. Process. 2007, 21, 688–705. [Google Scholar] [CrossRef]
  17. Lam, H.F.; Yuen, K.V.; Beck, J.L. Structural health monitoring via measured Ritz vectors utilizing artificial neural networks. Comput.-Aided Civ. Infrastruct. Eng. 2006, 21, 232–241. [Google Scholar] [CrossRef]
  18. Cao, M.; Qiao, P.; Ren, Q. Improved hybrid wavelet neural network methodology for time-varying behavior prediction of engineering structures. Neural Comput. Appl. 2009, 18, 821–832. [Google Scholar] [CrossRef]
  19. Ding, Z.; Cao, M.; Jia, H.; Pan, L.; Xu, H. Structural dynamics-guided hierarchical neural-networks scheme for locating and quantifying damage in beam-type structures. J. Vibroeng. 2014, 16, 3595–3608. [Google Scholar]
  20. Cao, M.; Pan, L.; Gao, Y.; Novák, D.; Ding, Z.; Lehký, D.; Li, X. Neural network ensemble-based parameter sensitivity analysis in civil engineering systems. Neural Comput. Appl. 2017, 28, 1583–1590. [Google Scholar] [CrossRef]
  21. Ni, Y.; Wang, B.; Ko, J. Constructing input vectors to neural networks for structural damage identification. Smart Mater. Struct. 2002, 11, 825. [Google Scholar] [CrossRef]
  22. Cao, M.-S.; Ding, Y.-J.; Ren, W.-X.; Wang, Q.; Ragulskis, M.; Ding, Z.-C. Hierarchical wavelet-aided neural intelligent identification of structural damage in noisy conditions. Appl. Sci. 2017, 7, 391. [Google Scholar] [CrossRef] [Green Version]
  23. Sambath, S.; Nagaraj, P.; Selvakumar, N. Automatic defect classification in ultrasonic NDT using artificial intelligence. J. Nondestr. Eval. 2011, 30, 20–28. [Google Scholar] [CrossRef]
  24. Hinton, G.E.; Osindero, S.; Teh, Y.-W. A fast learning algorithm for deep belief nets. Neural Comput. 2006, 18, 1527–1554. [Google Scholar] [CrossRef] [PubMed]
  25. Cha, Y.J.; Choi, W.; Büyüköztürk, O. Deep learning-based crack damage detection using convolutional neural networks. Comput.-Aided Civ. Infrastruct. Eng. 2017, 32, 361–378. [Google Scholar] [CrossRef]
  26. Cha, Y.J.; Choi, W.; Suh, G.; Mahmoudkhani, S.; Büyüköztürk, O. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Comput.-Aided Civ. Infrastruct. Eng. 2018, 33, 731–747. [Google Scholar] [CrossRef]
  27. Wen, L.; Li, X.; Gao, L.; Zhang, Y. A new convolutional neural network-based data-driven fault diagnosis method. IEEE Trans. Ind. Electron. 2017, 65, 5990–5998. [Google Scholar] [CrossRef]
  28. Janssens, O.; Slavkovikj, V.; Vervisch, B.; Stockman, K.; Loccufier, M.; Verstockt, S.; Van de Walle, R.; Van Hoecke, S. Convolutional neural network based fault detection for rotating machinery. J. Sound Vib. 2016, 377, 331–345. [Google Scholar] [CrossRef]
  29. Meng, M.; Chua, Y.J.; Wouterson, E.; Ong, C.P.K. Ultrasonic signal classification and imaging system for composite materials via deep convolutional neural networks. Neurocomputing 2017, 257, 128–135. [Google Scholar] [CrossRef]
  30. Ince, T.; Kiranyaz, S.; Eren, L.; Askar, M.; Gabbouj, M. Real-time motor fault detection by 1-D convolutional neural networks. IEEE Trans. Ind. Electron. 2016, 63, 7067–7075. [Google Scholar] [CrossRef]
  31. Zhang, W.; Peng, G.; Li, C.; Chen, Y.; Zhang, Z. A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals. Sensors 2017, 17, 425. [Google Scholar] [CrossRef]
  32. Abdeljaber, O.; Avci, O.; Kiranyaz, S.; Gabbouj, M.; Inman, D.J. Real-time vibration-based structural damage detection using one-dimensional convolutional neural networks. J. Sound Vib. 2017, 388, 154–170. [Google Scholar] [CrossRef]
  33. Avci, O.; Abdeljaber, O.; Kiranyaz, S.; Inman, D. Structural damage detection in real time: Implementation of 1D convolutional neural networks for SHM applications. In Structural Health Monitoring & Damage Detection; Niezrecki, C., Ed.; Springer: Cham, Switzerland, 2017; Volume 7, pp. 49–54. [Google Scholar]
  34. Abdeljaber, O.; Avci, O.; Kiranyaz, M.S.; Boashash, B.; Sodano, H.; Inman, D.J. 1-D CNNs for structural damage detection: Verification on a structural health monitoring benchmark data. Neurocomputing 2018, 275, 1308–1317. [Google Scholar] [CrossRef]
  35. Devriendt, C.; Guillaume, P. The use of transmissibility measurements in output-only modal analysis. Mech. Syst. Sig. Process. 2007, 21, 2689–2696. [Google Scholar] [CrossRef]
  36. Devriendt, C.; Guillaume, P. Identification of modal parameters from transmissibility measurements. J. Sound Vib. 2008, 314, 343–356. [Google Scholar] [CrossRef]
  37. Devriendt, C.; De Sitter, G.; Vanlanduit, S.; Guillaume, P. Operational modal analysis in the presence of harmonic excitations by the use of transmissibility measurements. Mech. Syst. Sig. Process. 2009, 23, 621–635. [Google Scholar] [CrossRef]
  38. Devriendt, C.; De Sitter, G.; Guillaume, P. An operational modal analysis approach based on parametrically identified multivariable transmissibilities. Mech. Syst. Sig. Process. 2010, 24, 1250–1259. [Google Scholar] [CrossRef]
  39. Johnson, T.J.; Adams, D.E. Transmissibility as a differential indicator of structural damage. J. Vib. Acoust. 2002, 124, 634–641. [Google Scholar] [CrossRef]
  40. Kong, X.; Cai, C.; Kong, B. Damage detection based on transmissibility of a vehicle and bridge coupled system. J. Eng. Mech. 2014, 141, 04014102. [Google Scholar] [CrossRef]
  41. Caccese, V.; Mewer, R.; Vel, S.S. Detection of bolt load loss in hybrid composite/metal bolted connections. Eng. Struct. 2004, 26, 895–906. [Google Scholar] [CrossRef]
  42. Zhu, D.; Yi, X.; Wang, Y. Sensitivity analysis of transmissibility functions for structural damage detection. In Proceedings of the SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring, San Diego, CA, USA, 6–10 March 2011; p. 79832M. [Google Scholar]
  43. Feng, L.; Yi, X.; Zhu, D.; Xie, X.; Wang, Y. Damage detection of metro tunnel structure through transmissibility function and cross correlation analysis using local excitation and measurement. Mech. Syst. Sig. Process. 2015, 60, 59–74. [Google Scholar] [CrossRef]
  44. Zhou, Y.-L.; Cao, H.; Liu, Q.; Wahab, M.A. Output-based structural damage detection by using correlation analysis together with transmissibility. Materials 2017, 10, 866. [Google Scholar] [CrossRef] [Green Version]
  45. Zhang, H.; Schulz, M.; Naser, A.; Ferguson, F.; Pai, P. Structural health monitoring using transmittance functions. Mech. Syst. Sig. Process. 1999, 13, 765–787. [Google Scholar] [CrossRef]
  46. Schulz, M.; Pai, P.; Inman, D. Health monitoring and active control of composite structures using piezoceramic patches. Compos. B. Eng. 1999, 30, 713–725. [Google Scholar] [CrossRef]
  47. Johnson, E.A.; Lam, H.-F.; Katafygiotis, L.S.; Beck, J.L. Phase I IASC-ASCE structural health monitoring benchmark problem using simulated data. J. Eng. Mech. 2004, 130, 3–15. [Google Scholar] [CrossRef]
  48. Maaten, L.V.D.; Hinton, G. Visualizing data using t-SNE. J. Mach. Learn. Res. 2008, 9, 2579–2605. [Google Scholar]
Figure 1. The designed structure of the one-dimensional convolutional neural network (1D CNN) model.
Figure 1. The designed structure of the one-dimensional convolutional neural network (1D CNN) model.
Sensors 20 01059 g001
Figure 2. Illustration of transmissibility function (TF)-1D CNN damage identification framework.
Figure 2. Illustration of transmissibility function (TF)-1D CNN damage identification framework.
Sensors 20 01059 g002
Figure 3. American Society of Civil Engineers (ASCE) structural health monitoring benchmark structure.
Figure 3. American Society of Civil Engineers (ASCE) structural health monitoring benchmark structure.
Sensors 20 01059 g003
Figure 4. Finite element model of the ASCE structural health monitoring benchmark structure with marked positions of (a) the damaged braces and response measurement and (b) the excitations.
Figure 4. Finite element model of the ASCE structural health monitoring benchmark structure with marked positions of (a) the damaged braces and response measurement and (b) the excitations.
Sensors 20 01059 g004
Figure 5. Dynamic responses in terms of (a) time series (TS), (b) fast Fourier transform (FFT)-based, and (c) TF signals, subject to different damage scenarios and the same excitation condition.
Figure 5. Dynamic responses in terms of (a) time series (TS), (b) fast Fourier transform (FFT)-based, and (c) TF signals, subject to different damage scenarios and the same excitation condition.
Sensors 20 01059 g005aSensors 20 01059 g005b
Figure 6. Dynamic responses in terms of (a) TS, (b) FFT-based, and (c) TF signals, subject to the same damage scenario and different excitation conditions.
Figure 6. Dynamic responses in terms of (a) TS, (b) FFT-based, and (c) TF signals, subject to the same damage scenario and different excitation conditions.
Sensors 20 01059 g006aSensors 20 01059 g006b
Figure 7. TFs between accelerations b and a under (a) stiffness loss of brace A, ranging from 5% to 50% at 5% intervals; (b) stiffness loss of brace B, ranging from 5% to 50% at 5% intervals.
Figure 7. TFs between accelerations b and a under (a) stiffness loss of brace A, ranging from 5% to 50% at 5% intervals; (b) stiffness loss of brace B, ranging from 5% to 50% at 5% intervals.
Sensors 20 01059 g007aSensors 20 01059 g007b
Figure 8. Equivalent damage scenarios in terms of damage in two braces on the same side of a layer.
Figure 8. Equivalent damage scenarios in terms of damage in two braces on the same side of a layer.
Sensors 20 01059 g008
Figure 9. The locations at which (a) reference and (b) non-reference acceleration dynamic responses were captured from the structure along the x and y directions.
Figure 9. The locations at which (a) reference and (b) non-reference acceleration dynamic responses were captured from the structure along the x and y directions.
Sensors 20 01059 g009
Figure 10. Visualization results of the damage features in the TF signals extracted by the 1D CNN model: (a) two- and (b) three- dimensional maps (different damage scenarios are labeled in the figure from 1 to 16).
Figure 10. Visualization results of the damage features in the TF signals extracted by the 1D CNN model: (a) two- and (b) three- dimensional maps (different damage scenarios are labeled in the figure from 1 to 16).
Sensors 20 01059 g010
Figure 11. Visualization results of the damage features in the TFs extracted by the 1D CNN model, under the noise levels of the signal-to-noise ratio (SNR) = (a) 50, (b) 40, (c) 35, (d) 30, (e) 25, (f) 20, (g) 15, and (h) 10 dB.
Figure 11. Visualization results of the damage features in the TFs extracted by the 1D CNN model, under the noise levels of the signal-to-noise ratio (SNR) = (a) 50, (b) 40, (c) 35, (d) 30, (e) 25, (f) 20, (g) 15, and (h) 10 dB.
Sensors 20 01059 g011aSensors 20 01059 g011bSensors 20 01059 g011cSensors 20 01059 g011d
Figure 12. Visualization results of signal features in the (a) TS and (b) FFT-based signals extracted by the 1D CNN model.
Figure 12. Visualization results of signal features in the (a) TS and (b) FFT-based signals extracted by the 1D CNN model.
Sensors 20 01059 g012aSensors 20 01059 g012b
Figure 13. Visualization results of signal features in the TSs extracted by the 1D CNN model under the noise levels of SNR = (a) 50, (b) 40, (c) 35, (d) 30, (e) 25, (f) 20, (g) 15, and (h) 10 dB.
Figure 13. Visualization results of signal features in the TSs extracted by the 1D CNN model under the noise levels of SNR = (a) 50, (b) 40, (c) 35, (d) 30, (e) 25, (f) 20, (g) 15, and (h) 10 dB.
Sensors 20 01059 g013aSensors 20 01059 g013b
Figure 14. Visualization results of the features in the FFT-based signals extracted by the 1D CNN model under the noise levels of SNR = (a) 50, (b) 40, (c) 35, (d) 30, (e) 25, (f) 20, (g) 15, and (h) 10 dB.
Figure 14. Visualization results of the features in the FFT-based signals extracted by the 1D CNN model under the noise levels of SNR = (a) 50, (b) 40, (c) 35, (d) 30, (e) 25, (f) 20, (g) 15, and (h) 10 dB.
Sensors 20 01059 g014aSensors 20 01059 g014b
Table 1. Accuracy of damage identification using the transmissibility function (TF)-one-dimensional convolutional neural network (1D CNN) framework under noise influence. Signal-to-noise ratio (SNR).
Table 1. Accuracy of damage identification using the transmissibility function (TF)-one-dimensional convolutional neural network (1D CNN) framework under noise influence. Signal-to-noise ratio (SNR).
NoiseSNR (dB)
5040353025201510
Accuracy (%)100.00100.00100.0097.7083.0370.4260.9141.27
Table 2. Accuracy of damage identification based on time series (TS)- and fast Fourier transform (FFT)-1D CNN frameworks under different noise levels.
Table 2. Accuracy of damage identification based on time series (TS)- and fast Fourier transform (FFT)-1D CNN frameworks under different noise levels.
NoiseSNR (dB)
5040353025201510
Accuracy (%)TS-1D CNN11.3311.4511.2711.5811.8810.7310.7911.33
FFT-1D CNN45.3345.2745.2745.4545.2144.9744.8545.45
Table 3. Comparison between the TF-1D CNN and TF-artificial neural network (ANN) framework in noisy environments under different noise levels.
Table 3. Comparison between the TF-1D CNN and TF-artificial neural network (ANN) framework in noisy environments under different noise levels.
NoiseSNR (dB)
5040353025201510
Accuracy (%)TF-1D CNN100.00100.00100.0097.7083.0370.4260.9141.27
TF-ANN96.3695.1590.1871.8843.2130.9123.5218.91

Share and Cite

MDPI and ACS Style

Liu, T.; Xu, H.; Ragulskis, M.; Cao, M.; Ostachowicz, W. A Data-Driven Damage Identification Framework Based on Transmissibility Function Datasets and One-Dimensional Convolutional Neural Networks: Verification on a Structural Health Monitoring Benchmark Structure. Sensors 2020, 20, 1059. https://doi.org/10.3390/s20041059

AMA Style

Liu T, Xu H, Ragulskis M, Cao M, Ostachowicz W. A Data-Driven Damage Identification Framework Based on Transmissibility Function Datasets and One-Dimensional Convolutional Neural Networks: Verification on a Structural Health Monitoring Benchmark Structure. Sensors. 2020; 20(4):1059. https://doi.org/10.3390/s20041059

Chicago/Turabian Style

Liu, Tongwei, Hao Xu, Minvydas Ragulskis, Maosen Cao, and Wiesław Ostachowicz. 2020. "A Data-Driven Damage Identification Framework Based on Transmissibility Function Datasets and One-Dimensional Convolutional Neural Networks: Verification on a Structural Health Monitoring Benchmark Structure" Sensors 20, no. 4: 1059. https://doi.org/10.3390/s20041059

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop