Next Article in Journal
Influence of Boundary Impedance of 3D Cavity on Targeted Energy Transfer between a Damped Acoustic Mode and a Nonlinear Membrane Absorber
Next Article in Special Issue
Virtual Engineering and Commissioning to Support the Lifecycle of a Manufacturing Assembly System
Previous Article in Journal
Efficiency Analysis of Axial Flux SynRM in Variable Speed Applications
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Zero-Defect Manufacturing and Automated Defect Detection Using Time of Flight Diffraction (TOFD) Images

Brunel Innovation Centre, Brunel University London, Cambridge CB21 6AL, UK
*
Author to whom correspondence should be addressed.
Machines 2022, 10(10), 839; https://doi.org/10.3390/machines10100839
Submission received: 3 August 2022 / Revised: 14 September 2022 / Accepted: 19 September 2022 / Published: 21 September 2022

Abstract

:
Ultrasonic time-of-flight diffraction (TOFD) is a non-destructive testing (NDT) technique for weld inspection that has gained popularity in the industry, due to its ability to detect, position, and size defects based on the time difference of the echo signal. Although the TOFD technique provides high-speed data, ultrasonic data interpretation is typically a manual and time-consuming process, thereby necessitating a trained expert. The main aim of this work is to develop a fully automated defect detection and data interpretation approach that enables predictive maintenance using signal and image processing. Through this research, the characterization of weld defects was achieved by identifying the region of interest from A-scan signals, followed by segmentation. The experimental results were compared with samples of known defect size for validation; it was found that this novel method is capable of automatically measuring the defect size with considerable accuracy. It is anticipated that using such a system will significantly increase inspection speed, cost, and safety.

1. Introduction

Non-destructive testing (NDT) refers to a set of procedures and techniques used to test the materials without destroying them or modifying their physical characteristics. The material under test can range from small devices to heavy equipment with a variety of geometrical shapes and material characteristics. The necessity for the application of NDT has grown recently for diverse reasons, including product safety, quality control, health monitoring, and security testing [1]. NDT also forms an integral part of quality inspection and planning for maintenance in various manufacturing systems [2]. One such application is the use of NDT techniques to identify defects in welded structures. There are several different types of NDT methods that are applicable to weld inspection and ultrasonic time-of-flight diffraction (TOFD) is one such technique that can be used to detect the size of embedded defects [3]. Through this process, it is possible to obtain ultrasound signals, namely, the A-scan mode, which can be displayed on the screen of the ultrasound equipment as an amplitude versus time trace.
Although ultrasonic TOFD uses computer-aided data acquisition, the data processing and interpretation are performed manually, subject to the skill of the operator [4]. The output of the TOFD data acquisition needs significant processing before using for defect detection. These include denoising, scan alignment, the estimation of lateral-backwall positions, and segmentation. Even though there are numerous software programs available for processing TOFD data, trained operators are necessary for these activities, which takes more time and operator effort [5]. Additionally, the operator-dependent processing mechanism can occasionally result in inconsistencies and mistakes.
Therefore, to address these problems, this research proposes the novel contributions of:
  • Automated processing via image and signal-processing algorithms;
  • Developing reliable and robust algorithms capable of producing results of different operating conditions and components that are characterized by having various shapes and sizes;
  • Decision support regarding defect detection.
The key benefits of the work include:
  • The automatic processing systems that break through the limitations of the conventional processing and interpretation systems;
  • Improving the efficiency of the inspection process;
  • Enabling smart manufacturing through the automation of inspections and maintenance.

2. Literature Review

2.1. Related Works on TOFD

The most widely used NDT method for subsurface defect analysis is ultrasound TOFD. The experimental work was initiated by [5,6,7,8]; since then, several research projects have been conducted in related areas, including the experimental analysis of TOFD, hardware and software development, image and signal processing analysis for TOFD data augmentation, and automatic analysis. Image denoising, segmentation, classification, and fault sizing analysis are some of the many automation efforts related to TOFD data processing. The undesirable form of energy known as noise can have an impact on the ultrasonic signal’s accuracy and precision. Noise can arise due to unwanted electronic properties or material grain properties; to obtain consistent data quality, noise reduction should be considered a crucial processing step. Numerous TOFD signal denoising algorithms [9] have previously been described in the literature. One of the most promising methods for signal conditioning is wavelet analysis. The usage of DWT-based signal denoising by numerous authors demonstrates its applicability in a wide range of applications. Wavelet transform-based TOFD signal denoising was utilized by [9] to improve the obtained TOFD signal quality. By using wavelet-based thresholding, the structural noise that contributed to the A-scan signals during acquisition was eliminated. Compared with lower-order wavelets, the higher-order wavelets displayed a higher signal-to-noise ratio (SNR). The drift that was discovered during inspection has been fixed in [10]. They used a subpixel registration algorithm based on a discrete Fourier transform (DFT) to enhance the image by correcting the drift. Jiaxu Duan et al. [11] presented a signal denoising technique based on wavelet transforms as an improved method for TOFD processing. Maximum correlation-based image registration could eliminate the displacement between TOFD pictures caused by the adjustment of the probes. This method’s results showed that the SNR of the TOFD signals had improved. Different combinations of wavelets [12], decomposition levels, and thresholding were employed to develop an optimum denoising algorithm; the performances were then evaluated using the SNR calculations. To create the best denoising algorithm, various wavelet combinations [12], decomposition levels, and thresholding were used, then the performance was assessed using SNR estimates. In the same year, wavelet transform for TOFD data was examined by the authors of [13] for the automatic positioning and sizing of flaw detection. This strategy uses a fuzzy clustering method, with fuzzy C-means wavelet transform and texture analysis. This hybrid approach to fault detection from a TOFD-type ultrasonic image is quick and accurate.

2.2. Automated Defect Detection

Even though TOFD signal enhancement has received much scientific attention, only a few notable works have been proposed for automatic defect segmentation. Two-dimensional (2D) entropy-based TOFD D-scan defect segmentation begins with wavelet-based denoising [14], which is a pre-processing step. In terms of automation, the obtained results have been encouraging. The segmentation of flaws in TOFD images of austenitic stainless-steel welds has been performed using several segmentation techniques [15]. For automatic defect detection, the discontinuity-based segmentation algorithm and the region-based level set technique were investigated. While the segmentation algorithms extracted the flaws, an expert operator was still required to identify the specific type of defect that was present in the test sample. Researchers have demonstrated how machine learning can categorize weld defects. Wavelet-based image processing with a support vector machine (SVM) was used for TOFD signal classification in [16]. The SVM classifier is reliable, promising, and performs well, even in the absence of training data. The classification of a lack of fusion and a lack of penetration cracks from TOFD images was also conducted using a backpropagation neural network [17]. By extracting multiscale features rather than single-scale features, classification accuracy can be increased. Depending on the application, artificial intelligence (AI) plays a crucial part in automation. However, most applications in TOFD data processing might not be able to obtain as many training and test D-scan images. The researchers therefore employed image- and signal-processing techniques to automatically detect flaws in the TOFD images. For the purpose of differentiating between distinct defect types, the phase correlations between diffracted echoes from the defect tips and with the lateral wave and backwall signals were used [18]. The TOFD image interpretation system was created by the same author [19] and comprises defect segmentation, noise suppression, drift correction, scan alignment, and an estimation of lateral-backwall echo. When dealing with highly variable data, the suggested strategy used in this research performed well in terms of accuracy and dependability.
TOFD signal enhancement and automatic defect detection have been the subject of numerous studies. Automatic sizing and positioning are also necessary for automatic defect quantification. The TOFD data acquisition and visualization setup themselves may result in some errors that cannot be identified by manual interpretation. For the purposes of defect detection, previous studies have suggested using TOFD B-scan images. The edge detection method was used for defect identification by the authors of [20]. The manual and automated sizing and positioning of defects have been investigated using ultrasonic B-scan images [21]. Compared to what the user could have calculated using manual calibration, this does not demonstrate very high accuracy.

2.3. Applications in Manufacturing

Manufacturing systems are faced with high levels of uncertainties that are associated with product variety, demand fluctuations, supply chain issues, etc. In such circumstances, there is a high probability that product defects, rework and manual errors will occur. It is, however, important to ensure that these defects do not impact the production environment. This can be achieved by instituting procedures to constantly monitor, detect, and prevent defects. For this purpose, there are several different NDT approaches that are built upon various principles and theories. They have been proven to be successful at finding defects across various manufacturing processes [22,23]. NDT principles also play a significant role in the Industry 4.0 revolution; the integration between NDT and the manufacturing sector is highly desirable [23]. For instance, the application of NDT methods for additive manufacturing [24], in-process inspection, and in-process calibration systems [25] have been much discussed in the literature. This underscores the importance of NDT methods to provide the much-needed push that manufacturing systems require to fulfill the concepts of sustainability and zero-defect manufacturing.

2.4. Summary of the Literature Review

This literature review provides a summary of the core methods, such as the theory behind TOFD and automated defect detection, that are proposed in this research work. It also highlights the research gap demonstrated by the lack of an effective and appropriate method for image and signal processing in the context of TOFD data processing. This review also highlights the need for an automated defect detection process within the wider context of zero-defect manufacturing in the welding process.

3. Preliminaries

3.1. TOFD Setup

In TOFD, a pair of ultrasonic probes are used that sit on opposite sides of a weld joint or an area of interest. When the transducers are moved in a direction parallel or perpendicular to the weld center line, a transmitter probe emits an ultrasonic pulse that is picked up by the receiver probe on the opposite side [1,2]. In an undamaged part, the signals picked up by the receiver probe are from two waves: one that travels along the surface (lateral wave) and one that reflects off the far wall (backwall reflection). When a discontinuity such as a crack is present, there is a diffraction of the ultrasonic sound wave from the top and bottom tips of the crack to be generated. The resulting ultrasonic waveforms are digitized, stored, and finally processed to generate a cross-sectional image of the weld for further interpretation and analysis.
A-scan mode is the most typical form of an ultrasound signal, which can be displayed on the screen of the ultrasound equipment as an amplitude versus time trace. The acquisition of several unrectified A-scan signals, consecutively recorded along a weld bead, allows the formation of a grayscale D-scan or grayscale B-scan image in a format commonly known as a “waterfall” diagram. These images are created by stacking A-scans from successive probe positions. The display configuration is shown in Figure 1.

3.2. Image Denoising

Ultrasonic signals are dominated by various noise types, such as environmental noise, instrumental noise, material noise, shot noise, thermal noise, Johnson noise, etc. The TOFD technique is considered one of the most effective techniques for the generation of images of weld imperfections and it does not involve ionizing radiation. The main drawback associated with TOFD signals is the appearance of noise, which principally originated when the micro-structure—grains of the material under test—interfered with the weak diffracted echo wave. Hence, noise reduction is an important process in the evaluation of TOFD signals for the detection and characterization of weld defects [9].

3.3. Mean-Based Segmentation

Thresholds (T) for image segmentation can be represented by the following expression:
T = μ + z . σ
The parameter μ represents the mean gray level of the entire image’s pixels. The parameter σ represents the standard deviation of the mean gray levels in the defective image (original). Factor z could be selected by trial and error to determine the strictness of the defect-detection test [26].

3.4. One-Dimensional Extropy-Based Method

Let f 1 , f 2 , f 3 . , f n be the observed gray level frequencies [27], and let:
p i = F i N   ,   i = 1 n F i = N           i = 1 , 2 , n
where N is the total number of pixels and n is the total number of gray levels. The total entropy, based on the distribution p 1 , p 2 , p 3 . , p n , is given by:
E T = i = 1 n p i ln   p i
The object and background distributions are derived from the original gray level distribution p 1 , p 2 , p 3 . , p n of the images, as follows:
A : p 1 P s   ,   p 2 P s   , . , p s P s  
and
B : p s + 1 1 P s   ,   p s + 2 1 P s   , . , p n 1 P s   P s = i = 1 s p i         let           E s = i = 1 s p i ln p i
Then, the entropies associated with each of the distributions are given by:
E b ( s ) = E ( A ) = i = 1 s p i P s ln p i P s
1 P s [ i = 1 s p i l n   ( p i ) P s l n   ( P s ) ] l n (   P s ) + E s P s
and
E w ( s ) = E ( B ) = i = 1 + s n p i 1 P s ln p i 1 P s
1 1 P s [ i = s + 1 n p i l n   ( p i ) ( 1 P s ) l n   ( 1 P s ) ]
l n ( 1 P s ) + E T E s 1 P s .
The sum of E(A) and E(B) is denoted by ψ(s). Hence:
ψ ( s ) = P s ( 1 P s ) + E s P s + E T E s 1 P s                      
Finally, we select the optimal thresholding using the following formula:
ψ ( s * ) = max { ψ ( s ) }

3.5. Two-Dimensional Entropy-Based Segmentation

The two-dimensional entropy [28] thresholding segmentation method separates an image with the thresholding, based on a two-dimensional histogram, which is formed of the gray level values of the pixels of the image and the average gray level values of their neighborhoods. The following details on two-dimensional entropy-based segmentation have been identified from [29]. Let the gray level be divided into M values; the average gray level is also divided into the same M values. At each pixel, the average gray-level value of the neighborhood is calculated. This forms a pair: the pixel gray level and the average of the neighborhood. Each pair belongs to a two-dimensional bin. The total number of bins is obviously m X m and the total number of pixels to be tested is N × N. The total number of occurrences f i j of a pair (i, j), divided by the total number of pixels, N2, defines the joint probability mass function P i j :
P i j = F i j N 2   , where   i   and   j = 1 .. m
The relationship between the defect, the background image, and noise can be represented using a two-dimensional grey histogram. For example. A and B, along the diagonal, represent the objects and the background of an image. Then, the probability of A and B is normalized using their posterior probability, which is represented as   P i j . If we suppose the thresholding is (s, t), then:
P A   = i = 0 s j = 0 t P i j
P B   = i = s + 1 M 1 j = t + 1 M 1 P i j
According to Shannon’s entropy function, we can define two-dimensional discrete entropy as follows:
E = i = 0 M 1 j = 0 M 1 P i j .
Then, the two-dimensional entropy of the object and background of an image is appointed by the following:
E 1 = i = 0 s j = 0 t P i j P 1 l g   P i j P 1 = l g   P 1 + E 1 P 1
E 2 = i = s + 1 M 1 j = t + 1 M 1 P i j P 2 l g   P i j P 2 = l g   P 2 + E 2 P 2 .
In the formula, E 1 and E 2 are defined as:
E 1 = i = 0 s j = 0 t P i j   l o g P i j
E 2 = i = s + 1 M 1 j = t + 1 M 1 P i j   l o g P i j
P 2 = 1 P 1   and   E 2 = E E 1
Then:
E 2 = lg ( 1 P 1 ) + E E 1   1 P 1
The entropy function can be defined as follows:
ψ ( s , t ) = E 1 + E 2 = lg [ P 1 ( 1 P 1 ) ] + ( E 1 ) P 1 + E E 1   1 P 1
Finally, we select the optimal thresholding using the following formula:
ψ ( s * , t * ) = max { ψ ( s , t ) } .

4. Research Methodology

This section presents the proposed methodology and explains the experimental setup and implementation. The overview of the proposed method is shown in Figure 2.

4.1. Wavelet Transform Image Denoising

The first step is image denoising. The following steps are involved in wavelet-based denoising. First, we apply discrete wavelet transform (DWT) to a signal, obtain the wavelet coefficients, and threshold the detail coefficients, assigning zero to the wavelet coefficients based on a certain threshold. After thresholding, the thresholded wavelet coefficients need to be transformed to reconstruct the signal, using inverse discrete wavelet transform (IDWT). The most important thing in the application of thresholding is the determination of the threshold value. There are four different estimators of the threshold value, given as Heasure, Minimax, Rigsure, and Sqtwolog. Thresholding can also be applied in two different methods: hard and soft thresholding. A hard threshold can be explained as setting elements to zero where their absolute values are lower than the threshold. A hard threshold gives sharper results. On the other hand, soft thresholding softens the coefficients that exceed the threshold by lowering them by as much as the threshold value. Soft thresholding requires more computations but gives a better denoising performance. The SURE-threshold selection rule with soft thresholding can be used to denoise the A-scan signals.

4.2. Scan Alignment

To make sure that all the signals are of equal length, we compare the length of the first signal with that of the second one and then zero-pad the shortest one. The same procedure is repeated until all A-scan signals are of equal length. Several data acquisition factors may contribute to the misalignment of adjacent A-scans, including coupling thickness variations, surface irregularities, inadvertent changes in probe separation, and accidental probe lift-off. Scan alignment is carried out by subsampling each scan and cross-correlating each scan with an arbitrary “reference” scan.
Here, we suppose two A-scan signals, x(t) and y(t), respectively. The cross-correlation function can be described as:
R x y ( t ) = 1 T 0 T x ( t )   y ( t + λ ) d t
and the discrete description of R x y ( t )   is
R x y ( λ ) = 1 n i = 1 n x ( i ) y ( i + λ )
where λ is the delay between x(t) and y(t).
The D-scan image is aligned in the following way.
We choose one A-scan signal as a reference signal, M ( 0 ) .   We then calculate the cross-correlation function ( R x y )   between M ( 0 ) and other A-scan signals N ( l )   and determine the largest peak of ( R x y ) and the corresponding delay time interval, t. Then, we find the medium value of all the samplings in the signals M ( 0 )   and N ( l ) , and compute the difference between the delay time t and the medium value of all samplings.
We shift each A-scan signal N ( l ) forward or backward, from the difference between the time t and the medium value of all samplings, in such a way as to align the envelope of the lateral wavelets. The amplitude of each sample in the cross-correlation signal is a measure of how much the signal input signal resembles the target signal at that point. The value of the cross-correlation is maximized when the target signal is aligned with the received signal. Finally, we accumulate the successive A-scan ultrasonic signals and the ultrasonic D-scan image is calibrated [20].

4.3. Region of Interest Extraction

For the automatic interpretation to be accurate, the positions of the lateral and backwall echo must be correctly estimated, with high accuracy.
  • The first positive maximum of the signal is identified using a particular threshold and is marked as a lateral wave.
  • The backwall echo has been identified using threshold and maximum amplitude information. The region between the latter and the backwall echo is marked as an area of interest for defect segmentation.

4.4. Defect Segmentation

After estimating the positions of the lateral wave and backwall signals, the region of interest is marked between the two echoes, and only the defect segmentation in the chosen ROI is performed. Only a small fraction of the collected data represents defects, whereas the majority of the data are considered redundant. The three segmentation methods, as explained in Section 3.3, Section 3.4 and Section 3.5, are employed in the experiments.

4.5. Defect Sizing

The position of the lateral and backwall wave signals must be determined from the A-scan data to automatically quantify the extent of the flaws. The arrival time of the diffracted echo carries information about the spatial relationship of the crack tips. Hence, the depth and height of the defect can be estimated by measuring the arrival time of the lateral and backwall echoes. The size of the defect is determined by its width, height, and depth. The width is measured as the difference between defect extremities in a horizontal direction. The height is defined as the vertical distance between top and bottom echoes. The depth is directly related to the time of flight between the lateral wave and echo from the defect top tip. The depth information could be calculated by substituting the predefined calibration parameters, such as the velocity of the sound in the material (C), probe center spacing (PCS), time of flight of the signal from the reflector(t), probe delay (time taken for the sound wave traveling through one wave ( t 0 )   the depth of the reflector in the material (d), and thickness of the material (D) in the following A-scan signal. The discontinuity depth (backwall echo) and the time of flight are shown in the x-axis. The y-axis indicates the amplitude of the reflected signals (echoes) and can be used to estimate the size of the discontinuity compared to a known reference reflector.

4.6. Example Calculation of Defect Size

The lateral and backwall time have been calculated by calculating lateral and backwall wave point from A-scan signals. For example, with lateral wave points of 74 and backwall point of 295 shown in Figure 3.
Thickness = 25 mm
Velocity (C) = 5.89 mm/us
A-scan resolution = 0.01 us, PCS = 91.58 mm
Start   time   of   the   A - scan   signal = 14.68   μ s
The time of the lateral wave = lateral wave point × A-scan resolution + start time
= 74   ×   0.01 + 14.68 = 15.42   μ s
The time of the backwall wave = backwall wave point * A-scan resolution + start time
= 295   ×   0.01 + 14.68 = 17.63   μ s
Estimation of the depth of the backwall is given by the formula:
d = ( C 2 ) 2   * t 2 S 2 d = ( C 2 ) 2   * t 2 S 2 d = 24.8471   mm .
Arrival time of the backwall or depth calculation:
t = 2 * ( S 2 + d 2 ) C + t 0 t = 2 * ( ( 0.5 * 91.58 ) 2 + 24.84 2 ) 5.89 + 17.63
t = 28.8809 mm

4.7. Experimental Setup

For the experiment, carbon steel samples with a thickness of 25 mm were given a weld of approximately 30 mm. The samples included known defects of different characteristics (planar: cracks, lack of fusions; volumetric) and sizes that allowed evaluating the results of the algorithm described above. As a way of comparison, a competent operator used phased-array ultrasonic testing (PAUT) to test the samples and to establish a benchmark for the algorithm’s detection and sizing capabilities. The schematic of the experimental setup is shown in Figure 4. The shaded areas of the figure highlight the novel contributions.
All the experiments were performed using the same setup, only changing the parameters depending on the thickness of the sample. The data acquisition was performed with an Olympus OmniScan MX2 (https://www.olympus-ims.com/en/omniscan-mx2/, accessed on 2 August 2022) using a pair of TOFD probes (highly dumped probes, producing 1.5 cycles) of 5MHz and 6 mm crystal diameter, with the corresponding 60-degree wedges (the angle on the material). The scans were performed in a direction perpendicular to the sound beam, with a resolution of 1 mm. The PCS was established using two-thirds of the sample thickness as focus depth and with the following calculation where θ is the angle of the sound beam in the material (i.e., 60 degrees):
d = 2 3 t
P C S = 2   d tan θ
The acquisition was performed at a maximum scanning speed of 60 mm/s and with a digitizing frequency of 100 MHz (A-scan time resolution, 10 ns). As the probes and wedges were the same for all the tests, the probe delay used was 5.9 μs. Although the algorithm allows performing post-processing calibration, for this test, the parent material velocity and PCS were calibrated to ensure the quality of the data. The acquired data were in the form of text (.txt) files, which included header information specifying the calibration parameters and data for further defect detection.

5. Results and Discussion

The inspection text data file was processed using an automatic defect detection algorithm. The inspection text data file’s header comprises scan data along with calibration parameters and workpiece specifications. Each column of the text file represented one A-scan signal. All the A-scan signals have been combined to form a TOFD D-scan image. The results at each stage of the methodology are shown in Figure 5, Figure 6, Figure 7, Figure 8, Figure 9, Figure 10, Figure 11, Figure 12, Figure 13, Figure 14 and Figure 15.
A TOFD detection system is always operating in high-gain mode, which increases both the signal intensity and the noise added to the signal. Wavelet transform-based denoising has been used here to denoise the signal, as shown in Figure 7 and Figure 8. Initially, to make all the signals of equal length, zero was appended to the shortest signal by comparing them with the reference one. The signals were further aligned to avoid any misalignment of A-scan singles caused during the experiment, using the correlation function. After that, the ROI between the lateral and backwall echoes was identified using thresholding and amplitude information. Finally, the defects were segmented from ROI using segmentation algorithms, namely, mean segmentation and two- and one-dimensional entropy-based segmentation. The size of the defects was measured using an automatic defect-sizing algorithm.
The process of image denoising eliminated the small peaks, which are noise from the signal, as is shown in Figure 9. Therefore, the automatic defect detection algorithm could be able to locate the lateral and backwall wave positions precisely. The mean and standard deviation-based segmentations are easy to implement, and the observed defects are more accurate, as can be seen in Figure 12. The constant value is set here at 0.5, based on previous experiments. One-dimensional (1D) entropy-based segmentation limits the threshold, based on the selection of the number of bins. One serious drawback of first-order thresholding, based on a 1D histogram, is that the spatial correlation between pixels is not considered. A two-dimensional (2D) histogram-based image thresholding segmentation method means that the original grey-level histogram is integrated with the local averaging of pixels to form a grey-local 2D histogram. No prior knowledge is necessary to determine the ideal threshold.
Finally, automatic defect sizing was performed to measure the width, height, and depth of the defects automatically, which would consume the operator’s time and give greater accuracy. Defect sizing using TOFD depends on an accurate measurement of the arrival time of the diffracted and reflected waves at the defect extremities—the lateral and backwall wave arrival times, calculated for each A-scan signal. The depth of the reflector material is calculated using Equation (27) automatically and is verified with the actual value of the 30 mm weld. Once the depth has been evaluated, the time of flight of the signal from the reflector is measured. The final interpretation has been made via post-processing to calculate the actual sizing and positioning measurements. The post-processing begins by rescaling the vertical and horizontal axes of the D-scan image. The vertical axis is rescaled to represent depth while the horizontal axis is rescaled to the actual scanned distance in millimeters.
The advantage of using three segmentation methods is that the user is able to compare the detected defects on the developed graphical user interface (GUI). Therefore, a GUI that is interactive has been created to assist users in loading and viewing flaws has been created. The decision support GUI is shown in Figure 16. The created GUI tool offers a user-interactive subsurface plot that is easy for the users to understand.

6. Conclusions

The proposed work comprised several image and signal processing functions to aid in the automation of pre-processing, segmentation, and defect sizing with TOFD D-scan data, in terms of an interpretation tool. The interpretation system starts by pre-processing the D-scan image to prepare the data for subsequent processing. It was discovered that wavelet-based denoising had a positive impact on lateral and backwall echo identification and defect detection. Scan alignment was utilized to ensure the consistency of the data for defect detection and sizing. The region between the lateral and backwall echoes has been marked as a region of interest (ROI) for the next stage of defect segmentation. For the purpose of automatically detecting defects, three segmentation methods were verified. As a result, the operator can compare and see the segmentation findings to make appropriate decisions. The sizing associated with the defects are height, width, and depth, and were determined by the automatic sizing algorithm. The actual experimental data could be used to confirm the obtained sizing measurements. Overall, the acquired findings showed substantial improvements in terms of speed and accuracy regarding the highly variable TOFD data. This would make the proposed system a better option in an environment requiring the automatic interpretation of a large volume of data, hence, reducing the time spent and cost for the operator. The created GUI offers a result that is both easier for experts to use and more user-friendly. However, this tool is intended to reduce human error and give the inspector more time for decision-making, rather than to completely replace human inspections. This aligns with the goals of smart manufacturing and zero-defect manufacturing and supports decision-making, while also improving quality and efficiency and reducing the defects in manufacturing settings.

Author Contributions

Conceptualization, J.K.; methodology, T.-H.G.; software, S.S.; validation, S.S. and J.K.; formal analysis, S.S.; investigation, T.-H.G.; writing—original draft preparation, S.S.; writing—review and editing, J.K.; visualization, S.S.; supervision, T.-H.G. All authors have read and agreed to the published version of the manuscript.

Funding

The research leading to these results has received funding from the UK’s innovation agency, Innovate UK, under grant agreement No. 103991. The research has been undertaken as a part of the project Amphibious robot for inspection and predictive maintenance of offshore wind assets (iFROG).

Data Availability Statement

Data available on request due to restrictions eg privacy or ethical.

Acknowledgments

The iFROG project is a collaboration between the following organizations: Innovative Technology and Science Ltd., Brunel University London, TWI Ltd., and ORE Catapult Development Services Ltd.

Conflicts of Interest

The authors declare that there is no conflict of interest.

References

  1. Omar, M. Nondestructive Tesitng Methods and New Applications; IntechOpen: London, UK, 2012. [Google Scholar] [CrossRef]
  2. Silk, M.G. Changes in ultrasonic defect location and sizing. NDT Int. 1987, 20, 9–14. [Google Scholar]
  3. Charlesworth, J.P.J.; Temple, A.G. Engineering Applications of Ultrasonic Time-of-Flight Diffraction; Research Studies Press Ltd.: Baldock, UK, 2001. [Google Scholar]
  4. Silk, M.G. The ultrasonic inspection of difficult materials. In Proceedings of the European Conference on NDT, London, UK, 13–17 September 1987; Pergamon Press: Oxford, UK, 1987. [Google Scholar]
  5. Manjula, K.; Vijayarekha, K.; Venkatraman, B.; Karthik, D. Ultrasonic Time of Flight Diffraction Technique for Weld Defects: A Review. Res. J. Appl. Sci. Eng. Technol. 2012, 4, 5525–5533. [Google Scholar]
  6. Silk, M.G. The Capabilities and Limitations of NDT. In Chapter Ultra Sonic Testing—Special Techniques; The British Institute of Non-Destructive Testing: Northampton, UK, 1988; Volume 1. [Google Scholar]
  7. Silk, M.G. Some modern non-destructive testing techniques and their application. Qual. Assur. 1978, 4, 92–97. [Google Scholar]
  8. Silk, M.G. Defect sizing using ultrasonic diffraction. Br. J. NDT 1979, 21, 12–15. [Google Scholar]
  9. Praveen, A.; Vijayarekha, K.; Abraham, S.T.; Venkatraman, B. Signal quality enhancement using higher order wavelets for ultrasonic TOFD signals from austenitic stainless-steel welds. Ultrasonics 2013, 53, 1288–1292. [Google Scholar] [CrossRef] [PubMed]
  10. Ying, W.; Xiao, G.; Jian, G.; Ze, W. Ultrasonic TOFD image registration algorithm of sub-pixel accuracy based on DFT. In IEEE Far East Forum on Non-Destructive Evaluation/Testing (FENDT); IEEE: Chengdu, China, 2014; pp. 84–88. [Google Scholar] [CrossRef]
  11. Jia, D.; Lin, L.; Xiao, G.; Jian, P.; Jin, L. Multiframe Ultrasonic TOFD Weld Inspection Imaging Based on Wavelet Transform and Image Registration. J. Sens. 2018, 2018, 9545832. [Google Scholar] [CrossRef]
  12. Lalithakumari, S.; Pandian, R. Discrete Wavelet Transform based Denoising of TOFD Signals of Austenitic Stainless-Steel Weld at Elevated Temperature. Russ. J. Nondestruct. Test. 2019, 55, 363–368. [Google Scholar] [CrossRef]
  13. Ahmed, K.; Redouane, D.; Abdessalem, B. Image processing and wavelets transform for sizing of weld defects using ultrasonic TOFD images. J. Acoust. Soc. Am. 2008, 123, 3083. [Google Scholar] [CrossRef]
  14. Chi, D.; Gang, T. Automatic defect detection in ultrasonic TOFD D-scan data using image processing methods. China Weld. (Engl. Ed.) 2015, 24, 56–61. [Google Scholar]
  15. Theresa Cenate, C.F.; Sheela Rani, B.; Sangeetha, B.N.; Venkatraman, B. Comparative Study of Diverse Techniques for Flaw Segmentation in TOFD Images of Austenitic Stainless Steel Weld. Indian J. Sci. Technol. 2015, 8, 1. [Google Scholar] [CrossRef]
  16. Al-Ataby, A.; Al-Nuaimy, W.; Brett, C.R.; Zahran, O. Automatic detection and classification of weld flaws in TOFD data using wavelet transform and support vector machines. Insight. Non. Destr. Test. Cond. Monit. 2010, 52, 597–602. [Google Scholar] [CrossRef]
  17. Lalithakumari, S.; Sheelarani, B.; Venkatraman, B. Classification of TOFD Signals by Artificial Neural Network. In Proceedings of the World Conference on Nondestructive Testing, Durban, South Africa, 16–20 April 2012. [Google Scholar]
  18. Zahran, O.; Al-Nuaimy, W. Utilising phase relationships for automatic weld flaw categorisation in time-of-flight diffraction images. In Proceedings of the International Conference on NDT, Turin, Italy, 20–25 March 2005. [Google Scholar]
  19. Al-Nuaimy, W.; Zahran, O. Automatic data processing and defect detection in time-of-flight diffraction images using statistical techniques. Insight. Non. Destr. Test. Cond. Monit. 2005, 47, 538–542. [Google Scholar]
  20. Cao, Y.; Zhu, H.; Yang, P. Ultrasonic Time of Flight Diffraction Defect Recognition Based on Edge Detection. In Proceedings of the International Conference on Biomedical Engineering and Computer Science, Wuhan, China, 23–25 April 2010; pp. 1–4. [Google Scholar] [CrossRef]
  21. Shan, M.; Liu, S. Defect depth automation measurement based on image processing for tofd parallel scanning. In Proceedings of the 10th World Congress on Intelligent Control and Automation, Beijing, China, 6–8 July 2012; pp. 4180–4183. [Google Scholar] [CrossRef]
  22. Wang, K.S. Towards zero-defect manufacturing (ZDM)—A data mining approach. Adv. Manuf. 2013, 1, 62–74. [Google Scholar] [CrossRef]
  23. Sophian, A. Non-destructive testing (NDT) in industry 4.0: A brief review. In Proceedings of the International Conference on Science and Technology(ICST), Oluvil, Sri Lanka, 3 July 2021; 2. [Google Scholar]
  24. Shaloo, M.; Schnall, M.; Klein, T.; Huber, N.; Reitinger, B. A Review of Non-Destructive Testing (NDT) Techniques for Defect Detection: Application to Fusion Welding and Future Wire Arc Additive Manufacturing Processes. Materials 2022, 15, 3697. [Google Scholar] [CrossRef] [PubMed]
  25. Javadi, Y.; Sweeney, N.E.; Mohseni, E.; MacLeod, C.N.; Lines, D.; Vasilev, M.; Qiu, Z.; Vithanage, R.K.W.; Mineo, C.; Stratoudaki, T.; et al. In-process calibration of a non-destructive testing system used for in-process inspection of multi-pass welding. Mater. Des. 2020, 195, 108981. [Google Scholar] [CrossRef]
  26. Gonzalez, R.C.; Woods, R.E. Digital Image Processing; Addison-Wesley: Boston, MA, USA, 1992. [Google Scholar]
  27. Zou, Y.; Zhang, J.; Upadhyay, M.; Sun, S.; Jiang, T. Automatic Image Thresholding Based on Shannon Entropy Difference and Dynamic Synergic Entropy. IEEE Access 2020, 8, 171218–171239. [Google Scholar] [CrossRef]
  28. Brink, A. Thresholding of digital images using two-dimensional entropies. Pattern Recognit. 1992, 25, 803–808. [Google Scholar] [CrossRef]
  29. de Albuquerque, M.P.; Esquef, I.F.; Gesualdi Mello, A.R. Image thresholding using Tsallis entropy. Pattern Recognit. Lett. 2004, 25, 1059–1065. [Google Scholar] [CrossRef]
Figure 1. Common TOFD display: (a) Unrectified A-scan; (b) D-scan.
Figure 1. Common TOFD display: (a) Unrectified A-scan; (b) D-scan.
Machines 10 00839 g001
Figure 2. The proposed method.
Figure 2. The proposed method.
Machines 10 00839 g002
Figure 3. Plotted A-scan signal.
Figure 3. Plotted A-scan signal.
Machines 10 00839 g003
Figure 4. Schematic of the experimental setup.
Figure 4. Schematic of the experimental setup.
Machines 10 00839 g004
Figure 5. Schematic of the experimental setup.
Figure 5. Schematic of the experimental setup.
Machines 10 00839 g005
Figure 6. D-scan image after scan alignment.
Figure 6. D-scan image after scan alignment.
Machines 10 00839 g006
Figure 7. A-scan signal before denoising.
Figure 7. A-scan signal before denoising.
Machines 10 00839 g007
Figure 8. A-scan signal after denoising.
Figure 8. A-scan signal after denoising.
Machines 10 00839 g008
Figure 9. Denoised D-scan image.
Figure 9. Denoised D-scan image.
Machines 10 00839 g009
Figure 10. The region between the lateral and backwall wave.
Figure 10. The region between the lateral and backwall wave.
Machines 10 00839 g010
Figure 11. The region of interest.
Figure 11. The region of interest.
Machines 10 00839 g011
Figure 12. Mean segmentation.
Figure 12. Mean segmentation.
Machines 10 00839 g012
Figure 13. One-dimensional entropy-based segmentation.
Figure 13. One-dimensional entropy-based segmentation.
Machines 10 00839 g013
Figure 14. Two-dimensional entropy-based segmentation.
Figure 14. Two-dimensional entropy-based segmentation.
Machines 10 00839 g014
Figure 15. Depth map.
Figure 15. Depth map.
Machines 10 00839 g015
Figure 16. The graphical user interface.
Figure 16. The graphical user interface.
Machines 10 00839 g016
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Subramaniam, S.; Kanfoud, J.; Gan, T.-H. Zero-Defect Manufacturing and Automated Defect Detection Using Time of Flight Diffraction (TOFD) Images. Machines 2022, 10, 839. https://doi.org/10.3390/machines10100839

AMA Style

Subramaniam S, Kanfoud J, Gan T-H. Zero-Defect Manufacturing and Automated Defect Detection Using Time of Flight Diffraction (TOFD) Images. Machines. 2022; 10(10):839. https://doi.org/10.3390/machines10100839

Chicago/Turabian Style

Subramaniam, Sulochana, Jamil Kanfoud, and Tat-Hean Gan. 2022. "Zero-Defect Manufacturing and Automated Defect Detection Using Time of Flight Diffraction (TOFD) Images" Machines 10, no. 10: 839. https://doi.org/10.3390/machines10100839

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop