Next Article in Journal
Leakage Current Mitigation of Photovoltaic System Using Optimized Predictive Control for Improved Efficiency
Next Article in Special Issue
Automatic Defect Identification Method for Magnetic Particle Inspection of Bearing Rings Based on Visual Characteristics and High-Level Features
Previous Article in Journal
Implementation of a Noise-Shaped Signaling System through Software-Defined Radio
Previous Article in Special Issue
Dynamic Wind Turbine Blade Inspection Using Micro-Polarisation Spatial Phase Shift Digital Shearography
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Research on Sparse Representation Method of Acoustic Microimaging Signals

1
State Key Laboratory of Acoustics, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China
2
School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
3
Shanghai Shipbuilding Technology Research Institute, Shanghai 200032, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2022, 12(2), 642; https://doi.org/10.3390/app12020642
Submission received: 3 November 2021 / Revised: 30 December 2021 / Accepted: 5 January 2022 / Published: 10 January 2022
(This article belongs to the Special Issue Advanced Digital Non-Destructive Testing Technology)

Abstract

:
Acoustic microimaging (AMI), a technology for high-resolution imaging of materials using a scanning acoustic microscope, has been widely used for non-destructive testing and evaluation of electronic packages. Recently, the internal features and defects of electronic packages have reached the resolution limits of conventional time domain or frequency domain AMI methods with the miniaturization of electronic packages. Various time-frequency domain AMI methods have been developed to achieve super-resolution. In this paper, the sparse representation of AMI signals is studied, and a constraint dictionary-based sparse representation (CD-SR) method is proposed. First, the time-frequency parameters of the atom dictionary are constrained according to the AMI signal to constitute a constraint dictionary. Then, the AMI signal is sparsely decomposed using the matching pursuit algorithm, and echoes selection and echoes reconstruction are performed. The performance of CD-SR was quantitatively evaluated by simulated and experimental ultrasonic A-scan signals. The results demonstrated that CD-SR has superior longitudinal resolution and robustness.

1. Introduction

AMI can evaluate the surface layer, sub-surface layer and internal structure of materials with non-destructive, precision and high sensitivity. It has been used in the fields of microelectronics [1], materials science [2], technical science [3], etc. AMI is particularly sensitive to area defects such as poor adhesion and closed cracks in multi-layer structures, making it especially suitable for failure analysis and reliability evaluation of electronic packages [4,5,6,7]. The thickness of each layer of an electronic package is about micron to sub-millimeter level. Considering the penetration depth and resolution, the ultrasonic frequencies required for electronic packages detection are 20–200 MHz. Recently, electronic packages have been evolving towards ultra-miniaturization and ultra-high density, which creates challenges for their AMI. When the thickness of the layer is less than or equal to the length of the ultrasonic wave, the echo overlap and waveform distortion of the adjacent interface are caused by insufficient longitudinal resolution. As shown in Figure 1, when the top and bottom layers of the die are detected, the top echo x 1 t and the bottom echo x 2 t are overlapped with other echoes. While increasing the ultrasonic frequency can improve longitudinal resolution, it also means greater attenuation and lower penetration. In addition, the attenuation of high-frequency ultrasound results in a relatively low signal-to-noise ratio [8].
The above problems make the traditional time domain AMI methods no longer applicable, and the resolution limit of time domain AMI has been reached. Frequency domain AMI methods obtain single-frequency images by processing the threshold echoes through FFT, which can reveal some features and defects below the resolution limit of time domain AMI, but the improvement of the resolution is limited because of the spectrum overlap and frequency shifting [9,10]. Since ultrasonic echoes are non-stationary signals limited by time and frequency, the time-frequency analysis method is more suitable for the analysis of overlapping echoes [11]. Wavelet analysis-based deconvolution (WABAD) [12], continuous wavelet transform (CWT) [13], sparse representation (SR) [14] and other time-frequency domain AMI methods have been proposed to achieve super-resolution and high robustness. Among them, SR can adaptively select the atoms that match the signal from the atom dictionary and concentrate the information or energy contained in the signal on a few atoms, which can effectively reveal the time-frequency structure of the signal. Studies [13,15] have shown that SR has certain advantages in solving the above problems and has been applied to resolution improvement [10,16], noise suppression [17,18], pulse detection [15,19,20], blind source separation [21], multi-mode guided wave separation [22], etc.
The SR method uses an atom dictionary as a decomposition set [23], which is concise and adaptive. The key to successfully using the SR method is to select an appropriate atom dictionary [24]. Atom dictionaries can be divided into traditional dictionaries and learning dictionaries. The commonly used traditional dictionaries are the Chirplet dictionary [25], Daubechies dictionary [26] and Gabor dictionary [27,28], which show a strong resemblance to ultrasonic echoes. Traditional dictionaries contain extensive time-frequency features, sufficient diversity and high redundancy, which are not suitable for processing overlapping echoes. Lu et al. [24,29] proposed an adaptive and interpolated Gabor dictionary for the analysis of complex ultrasonic echoes. Researchers have proposed learning dictionaries, such as the ICA learning dictionary [8], FOCUSS-CNDL learning dictionary [30] and K-SVD learning dictionary [31], to obtain a more sparse representation. Learning dictionaries obviously match the echo better, but its versatility is poor and engineering implementation is also difficult. Furthermore, most of the existing studies address the overlap of two echoes [8,10,12,13], while there are few studies on the overlap of multiple echoes for electronic packages detection. In order to quantitatively discuss [14] the overlap of multiple echoes and effectively improve the longitudinal resolution, it is necessary not only to improve the matching between the atoms in the dictionary and the echoes before overlap [32], but also to improve the accuracy of the decomposition and reconstruction algorithm [33].
In this paper, the AMI signal model and sparse representation theory are reviewed, and a constraint dictionary-based sparse representation (CD-SR) method is proposed to achieve super-resolution and high robustness in Section 2. In Section 3, a simulation model of the electronic package is developed to quantitatively test and compare the performance of the traditional SR method and the CD-SR method. Experimental results for 20 MHz and 200 MHz are given in Section 4. We conclude in Section 5.

2. Materials and Methods

2.1. General Formulation

2.1.1. Acoustic Microimaging Signals Model

Generally, in a reflective ultrasonic detection system, the A-scan AMI signal y t can be expressed as a linear combination of reflected echoes x i t from different interfaces in the sample, i.e.,
y t = i = 0 m x i t + n t ,
where n t is the noise from the detection system and material. In scanning acoustic microscopy, the shape of the ultrasonic wave will change during propagation due to focusing effects, frequency-dependent attenuation and microstructural scattering of the medium. At this time, the AMI signal y t can be written as:
y t = i = 0 m c i φ i t + n t ,
where c i is the reflection coefficient, φ i t is the “quasi” incident pulse at the i th interface, which is not a real incident pulse, but a pulse that includes dual-way transmission and attenuation. In the matrix format, Equation (2) becomes [8,10]:
y = c Ф + n .
In fact, the AMI signal y t is composed of a finite number of echoes, that is, m is finite, so it can be assumed that the AMI signal y t has a sparse representation in the appropriate atom dictionary Ф [34].

2.1.2. Sparse Representation

Sparse representation takes the form of adaptively selecting atoms in the atom dictionary to approximate the signal using a sparse decomposition algorithm. Considering the sparsity of the solution, decomposition speed and accuracy, Matching pursuit (MP) [27] is one of the most commonly used sparse decomposition algorithms. The MP algorithm is a greedy algorithm to find sub-optimal sparse decomposition locally. Given that the atom dictionary Ф = φ γ t γ Г , φ γ is the atom, and Г is the parameter set, through orthogonal projection in the dictionary Ф , y t is decomposed into [23,35]:
y   =   R 0 y ,     φ γ 0 φ γ 0 + R 1 y ,
where R 0 y = y , R 1 y is the residual signal after y is approximated in the φ γ 0 direction. In order to make R 1 y as small as possible, the atom φ γ 0 should satisfy:
y ,     φ γ 0 = max γ Г y ,     φ γ ,
We perform decomposition m times, then,
y = i = 0 m 1 R i y ,     φ γ i φ γ i + R m y .
The atoms in the atom dictionary have localized characteristics in time and frequency. It is shown that the Gabor dictionary can simulate AMI signals well and is the most commonly used dictionary for processing AMI signals [10,15,29]. The Gabor dictionary is defined as [27]:
φ γ = 1 s g t u s cos ω t + θ ,
where g t = e π t 2 is the Gaussian window function, γ = s , u , ω , θ is the time-frequency parameter, s is the scale factor, u is the displacement factor, ω is the frequency factor, and θ is the phase factor. In practical applications, γ is discretized as [27,36]:
γ = a j , p a j u , k a j ω , q θ .
where a = 2 , u = 1 / 2 , ω = π , θ = π / 6 , 0 < j log 2 N , 0 p N 2 j + 1 , 0 k < 2 j + 1 , 0 q 12 . The number of atoms L Ф is determined by the signal length N , and L Ф = 52 N log 2 N + N 1 .
The energy of the echoes is mainly concentrated in small time-frequency subspaces, while the noise is distributed over the entire time-frequency plane. In the sparse decomposition process, the echoes are decomposed into several atoms, and the noise usually does not match any atoms. In order to achieve super-resolution and high robustness, the time-frequency window is determined according to the frequency of the transducer and the target interface or defect location in the sample. In addition, the atom with the center in the time-frequency window and the largest decomposition coefficient is selected. The selected atom and its decomposition coefficient are respectively used as the approximation of the incident pulse φ i t and the reflection coefficient c i [8,10].

2.2. Constraint Dictionary-Based Sparse Representation

Mathematically, the above Gabor dictionary is concise and complete. However, when dealing with overlapping echoes, the above Gabor dictionary contains quite a lot of atoms that do not match the actual echoes, which affect the calculation efficiency. In addition, the above Gabor dictionary may contain atoms that match the echoes after overlap, so that the echoes before the overlap cannot be distinguished and the improvement of longitudinal resolution is limited. In order to effectively improve longitudinal resolution, the CD-SR method is proposed. The constraint dictionary and algorithm design are as follows.

2.2.1. Constraint Dictionary

In order to constrain the time-frequency parameters of the Gabor dictionary so that the atoms match the echoes better, a reference echo is introduced. The reference echo is selected from non-overlapping echoes, as in Figure 1b, and x 0 t can be taken as the reference echo, whose expression is adopted from the Gabor function, i.e.,
x 0 t = 1 s 0 g t u 0 s 0 c o s ω 0 t + θ 0 .
The time-frequency parameter γ 0 = s 0 , u 0 , ω 0 , θ 0 of the reference echo are calculated. Based on the reference echo x 0 t , the constraint method for the Gabor dictionary time-frequency parameters applicable to the electronic packages AMI is as follows.
1.
When ultrasonic waves propagate inside an electronic package, absorption attenuation is dominant, and the transfer function is:
H d f = e 2 d α 0 f β ,
where α 0 is the attenuation factor, β is the frequency-dependent index (in electronic packages β 1 ), and d is the distance between the reference interface and the target interface. According to Equations (9) and (10), the peak frequency of the target echo can be calculated as:
ω d = ω 0 2 α 0 d s 0 2 .
Therefore, the discrete range of the frequency factor ω can be constrained to { ω | 1 ω d ω ω 0 } , where is a constant less than 1, which is used to eliminate calculation errors and prevent over-constraining.
2.
The full width at one-tenth maximum (FWTM) of the Gaussian window is about 1.71 s , and the duration T of Gabor atoms in the time domain can be approximated by FWTM, that is, T = 1.71 s . Relating the scale factor s to the frequency factor ω , s can be expressed as:
s = T 1.71 = 2 π p 1.71 ω .
where p is the number of cycles within the FWTM [29], and the number of cycles of the reference echo is p 0 . Due to the attenuation of the medium, the range of the number of cycles of the target echo is 1 p 0 , p 0 . Therefore, the discrete range of the scale factor s can be constrained to { 2 π p / 1.71 ω | 1 p 0 p p 0 } .
3.
The displacement of the reference echo is u 0 , so the displacement of the target echo is u d = u 0 + 2 d / c L , where c L is the longitudinal wave velocity in the medium. Therefore, the discrete range of the displacement factor u can be constrained to { u | 1 u d u 1 + u d } .
4.
Due to the frequency-dependent attenuation of the medium, the target echo and the reference echo are no longer simply in-phase or anti-phase, but show a certain difference. Therefore, the dispersion range of the phase factor θ can be constrained to { θ | 1 θ 0 θ 1 + θ 0 } .
Figure 2 shows the spatial sampling of the frequency factor before and after the constraint. Before the constraint, the sweep interval of the frequency gradually becomes dense as the octave value increases. After the constraint, the sweep interval of the frequency is small and constant, and the frequencies of the atoms are close to the echo frequency. On the one hand, the calculation accuracy and efficiency are improved. On the other hand, signals with serious overlap can be separated.

2.2.2. Algorithm Design

The sparse representation based on the constraint dictionary is equivalent to an approximate solution of the following optimization problem:
m i n c 0                 s .   t .               y = c Ф .
Its astringency has been be proved [27]. In this paper, the time-frequency parameters of the atom dictionary are constrained to form a constraint dictionary according to AMI signals. Then MP algorithm is utilized to adaptively choose atoms from the constraint dictionary to decompose the signal. Finally, atoms are selected according to the time-frequency window to reconstruct the echoes before overlap. The detailed algorithm design is as follows.
1.
Initialization: given the overlapping AMI signal y , the constrained Gabor dictionary Ф and the residual signal threshold ε , set the initial solution support set S 0 = and the initial residual signal R 0 y = y .
2.
Discretization of constraint dictionary: the AMI signal is exemplified in Figure 3a, where x 0 t is selected as the reference echo and the target echoes are x 1 t and x 2 t . According to the constraints above, discretization is performed at a small discrete interval to achieve high resolution.
3.
Matching pursuit ( i = 0 , 1 , 2 , , m 1 ):
(a)
All the atoms φ γ are sequentially inner producted with the residual signal R i y to find the atom φ γ i whose decomposition coefficient satisfies c i = R i y ,   φ γ i = max γ Г R i y ,   φ γ , and update the support set S i + 1 = S i φ γ i . (Since N inner product operations can be converted into a cross-correlation operation, FFT can be used to quickly implement cross-correlation operations to increase the calculation speed [23].)
(b)
Update residual signal: R i + 1 y = R i y R i y ,   φ γ i .
(c)
Stop condition: R m y 2 ε .
4.
Selection and reconstruction:
(a)
As shown in Figure 3b, each atom φ γ i obtained by the matching iteration is represented by a Heisenberg box, and the decomposition coefficient is represented by the darkness of the box. The larger the coefficient, the darker the box.
(b)
According to the target echoes x 1 t and x 2 t , atoms with the largest decomposition coefficients are selected as the time-frequency window, respectively.
(c)
The atom and its decomposition coefficient are considered as the approximation of the incident pulse φ i t and the reflection coefficient c i [8,10]. The atoms whose centers lie within the time-frequency window are chosen to reconstruct x 1 t and x 2 t before the overlap, i.e., x 1 t = c 0 φ γ 0 + c 4 φ γ 4 , x 2 t = c 1 φ γ 1 + c 5 φ γ 5 , resulting in Figure 3c.
(d)
Display the peak value of the target echo at each x-y position to generate a C-scan image.

3. Simulations

3.1. Simulation Model

As shown in Figure 4a, a simple model of scanning acoustic microscopy of electronic packages was established using PZFlex software (Weidlinger Associates, Los ltos, CA, USA), where the electronic package was simulated by Epoxy Molding Compound (EMC) and silicon die. The transducer frequency was set to 20 MHz, and the material properties are listed in Table 1. As shown in Figure 4b, the reference interface is the top layer of the EMC, corresponding to the reference echo x 0 t , and the target interfaces are the top and bottom layers of the die, corresponding to the target echoes x 1 t and x 2 t , respectively. x 3 t to x m t are the multiple reflected echoes within the die. When the thickness of the die becomes smaller, x 2 t to x m t will all move toward x 1 t , resulting in the overlap of multiple echoes. The degree of overlap δ is defined as the relative size of the overlap between x 1 t and x 2 t .
δ = T 2 d c L / T .
where d is the thickness of the die, c L = 7526   m / s is the longitudinal wave velocity in the die, and T = 110.0   ns is the FWTM duration of x 1 t . When the thickness of the die is half-wavelength, that is, d = T c L / 2 = 413.9   μ m , the degree of overlap is zero. By changing the thickness of the die, different degrees of overlap between x 1 t and x 2 t can be simulated. Figure 5a–c are the cases where the overlap degree is −45%, 30% and 60%, respectively.

3.2. Simulation Results

3.2.1. Longitudinal Resolution

AMI signals with different degrees of overlap can be obtained by the above simulation model, and are used to test the performance of SR and CD-SR methods in improving the longitudinal resolution. To quantitatively evaluate the performance, the amplitude error A e r r and the position error P e r r of the reconstructed echo are used, which are defined as:
A e r r = A r e c A t h e o A t h e o × 100 %
P e r r = P r e c P t h e o P t h e o × 100 %
where A r e c is the peak-to-peak value of the reconstructed echo, A t h e o is the theoretical peak-to-peak value, P r e c is the position of the reconstructed echo, and P t h e o is the theoretical position. The amplitude error and position error directly affect the C-scan imaging effect. When the amplitude error or position error of the reconstructed echo is greater than 30%, it is considered that the method cannot correctly reconstruct the echo before the overlap.
In the case of an equal number of dictionary atoms, the results is shown in Figure 6, where A e r r x 1 and A e r r x 2 are the amplitude errors of x 1 t and x 2 t , respectively, and P e r r is the error in the relative positions of x 1 t and x 2 t . The simulation results demonstrated that CD-SR has a better ability to distinguish overlapping echoes, and can distinguish and reconstruct echoes with overlap less than 63%. SR can only distinguish echoes with overlap less than 52%, and the amplitude error and position error are relatively large.
In addition, the waveform characteristics of the reconstructed echoes are compared. When δ = 50 % , the comparison result is shown in Figure 7a. It can be observed that the waveforms of x 1 t and x 2 t reconstructed by CD-SR are more consistent with the actual waveforms (see Figure 5a), while SR has a larger error. Figure 7b shows the reconstruction results when δ = 60 % . The waveforms obtained by CD-SR still match the actual waveforms, while SR can no longer successfully separate the overlapping echoes.

3.2.2. Robustness

The noise problem of scanning acoustic microscopy is more prominent than traditional ultrasonic testing. In order to test the robustness of SR and CD-SR, zero-mean Gaussian white noise was added to the AMI signal to construct AMI signals with different signal-to-noise ratios. Figure 8a shows x 1 t and x 2 t without noise. After adding noise, as shown in Figure 8b,c, the signal-to-noise ratio is 0 and −15 dB, respectively.
The comparison results are shown in Figure 9. Compared with SR, CD-SR has smaller amplitude error and position error in reconstructing echoes, and is more robust for cases with poorer signal-to-noise ratio. In the case of a signal-to-noise ratio of −15 dB, the reconstructed echoes are shown in Figure 10. The waveforms obtained by CD-SR are still consistent with the actual waveforms (see Figure 8a), but SR can no longer successfully separate the echoes.

4. Experiments

4.1. Conventional Experiment

4.1.1. Experimental Setup

In order to verify the performance of the SR and CD-SR methods, an experimental platform consistent with the simulation was established. As shown in Figure 11, the Olympus V316 20 MHz (Olympus NDT, Waltham, MA, USA) focused transducer was excited with an Olympus 5800 Pulser-Receiver (Olympus NDT, Waltham, MA, USA) and the signal was acquired with a Tektronix MDO3032 oscilloscope (Tektronics, Beaverton, OR, USA). The sample was composed of polystyrene sheets and silicon wafer, and the material properties are shown in Table 2. The reference echo is from the top layer of polystyrene sheet. The target echoes are the top layer echo x 1 t (whose FWTM duration T is 127.7   ns ) and the bottom layer echo x 2 t of the silicon wafer. Three cases were designed by changing the thickness d of the silicon wafer. Figure 12a–c are the cases where the overlap degree δ is −30%, 50% and 60%, respectively.

4.1.2. Experimental Results

As shown in Figure 13, when the degree of overlap is 50% or 60%, the waveforms of x 1 t and x 2 t reconstructed by CD-SR are consistent with the actual waveforms (see Figure 12a), but SR can no longer successfully separate the overlapping echoes. The reason why SR fails in the experiment is that the actual overlapping echoes have relatively small differences in time-frequency parameters, while SR distinguishes overlapping echoes based on the difference in time-frequency parameters of the echoes. CD-SR forms a dictionary through pre-calculation and constraint. The atoms in the constraint dictionary are similar to the echoes before the overlap, and none of them are similar to the overlapping echoes, so the overlapping echoes can be successfully decomposed and reconstructed. Due to the tailing and noise of the experimental echoes, the experimental performance is not as good as the simulation. Table 3 shows the amplitude error A e r r x 1 and position error P e r r of CD-SR, indicating that the errors are small.

4.2. Analogous Experiment for Very High Frequency

4.2.1. Experimental Design

To verify the performance of the SR and CD-SR methods in the very high frequency range (30–300 MHz), the thickness of the silicon die is required to be tens of microns, which undoubtedly has high requirements on the production accuracy. Considering the analogy between acoustics and electricity, the propagation of ultrasonic waves in a die is analogous to the propagation of electromagnetic waves in a coaxial cable, and the reflection of ultrasonic waves caused by the difference in acoustic impedance on the surface of the die is analogous to the reflection of electromagnetic waves caused by the difference in electrical impedance at the two ends of the coaxial cable. Therefore, echoes with different degrees of overlap can be obtained simply by changing the length of the coaxial cable. The experimental device is shown in Figure 14. The CTS VF428 200 MHz acoustic lens-focused transducer (CTS, Lisle, IL, USA) was excited with a high-frequency transmitting circuit. The receiving circuit and the Keysight MSO9254A oscilloscope (Keysight, Santa Rosa, CA, USA) were used to amplify and acquire the AMI signal (lens echo), respectively. The coaxial cable was located between the transducer and the receiving circuit. When the length of the coaxial cable is zero, the reference echo x 0 was obtained. The FWTM duration T of the electromagnetic wave is 12.0   ns , and the properties of the coaxial cable are shown in Table 4. Three cases were designed by changing the length d of the coaxial cable. Figure 15a–c are the cases where the overlap degree is −25%, 50% and 60%, respectively.

4.2.2. Experimental Results

As shown in Figure 16, CD-SR successfully separates the overlapping echoes when the degree of overlap is 50% or 60%, and the reconstructed waveforms of x 1 t and x 2 t are consistent with the actual waveforms (see Figure 15a). However, SR cannot successfully separate the overlapping echoes. The results are consistent with the results of conventional experiment in Section 4.1. Table 5 shows the amplitude error and position error of CD-SR, indicating that the errors are as small as the simulation results.

5. Conclusions

With the miniaturization of electronic packages, the resolution limits of traditional time domain AMI and frequency domain AMI have been reached. SR is a time-frequency domain AMI method that can improve longitudinal resolution. The SR method with traditional Gabor dictionary distinguishes overlapping echoes based on the differences in the time-frequency parameters of the echoes, and is often used to separate two echoes with certain differences. For the overlap problem of multiple similar echoes in electronic packages detection, the SR method has limited separation effect.
In this paper, the CD-SR method is proposed to achieve super-resolution and high robustness. The innovation lies in: (1) Quantitative discussion on the overlap of multiple echoes. The degree of overlap and the performance of the method are quantitatively analyzed. (2) Constraint dictionaries are proposed. The constraint dictionary differs from the conventional dictionary in that its time-frequency parameters are determined according to the AMI signal to be processed and used to achieve higher matching accuracy. (3) The sparse decomposition and reconstruction algorithm of AMI signals is improved to achieve more accurate decomposition and reconstruction.
Simulation and experimental results demonstrated that the reconstruction errors of CD-SR remains within 13% when the echo overlap degree is as high as 60%, with superior longitudinal resolution and robustness. Although the Gabor dictionary is used in this paper for constraint, the proposed constraint idea is universal and can be used for different types of dictionary to solve the problems in ultrasonic detection, such as resolution improvement, noise suppression, pulse detection, etc.

Author Contributions

Conceptualization, K.W., T.L. and J.M.; methodology, K.W. and T.L.; validation, J.M. and G.L.; simulation, K.W. and T.L.; experiment, K.W. and T.L.; data curation, K.W.; writing—original draft preparation, K.W.; writing—review and editing, T.L., J.M., G.L. and C.Z.; visualization, T.L., J.M., G.L. and C.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data is contained within the article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hertl, M.; Mialhe, F.; Richard, I. On the replacement of water as coupling medium in scanning acoustic microscopy analysis of sensitive electronics components. Microelectron. Reliab. 2020, 114, 113860. [Google Scholar] [CrossRef]
  2. Altun, B.; Demirkan, I.; Isik, E.O.; Kocaturk, O.; Unlu, M.B.; Garipcan, B. Acoustic impedance measurement of tissue mimicking materials by using scanning acoustic microscopy. Ultrasonics 2020, 110, 106274. [Google Scholar] [CrossRef] [PubMed]
  3. Zinin, P.V.; Kutuza, I.B.; Titov, S.A. Near-Field Defects Imaging in Thin DLC Coatings Using High-Frequency Scanning Acoustic Microscopy. J. Surf. Investig. X-ray Synchrotron Neutron Tech. 2018, 12, 1285–1293. [Google Scholar] [CrossRef]
  4. Mehr, M.Y.; Bahrami, A.; Fischer, H.; Gielen, S.; Corbeij, R.; Van Driel, W.D.; Zhang, G.Q. An overview of scanning acoustic mi-croscope, a reliable method for non-destructive failure analysis of microelectronic components. In Proceedings of the 2015 16th International Conference on Thermal, Mechanical and Multi-Physics Simulation and Experiments in Microelectronics and Microsystems, EuroSimE 2015, Budapest, Hungary, 19–22 April 2015. [Google Scholar]
  5. Yu, X.; Huang, H.; Xie, W.; Gu, J.; Li, K.; Su, L. Simulation Research on Sparse Reconstruction for Defect Signals of Flip Chip Based on High-Frequency Ultrasound. Appl. Sci. 2020, 10, 1292. [Google Scholar] [CrossRef] [Green Version]
  6. Wolter, K.J.; Speck, M.; Heinze, R. Reliability analysis in microelectronic packaging by acoustic microscopy. In Proceedings of the 28th International Spring Seminar on Electronics Technology: Meeting the Challenges of Electronics Technology Progress, Wiener Neustadt, Austria, 19–20 May 2005. [Google Scholar]
  7. Ma, L.; Bao, S.; Lv, D.; Du, Z.; Li, S. Application of C-mode scanning acoustic microscopy in packaging. In Proceedings of the Electronic Packaging Technology Conference, EPTC, Sparks, NV, USA, 29 May–1 June 2007. [Google Scholar]
  8. Zhang, G.-M.; Harvey, D.M.; Braden, D.R. An improved acoustic microimaging technique with learning overcomplete representation. J. Acoust. Soc. Am. 2005, 118, 3706. [Google Scholar] [CrossRef]
  9. Semmens, J.E.; Kessler, L.W. Application of Acoustic Frequency Domain Imaging for the Evaluation of Advanced Micro Electronic Packages. Microelectron. Reliab. 2002, 42, 1735–1740. [Google Scholar] [CrossRef]
  10. Zhang, G.-M.; Harvey, D.; Braden, D. Advanced Acoustic Microimaging Using Sparse Signal Representation for the Evaluation of Microelectronic Packages. IEEE Trans. Adv. Packag. 2006, 29, 271–283. [Google Scholar] [CrossRef]
  11. Feng, W.; Chen, X.; Wang, C.; Shi, Y. Application research on the time–frequency analysis method in the quality detection of ultrasonic wire bonding. Int. J. Distrib. Sens. Networks 2021, 17, 15501477211018346. [Google Scholar] [CrossRef]
  12. Jhang, K.; Jang, H.; Park, B.; Ha, J.; Park, I.; Kim, K. Wavelet analysis based deconvolution to improve the resolution of scanning acoustic microscope images for the inspection of thin die layer in semiconductor. NDTE Int. 2002, 35, 549–557. [Google Scholar] [CrossRef]
  13. Zhang, G.-M.; Harvey, D.M.; Braden, D.R. Resolution improvement of acoustic microimaging by continuous wavelet transform for semiconductor inspection. Microelectron. Reliab. 2006, 46, 811–821. [Google Scholar] [CrossRef]
  14. Zhang, G.-M.; Zhang, C.-Z.; Harvey, D.M. Sparse signal representation and its applications in ultrasonic NDE. Ultrasonics 2012, 52, 351–363. [Google Scholar] [CrossRef] [PubMed]
  15. Qi, A.L.; Ma, H.W.; Liu, T. A weak signal detection method based on artificial fish swarm optimized matching pursuit. In Proceedings of the 2009 WRI World Congress on Computer Science and Information Engineering, Los Angeles, CA, USA, 31 March–2 April 2009; Volume 6, pp. 185–189. [Google Scholar]
  16. Duan, J.; Zhong, H.; Jing, B.; Zhang, S.; Wan, M. Increasing Axial Resolution of Ultrasonic Imaging with a Joint Sparse Representation Model. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 2016, 63, 2045–2056. [Google Scholar] [CrossRef]
  17. Ruiz-Reyes, N.; Vera-Candeas, P.; Curpián-Alonso, J.; Mata-Campos, R.; Cuevas-Martínez, J. New matching pursuit-based algorithm for SNR improvement in ultrasonic NDT. NDTE Int. 2005, 38, 453–458. [Google Scholar] [CrossRef]
  18. Jabarulla, M.Y.; Lee, H.-N. Speckle Reduction on Ultrasound Liver Images Based on a Sparse Representation over a Learned Dictionary. Appl. Sci. 2018, 8, 903. [Google Scholar] [CrossRef] [Green Version]
  19. Qi, A.-L.; Zhang, G.-M.; Dong, M.; Ma, H.-W.; Harvey, D.M. An artificial bee colony optimization based matching pursuit approach for ultrasonic echo estimation. Ultrasonics 2018, 88, 1–8. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Wang, B.; Li, Y.; Zhao, W.; Zhang, Z.; Zhang, Y.; Wang, Z. Effective Crack Damage Detection Using Multilayer Sparse Feature Representation and Incremental Extreme Learning Machine. Appl. Sci. 2019, 9, 614. [Google Scholar] [CrossRef] [Green Version]
  21. Zibulevsky, M.; Pearlmutter, B. Blind Source Separation by Sparse Decomposition in a Signal Dictionary. Neural Comput. 2001, 13, 863–882. [Google Scholar] [CrossRef]
  22. Wang, W.; Bao, Y.; Zhou, W.; Li, H. Sparse representation for Lamb-wave-based damage detection using a dictionary algorithm. Ultrasonics 2018, 87, 48–58. [Google Scholar] [CrossRef] [PubMed]
  23. Elad, M. Sparse and Redundant Representations; Springer: New York, NY, USA, 2010; ISBN 978-1-4419-7010-7. [Google Scholar]
  24. Lu, Y.; Michaels, J.E. Ultrasonic Signal Decomposition via Matching Pursuit with an Adaptive and Interpolated Dictionary. AIP Conf. Proc. 2007, 894, 579–586. [Google Scholar] [CrossRef]
  25. Hong, J.-C.; Sun, K.H.; Kim, Y.Y. Waveguide damage detection by the matching pursuit approach employing the dispersion-based chirp functions. IEEE Trans. Ultrason. Ferroelectr. Freq. Control. 2006, 53, 592–605. [Google Scholar] [CrossRef]
  26. Yang, G.; Zhang, Q.; Que, P.-W. Matching-pursuit-based adaptive wavelet-packet atomic decomposition applied in ultrasonic inspection. Russ. J. Nondestruct. Test. 2007, 43, 62–68. [Google Scholar] [CrossRef]
  27. Mallat, S.; Zhang, Z. Matching pursuits with time-frequency dictionaries. IEEE Trans. Signal Process. 1993, 41, 3397–3415. [Google Scholar] [CrossRef] [Green Version]
  28. Boßmann, F.; Plonka, G.; Peter, T.; Nemitz, O.; Schmitte, T. Sparse Deconvolution Methods for Ultrasonic NDT. J. Nondestruct. Evaluation 2012, 31, 225–244. [Google Scholar] [CrossRef] [Green Version]
  29. Lu, Y.; Michaels, J.E. Numerical implementation of matching pursuit for the analysis of complex ultrasonic signals. IEEE Trans. Ultrason. Ferroelectr. Freq. Control. 2008, 55, 173–182. [Google Scholar] [CrossRef]
  30. Murray, J.F.; Kreutz-Delgado, K. Learning Sparse Overcomplete Codes for Images. J. VLSI Signal Process. Syst. Signal Image Video Technol. 2006, 46, 1–13. [Google Scholar] [CrossRef] [Green Version]
  31. Feng, J.; Song, L.; Yang, X.; Zhang, W. Sub clustering K-SVD: Size variable dictionary learning for sparse representations. In Proceedings of the Proceedings—International Conference on Image Processing, Las Vegas, NV, USA, 13–16 July 2009; pp. 2149–2152. [Google Scholar] [CrossRef]
  32. Rubinstein, R.; Bruckstein, A.M.; Elad, M. Dictionaries for Sparse Representation Modeling. Proc. IEEE 2010, 98, 1045–1057. [Google Scholar] [CrossRef]
  33. Elad, M.; Yavneh, I. A Plurality of Sparse Representations Is Better Than the Sparsest One Alone. IEEE Trans. Inf. Theory 2009, 55, 4701–4714. [Google Scholar] [CrossRef]
  34. Zhang, G.-M.; Harvey, D.M.; Braden, D.R. Microelectronic package characterisation using scanning acoustic microscopy. NDT E Int. 2007, 40, 609–617. [Google Scholar] [CrossRef]
  35. Qi, A.L.; Ma, H.W.; Liu, T. Ultrasonic signal detection via improved sparse representations. In Proceedings of the 2009 WRI Global Congress on Intelligent Systems, Xiamen, China, 19–21 May 2009; Volume 1, pp. 309–313. [Google Scholar]
  36. Lobo, A.; Loizou, P. Voiced/unvoiced speech discrimination in noise using Gabor atomic decomposition. In Proceedings of the ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing, Hong Kong, China, 6–10 April 2003; Volume 1, pp. 820–823. [Google Scholar] [CrossRef]
Figure 1. Scanning acoustic microscopy of electronic packages: (a) common structure of electronic packages; (b) acoustic microimaging (AMI) signal.
Figure 1. Scanning acoustic microscopy of electronic packages: (a) common structure of electronic packages; (b) acoustic microimaging (AMI) signal.
Applsci 12 00642 g001
Figure 2. Spatial sampling of the frequency factor before (a) and after (b) constraint.
Figure 2. Spatial sampling of the frequency factor before (a) and after (b) constraint.
Applsci 12 00642 g002
Figure 3. Sparse decomposition and echoes reconstruction: (a) AMI signal; (b) time-frequency diagram of atoms obtained by sparse decomposition; (c) reconstructed x 1 t and x 2 t .
Figure 3. Sparse decomposition and echoes reconstruction: (a) AMI signal; (b) time-frequency diagram of atoms obtained by sparse decomposition; (c) reconstructed x 1 t and x 2 t .
Applsci 12 00642 g003
Figure 4. Simple model of scanning acoustic microscopy of electronic packages (a) and AMI signal (b).
Figure 4. Simple model of scanning acoustic microscopy of electronic packages (a) and AMI signal (b).
Applsci 12 00642 g004
Figure 5. AMI signals with different degrees of overlap: (a) δ = 45 % ; (b) δ = 30 % ; (c) δ = 60 % .
Figure 5. AMI signals with different degrees of overlap: (a) δ = 45 % ; (b) δ = 30 % ; (c) δ = 60 % .
Applsci 12 00642 g005
Figure 6. Comparison of errors (Red: constraint dictionary-based sparse representation (CD-SR), Black: sparse representation (SR)).
Figure 6. Comparison of errors (Red: constraint dictionary-based sparse representation (CD-SR), Black: sparse representation (SR)).
Applsci 12 00642 g006
Figure 7. Comparison of reconstructed echoes: (a) δ = 50 % ; (b) δ = 60 % .
Figure 7. Comparison of reconstructed echoes: (a) δ = 50 % ; (b) δ = 60 % .
Applsci 12 00642 g007
Figure 8. AMI signals with different signal-to-noise ratios (SNR): (a) SNR = + ; (b) SNR = 0   dB ; (c) SNR = 15   dB .
Figure 8. AMI signals with different signal-to-noise ratios (SNR): (a) SNR = + ; (b) SNR = 0   dB ; (c) SNR = 15   dB .
Applsci 12 00642 g008
Figure 9. Comparison of errors (Red: CD-SR, Black: SR).
Figure 9. Comparison of errors (Red: CD-SR, Black: SR).
Applsci 12 00642 g009
Figure 10. Comparison of reconstructed echoes ( SNR = 15   dB ).
Figure 10. Comparison of reconstructed echoes ( SNR = 15   dB ).
Applsci 12 00642 g010
Figure 11. The 20 MHz experimental platform.
Figure 11. The 20 MHz experimental platform.
Applsci 12 00642 g011
Figure 12. AMI signals with different degrees of overlap: (a) δ = 30 % ; (b) δ = 50 % ; (c) δ = 60 % .
Figure 12. AMI signals with different degrees of overlap: (a) δ = 30 % ; (b) δ = 50 % ; (c) δ = 60 % .
Applsci 12 00642 g012
Figure 13. Comparison of reconstructed echoes: (a) δ = 50 % ; (b) δ = 60 % .
Figure 13. Comparison of reconstructed echoes: (a) δ = 50 % ; (b) δ = 60 % .
Applsci 12 00642 g013
Figure 14. The 200 MHz experimental device.
Figure 14. The 200 MHz experimental device.
Applsci 12 00642 g014
Figure 15. AMI signals with different degrees of overlap: (a) δ = 25 % ; (b) δ = 50 % ; (c) δ = 60 % .
Figure 15. AMI signals with different degrees of overlap: (a) δ = 25 % ; (b) δ = 50 % ; (c) δ = 60 % .
Applsci 12 00642 g015
Figure 16. Comparison of reconstructed echoes: (a) δ = 50 % ; (b) δ = 60 % .
Figure 16. Comparison of reconstructed echoes: (a) δ = 50 % ; (b) δ = 60 % .
Applsci 12 00642 g016
Table 1. Material properties.
Table 1. Material properties.
Silicon DieEpoxy Molding Compound (EMC)Water
Density   ρ   ( kg / m 3 )233010501000
Longitudinal   wave   velocity   c L   ( m / s )752624001496
Attenuation   at   20   MHz   ( dB / cm )2.07.10.8
Thickness   ( μ m ) d = 413.9 1 δ d 1 = 1000 d 2 = 2000
Table 2. Material properties.
Table 2. Material properties.
Silicon WaferPolystyrene Sheet
Density   ρ   ( kg / m 3 )23301050
Longitudinal   wave   velocity   c L   ( m / s )78342314
Thickness   ( μ m ) 500.2 1 δ 1000
Table 3. Reconstruction errors of CD-SR.
Table 3. Reconstruction errors of CD-SR.
d   μ m δ   % A e r r x 1   % P e r r   %
250504.128.48
200602.683.42
Table 4. Coaxial cable properties.
Table 4. Coaxial cable properties.
Coaxial Cable
Characteristic   impedance   Z 0   ( Ω ) 50
Electromagnetic   wave   velocity   c L   ( m / s ) 2 × 10 8
Attenuation   ( dB / cm ) 0
Length   ( m ) d = 1.2 1 δ
Table 5. Reconstruction errors of CD-SR.
Table 5. Reconstruction errors of CD-SR.
d   m   δ   %   A e r r x 1   % P e r r   % A e r r x 2   %
0.60503.481.040.47
0.48600.622.3912.64
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wang, K.; Leng, T.; Mao, J.; Lian, G.; Zhou, C. Research on Sparse Representation Method of Acoustic Microimaging Signals. Appl. Sci. 2022, 12, 642. https://doi.org/10.3390/app12020642

AMA Style

Wang K, Leng T, Mao J, Lian G, Zhou C. Research on Sparse Representation Method of Acoustic Microimaging Signals. Applied Sciences. 2022; 12(2):642. https://doi.org/10.3390/app12020642

Chicago/Turabian Style

Wang, Kun, Tao Leng, Jie Mao, Guoxuan Lian, and Changzhi Zhou. 2022. "Research on Sparse Representation Method of Acoustic Microimaging Signals" Applied Sciences 12, no. 2: 642. https://doi.org/10.3390/app12020642

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop