Next Article in Journal
Convolutional Neural Network with Attention Mechanism and Visual Vibration Signal Analysis for Bearing Fault Diagnosis
Previous Article in Journal
Efficient Neural Networks on the Edge with FPGAs by Optimizing an Adaptive Activation Function
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fault Diagnosis of a Multistage Centrifugal Pump Using Explanatory Ratio Linear Discriminant Analysis

1
Department of Electrical, Electronic and Computer Engineering, University of Ulsan, Ulsan 44610, Republic of Korea
2
Prognosis and Diagnostic Technologies Co., Ulsan 44610, Republic of Korea
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(6), 1830; https://doi.org/10.3390/s24061830
Submission received: 21 February 2024 / Revised: 6 March 2024 / Accepted: 11 March 2024 / Published: 13 March 2024

Abstract

:
This study introduces an innovative approach for fault diagnosis of a multistage centrifugal pump (MCP) using explanatory ratio (ER) linear discriminant analysis (LDA). Initially, the method addresses the challenge of background noise and interference in vibration signals by identifying a fault-sensitive frequency band (FSFB). From the FSFB, raw hybrid statistical features are extracted in time, frequency, and time–frequency domains, forming a comprehensive feature pool. Recognizing that not all features adequately represent MCP conditions and can reduce classification accuracy, we propose a novel ER-LDA method. ER-LDA evaluates feature importance by calculating the explanatory ratio between interclass distance and intraclass scatteredness, facilitating the selection of discriminative features through LDA. This fusion of ER-based feature assessment and LDA yields the novel ER-LDA technique. The resulting selective feature set is then passed into a k-nearest neighbor (K-NN) algorithm for condition classification, distinguishing between normal, mechanical seal hole, mechanical seal scratch, and impeller defect states of the MCP. The proposed technique surpasses current cutting-edge techniques in fault classification.

1. Introduction

Multistage centrifugal pumps (MCPs) transform electrical energy into mechanical energy for industrial operations. These pumps use a series of impellers arranged sequentially to guide fluid through the pumps. A recent examination of 437 malfunctioning MCP found that the industry suffered 6128 h of maintenance-related downtime due to the absence of precise and intelligent fault diagnosis (FD), incurring a cost of $50 million USD [1].
The broad range of applications for MCPs means that faults can result in significant consequences, including wasted energy, downtime in industrial processes, economic setbacks, expensive repairs, and compromised safety for staff. To maintain dependable MCP operation, early fault detection is important and should minimize maintenance and repair expenses. Regular monitoring can be carried out through the collaboration of personnel or by utilizing cost-effective and dependable signal-processing and artificial intelligence (AI) methods [2,3,4]. AI methods for FD consist of preprocessing signals and features as well as tasks related to fault identification and classification [5,6].
There are two primary categories for faults in MCP: mechanical faults (MFs) and fluid flow-related faults. While these faults can be interrelated, MFs occur more frequently. Among MCP faults, 34% are related to issues with a mechanical seal (MS). Besides MS failures, problems with MCP impellers can result in either mechanical faults or a combination of mechanical and liquid flow issues. Additionally, MFs in MCPs can manifest as either soft or hard failures. The latter are easily recognizable but soft failures can cause performance deterioration while allowing the pump to continue functioning. Identifying soft failures in a timely manner is therefore important.
A faulty MS can lead to soft defects in MCPs, including fretting, fluid flushing, and shaft wear. Moreover, an impeller defect (ID) can cause both hydraulic and soft mechanical failures [7]. To minimize maintenance expenses and downtime for MCPs, this study focuses on early fault detection, specifically targeting soft defects arising from a mechanical seal hole (MSH), a mechanical seal scratch (MSS), or an ID.
A variation in the stiffness of a mechanical structure due to a defect causes impulses in the vibration signals (VSs), making it a valuable tool for monitoring the condition of an MCP [8,9]. MFs exert a significant impact on a VS obtained from an MCP. These defects render the VS impulsive and non-stationary, necessitating paying attention to the FD [10,11]. These impulses arise at frequencies in the relevant frequency spectrum but are often overwhelmed by background noise due to their low energy [12]. Bearing-fault harmonics can be differentiated from interference noise using a fault-oriented window series based on a Gaussian mixture model. However, methods that rely on narrowband demodulation often struggle to distinguish between fault impulses and interference noise [13]. Moreover, the statistical characteristics of a defective VS vary over time, making them complex and non-stationary [14,15,16]. Fourier transforms, which are particularly useful for analyzing stationary signals, cannot easily handle such changes. To tackle these challenges, a denoising technique, blind source separation (BSS), was proposed. However, BSS necessitates a baseline signal, posing a limitation for complex VS situations [17]. To proficiently analyze non-stationary signals, innovative signal-processing methods, such as the short time Fourier transform (STFT), have been utilized [18,19].
An STFT uses sample windows of fixed sizes and is commonly applied to time–frequency analysis. Nevertheless, optimizing the frequency resolution may lead to a diminished time resolution and vice versa [20,21]. Time–frequency domain (TFD) transforms offer benefits for complex signals [22]. The TFD wavelet transform (WT) is sensitive to non-stationary defect impulses [23,24,25]. A WT is used to preprocess MCP VSs and extract statistical features in FD [26]. Optimal selection of the mother wavelet is important for WT to avoid oscillation effects, and empirical mode decomposition, an adaptive signal decomposition technique, can overcome the limitations of a WT [27,28]. However, empirical mode decomposition is susceptible to mode mixing and extreme interpolation, enhancing the WT’s attractiveness [22]. Another method that uses the S-transform for preprocessing a VS addresses the shortcomings of both WT and STFT [29,30]. Wavelet coherence analysis is a state-of-the-art method used for FD in MCPs. It generates coherograms and then applies deep-learning techniques [31]. This paper diverges from previous studies that concentrated on a specific frequency range, and this study examines vibration modes across the entire spectrum of a defective MCP. These modes related to defects are filtered out to remove interference from other vibrations. This filtered mode results in the fault-sensitive frequency band (FSFB), which helps us to extract important features for identifying faults.
In intelligent FD, after preprocessing the vibration spectrum, extraction and preprocessing of features are crucial [32]. Extracting discriminant statistical features from the VS across the time domain, frequency domain, and TFD is essential [33,34,35,36]. Deep-learning techniques show considerable potential for extracting and classifying features related to faults [37,38,39]. A data-driven strategy has been introduced for bearing FD, extracting statistical features from raw VS in multiple domains, and a novel deep-learning technique has been proposed based on such features [40]. However, VS from MCP under soft-defect conditions differ due to complex fluid and mechanical interactions, making statistical features extracted from raw MCP VS noisy and inadequate for representing MCP fault-related information. Statistical features from raw VS in the time domain can lack sensitivity to incipient defects and are unsuitable for severe defects. Similarly, frequency-domain statistical features from a raw VS can be noisy due to MCP faults occurring at lower frequencies, which are obscured by noise from microstructural vibrations. To tackle such issues, a new MCP VS preprocessing approach has been proposed that calculates modes for MCP defects in a VS, filters these modes from the MCP vibration spectrum, forming the FSFB, and uses it to extract discriminant statistical features in time, frequency, and TFD.
In previous studies, the emphasis has been on refining VS analysis and statistical feature preprocessing to extract discriminant fault information. Several techniques for feature discrimination evaluation and dimensionality reduction have emerged, with linear discriminant analysis (LDA) and principal component analysis (PCA) among the more prominent [41]. A comparative analysis of dimensionality-reduction methods for MCP FD reportedly produced promising results in PCA [42]. The components generated by PCA capture various symptoms of machinery faults. However, PCA cannot estimate intraclass separability and suffers from information loss. In contrast, LDA aims for an optimized and reduced dimensional representation by taking into account both interclass scatteredness and intraclass separability. As with any supervised learning technique, a large, labeled dataset is required to achieve useful results [43]. Variants such as robust linear optimized LDA [44] and trace ratio LDA [45] have been proposed but face issues due to the penalty graph in intraclass discrimination, undermining classification precision. These limitations emphasize the need for a new explanatory ratio (ER)-LDA technique. The proposed technique begins by evaluating feature informativeness with respect to faults. It calculates the explanatory ratio by comparing the feature’s intraclass degree of scattering to its interclass distance. Features with a high ER undergo LDA to acquire a discriminant set of statistical features with reduced dimensions. The fusion of a feature assessment based on ER and LDA constitutes the novel ER-LDA method. The primary contribution of this work can be summarized as follows:
  • The VS obtained consists of a lot of macrostructural interference noise. To address this concern, the proposed method computes the vibrational modes related to MCP defects and isolates them through filtering, resulting in the formation of the FSFB. This FSFB is important for extracting discriminant statistical features across three domains, which are then integrated into a unified feature pool.
  • The feature pool consists of multiple features. No feature is optimal for accurately defining the MCP condition, and their inclusion could affect the precision of the classification. Therefore, in the proposed method, ER-LDA is used as a technique for extracting discriminant features in MCP FD. ER-LDA evaluates the informativeness of features concerning faults by calculating the explanatory ratio of statistical features. It then applies LDA to highly informative features to achieve reduced-dimension discriminant sets.
  • To ensure practical validation of the approach, the proposed methodology is evaluated using MCP vibration signals obtained from an industrial test rig.
The subsequent sections of this proposed work are structured as follows. Section 2 offers a concise technical background on LDA. Section 3 outlines the setup of the MCP test rig and details the procedure used in the experiment. Section 4 presents and discusses the proposed method. Section 5 presents and elucidates the experimental results. Finally, Section 6 provides concluding remarks and offers potential avenues for future research.

2. Technical Background

Multiclass LDA

LDA is a supervised machine-learning technique for reducing dimensionality by transforming a dataset provided as an input into a lower-dimensional space. It is primarily used in supervised learning scenarios. LDA determines a vector that satisfies two critical properties:
  • It maximizes the sum of the distances between the projections averaged from each class when data points are projected. Essentially, it seeks a vector that maximizes the separation between different classes.
  • It minimizes the variance of projections within the same class during the data-point projection to reduce the variance within each class.
Ultimately, LDA seeks a vector that not only minimizes variance within classes but also maximizes the separation between classes, effectively projecting data points in this optimized space. LDA’s ability to optimize class separation through projection makes it an effective pre-processing step for reducing dimensionality. By maximizing the distinction between different classes of data, LDA creates a lower-dimensional representation that enhances the classification task for subsequent algorithms. This distinct advantage of LDA—amplifying class separability—provides a foundation for algorithms such as k-nearest neighbor (KNN) and support vector machines (SVMs) to operate more effectively and make better-informed decisions in the reduced-feature space [46]. For a training dataset consisting of x 1 , x 2 , , x n and two classes C 1 and C 2 , a mathematical representation of the two critical properties is given in Equation (1). The numerator represents interclass scatter, while the denominator corresponds to intraclass scatter.
J X = ( μ 1 * μ 2 * ) 2 σ 1 2 + σ 2 2
In Equation (1), μ 1 * and μ 2 * represent projected centroids of classes C 1 and C 2 , respectively, whereas σ 1 2 and σ 2 2 represent the variances of classes C 1 and C 2 , respectively. If we have j t h number of classes, the projected centroid of the respective C j class will be represented as in Equation (2).
μ j * = X T μ j
Here, X is the projected vector also known as an eigenvector and μ j is the mean of the respective class. The numerator in Equation (1), which is the distance between the projected centroids of the two classes, can be further simplified as below:
( μ 1 * μ 2 * ) 2 = X T μ 1 X T μ 2 2
( μ 1 * μ 2 * ) 2 = X T ( μ 1 μ 2 ) 2
( μ 1 * μ 2 * ) 2 = X T μ 1 μ 2 μ 1 μ 2 T X
( μ 1 * μ 2 * ) 2 = X T D b X
In Equation (6), D b is the scatter between classes. If we have j t h number of class, the variance of the respective C j class will be represented as in Equation (7).
σ j 2 = x n ϵ C j { X T x n X T μ j } { X T x n X T μ j } T
σ j 2 = X T [ x n ϵ C j { x n μ j } { x n μ j } T ] X
σ j 2 = X T σ j X
Using Equation (9), the denominator that represents the intraclass scatter can be simplified as given in Equation (10)
σ 1 2 + σ 2 2 = X T σ 1 X + X T σ 2 X
σ 1 2 + σ 2 2 = X T σ 1 + σ 2 X
σ 1 2 + σ 2 2 = X T D w X
In Equation (12), D w is the within-class scatter. We then replaced the values in Equation (1) with Equation (6) and Equation (12) regarding the numerator and denominator, respectively.
J X = X T D b X X T D w X
Upon differentiating Equation (13) with respect to X and equating it with zero, it becomes a generalized eigenvalue and eigenvector problem.
D b X = λ D w X
Considering D w is a full rank matrix in Equation (14), we can take its inverse:
D w 1 D b X = λ X
where λ is the eigenvalue and X is the eigenvector.

3. Experimental Test Setup

An MCP setup designed to collect datasets for FD is illustrated in Figure 1. This arrangement comprises a PMT-4008 MCP (Hanil, Gwangju, Republic of Korea) propelled by a 5.5-kW motor; a panel consisting of controllers for temperature, water supply, speed, switch, and flow rate; and a display. The experimental setup involves the utilization of two tanks for water, a main tank and a buffer tank. These tanks were elevated to ensure the maintenance of a net positive suction head at the MCP inlet. The interconnection between the water tanks and the MCP involved steel pipes equipped with pressure gauges and water valves. Figure 2 provides a schematic representation of this experimental setup.
Once the two tanks were linked to the MCP’s inlet and outlet, the MCP was driven consistently at 1733 rpm. Four accelerometers were used to gather the vibration data from the MCP, positioned strategically with two close to the pump casing and the other two closer to the MS and impellers, each affixed using a sticky substance. All accelerometers functioned independently to record the MCP’s VS. An NI-9234 device was used to digitize the data gathered from the MCP through the accelerometers. For further insight, details regarding the sensors and the digitizing equipment utilized in the procedure are provided in Table 1.
An MS consists of rotating and stationary seals. Two seals with 38 mm inner diameters were used for this study. In the rotating part of both the seals, an intentional hole was drilled, as shown in Figure 3a, keeping the stationary part flawless. The diameter and depth of the hole were both 2.8 mm. These defective seals were used to collect MSH fault data. Figure 3b shows a scratch that was made deliberately on the rotating part of the seal with a length of 10 mm, a diameter of 2.5 mm, and a depth of 2.8 mm, while keeping the stationary part of the seal in a normal condition to gather data for the MSS faults.
Crevice corrosion is a prevalent cause of impeller faults. This study deliberately induced a similar fault with a diameter of 161 mm on a cast-iron impeller by removing a piece of the metal measuring 18 mm in length, 2.5 mm in diameter, and 2.8 mm deep, as shown in Figure 4.

4. Proposed Approach

The proposed approach begins with the preprocessing of MCP VS and winds up with the classification of MF in the MCP. The sequence of the proposed FD approach for the MCP is depicted in Figure 5.
Each stage of this proposed approach to FD is explained in this section.

4.1. Data Acquisition

At a sampling rate of 25.6 kHz, vibration data from the MCP was gathered for 5 min, resulting in 1200 samples. Among these samples, 300 were obtained during normal operating conditions, another 300 were specifically recorded during an MSH fault, another 300 were acquired in the presence of an MSS fault, and the remaining 300 were collected during the ID condition. These VSs are shown in Figure 6.

4.2. Fault-Sensitive Frequency Band Selection

A mechanical defect in the MCP alters the stiffness of the structure, triggering a shock. Generally, such shocks are easily seen in the frequency spectrum at certain points. However, the complexity resulting from the interaction between the mechanical parts and the fluids makes this difficult in MCP. The interaction of the mechanical parts and fluid results in hydraulic faults, and MF cannot be identified by observing the frequency spectrum alone. The negative effect on the statistical features of an unprocessed VS due to macrostructural vibrations is also problematic.
Excitation, generated, and electronic frequencies are the three primary types observed in MCPs. The first two are particularly significant. Along with a thorough understanding of both, familiarization with the frequency harmonics produced by the imbalances in MCPs is equally important. The rotating speed and geometry of MCPs are required parameters for identifying the imbalance fault-sensitive frequencies. For ID, generated frequencies act as a major source for identification. The ID results in an imbalance in the VS. This imbalance can be explained as a fault-sensitive frequency by the following equation:
I D f = f n . v
In Equation (16), f n represents the frequency harmonics and v is the operating speed of the MCP. Figure 7a depicts the frequency spectrum when the MCP is operating under healthy and normal conditions without facing any defect. Figure 7b depicts the frequency spectrum of the MCP under an ID scenario. The amplitude of I D f increased compared with a healthy frequency spectrum at the third, fourth, and fifth harmonics due to the ID.
Fluid interactions with the ID resulted in additional spikes in the ID frequency spectrum. MS defects are related to the excitation frequency of the MCP. The vibration theory of circular rings, based on the potential energy (U) and kinetic energy (K), is used to calculate the excitation frequency. Using the energy conservation principle,
d d t K + U = 0
K = 2 π r s r 2 ρ A 2
U = A E π s r 2 r
In Equations (18) and (19), r is the ring radius, s r is the radial displacement, and A and E denote the cross-sectional area and elastic modulus, respectively. s r r in the potential energy equation is the mathematical representation for ring-unit elongation. Simplifying Equation (17) produces Equation (20):
s r + ω 2 s r = 0
where ω is the angular frequency. The ring fundamental frequency (RFF) can be obtained by solving Equation (20):
R F F = E ρ 1 2 π r
Using appropriate modes of vibration, the in- and out-of-plane vibration modes in MS are expressed in Equations (22) and (23), respectively:
F I P = 2 m 3 2 m π d 2 E a h 2 12 a ρ m 2 + 2 t h 3 ( 1 + ν )
F O P = m 3 m π m 2 + 1 E t 2 3 d 4 ρ
In Equations (22) and (23), m is the vibration mode, ν is Poisson’s ratio, and a denotes the constant of torsion, while d , t , and h are the diameter, thickness, and height, respectively. In-plane vibrations generally occur at high frequencies, while in the context of an MS, lower frequencies manifest in out-of-plane bending modes of vibrations. Figure 8a–c reveal that an MCP excitation frequency emerges between the second and third modes of flexural vibration, with an amplitude almost twice as large as the normal condition (NC) whenever an MS defect occurs.
To extract distinctive statistical features from a VS and to cater to macrostructural vibrations, this study focuses on the MCP VS up to the third mode of flexural vibration. This involves applying a lowpass filter with a cutoff frequency of 4.6 kHz, which effectively encompasses the fault-sensitive frequencies associated with an ID, corresponding hydraulic defects, and CP excitation frequencies. The filtered modes of vibration result in an FSFB used for statistical feature extraction in the three domains in the next step.

4.3. Feature Pool

A combination of features extracted in three domains resulted in the feature pool. A variation in the stiffness of a mechanical structure due to a defect causes impulses in the vibration signals (VSs). These variations in the stiffness result in the change in amplitudes of the signals in the time domain. Therefore, the extraction of statistical features from the time-domain signal can be a valuable tool for monitoring the condition of the MCP. Different statistical features in the time domain are given in Table 2. In time-domain statistical features, X m , X r , X r m s , and X p represent the mean, root amplitude, root mean square, and peak value of the signal. Generally, mechanical vibrations are excited by the occurrence of any fault and hence uplift the values of these features. However, these features are not sensitive to weak or emerging faults. Therefore, kurtosis ( X k u r ), crest factor ( X c r e s t ), clearance factor ( X c l e a r a n c e ), and impulse factor ( X i m p u l s e ) can indicate the existence of the impulse in the vibration signals and are better indicators for incipient faults. X i m p u l s e and X c l e a r a n c e are also helpful in indicating the sharp impulses resulting from the mating of the surfaces of the defective part and the bearing. X k u r is very sensitive to the faults in the early stage; however, it is not a good indicator for more severe faults as its value starts decreasing at a certain stage of severity instead of increasing further. Hence, it can be seen that the different statistical features in the time domain given in Table 2 have their own importance depending upon the severity of the fault and are equally important in diagnosing any fault. These features compensate each other, and each feature consists of fault information as per its own properties. Therefore, more features are extracted to accurately diagnose machinery faults [47].
Table 3 presents the frequency-domain statistical features used in the study. Mean frequency ( X m f ) indicates the energy of the vibration signal in the frequency domain. As the fault increases, X m f increases accordingly. σ f and X r v f represent the standard deviation and root variance frequency, which shows the convergence of the spectrum power. Root mean square frequency ( X f r m s ) and spectral kurtosis ( X s p k u r ) indicate the change in the position of the dominant frequencies in the frequency spectrum. Hence, these statistical features in the frequency domain can analyze the fault from different aspects. Therefore, these features are equally important and are selected to achieve more accurate and precise diagnosis results [47].
To obtain the statistical features in the TFD, the FSFB transforms the TFD using a wavelet packet transform (WPT). In this investigation, a Daubechies family db4 mother wavelet was chosen to decompose the FSFB up to m = 3 levels, resulting in a total of 2 m WPT bases. The features outlined in Table 2 were then extracted from each WPT base. Experimental studies on wavelet selection indicate that Daubechies family db4 mother wavelets are sensitive to processes that occur within an MCP. In the proposed approach, a Daubechies family db4 mother wavelet was chosen for FSFB decomposition. All the extracted statistical features were amalgamated into a combined feature pool, encompassing features from all domains. The feature pool comprises 113 features for every MCP condition.

4.4. Explanatory Ratio LDA

The feature pool consists of multiple features. No feature is optimal for accurately defining the MCP condition, and their inclusion could affect the precision of the classification. ER-LDA was introduced to extract the discriminant feature in MCP FD. ER-LDA evaluates feature informativeness regarding faults by calculating the ER of the statistical feature, followed by the application of LDA to highly informative features to achieve reduced-dimension discriminant sets. A step-by-step explanation is given below:
Step 1. Equation (24) is used to calculate the sparseness of the feature between classes denoted by S i .
S i = 1 K k = 1 K S k , i
S k , i can be obtained using Equation (25)
S k , i = 1 N k ( N k 1 ) l , m = 1 N k | y m , k , i y l , k , i |
where l , m = 1,2 N k , l m .
In Equations (24) and (25), k denotes the classes, y is the feature, i represents the number of features, and N k is the sample number.
Step 2. The feature mean between classes, μ k , i , is calculated.
Step 3. Equation (26) is used to calculate the distance between the separate classes’ features.
D i = 1 K ( K 1 ) r , s = 1 R | μ s , i μ r , i |
where r , s = 1,2 R , r s .
Step 4. The explanatory ratio of the feature is calculated in this step by using Equation (27), which depends on the values obtained in step 1 and step 3.
E R = D i S i
Step 5. Those features with an explanatory ratio greater than 0.5 will be considered helpful while others will be considered less helpful. LDA will be applied to the helpful features of the feature pool.
H F P = E R > 0.5 ,   h e l p f u l o t h e r w i s e   l e s s   h e l p f u l
A set of discriminant features, characterized by high interclass distance, reduced intraclass sparseness, and lower dimensions, was successfully obtained. This new approach, termed ER-LDA, effectively addresses the issues of interclass feature distance and intraclass feature sparseness of traditional LDAs.

4.5. K-NN

The resulting features were then utilized in MCP condition classification using the K-Nearest Neighbors (K-NN) algorithm, with K set to three. The choice of K-NN for MCP fault classification is motivated by its low computational cost and straightforward architecture. Tuning of a single hyperparameter K is required in K-NN which makes tuning easy. Another advantage of K-NN is if we add new data to the dataset, there is no need to retrain a new model as the prediction is adjusted and constantly changes with new data itself.

5. Results

The evaluation dataset consists of 1200 VS sourced from the MCP, encompassing conditions such as NC, MSH, MSS, and ID. The feature pool aggregates the extracted statistical feature from these VS values, calculated as N × SFN × VSins. Here, N represents the classes, VSins signifies the VS instances, and SFN denotes the statistical feature derived from the VS for each class. For validation, a cross-validation approach employing n folds (n = 3) was used. The dataset was divided into three folds, where one fold underwent testing for classifier assessment while the remaining two folds were utilized for training. Among the 1200 samples, 800 were used to train the classifier, and the remaining 400 were dedicated to testing the classifier. Random sample selection was ensured across trials, conducted 25 times to ensure stable results in the classification process.
Following VS and statistical feature preprocessing with the proposed approach, novel fault-related features were extracted. This study extensively evaluated the extracted features for FD and compared them against other methodologies: a time-domain feature extraction method (WPT-BE-MSVM), an unsupervised feature preprocessing technique (PCA) [42], and a supervised feature preprocessing method (Tr-LDA) [41]. The comparison employs evaluation metrics, namely the true positive rate (TPR) or Recall, the average accuracy of classification (AAC) or Precision, and the error rate ( E R ) for classification. These metrics were determined using the following equations:
T P R % = 1 j i = 1 j T P i , l T P i , l + F N i , l × 100 %
A A C % = 1 j i = 1 j l = 1 m T P i , l N × 100 %
E R % = 1 j i = 1 j T P i , l + F N i , l T P i , l + F N i , l + T N i , l + F P i , l × 100 %
These equations describe the elements involved in evaluating the performance metrics within the cross-validation framework. N denotes the number of samples, j signifies the fold, i is used for the number of iterations, and T P i , l , F N i , l , T N i , l , and F P i , l indicate the true positive, false negative, true negative, and false positive, respectively, in the testing subset used to evaluate the CV process. These elements are utilized in Equations (29)–(31) to compute various performance metrics pertaining to accuracy, precision, and E R across the different conditions or classes.
The findings presented in Figure 9 and Figure 10 and Table 4 show that, compared with state-of-the-art methods, the proposed method achieved superior performance in identifying MCP working conditions, reaching 100% AAC, 100% TPR, and 0% E R . This performance superiority aligns with the method’s approach, which is initiated by computing vibration modes specific to MCP defects.
By filtering out interference from macrostructural vibration noise and isolating MCP defect modes from the overall vibration spectrum, the proposed method constructed the FSFB, which was then used to extract statistical features in multiple domains and combine them into a higher-dimensional feature pool. Recognizing potential noise among these features, the proposed method employed ER-LDA to reduce the dimensionality while extracting discriminant features. ER-LDA evaluated feature relevance regarding faults, after which LDA was applied to features displaying high informativeness. The discriminant feature space resulting from the proposed approach (Figure 9) exhibited significant discriminative capabilities, demonstrating reduced sparsity among features within the same class. Figure 10 confirms the higher AAC achieved by the proposed method. These observations indicate the method’s efficacy in extracting relevant, discriminative features and contributing to superior classification accuracy.
The WPT+BE-MSVM method employs a continuous decomposition of VS into distinct frequency bands using the WPT. This process rearranges WPT nodes based on their energy levels and subsequently extracts significant time-domain features. From each of these nodes, features are extracted and classified utilizing SVMs. The suggested node for MCP FD is determined by the node producing the greatest classification accuracy. In this case, WPT+BE-MSVM achieved an overall AAC of 96.3%, a TPR of 96.2%, and an E R of 7%.
The supervised feature pre-processing technique, Tr-LDA, is a linear dimensionality-reduction method, using trace ratio criteria to increase interclass distances and minimize intraclass dispersion. When applied to our dataset, this algorithm yielded an E R of 16.8%, an AAC of 89.6%, and a TPR of 89.6%. These results indicate underperformance relative to our proposed method. This underperformance aligns with expectations as Tr-LDA transforms data without emphasizing feature processing for the extraction of intrinsic discriminant information from raw statistical features. Although proficient in minimizing intraclass dispersion, Tr-LDA struggled to achieve effective separation among different classes, as evidenced by the 16.8% E R observed (Figure 10).
PCA operates as an unsupervised method for feature processing, reducing dimensionality by capturing data variance and creating a condensed data representation. When used with a KNN classifier on our dataset, PCA yielded an E R of 23.5%, an AAC of 83%, and a TPR of 82%. These results, shown in Table 4 and Figure 10, indicate its poor performance relative to the proposed method. Determining the optimal number of components in PCA to retain important fault-related data features presents a challenge. Figure 9 underscores this difficulty, emphasizing that the feature classification achieved by PCA is not as robust as that of the proposed technique. This disparity in feature classification quality contributes to the higher classification error observed in PCA, emphasizing its limitations while comparing it to the efficacy of the proposed approach.

6. Conclusions

The paper introduces a novel method for condition classification in MCP. In the signal pre-processing phase, this method identifies an FSFB from raw VS data. This selection involves calculating vibration modes specific to pump defects, subsequently filtering these modes to isolate FSFB. From these bands, statistical features across time, frequency, and time–frequency domains are extracted and consolidated into a unified feature pool. To reduce dimensions while extracting discriminant features from this pool, a novel ER-LDA approach is employed. ER-LDA evaluates feature relevance concerning faults by assessing explanatory ratios, using LDA to retain features with high informativeness. The MCP condition classification of the resulting discriminant feature set is carried out using K-NN. The proposed technique demonstrates superior results compared with existing state-of-the-art methods, achieving an AAC of 100%. However, the highly separable and compact feature space generated by this method may pose challenges if different classification algorithms other than K-NN are employed. Future endeavors should apply the proposed method on a varying-speed dataset of MCP. An additional recommendation for future work is the application of this method to fluid-related defects in MCP.

Author Contributions

Conceptualization, S.U., Z.A. and J.-M.K.; methodology, S.U., Z.A. and J.-M.K.; validation, S.U., Z.A. and J.-M.K.; formal analysis, S.U., Z.A. and J.-M.K.; resources, S.U., Z.A. and J.-M.K.; writing—original draft preparation, S.U. and Z.A.; writing—review and editing, J.-M.K.; visualization, S.U. and Z.A.; supervision, J.-M.K.; project administration, J.-M.K.; funding acquisition, J.-M.K. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Technology Innovation Program (20023566, Development and Demonstration of Industrial IoT and AI Based Process Facility Intelligence Support System in Small and Medium Manufacturing Sites) funded by the Ministry of Trade, Industry & Energy (MOTIE, Korea). This paper was also supported by the Korea Industrial Complex Corporation grant funded by the Korea Government (MOTIE) (SG20220905).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data are from the industry. They are not available publicly due to the privacy policy of the industry.

Conflicts of Interest

Author Jong-Myon Kim was employed by the company Prognosis and Diagnostic Technologies Co. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. Rane, S.B.; Narvel, Y.A.M. Re-designing the business organization using disruptive innovations based on blockchain-IoT integrated architecture for improving agility in future Industry 4.0. Benchmarking Int. J. 2021, 28, 1883–1908. [Google Scholar] [CrossRef]
  2. Sunal, C.E.; Dyo, V.; Velisavljevic, V. Review of Machine Learning Based Fault Detection for Centrifugal Pump Induction Motors. IEEE Access 2022, 10, 71344–71355. [Google Scholar] [CrossRef]
  3. Han, T.; Xie, W.; Pei, Z. Semi-supervised adversarial discriminative learning approach for intelligent fault diagnosis of wind turbine. Inf. Sci. 2023, 648, 119496. [Google Scholar] [CrossRef]
  4. Yao, J.; Han, T. Data-driven lithium-ion batteries capacity estimation based on deep transfer learning using partial segment of charging/discharging data. Energy 2023, 271, 127033. [Google Scholar] [CrossRef]
  5. Saeed, U.; Jan, S.U.; Lee, Y.-D.; Koo, I. Fault diagnosis based on extremely randomized trees in wireless sensor networks. Reliab. Eng. Syst. Saf. 2021, 205, 107284. [Google Scholar] [CrossRef]
  6. Ahmad, Z.; Hasan, M.J.; Kim, J.-M. Centrifugal Pump Fault Diagnosis Using Discriminative Factor-Based Features Selection and K-Nearest Neighbors. In Intelligent Systems Design and Applications; Springer: Cham, Seitzerland, 2022. [Google Scholar]
  7. Cao, S.; Hu, Z.; Luo, X.; Wang, H. Research on fault diagnosis technology of centrifugal pump blade crack based on PCA and GMM. Measurement 2021, 173, 108558. [Google Scholar] [CrossRef]
  8. Li, X.; Zhao, H.; Yu, L.; Chen, H.; Deng, W.; Deng, W. Feature Extraction Using Parameterized Multisynchrosqueezing Transform. IEEE Sens. J. 2022, 22, 14263–14272. [Google Scholar] [CrossRef]
  9. Xie, C.; Zhou, L.; Ding, S.; Lu, M.; Zhou, X. Research on self-propulsion simulation of a polar ship in a brash ice channel based on body force model. Int. J. Nav. Archit. Ocean Eng. 2023, 15, 100557. [Google Scholar] [CrossRef]
  10. Panda, A.K.; Rapur, J.S.; Tiwari, R. Prediction of flow blockages and impending cavitation in centrifugal pumps using Support Vector Machine (SVM) algorithms based on vibration measurements. Measurement 2018, 130, 44–56. [Google Scholar] [CrossRef]
  11. Araste, Z.; Sadighi, A.; Jamimoghaddam, M. Fault Diagnosis of a Centrifugal Pump Using Electrical Signature Analysis and Support Vector Machine. J. Vib. Eng. Technol. 2023, 11, 2057–2067. [Google Scholar] [CrossRef]
  12. Qin, Y.; Jin, L.; Zhang, A.; He, B. Rolling Bearing Fault Diagnosis with Adaptive Harmonic Kurtosis and Improved Bat Algorithm. IEEE Trans. Instrum. Meas. 2021, 70, 3508112. [Google Scholar] [CrossRef]
  13. Rapur, J.S.; Tiwari, R. Experimental fault diagnosis for known and unseen operating conditions of centrifugal pumps using MSVM and WPT based analyses. Measurement 2019, 147, 106809. [Google Scholar] [CrossRef]
  14. Deng, W.; Li, Z.; Li, X.; Chen, H.; Zhao, H. Compound Fault Diagnosis Using Optimized MCKD and Sparse Representation for Rolling Bearings. IEEE Trans. Instrum. Meas. 2022, 71, 3508509. [Google Scholar] [CrossRef]
  15. Chen, Y.; Rao, M.; Feng, K.; Niu, G. Modified Varying Index Coefficient Autoregression Model for Representation of the Nonstationary Vibration from a Planetary Gearbox. IEEE Trans. Instrum. Meas. 2023, 72, 3511812. [Google Scholar] [CrossRef]
  16. Chen, Y.; Rao, M.; Feng, K.; Zuo, M.J. Physics-Informed LSTM hyperparameters selection for gearbox fault detection. Mech. Syst. Signal Process. 2022, 171, 108907. [Google Scholar] [CrossRef]
  17. Tra, V.; Kim, J. Pressure Vessel Diagnosis by Eliminating Undesired Signal Sources and Incorporating GA-Based Fault Feature Evaluation. IEEE Access 2020, 8, 134653–134667. [Google Scholar] [CrossRef]
  18. Zhang, X.; Hu, Y.; Deng, J.; Xu, H.; Wen, H. Feature Engineering and Artificial Intelligence-Supported Approaches Used for Electric Powertrain Fault Diagnosis: A Review. IEEE Access 2022, 10, 29069–29088. [Google Scholar] [CrossRef]
  19. Siddique, M.F.; Ahmad, Z.; Ullah, N.; Kim, J. A Hybrid Deep Learning Approach: Integrating Short-Time Fourier Transform and Continuous Wavelet Transform for Improved Pipeline Leak Detection. Sensors 2023, 23, 8079. [Google Scholar] [CrossRef] [PubMed]
  20. Satpathi, K.; Yeap, Y.M.; Ukil, A.; Geddada, N. Short-Time Fourier Transform Based Transient Analysis of VSC Interfaced Point-to-Point DC System. IEEE Trans. Ind. Electron. 2018, 65, 4080–4091. [Google Scholar] [CrossRef]
  21. Zhou, Z.; Yang, X.; Ji, J.; Wang, Y.; Zhu, Z. Classifying fabric defects with evolving Inception v3 by improved L2,1-norm regularized extreme learning machine. Text. Res. J. 2023, 93, 936–956. [Google Scholar] [CrossRef]
  22. Li, M.; Wang, T.; Chu, F.; Han, Q.; Qin, Z.; Zuo, M.J. Scaling-Basis Chirplet Transform. IEEE Trans. Ind. Electron. 2021, 68, 8777–8788. [Google Scholar] [CrossRef]
  23. Wei, H.; Zhang, Q.; Shang, M.; Gu, Y. Extreme learning Machine-based classifier for fault diagnosis of rotating Machinery using a residual network and continuous wavelet transform. Measurement 2021, 183, 109864. [Google Scholar] [CrossRef]
  24. Zhang, K.; Ma, C.; Xu, Y.; Chen, P.; Du, J. Feature extraction method based on adaptive and concise empirical wavelet transform and its applications in bearing fault diagnosis. Measurement 2021, 172, 108976. [Google Scholar] [CrossRef]
  25. Jalayer, M.; Orsenigo, C.; Vercellis, C. Fault detection and diagnosis for rotating machinery: A model based on convolutional LSTM, Fast Fourier and continuous wavelet transforms. Comput. Ind. 2021, 125, 103378. [Google Scholar] [CrossRef]
  26. Yang, X.; Wang, X.; Wang, S.; Puig, V. Switching-based adaptive fault-tolerant control for uncertain nonlinear systems against actuator and sensor faults. J. Franklin. Inst. 2023, 360, 11462–11488. [Google Scholar] [CrossRef]
  27. Alabied, S.; Haba, U.; Daraz, A.; Gu, F.; Ball, A.D. Empirical Mode Decomposition of Motor Current Signatures for Centrifugal Pump Diagnostics. In Proceedings of the 2018 24th International Conference on Automation and Computing (ICAC), Newcastle upon Tyne, UK, 6–7 September 2018; pp. 1–6. [Google Scholar]
  28. Fang, L.; Li, D.; Qu, R. Torque Improvement of Vernier Permanent Magnet Machine with Larger Rotor Pole Pairs Than Stator Teeth Number. IEEE Trans. Ind. Electron. 2023, 70, 12648–12659. [Google Scholar] [CrossRef]
  29. Zaman, W.; Ahmad, Z.; Kim, J.-M. Fault Diagnosis in Centrifugal Pumps: A Dual-Scalogram Approach with Convolution Autoencoder and Artificial Neural Network. Sensors 2024, 24, 851. [Google Scholar] [CrossRef]
  30. Hu, W.; Wang, T.; Chu, F. Novel Ramanujan Digital Twin for Motor Periodic Fault Monitoring and Detection. IEEE Trans. Industr. Inform. 2023, 19, 11564–11572. [Google Scholar] [CrossRef]
  31. Ullah, N.; Ahmad, Z.; Siddique, M.F.; Im, K.; Shon, D.-K.; Yoon, T.-H.; Yoo, D.-S.; Kim, J.-M. An Intelligent Framework for Fault Diagnosis of Centrifugal Pump Leveraging Wavelet Coherence Analysis and Deep Learning. Sensors 2023, 23, 8850. [Google Scholar] [CrossRef]
  32. Reges, G.; Fontana, M.; Ribeiro, M.; Silva, T.; Abreu, O.; Reis, R.; Schnitman, L. Electric submersible pump vibration analysis under several operational conditions for vibration fault differential diagnosis. Ocean Eng. 2021, 219, 108249. [Google Scholar] [CrossRef]
  33. Gonçalves, J.P.S.; Fruett, F.; Dalfré Filho, J.G.; Giesbrecht, M. Faults detection and classification in a centrifugal pump from vibration data using markov parameters. Mech. Syst. Signal Process. 2021, 158, 107694. [Google Scholar] [CrossRef]
  34. Karagiovanidis, M.; Pantazi, X.E.; Papamichail, D.; Fragos, V. Early Detection of Cavitation in Centrifugal Pumps Using Low-Cost Vibration and Sound Sensors. Agriculture 2023, 13, 1544. [Google Scholar] [CrossRef]
  35. Chen, R.; Zhao, B.; He, T.; Tu, L.; Xie, Z.; Zhong, N.; Zou, D. Study on coupling transient mixed lubrication and time-varying wear of main bearing in actual operation of low-speed diesel engine. Tribol. Int. 2024, 191, 109159. [Google Scholar] [CrossRef]
  36. Huang, Z.; Lyu, Z.; Luo, P.; Zhang, G.; Ying, W.; Chen, A.; Xiao, H. Effects of Methanol–Ammonia Blending Ratio on Performance and Emission Characteristics of a Compression Ignition Engine. J. Mar. Sci. Eng. 2023, 11, 2388. [Google Scholar] [CrossRef]
  37. Ahmad, W.; Ayub, N.; Ali, T.; Irfan, M.; Awais, M.; Shiraz, M.; Glowacz, A. Towards Short Term Electricity Load Forecasting Using Improved Support Vector Machine and Extreme Learning Machine. Energies 2020, 13, 2907. [Google Scholar] [CrossRef]
  38. Jing, X.; Wu, Z.; Zhang, L.; Li, Z.; Mu, D. Electrical Fault Diagnosis from Text Data: A Supervised Sentence Embedding Combined with Imbalanced Classification. IEEE Trans. Ind. Electron. 2024, 71, 3064–3073. [Google Scholar] [CrossRef]
  39. Xu, B.; Wang, X.; Zhang, J.; Guo, Y.; Razzaqi, A.A. A Novel Adaptive Filtering for Cooperative Localization Under Compass Failure and Non-Gaussian Noise. IEEE Trans. Veh. Technol. 2022, 71, 3737–3749. [Google Scholar] [CrossRef]
  40. Cheng, Z.; Liu, H.; Hua, R.; Dong, L.; Ma, Q.; Zhu, J. Research on Multi-Fault Identification of Marine Vertical Centrifugal Pump Based on Multi-Domain Characteristic Parameters. J. Mar. Sci. Eng. 2023, 11, 551. [Google Scholar] [CrossRef]
  41. Roopa, H.; Asha, T. A Linear Model Based on Principal Component Analysis for Disease Prediction. IEEE Access 2019, 7, 105314–105318. [Google Scholar] [CrossRef]
  42. Sakthivel, N.R.; Nair, B.B.; Elangovan, M.; Sugumaran, V.; Saravanmurugan, S. Comparison of dimensionality reduction techniques for the fault diagnosis of mono block centrifugal pump using vibration signals. Eng. Sci. Technol. Int. J. 2014, 17, 30–38. [Google Scholar] [CrossRef]
  43. Liu, J.; Xu, H.; Peng, X.; Wang, J.; He, C. Reliable composite fault diagnosis of hydraulic systems based on linear discriminant analysis and multi-output hybrid kernel extreme learning machine. Reliab. Eng. Syst. Saf. 2023, 234, 109178. [Google Scholar] [CrossRef]
  44. Yang, L.; Liu, X.; Nie, F.; Liu, Y. Robust and Efficient Linear Discriminant Analysis with L2,1-Norm for Feature Selection. IEEE Access 2020, 8, 44100–44110. [Google Scholar] [CrossRef]
  45. Wang, H.; Yan, S.; Xu, D.; Tang, X.; Huang, T. Trace Ratio vs. Ratio Trace for Dimensionality Reduction. In Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA, 17–22 June 2007; pp. 1–8. [Google Scholar]
  46. Dutta, N.; Kaliannan, P.; Shanmugam, P. SVM Algorithm for Vibration Fault Diagnosis in Centrifugal Pump. Intell. Autom. Soft Comput. 2023, 35, 2997–3020. [Google Scholar] [CrossRef]
  47. Lei, Y. Intelligent Fault Diagnosis and Remaining Useful Life Prediction of Rotating Machinery; Elsevier: Amsterdam, The Netherlands, 2016. [Google Scholar]
Figure 1. MCP test setup for data collection for fault diagnosis.
Figure 1. MCP test setup for data collection for fault diagnosis.
Sensors 24 01830 g001
Figure 2. MCP test setup schematics.
Figure 2. MCP test setup schematics.
Sensors 24 01830 g002
Figure 3. (a) Mechanical seal hole and (b) a mechanical seal scratch.
Figure 3. (a) Mechanical seal hole and (b) a mechanical seal scratch.
Sensors 24 01830 g003
Figure 4. Impeller defect.
Figure 4. Impeller defect.
Sensors 24 01830 g004
Figure 5. Sequential diagram of proposed FD approach of MCP.
Figure 5. Sequential diagram of proposed FD approach of MCP.
Sensors 24 01830 g005
Figure 6. Vibration signals under different conditions of MCP.
Figure 6. Vibration signals under different conditions of MCP.
Sensors 24 01830 g006
Figure 7. MCP frequency spectrum: (a) healthy condition and (b) impeller defect condition.
Figure 7. MCP frequency spectrum: (a) healthy condition and (b) impeller defect condition.
Sensors 24 01830 g007
Figure 8. MCP frequency spectrum: (a) Healthy condition, (b) MSS condition, and (c) MSH condition.
Figure 8. MCP frequency spectrum: (a) Healthy condition, (b) MSS condition, and (c) MSH condition.
Sensors 24 01830 g008
Figure 9. 3D presentation of feature pool: (a) proposed method, (b) WPT-BE-MSVM, (c) Tr-LDA, and (d) PCA.
Figure 9. 3D presentation of feature pool: (a) proposed method, (b) WPT-BE-MSVM, (c) Tr-LDA, and (d) PCA.
Sensors 24 01830 g009
Figure 10. Error rate, precision, and recall obtained from the proposed and reference methods.
Figure 10. Error rate, precision, and recall obtained from the proposed and reference methods.
Sensors 24 01830 g010
Table 1. Instrument details for data collection.
Table 1. Instrument details for data collection.
Instrument NameSpecificationValue
Accelerometer 622b01Sensitivity100 mV/g (10.2 mV/(m/s2)) ± 5%
Frequency range0.42–10 kHz
DAQ NI-9234Generator24 bits ADC resolution and 4 analog input channels
Frequency range0–13.1 MHz
Table 2. Time-domain statistical features.
Table 2. Time-domain statistical features.
Statistical FeatureFormulaStatistical FeaturesFormula
RMS X r m s = n = 1 N [ x ( n ) ] 2 N Kurtosis X k u r = n = 1 N [ x n X m ] 4 ( N 1 ) X s d 4
Shape factor X s f = X r m s 1 N n = 1 N | x n | Variance X v = n = 1 N [ x n X m ] 2 ( N 1 )
Root amplitude X r = [ n = 1 N | x n | N ] 2 Peak value X p = m a x | x n |
Mean X m = n = 1 N x ( n ) N Crest factor X c r e s t = X p X m
Standard deviation X s d = n = 1 N [ x n X m ] 2 ( N 1 ) Clearance factor X c l e a r a n c e = X p X r o o t
Skewness X s k e w = n = 1 N [ x n X m ] 2 ( N 1 ) X s d 3 Impulse factor X i m p u l s e = X p 1 N n = 1 N | x n |
Table 3. Frequency-domain statistical features.
Table 3. Frequency-domain statistical features.
Statistical FeatureFormulaStatistical FeaturesFormula
Mean frequency X m f = k = 1 K s ( k ) K Spectral kurtosis X s p k u r = k = 1 K [ s k X m f ] 4 ( K 1 ) σ f 4
Standard deviation σ f = k = 1 K [ s k X m f ] 2 ( K 1 ) Root mean square
frequency
X f r m s = k = 1 K f k 2 ( s ( k ) ) 2 s ( k )
Root variance
frequency
X r v f = k = 1 K ( s k X m f ) 2 K
Table 4. Results obtained from proposed and state-of-the-art methods.
Table 4. Results obtained from proposed and state-of-the-art methods.
HealthyMSHMSSIDACA
Proposed100100100100100%
WPT-BE-MSVM10096.5097.8290.4996.20%
Tr-LDA87.7394.2376.8210089.56%
PCA97.7080.3564.0485.7181.95%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ullah, S.; Ahmad, Z.; Kim, J.-M. Fault Diagnosis of a Multistage Centrifugal Pump Using Explanatory Ratio Linear Discriminant Analysis. Sensors 2024, 24, 1830. https://doi.org/10.3390/s24061830

AMA Style

Ullah S, Ahmad Z, Kim J-M. Fault Diagnosis of a Multistage Centrifugal Pump Using Explanatory Ratio Linear Discriminant Analysis. Sensors. 2024; 24(6):1830. https://doi.org/10.3390/s24061830

Chicago/Turabian Style

Ullah, Saif, Zahoor Ahmad, and Jong-Myon Kim. 2024. "Fault Diagnosis of a Multistage Centrifugal Pump Using Explanatory Ratio Linear Discriminant Analysis" Sensors 24, no. 6: 1830. https://doi.org/10.3390/s24061830

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop