Next Article in Journal
Protein-Based Anchoring Methods for Nucleic Acid Detection in Lateral Flow Format Assays
Next Article in Special Issue
Editorial for the Special Issue on Micro-Electromechanical System Inertial Devices
Previous Article in Journal
Structural and Dimensional Analysis by Computed Tomography of a Multi Geometric Template Manufactured by Fused Deposition Modeling
Previous Article in Special Issue
Virtual Coriolis-Force-Based Mode-Matching Micromachine-Optimized Tuning Fork Gyroscope without a Quadrature-Nulling Loop
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Seamless MEMS-INS/Geomagnetic Navigation System Based on Deep-Learning Strong Tracking Square-Root Cubature Kalman Filter

The State Key Laboratory of Dynamic Measurement Technology, and The School of Instrument and Electronics, North University of China, Taiyuan 030051, China
*
Author to whom correspondence should be addressed.
Micromachines 2023, 14(10), 1935; https://doi.org/10.3390/mi14101935
Submission received: 28 September 2023 / Revised: 11 October 2023 / Accepted: 14 October 2023 / Published: 15 October 2023
(This article belongs to the Special Issue MEMS Inertial Device, 2nd Edition)

Abstract

:
To suppress inertial navigation system drift and improve the seamless navigation capability of microelectromechanical system-inertial navigation systems/geomagnetic navigation systems (MEMS-INS/MNS) in geomagnetically unlocked environments, this paper proposes a hybrid seamless MEMS-INS/MNS strategy combining a strongly tracked square-root cubature Kalman filter with deep self-learning (DSL-STSRCKF). The proposed DSL-STSRCKF method consists of two innovative steps: (i) The relationship between the deep Kalman filter gain and the optimal estimation is established. In this paper, combining the two auxiliary methods of strong tracking filtering and square-root filtering based on singular value decomposition, the heading accuracy error of ST-SRCKF can reach 1.29°, which improves the heading accuracy by 90.10% and 9.20% compared to the traditional single INS and the traditional integrated navigation algorithm and greatly improves the robustness and computational efficiency. (ii) Providing deep self-learning capability for the ST-SRCKF by introducing a nonlinear autoregressive neural network (NARX) with exogenous inputs, which means that the heading accuracy can still reach 1.33° even during the MNS lockout period, and the heading accuracy can be improved by 89.80% compared with the single INS, realizing the continuous high-precision navigation estimation.

1. Introduction

As unmanned vehicles and other unmanned areas of research become more and more popular [1], a variety of high-precision navigation and positioning methods are also rapidly developing, such as global navigation satellite systems (GNSS), inertial navigation systems (INS), vision navigation systems, geomagnetic navigation systems (MNS), bionic navigation systems, and microelectromechanical navigation systems (MEMS), etc. These are more widely used navigation methods, and the characteristics of each navigation system and the respective strengths and weaknesses of the mutual coexistence of the systems are examined in [2,3,4,5,6].
This paper investigates an autonomous navigation system with unmanned capability applied in outdoor environments. Microelectromechanical systems-based inertial navigation (MEMS-INS) has the advantages of small size and strong anti-jamming, and it can maintain a short period of high-precision localization under autonomous use, but it has the fatal disadvantage of time-accumulated errors and cannot be used alone [7]. MNS is a passive system that utilizes the Earth’s magnetic field for positioning and navigation and has advantages such as no accumulation errors in time and distance. Therefore, the two navigation methods are complementary, and INS and MNS are combined together to suppress the drift of heading measurements. Florida Atlantic University [8] conducted research on INS/MNS information fusion to improve navigation accuracy. J.A. Barraza Madrigal implemented a 3D tracking method of the shoulder joint with respect to the thoracic cavity by using IMU/MARG integrated sensors and data fusion algorithms [9]. Due to the measurement errors of gyroscopes, accelerometers, and magnetometers inside the MIMU, many studies have proposed sensor fusion algorithms (SFAs) to accurately and robustly estimate the 3D orientation [10]. The above studies have provided some important insights into combined INS/MNS navigation. In this study, due to the complexity of the system as a nonlinear motion model, exploring how to incorporate auxiliary algorithms based on traditional filtering algorithms to optimize the fusion in order to reduce the error has been an important issue in combined navigation systems; therefore, we focused on the study of utilizing a variety of filtering schemes for more efficient fusion of INS/MNS information for more efficient fusion.
As a widely used optimization estimator, the Kalman filter (KF) is a customary filtering scheme to improve the accuracy of combinatorial navigation. However, when applied to motion nonlinear models, such as non-uniformly traveling carts or UAVs, it can cause the filter to be suboptimal or even divergent, and its performance is not satisfactory [11]. Therefore, a combined approach with the extended Kalman filter (EKF) and interactive multi-modeling is proposed to deal with the noise factor and to enable the use of highly dynamic models in non-motorized situations [12]. Since the EKF is sensitive to nonlinear errors and its linearization process introduces a significant truncation error, as well as a significant Jacobi matrix computation, three untraceable Kalman filters (UKFs) with different noise covariances are combined with interactive multi-models into an integrated framework to compensate for the filter divergence [13]. The cubature Kalman filter (CKF) utilizes the third-order spherical radial volume rule to make possible the numerical computation of multivariate moment integrals encountered in nonlinear Bayesian filters, and the CKF can be applied to solving an extensive range of nonlinear filtering problems, ranging from low to high dimensions [14]. Ref. [15] proposed an improved strong-tracking untraceable Kalman filter (ST-UKF) to resist the interference of motion modeling errors on combined INS/GNSS state estimation. The square root CKF (SRCKF) has shown excellent performance in non-Gaussian measurement noises and has received increasing attention [16]. However, in practical applications, due to the complexity of the system, there are more or less errors in the acquisition of the filter parameters, resulting in filter dispersion. In order to solve this problem, the concept of a strong tracking filter (STF) using the principle of vector orthogonality was proposed in [17], where an asymptotic cancellation factor is introduced to adjust the gain matrix over time for estimation. Based on the above research, this paper proposes to combine STF with SRCKF to develop a strong tracking SRCKF (ST-SRCKF) integrated filtering scheme for INS/MNS combined information fusion. The experimental results in this paper show that this filtering algorithm can improve the robustness of the combined navigation system, as well as reduce the number of unnecessary calculations and improve the computational efficiency.
Meanwhile, in practical applications, combined navigation is easily affected by external interference or inaccurate statistical information of sensor noise; for example, when a GPS-equipped ground vehicle or UAV passes through an environment with weak GPS signals, it will suffer from the problem of loss of lock, which leads to a drastic decrease in the navigation accuracy of the INS single-operating mode [18]. Similarly, geomagnetic navigation can be affected in strong magnetic environments; thus, solving the navigation disruption problem becomes more important. There is a growing interest in deep learning-related solutions, where an improved multilayer perceptron (MLP) artificial neural network directly relates INS velocity, angular rate, and acceleration to GPS position increments to predict velocity and position errors during GPS failures [19]. In recent years, deep learning has achieved satisfactory performance in time series prediction by integrating radial basis function neural networks (RBFNN) with time series to measure updates with prediction [20]. A recurrent neural network (RNN) was integrated with UKF to estimate and compensate for random drifts in gyroscopes [21]. By introducing a long- and short-term memory LSTM neural network to solve the problem of gradient vanishing and gradient explosion in RNNs during long-time sequences, the relationship between the internal gain and observations in combinatorial navigation is established to improve the error prediction accuracy [22]. In recent years, nonlinear autoregressive networks with exogenous inputs (NARX) have performed very well in data-driven metamodeling of nonlinear complex dynamic systems [23]. A nonlinear exogenous input autoregressive model for nonlinear systems based on neural network and time series analysis is proposed to predict the power generation of the photovoltaic module (PVM) for one month [24]. The above findings also provide an important guideline for the research ideas in this paper. The importance and innovation of this study lie in developing a seamless fusion strategy that combines the ST-SRCKF information fusion technique with the NARX neural network prediction tool applied to seamless combined INS/MNS navigation. The contributions of this paper are summarized as follows:
(1) In the IMU measurement unit, for the attitude angle information (pitch and roll angles) obtained from the gyroscope output solution, this paper fuses it with the additive counting data based on the quaternion solution method using the EKF to obtain more accurate and stable attitude information of pitch and roll angles. On the premise of the attitude information obtained by the above method, this paper proposes an ST-SRCKF algorithm to realize the fusion of INS information and MNS information and introduces an asymptotic factor to adjust the gain matrix over time for estimation so as to improve the robustness of the combined navigation system. The implementation utilizes singular value decomposition (SVD) to replace the original Cholesky decomposition process of SRCKF, which reduces the computational complexity and improves the numerical stability of the algorithm.
(2) A seamless fusion strategy is established to map the nonlinear relationship between INS inputs and heading observations during MNS outages. During the MNS availability time, the ST-SRCKF algorithm fuses the INS and MNS data to obtain accurate and reliable heading angle attitude information. Meanwhile, the NARX network is applied to train the INS data and MNS data to mine the relationship between INS parameters and heading observations. When the MNS is unavailable, the trained NARX predicts the lost observations during the MNS outage. Avoiding a single navigation situation ensures continuous navigation output with high accuracy.
The rest of the paper is organized as follows: Section 2 details the mathematical model of the combined INS/MNS navigation system and the proposed ST-SRCKF algorithm. Section 3 describes modeling the seamless fusion strategy over the NARX network in case of an MNS outage. Section 4 conducts experiments and simulations for validation. Section 5 concludes.

2. Inertial Navigation Systems/Geomagnetic Navigation Systems (INS/MNS) Navigation Model Based on Strongly Tracked Square-Root Cubature Kalman Filter (ST-SRCKF)

In combined navigation, INS is an essential part; in this paper, the EKF algorithm is utilized for the initial fusion of the INS inputs, i.e., gyroscope information and accelerometer information; the state quantity consists of the attitude quaternion and the gyroscope three-axis drift q 0 , q 1 , q 2 , q 3 , ε E , ε N , ε U   total of seven dimensions; and the accelerometer is used as a quantitative model to do the a posteriori estimation. This system resolves the carrier attitude information and has a better estimation for the traversing roll and pitching attitude information. The detailed settlement process can be found in [25]. However, due to the time drift of the INS, the obtained heading attitude information deviates greatly. As a complex nonlinear motion system, the deviation of the system model parameters leads to the filter performance degradation. In order to solve this problem, the concept of STF using the principle of vector orthogonality is introduced, and the asymptotic cancellation factor is introduced to adjust the gain matrix over time. In order to address the complexity of the computation of the mean-square error array P k of the CKF using the Cholesky decomposition, the singular value decomposition (SVD) is utilized instead of the original Cholesky decomposition process of the SRCKF, which effectively reduces the complexity of the computation. Based on the attitude angle information obtained from the INS solution, the proposed strongly tracked square-root cubature Kalman filter (ST-SRCKF) algorithm is used to incorporate the magnetometer data.
Taking the heading angle and gyro Z-axis bias of the gyro solution output as the state quantities and the heading angle compensated for tilt through the magnetometer data as the quantity measurement to do the a posteriori estimation, the optimal estimation of the heading attitude information is carried out by utilizing the proposed ST-SRCKF filtering algorithm, and the block diagram of the combined navigation is shown in Figure 1.
The equations of the state motion and measurement are expressed as
ψ k b k = 1 T 0 1 ψ k 1 b k 1 + T 0 w k
ψ m = 1 0 ψ k b k
respectively, where ψ k represents the heading angle; b k is the gyroscope Z-axis offset; w k is the gyroscope-measured angular velocity; 1 T 0 1 represents the state matrix A k , and 1 0 is measurement matrix H k ; and T is the update period.
Inclination compensation of the INS output attitude by magnetometer data was used to obtain the actual observations
M y = m x sin θ sin ϕ + m y cos θ m z cos ϕ sin θ M x = m x cos ϕ + m z sin ϕ Z k = ψ = atan 2 M y , M x
where ϕ , θ , and ψ represent the roll, pitch, and heading, respectively; and m x , m y , and m z are the magnetometer-measured three-axis data.
The entire process of the ST-SRCKF is divided into two parts: time update and observation update. The specific process is as follows:
(1)
Time update:
➀ The square root of the covariance matrix is:
U , D , V = svd P k 1 , P k 1 = U k 1 S k 1 V k 1 T
➁ Calculate and propagate the volume points:
X k / k 1 i = A k U k 1 S k 1 ξ i + x ^ k 1
where ξ i = n [ 1 ] i ,   i = 1,2 , , n , and n denote the state quantity dimension 2; [ 1 ] is the representative unit matrix; and x ^ k 1 is the previous state estimate.
➂ Predict the state:
x ^ k / k 1 i = 1 2 n 1 2 n X k / k 1 i
➃ Calculate the a priori error covariance matrix:
P k = 1 2 n i = 1 2 n X k / k 1 i X k / k 1 i T x ^ k / k 1 i x ^ k / k 1 i T + Q k
➄ where λ k is the regulatory factor. The calculation formula is shown as follows:
λ k = m a x tr W k H k Q k H k T β R k tr H k P k H k T + Q k
W k = ε k ε k T , k = 0 ρ W k 1 + ε k ε k T 1 + ρ , k 1 , ε k = Z k y ^ k
where ρ is the forgetting factor and is generally chosen to be ρ = 0.95 ; β is a weakening factor that takes the value β 1 ;   ε k is the innovation, the difference between the true measurement and the state estimate.
➅ The modified error covariance matrix:
P k λ = λ k A k P k A k T + Q k
(2)
Update the observation:
➀ The square root of the covariance matrix P k λ :
U , D , V = svd P k λ ,     P k λ = U k λ S k λ V k λ T
➁ Calculate and propagate the volume points:
y k i = H k U k λ S k λ ξ i + x ^ k / k 1 i
➂ Predict the measurement:
y ^ k = 1 2 n i = 1 2 n y k i
➃ Calculate the observed predicted covariance and cross-covariance:
P k y = 1 2 n i = 1 2 n y k i y k i T y ^ k y ^ k T + R k P k x y = 1 2 n i = 1 2 n X k i y k i T x ^ k / k 1 i y ^ k T
➄ Calculate the Kalman gain, state update, and corresponding error covariance matrix:
K k = P k x y P k y 1
x ^ k = x ^ k / k 1 i + K k ε k
P k = P k K k P k y K k T
The proposed combined navigation algorithm ST-SRCKF is essentially an iteration of the two processes of temporal update and measurement update, which is illustrated in Figure 2. In this paper, the initial estimates for x 0 and P 0 are provided so that the state estimates x ^ k can be computed recursively.

3. Seamless Fusion Strategy Based on Nonlinear Autoregressive with Exogenous Input (NARX)

3.1. Nonlinear Autoregressive Networks with Exogenous Input

Using a large amount of historical data to predict the future structural dynamic response effectively solves the problem of navigational disruption. The NARX neural network is based on a nonlinear autoregressive neural network with exogenous inputs. Compared with autoregressive and moving average models, NARX can capture the nonlinear relationship of the time series, which makes the model better adapted to the actual problem in complex environments, and its effectiveness in structural dynamic modeling has been proved in research [26]. The NARX network can discover long-term dependencies in the data through embedded input memory and is more compatible with gradient descent learning algorithms with faster convergence and better generalization than, e.g., LSTM recurrent neural networks with state variables [27].
For discrete time series, NARX can build the time series:
y t = f u t , y t ,
u ( t ) = t n e x Δ t , u t 2 Δ t , u t Δ t , u t T y ( t ) = t n i n Δ t , y t 2 Δ t , y t Δ t T .
where Δ t is the time step, u t and y t are referred to as internal and external inputs, n e x and n i n are the number of lags in u t and y t , respectively, and f is the right-to-left nonlinear basis function mapping data.
Replacement of the Equation (18) f function with the NARX network model
y ^ t = f u t , y t = h n + 1 W L n + 1 , n h n h 2 W L 2,1 h 1 W I 1,1 u t + b 1 + W L 1 , n + 1 y t + b 2 + b n + 1 .
y ^ t is the model output; h , W and b are the activation function, the weight matrix ( I denotes the input, and L denotes the number of network layers), and the deviation matrix constituting hypothesis f , respectively. After the number of hidden layers and neurons per layer are determined for the network structure, the performance function can be minimized by backpropagation with a gradient descent algorithm to iterate the network structure’s weight matrix and deviation matrix parameters.

3.2. Seamless Fusion Structure Based on NARX-Integrated ST-SRCKF

Since the combined INS/MNS navigation system is a nonlinear complex system, its combined mathematical model loses its accuracy when encountering an MNS outage situation. The proposed seamless fusion structure is precisely based on NARX to build the O I N S Y a w z k relational model, i.e., the relational model of specific force, angular velocity, and heading attitude information. It replaces the out-of-alignment mathematical model with the constructed relational model between the INS output information and the real measure z k . This provides important insights for better handling of complex nonlinear systems.
The input and output can be expressed as
Input : [ w x b , w y b , w z b , f x b , f y b , f z b ] Ouput : [ Yaw z k ]
where w x b , w y b , w z b represent the angular velocity of the tri-axial measured by the gyroscope; f x b , f y b , f z b represent the tri-axial specific force measured by the accelerometer; and   Yaw z k represents the measured heading angle.
The proposed NARX combined with the ST-SRCKF seamless fusion navigation structure is a two-mode structure. When MNS is available, the seamless fusion navigation strategy runs in training mode. The attitude information output from the INS solution is fused with the heading attitude information provided by the MNS in the ST-SRCKF to output the optimal estimate of the heading angle. Meanwhile, IMU raw and INS/MNS data are continuously fed into the NARX-based network model for training over a long period, iterating the network structure’s weight matrix and deviation matrix parameters to form a reliable O I N S   Yaw z k input-output relationship model.
When the MNS outage is unavailable, the seamless fusion structure goes into prediction mode. The current IMU data are used as input, and a trained NARX network model is utilized to predict the pseudo-heading attitude quantity, which continues to be incorporated into the ST-SRCKF as the measurement information along with the attitude information provided by the IMU, thus obtaining the optimal estimation of the heading angle. The NARX-ST-SRCKF seamless fusion navigation structure is designed to ensure that the navigation accuracy does not deteriorate drastically in the event of a loss of the MNS signal. The NARX-ST-SRCKF seamless INS/MNS fusion navigation structure is designed to ensure that the navigation accuracy does not degrade dramatically when the MNS signal is lost, as shown in Figure 3.
Combining neural networks with superior predictive capabilities with improved Kalman filtering algorithms can lead to a generalized and seamless fusion strategy that can be extended to other potential future applications with multiple sensor combinations. Examples include: monocular visual-inertial-liDAR simultaneous localization-fusion, a three-level multisensor fusion system that can achieve robust state estimation and globally consistent mapping in perceptually degraded environments [28]; convolutional neural network (CNN)-based faster regions with CNN (faster R-CNN) and you only look once (YOLO) V2 are investigated for improving the recognition technique of in-vehicle monocular cameras for designing preventive autonomous driving systems [29]; the uncertainty function is approximated using a radial basis function neural network (RBFNN). This means that vehicle platoon practical consensus can be achieved under the Zeno-free adaptive event-triggered control scheme, making connected automated vehicles’ platoon reach the string stability [30].

4. Experimental Results and Analysis

To verify the effectiveness of the proposed seamless fusion structure based on NARX- integrated ST-SRCKF, we self-designed and built an unmanned vehicle platform, and the platform is equipped with a CMP10A-10-axis attitude sensor. Figure 4 shows the experimental setup and hardware structure. A three-axis geomagnetic sensor and IMU were integrated into the 10-axis attitude measurement device. The sensor details are shown in Table 1. A computer was responsible for receiving and displaying the experimental data and running the program to achieve the fusion process of the heading angle. The reference heading angle of the test system comes from a high-precision compact optical fiber integrated navigation system (Model: SPAN-KVH1750) and its heading accuracy and sampling frequency could reach 0.035° (root mean square, RMS). To verify the superiority of the algorithm, experiments were conducted, and eight representative methods were proposed for comparison.
(1)
Method 1: Reference system.
(2)
Method 2: Pure INS algorithm.
(3)
Method 3: Pure Mag algorithm.
(4)
Method 4: EKF INS/MNS algorithm.
(5)
Method 5: CKF INS/MNS algorithm.
(6)
Method 6: ST-EKF INS/MNS algorithm.
(7)
Method 7: ST-SRCKF INS/MNS algorithm.
(8)
Method 8: NARX-ST-SRCKF INS/MNS algorithm.
The test results are analyzed later in this section.
Figure 4. Experimental equipment.
Figure 4. Experimental equipment.
Micromachines 14 01935 g004
Table 1. Sensor details.
Table 1. Sensor details.
SensorsParameterValue
SPAN-KVH1750Heading angle accuracy
Frequency
0.035°
100 HZ
CMP10A-10Axis Attitude SensorAccelerometer resolution
Gyroscope resolution
Magnetometer resolution
0.0005 (g/LSB)
0.061 (°/s)
0.0667 mGauss/LSB

4.1. Verification of the ST-SRCKF Algorithm

The test was conducted on 20 May 2023, at 12.40 p.m. at 3 College Road, Taiyuan, China (112.45° E, 38.02° N). The CMP10A-10-axis attitude sensor was mounted on the UV along with the reference system. In the initial stage of the experiment, the EKF fusion performance of the pitch and roll information of the IMU (three-axis gyroscope and three-axis accelerometer) was verified first, and then the EKF algorithm fusion process was performed for the collected three-axis gyroscope and three-axis accelerometer data. The comparison effect is shown in Figure 5a,b. The pitch and roll output accuracy and stability had a significant corrective effect.
Under the normal geomagnetic condition, the tri-axial magnetometer data collected by the device were fused with the experimental attitude output results in the initial stage using four comparative fusion algorithms. To evaluate the performance of the heading fusion strategy, the heading and heading error curves of each of the seven methods were plotted, as shown in Figure 6a,b, which were used for comparison.
Method 2 is accompanied by the gradual accumulation of time errors, decreasing measurement accuracy. As shown in Figure 6b, the magnetometer is susceptible to the influence of other electronic devices, and in Method 3, the heading angle error is highly volatile. Method 4 makes an obvious improvement in heading accuracy due to the fusion of geomagnetic data. However, as a complex nonlinear motion system, the heading accuracy of the method is lower and easy to diverge compared with the nonlinear fusion algorithm of Method 5; at the same time, the deviation of the system model parameters will result in the performance of the filter being degraded. Therefore, Method 6 introduces the concept of STF, which utilizes the fading factor to adjust the gain matrix over time. Method 7 introduces square root filtering based on Method 6 and replaces the Cholesky decomposition with SVD decomposition, greatly reducing computational complexity.
The results show that the method enhances the robustness of the combined navigation system, significantly improves the performance of heading angle measurement, reduces the computational complexity, and improves the numerical stability of the algorithm. To further illustrate the effectiveness of the algorithms in this paper, the statistical characteristic values of the six algorithms are summarized in Table 2. Compared with Method 2, Method 4 improves heading accuracy by 80.90%, Method 5 improves heading accuracy by 82.98%, Method 6 improves heading accuracy by 87.35%, and Method 7 improves heading accuracy by 90.10%. Among them, Method 7 proposed in this paper has a higher performance in all numerical characteristics, and its adaptability and robustness of fused heading angles are better than other fusion algorithms.

4.2. Verification of the Seamless Fusion Structure

During geomagnetic disturbances, to validate the effectiveness of the proposed NARX integrated ST-SRCKF seamless fusion structure, data collected by the device are divided into two phases, and two sets of training predictions are performed using the NARX network. The hardware device used for its training network is a NVIDIA GeForce 940MX. In the first stage, the first 4000 sets of sampled data points were used to train the model, and the last 1000 sets of sampled data points were used to predict and test the model. In the second stage, the first 6000 sets of sampled data points were used to train the model, and the remaining data points were used to predict and test the model. This grouping is to cover the basic motion states of the cart and, at the same time, to train the network model more efficiently, and the results of the training and validation analysis are shown in Figure 7a–d.
The data predicted in these two segments will replace the missing data during the MNS outage. During the MNS normal period, Method 7 was used to process the data; during the MNS outage, Method 8 was used to process the data predicted by the model. In order to evaluate the performance of the seamless fusion strategy in the case of geomagnetic loss of lock, the heading and heading error curves of the five methods were plotted, as shown in Figure 8a, and the heading angle error analysis curves were plotted for comparison, as shown in Figure 8b.
During interruptions, the geomagnetic sensors are subjected to strong magnetic interference, increasing the magnetometer output error. In contrast, the INS error gradually increases over time, leaving only the INS available for heading analysis, and the seamlessly fused structural prediction model of the NARX-integrated ST-SRCKF seamlessly bridges the interruption gap. Table 3 shows the comparative analysis of the statistical characteristic values of Method 8 with the pure INS and pure mag. The results show that in the case of MNS interruption, the seamless fusion structure of NARX-integrated ST-SRCKF can compensate for the resulting loss of heading accuracy in the case of geomagnetic interruptions and ensures the high-precision output of navigation.

5. Conclusions

This study aims to address the problem of error accumulation in single navigation and the problem of fusion optimization and disruption in combined navigation. Therefore, this paper proposes a new method for a seamless fusion of INS/MNS navigation systems based on the NARX integrated ST-SRCKF algorithm, with some effects of suppressing the INS error and achieving high robustness of the navigation system and low computational complexity. During the MNS data-loss process, the proposed seamless fusion structure can automatically correlate the current input information with the historical model information to compensate for the resulting loss of heading accuracy. Field experiments and simulations are conducted to verify the proposed method’s performance.
The experimental results show that the effectiveness of the fusion algorithm of Method 7 is verified in a magnetically normal environment. The heading accuracy of Method 4 is improved by 80.90%, Method 5 is improved by 82.98%, Method 6 is improved by 87.35%, and Method 7 is improved by 90.10% compared with that of Method 2. In the magnetic anomaly environment experiment, Method 8 improved the heading accuracy by 89.80% compared with the pure INS Method 2.
The results show that the designed seamless fusion strategy based on NARX network-assisted ST-SRCKF effectively estimates the inherent nonlinear relationship between the output of the inertial navigation system and the heading information and provides accurate navigation information when the MNS is interrupted. However, novel fusion filtering algorithms need to be explored in the future to minimize navigation errors further, designing fault detection schemes for autonomous detection in terms of active sensing of navigation system faults, and exploring deep learning networks with higher prediction accuracy in terms of interruption prediction compensation.

Author Contributions

T.Z.: Conceptualization, data curation, software, formal analysis, visualization, writing—original draft, writing—review and editing, investigation. C.W.: Formal analysis, writing—review and editing, funding acquisition. C.S.: Formal analysis, validation, supervision. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 61973281, in part by the Excellent Youth Foundation of Shanxi Province under Grant 202103021222011, in part by the Foundation of Science and Technology on Electro-Optical Information Security Control Laboratory under Grant 2021JCJQLB055010, in part by the Shanxi Province key laboratory of quantum sensing and precision measurement under Grant 201905D121001, in part by the 1331 Project of Shanxi Province.

Data Availability Statement

The raw data required to reproduce these findings cannot be shared at this time as the data also form part of an ongoing study.

Conflicts of Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References

  1. Groves, P. The Complexity Problem in Future Multisensor Navigation and Positioning Systems: A Modular Solution. J. Navig. 2014, 67, 311–326. [Google Scholar] [CrossRef]
  2. Ye, F.; Pan, S.; Gao, W.; Wang, H.; Liu, G.; Ma, C.; Wang, Y. An Improved Single-Epoch GNSS/INS Positioning Method for Urban Canyon Environment Based on Real-Time DISB Estimation. IEEE Access 2020, 8, 227566–227578. [Google Scholar] [CrossRef]
  3. Xu, Y.; Shmaliy, Y.S.; Bi, S.; Chen, X.; Zhuang, Y. Extended Kalman/UFIR Filters for UWB-Based Indoor Robot Locali-zation Under Time-Varying Colored Measurement Noise. IEEE Internet Things J. 2023, 10, 15632–15641. [Google Scholar] [CrossRef]
  4. Zheng, H.; Wang, H.; Wu, L.; Chai, H.; Wang, Y. Simulation Research on Gravity-Geomagnetism Combined Aided Underwater Navigation. J. Navig. 2013, 66, 83–98. [Google Scholar] [CrossRef]
  5. Liu, X.; Tang, J.; Shen, C.; Wang, C.; Guo, X.; Li, J.; Liu, J. Brain-like Position Measurement Method based on Improved Optical Flow Algorithm. ISA Trans. 2023, in press. [Google Scholar] [CrossRef] [PubMed]
  6. Shen, C.; Zhao, X.; Wu, X.; Cao, H.; Wang, C.; Tang, J.; Liu, J. Multi-aperture Visual Velocity Measurement Method based on Biomimetic Compound-eye for UAVs. IEEE Internet Things J. 2023; in press. [Google Scholar] [CrossRef]
  7. Li, R.; Wang, Z.; Chen, P. Development the method of pipeline bending strain measurement based on microelectromechanical systems inertial measurement unit. Sci. Prog. 2020, 103, 0036850420925231. [Google Scholar] [CrossRef] [PubMed]
  8. Grenon, G.; An, P.E.; Smith, S.M.; Healey, A.J. Enhancement of the Inertial Navigation System for the Morpheus Autonomous Underwater Vehicles. IEEE J. Ocean. Eng. 2001, 26, 548–560. [Google Scholar] [CrossRef]
  9. Madrigal, J.A.B.; Negrete, J.C.; Mu, R.; ContrerasRodríguez, L.A.; Sossa, H. 3D Motion tracking of the shoulder joint with respect to thethorax using MARG sensors and data fusion algorithm. Biocybern. Biomed. Eng. 2020, 40, 1205–1224. [Google Scholar] [CrossRef]
  10. Nazarahari, M.; Rouhani, H. Sensor fusion algorithms for orientation tracking via magnetic and inertial measurement units: An experimental comparison survey. Inf. Fusion 2021, 76, 8–23. [Google Scholar] [CrossRef]
  11. Guo, X.; Tang, J.; Li, J.; Shen, C.; Liu, J. Attitude measurement based on imaging ray tracking model and orthographic projection with iteration algorithm. ISA Trans. 2019, 95, 379–391. [Google Scholar] [CrossRef]
  12. Cao, H.; Zhang, Y.; Han, Z.; Shao, X.; Gao, J.; Huang, K.; Shi, Y.; Tang, J.; Shen, C.; Liu, J. Pole-Zero Temperature Compensation Circuit Design and Experiment for Dual-Mass MEMS Gyroscope Bandwidth Expansion. IEEE-ASME Trans. Mechatron. 2019, 24, 677–688. [Google Scholar] [CrossRef]
  13. Huiliang, C.; Yingjie, Z.; Chong, S.; Liu, Y.; Xinwang, W. Temperature Energy Influence Compensation for MEMS Vibration Gyroscope Based on RBF NN-GA-KF Method. Shock Vib. 2018, 2018, 2830686. [Google Scholar]
  14. Gao, B.; Hu, G.; Zhong, Y.; Zhu, X. Cubature Kalman Filter With Both Adaptability and Robustness for Tightly-Coupled GNSS/INS Integration. IEEE Sens. J. 2021, 21, 14997–15011. [Google Scholar] [CrossRef]
  15. Hu, G.; Wang, W.; Zhong, Y.; Gao, B.; Gu, C. A new direct filtering approach to INS/GNSS integration. Aerosp. Sci. Technol. 2018, 77, 755–764. [Google Scholar] [CrossRef]
  16. He, J.; Guo, Z. Laplace 1 Square-Root Cubature Kalman Filter for Non-Gaussian Measurement Noises. Circuits Syst. Signal Process. 2022, 41, 3328–3349. [Google Scholar] [CrossRef]
  17. Chen, T.; Xu, X.; Chen, L.; Jiang, H.; Cai, Y.; Li, Y. Estimation of longitudinal force, lateral vehicle speed and yaw rate for four-wheel independent driven electric vehicles. Mech. Syst. Sig. Process. 2018, 101, 377–388. [Google Scholar] [CrossRef]
  18. Wang, G.; Xu, X.; Yao, Y.; Tong, J. A Novel BPNN-Based Method to Overcome the GPS Outages for INS/GPS System. IEEE Access 2019, 7, 82134–82143. [Google Scholar] [CrossRef]
  19. Zhu, X.; Havyarimana, V.; Li, T.; Wang, D. A Nonlinear Framework of Delayed Particle Smoothing Method for Vehicle Localization under Non-Gaussian Environment. Sensors 2016, 16, 692–708. [Google Scholar]
  20. Linzhouting, C.; Jiancheng, F. A hybrid prediction method for bridging GPS outages in high-precision pos application. IEEE Trans. Instrum. Meas. 2014, 63, 1656–1665. [Google Scholar] [CrossRef]
  21. Li, D.; Zhou, J.; Liu, Y. Recurrent-neural-network-based unscented Kalman filter for estimating and compensating the random drift of MEMS gyroscopes in real time. Mech. Syst. Signal Process. 2021, 147, 107057. [Google Scholar] [CrossRef]
  22. Shen, C.; Zhang, Y.; Guo, X.; Chen, X.; Cao, H.; Tang, J.; Li, J.; Liu, J. Seamless GPS/Inertial Navigation System Based on Self-Learning Square-Root Cubature Kalman Filter. IEEE Trans. Ind. Electron. 2021, 68, 499–508. [Google Scholar] [CrossRef]
  23. Yu, B.; Shu, W.; Cao, C. A Novel Modeling Method for Aircraft Engine Using Nonlinear Autoregressive Exogenous (NARX) Models Based on Wavelet Neural Networks. Int. J. Turbo Jet-Engines 2018, 35, 161–169. [Google Scholar] [CrossRef]
  24. Louzazni, M.; Mosalam, H.; Cotfas, D.T. Forecasting of photovoltaic power by means of non-linear auto-regressive exogenous artificial neural network and time series analysis. Electronics 2021, 10, 1953. [Google Scholar] [CrossRef]
  25. Sabatelli, S.; Galgani, M.; Fanucci, L.; Rocchi, A. A Double-Stage Kalman Filter for Orientation Tracking with an Integrated Processor in 9-D IMU. IEEE Trans. Instrum. Meas. 2013, 62, 590–598. [Google Scholar] [CrossRef]
  26. Mai, C.V.; Spiridonakos, M.D.; Chatzi, E.N.; Sudret, B. Surrogate modeling for stochastic dynamical systems by combining nonlinear autoregressive with exogenous input models and polynomial chaos expansions. Int. J. Uncertain. Quantif. 2016, 6, 313–339. [Google Scholar] [CrossRef]
  27. Cheng, A.; Low, Y.M. Improved generalization of NARX neural networks for enhanced metamodeling of nonlinear dynamic systems under stochastic excitations. Mech. Syst. Signal Process. 2023, 200, 110543. [Google Scholar] [CrossRef]
  28. Wang, Y.; Ma, H. mVIL-Fusion: Monocular Visual-Inertial-LiDAR Simultaneous Localization and Mapping in Challenging Environments. IEEE Robot. Autom. Lett. 2023, 8, 504–511. [Google Scholar] [CrossRef]
  29. Lee, W.; Kang, M.-H.; Song, J.; Hwang, K. The Design of Preventive Automated Driving Systems Based on Convolutional Neural Network. Electronics 2021, 10, 1737. [Google Scholar] [CrossRef]
  30. Wu, Z.; Sun, J.; Hong, S. RBFNN-Based Adaptive Event-Triggered Control for Heterogeneous Vehicle Platoon Consensus. IEEE Trans. Intell. Transp. Syst. 2022, 23, 18761–18773. [Google Scholar] [CrossRef]
Figure 1. Block diagram of Inertial Navigation Systems/Geomagnetic Navigation Systems (INS/MNS) integrated navigation.
Figure 1. Block diagram of Inertial Navigation Systems/Geomagnetic Navigation Systems (INS/MNS) integrated navigation.
Micromachines 14 01935 g001
Figure 2. Block diagram of the Strongly Tracked Square-Root Cubature Kalman Filter (ST-SRCKF) algorithm.
Figure 2. Block diagram of the Strongly Tracked Square-Root Cubature Kalman Filter (ST-SRCKF) algorithm.
Micromachines 14 01935 g002
Figure 3. Seamless fusion structure based on NARX- integrated ST-SRCKF.
Figure 3. Seamless fusion structure based on NARX- integrated ST-SRCKF.
Micromachines 14 01935 g003
Figure 5. (a) Pitch angle in INS. (b) Roll angle in INS.
Figure 5. (a) Pitch angle in INS. (b) Roll angle in INS.
Micromachines 14 01935 g005
Figure 6. (a) Comparative analysis of the heading of the seven methods. (b) Comparative analysis of the heading error of the seven methods.
Figure 6. (a) Comparative analysis of the heading of the seven methods. (b) Comparative analysis of the heading error of the seven methods.
Micromachines 14 01935 g006
Figure 7. (a) Training and validation analysis based on the first phase of NARX. (b) Phase I prediction and observation error analysis. (c) Training and validation analysis based on the second phase of NARX. (d) Second-stage prediction and observation error analysis.
Figure 7. (a) Training and validation analysis based on the first phase of NARX. (b) Phase I prediction and observation error analysis. (c) Training and validation analysis based on the second phase of NARX. (d) Second-stage prediction and observation error analysis.
Micromachines 14 01935 g007
Figure 8. (a) Analysis of the heading angles of the five methods during periods containing geomagnetic interruptions. (b) Analysis of the heading angle errors of the five methods during the period containing the geomagnetic interruption.
Figure 8. (a) Analysis of the heading angles of the five methods during periods containing geomagnetic interruptions. (b) Analysis of the heading angle errors of the five methods during the period containing the geomagnetic interruption.
Micromachines 14 01935 g008
Table 2. Median, max, min, and RMS of the yaw obtained by the six methods in magnetic normality experiment (units: °).
Table 2. Median, max, min, and RMS of the yaw obtained by the six methods in magnetic normality experiment (units: °).
MethodMedianMaxMinRMSImprovement (RMS)
Method 2
Method 3
11.16
0.02
19.61
8.16
0.0021
8 × 10−5
13.04
2.78
\
\
Method 40.046.415 × 10−52.4980.90%
Method 50.164.9710−42.2282.98%
Method 6
Method 7
0.11
0.03
4.29
2.80
7 × 10−5
7 × 10−5
1.65
1.29
87.35%
90.10%
Table 3. Median, max, min, and RMS of the yaw obtained by the three methods in magnetic anomaly experiment (units: °).
Table 3. Median, max, min, and RMS of the yaw obtained by the three methods in magnetic anomaly experiment (units: °).
MethodMedianMaxMinRMSImprovement (RMS)
Method2
Method3
11.16
0.55
19.61
17.7
0.0021
8 × 10−5
13.04
6.50
\
\
Method80.013.312 × 10−51.3389.80%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhao, T.; Wang, C.; Shen, C. Seamless MEMS-INS/Geomagnetic Navigation System Based on Deep-Learning Strong Tracking Square-Root Cubature Kalman Filter. Micromachines 2023, 14, 1935. https://doi.org/10.3390/mi14101935

AMA Style

Zhao T, Wang C, Shen C. Seamless MEMS-INS/Geomagnetic Navigation System Based on Deep-Learning Strong Tracking Square-Root Cubature Kalman Filter. Micromachines. 2023; 14(10):1935. https://doi.org/10.3390/mi14101935

Chicago/Turabian Style

Zhao, Tianshang, Chenguang Wang, and Chong Shen. 2023. "Seamless MEMS-INS/Geomagnetic Navigation System Based on Deep-Learning Strong Tracking Square-Root Cubature Kalman Filter" Micromachines 14, no. 10: 1935. https://doi.org/10.3390/mi14101935

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop