Next Article in Journal
Advances in Cancer Diagnosis: Bio-Electrochemical and Biophysical Characterizations of Cancer Cells
Next Article in Special Issue
Multi-Grid Capacitive Transducers for Measuring the Surface Profile of Silicon Wafers
Previous Article in Journal
Investigation of Nonlinear Piezoelectric Energy Harvester for Low-Frequency and Wideband Applications
Previous Article in Special Issue
Research on the Application of MEMS Intelligent Sensor in Abnormal Monitoring of Metro Tunnel by Simplified Model Tests
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

GO-INO: Graph Optimization MEMS-IMU/NHC/Odometer Integration for Ground Vehicle Positioning

1
School of Automobile and Traffic Engineering, Jiangsu University of Technology, Changzhou 213001, China
2
School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China
3
Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, Masala, FI-0245 Espoo, Finland
*
Author to whom correspondence should be addressed.
Micromachines 2022, 13(9), 1400; https://doi.org/10.3390/mi13091400
Submission received: 28 July 2022 / Revised: 24 August 2022 / Accepted: 25 August 2022 / Published: 26 August 2022
(This article belongs to the Special Issue MEMS Sensors: Past, Present and Future)

Abstract

:
Global navigation satellite system (GNSS) and inertial navigation system (INS) are indispensable for ground vehicle position and navigation. The Kalman filter (KF) is the first choice to integrate them and output more reliable navigation solutions. However, the GNSS signal is denied in urban areas, i.e., tunnels, and the INS position errors diverge quickly over time. Under normal conditions, the ground vehicle will not slide or jump off the ground; nonholonomic constraints (NHC) and odometers are available to aid the INS and reduce its position errors. Factor graph optimization (FGO) recently attracted attention as an advanced sensor fusion algorithm. This paper implemented the FGO method based on GNSS/INS/NHC/Odometer integration. In the FGO, state transformation, measurement model, the NHC, and the odometer were all regarded as constraints employed to construct a graph; an iterative process was utilized to find the optimal estimation results. Two experiments were carried out: firstly, the FGO-GNSS/INS performance was assessed and compared with the KF-GNSS/INS; secondly, we compared the FGO-GNSS/INS/NHC/Odometer and KF-GNSS/INS/NHC/Odometer under GNSS denied environments. Experimental results supported that the FGO improved the performance.

1. Introduction

With the booming of the location-based service (LBS), i.e., autonomous driving, unmanned aerial vehicles (UAV), reliable positioning results are critical for these applications [1,2,3,4,5]. GNSS (global navigation satellite system) is the dominant tool for providing precise and dependable three-dimensional positioning information. In the open-sky environments [6], there are usually enough in-view satellites, and the GNSS receivers can generate exact three-dimensional positions. However, GNSS signals might be obstructed in urban areas with tall buildings or reflected by the surrounded buildings. The signal blockage will degrade the geometry distribution of the in-view satellites, and the positioning accuracy will decrease [7,8]. Therefore, GNSS is usually integrated with the INS to generate more reliable navigation solutions [9,10].
INS is a self-contained navigation system that generates position, velocity, and attitude (PVA) information through processing the gyroscope and raw accelerometer measurements from the inertial measurement unit (IMU) [11,12,13]. Due to the complex noises contained in the basic measurements from the IMU, INS positioning errors diverge quickly over time. In the GNSS/INS-integrated navigation system, the integration filter, usually the Kalman filter (KF), estimates the IMU error states and compensates for its errors; in this manner, the INS can still output precise navigation solutions in a short time during GNSS signal outage [14,15]. In urban areas, the GNSS signal is usually blocked by surrounding buildings. Improving the INS accuracy during GNSS signal outages is significant [16,17,18].
The methods to improve the INS positioning accuracy could be categorized into two groups. The first method is to analyze and denoise the raw measurements of the IMU. Allan variance was first employed in the IMU measurements noise analysis, modeling, and quantification [13,14,15]. Then, an autoregressive moving average model (ARMA) method was employed in estimating and modeling the IMU noises [19,20]. Additionally, some variants of the ARMA were proposed, e.g., a Sage Husa adaptive robust Kalman filtering method was utilized to tune the parameters of the ARMA [20]; an adaptive unscented fading Kalman filter for reducing drift of fiber optic gyroscope [21]; and a robust Kalman filter was proposed for gyro random noise [22]. In addition, wavelet denoising methods and machine learning methods were also employed in the IMU raw measurements denoising. Naser first proposed a wavelet denoising for IMU alignment [11]; after this, some other research was carried out to further explore the IMU denoising with different wavelet denoising methods [23,24,25]. Machine learning methods, e.g., support vector machine (SVM) [26], long-short-term-memory recurrent neural networks (LSTM-RNN) [27], deep simple reduce unit recurrent neural network (SRU-RNN) [28], and a neural architecture search neural network were employed in the MEMS IMU denoising [29].
In addition to the IMU raw measurements noising, modifications of the GNSS/INS integration filter were carried out to decrease the INS navigation solution errors. Some machine learning methods, radial basis function neural network, LSTM, recurrent fuzzy wavelet neural networks, and deep reinforcement learning were trained while the GNSS/INS integration worked well; they were employed to compensate for the INS navigation solution errors during signal outages [30,31,32,33,34]. For ground vehicles, some unique characteristics were extracted and utilized to suppress the INS navigation solution errors [35,36,37,38,39]. While the ground vehicle drove steadily on the road, the up-direction and lateral velocity were almost zero. The nonholonomic constraints (NHC) decreased the INS positioning errors [35,36,37,38,39]. In addition, an odometer was usually installed in the ground vehicles. Therefore, GNSS/INS/Odometry/NHC was constructed and assessed under GNSS signal-challenging environments [36].
Factor graph optimization (FGO) recently attracted attention as an alternative method to GNSS/INS integration [40,41,42,43]. Wen et al., presented comprehensive comparisons between the KF-GNSS/INS and the FGO-GNSS/INS with ground vehicle experiments in urban areas [40]. The FGO relinearization and the full use of the historical time-correlation measurements contribute to the FGO-GNSS/INS’s better performance than the KF-GNSS/INS [40]. Li et al., implemented the FGO-GNSS/INS tight integration, presenting the FGO-GNSS/INS improvements to the KF-GNSS/INS [41]. Researchers from the Georgia Institute of Technology released the optimization library GTSAM and implemented the FGO-GNSS/INS; FGO’s better performance than the KF-GNSS/INS is demonstrated [42]. This paper implemented the FGO-GNSS/INS integration and the FGO-INS/NHC/Odometer integration in GNSS-denied environments. FGO handles the measurements as constraints, making full use of the historical information and the inherent relationship among the states. Moreover, it is convenient to delete or add measures or constraints. Two field tests were carried out in urban areas to assess the performance of the FGO-GNSS/INS/Odometer integration and the FGO-INS/NHC/Odometer integration.
The remainder of the paper is organized as follows: Section 2 gives the KF-GNSS/INS/ Odometer details and the NHC mechanisms, state propagation model, measurement model, and the KF are presented; Section 3 presents the FGO-GNSS/INS integration and the FGO-INS/NHC/Odometer integration; Section 4 presents the field tests, the experimental results, and analysis. Finally, conclusions are drawn, and some discussions are also listed to deepen this method.

2. KF-GNSS/INS/NHC Integration

While the ground vehicles usually drive on the road, we can find two motion characteristics in the vehicle body coordinates (1) up-direction velocity is approximately zero; (2) velocity of the lateral is approximately zero. The equations are written as [44]:
v x v 0 v z v 0
where v x v denotes the lateral velocity in the vehicle body coordinates, v z v indicates the up-direction velocity. The ground vehicle coordinate is presented in Figure 1. X axis of the vehicle body coordinate is defined as pointing to the right side of the vehicle body, the Y axis of the vehicle body coordinate is defined as pointing to the direction of the vehicle heading, the Z axis of the vehicle body coordinate is defined as pointing to the direction of the roof.
While the ground vehicle drives smoothly on the road, these velocity constraints can be employed to suppress the diverging positioning errors of the INS. The motion constraints can be used as measurements in the GNSS/INS integration filter. While the IMU is installed in the vehicle for sensing the motions, there is a misalignment angle between the IMU body coordinate and the vehicle body coordinate. While applying the movement constraints in the integration filter, the measurement vector should be projected to the IMU body coordinate through the conversion matrix calculated through the misalignment angle. Here, assuming the misalignment matrix is C v b , then the conversion can be modeled as:
V b = C v b · V v
V b = v x b v y b v z b = C v b v x v v y v v z v = sin α ψ cos α θ cos α ψ cos α θ sin α θ · v y v
where α ψ denotes the misalignment heading angle, α θ denotes the pitch misalignment angle, V b denotes the velocity vector in the IMU body coordinate, v x b , v y b and v z b denote the three-axis velocity in the IMU body coordinate, V v denotes the velocity vector in the vehicle body frame, and v x v , v y v and v z v denote the three-axis velocity in the vehicle body coordinate.

2.1. State Propagation and Measurement Model

In the KF-GNSS/INS integration, attitude errors, velocity errors, position errors, gyroscope three-axis bias, and accelerometer three-axis bias are included in the state vector. The integration filter estimates these state variables, which is employed for compensating the INS errors. Assuming the state vector is termed as X I N S .
X I N S = [ δ ϕ , δ v e l , δ p o s , δ ε , δ ] T
where δ ϕ = α , β , γ refers to the three-axis attitude errors (pitch, roll, and yaw angle errors), δ v e l = δ v E   δ v N   δ v U means the velocity vector, which is composed of east, north, and up velocity error (East-North-Up coordinates), δ p o s = δ L   δ λ   δ H is the position error vector which is composed of latitude, longitude, and height error, then, δ ε = ε x   ε y   ε z denotes the three-axis accelerometer bias errors, and δ = x   y   z refers to the three-axis gyroscope bias errors, respectively.
The state transformation model of the GNSS/INS integration model is built based on the INS error propagation; the state equation is written as
X k + 1 = F k , k + 1 · X k + w
where X k I denotes the state vector, F k , k + 1 represents the state transformation matrix, and w indicates the state model noise matrix [35].
In the GNSS/INS integration, the position and velocity from GNSS and INS are subtracted and then employed to compose the measurement vector of the integration filter. The measurement vector is written as:
Z k + 1 = H k + 1 X k + 1 + μ
Z k + 1 = L k + 1 I N S L k + 1 G N S S · R M + h λ k + 1 I N S λ k + 1 G N S S · R N + h · cos L h k + 1 I N S h k + 1 G N S S v E , k + 1 I N S v E , k + 1 G N S S v N , k + 1 I N S v N , k + 1 G N S S v U , k + 1 I N S v U , k + 1 G N S S
where the measurement noise, the superscript “INS” and “GNSS” denote the information from the INS and GNSS, respectively, Z k + 1 indicates the measurement vector, which is composed of the position and velocity difference between the GNSS and INS (Equation (7)), μ denotes measurement noise, H k + 1 indicates the observation matrix and it is written as
Z k + 1 = d i a g R M + h · R N + h cos L   1 0 3 × 3 0 3 × 3 0 3 × 3 0 3 × 3 X k + 1 + μ

2.2. NHC Measurement Model

As aforementioned, while the vehicle drives smoothly on the road, the up and lateral velocity in the vehicle body coordinates are both almost zero and are termed as v x b and v z b . Converting the speed from the vehicle body frame to the IMU body frame:
V N H C b I = C b I · V N H C b
where C b I denotes the velocity conversion matrix, V N H C b I denotes the converted velocity in the IMU body coordinates; and then, converting the velocity from the IMU frame to the navigation frame and the procedure is expressed as
V N H C I n = C I n · V N H C b I
where C I n denotes the velocity conversion matrix, and the V N H C b I and V N H C I n denote the velocity in the IMU body frame and the navigation frames. The NHC measurement vector is written as
Z k + 1 N H C = V N H C I n V n I N S
V n I N S denotes the velocity obtained from processing the IMU raw measurements.

2.3. Odometer Measurement Model

An odometer can provide odometry measurements of the ground vehicle, and the ground vehicle velocity can be estimated with the odometry difference. The odometer output is written as
V O d o b = 0 V o d o , y b 0 T
The odometer velocity is measured in IMU body coordinates; we assumed the misalignment angle between the odometer and the IMU is zero. Then, converting the velocity from the IMU body frame to the East-North-Up navigation coordinates, the measurement vector is written as
Z k + 1 O d o = C b n · V O d o b V n I N S = V o d o E n V I E V o d o N n V I N V o d o U n V I U = H O d o · X + V O d o
where V n I N S denotes the IMU velocity, V O d o b denotes the velocity from the odometer, H O d o denotes the observation matrix, and V O d o denotes the measurement noise vector.
H O d o = 0 1 × 3 1 0 0 0 1 × 9 0 1 × 3 0 1 0 0 1 × 9 0 1 × 3 0 0 1 0 1 × 9

2.4. Kalman Filter

State and measurement models of the KF-GNSS/INS integration methods are listed in Equations (4)–(11); the KF is usually employed to estimate the state vector recursively. In the typical KF, five equations are generally essential for the two steps in KF: predicting and updating procedures.
In the prediction step, KF predicts the state vector through the state propagation model, and the state estimation errors covariance matrix is also predicted through the state propagation matrix. The equations of the prediction are written as
X k = F k | k 1 X k 1
P k = F k | k 1 P k 1 F k | k 1 T + Q k 1
The state vector, state estimation errors covariance matrix, and the Kalman gain matrix are updated in the updating step. The equations are written as
K k = P k · H k T H k · P k · H k T + R k 1
X ^ k = X k + K k · Z k H k · X k
P k = I K k · H k · P k
where F k | k 1 denotes the state transformation matrix, Q denotes the covariance matrix of the state process noise, and R denotes the covariance matrix of the measurement noise, P denotes the state estimation errors covariance matrix, H denotes the observation matrix, “−”denotes the prediction, “^”denotes the estimation, and K denotes the Kalman gain matrix. While the GNSS is expected, the system works with GNSS/INS integration mode, and reliable navigation solutions are expected. At the same time, GNSS is denied; according to the vehicle state detection results, NHC and odometer measurements are added to construct the integration to suppress the INS position errors.

3. FGO-GNSS/INS/NHC/Odometer

Recently, factor graph optimization (FGO) has attracted much attention in multi-sensor fusion [42,43]; the FGO utilizes the graphic model to represent the states and the measurements [43]. Unlike the KF, the FGO encodes the historical state transformation and measurements as the factors. It estimates the set of states at each epoch through a Gauss–Newton method or Levenberg–Marquardt (LM) method. In the FGO, the edge connects the factor node and the variable node. The factorized function is written as [13,14]:
f χ = i f i χ i
where χ i denotes nodes of the state variables. In the FGO, the optimal estimates χ ^ are obtained by minimizing the errors of the entire graph, and the procedure is summarized as
χ ^ = arg min χ i f i χ i
Here, there are four types of measurements: GNSS measurements, INS measurements, NHC measurements, and the odometer measurements. Suppose the process noise and the measurement noise are both subject to zero-mean Gaussian distributions with covariance matrix Σ k and Λ k . The optimal estimation of the state variables can be expressed as
X ^ = arg max P Z i X i P X i X i 1 , u i
P Z i X i exp 1 2 h i X i 1 , u i X i Σ i 2
P Z i X i exp 1 2 h i X i 1 X i Λ i 2
where Z i refers to the measurement vector, u i refers to the control input, and X ^ refers to the estimates of the state vector. Then, the optimal state estimates of the state can be converted to a nonlinear square problem, and the optimal state can be obtained by minimizing the cost function, which is written as:
X ^ = arg min i = 1 K f i X i 1 , u i X i Σ i 2 + i = 1 K h i X i 1 X i Λ i 2
where · means the Mahalanobis norm. Here, there are two different conditions, and Figure 2 presents the factor graph structure for the GNSS/INS integration (Figure 2a) and INS/NHC/Odometer integration (Figure 2b). The following subsections present the IMU, NHC, and odometer factors.

3.1. IMU Preintegration Factor

A standard IMU contains a three-axis accelerometer and gyroscope, which measures the acceleration and the rotation. The IMU measurement model is written as:
ω ˜ I t = ω W I t + b g t + η g t
a ˜ I t = R W I T t a W t g W + b a t + η a t
where ω ˜ I t denotes the angular velocity in the IMU coordinates, ω W I t denotes the angular velocity of the IMU frame relative to the world frame, b g t denotes the angular rate time-varying bias, η g t denotes the Gaussian white noise, a ˜ I t denotes the accelerometer measurements in the IMU frame, R W I T t denotes the rotation matrix from the world frame to the IMU frame, a W t and g W denote the acceleration measurements and the gravity vector in the world frame, and b a t and η a t denote the angular rate time-varying bias and the Gaussian white noise.
The IMU kinetic model is written as:
R ˙ W I = R W I ω W I
V ˙ W = a W
P ˙ W = v W
where ω is written as
ω = ω 1 ω 2 ω 3 = 0 ω 3 ω 2 ω 3 0 ω 1 ω 2 ω 1 0
Suppose that the angular rate and acceleration remain invariant during the IMU measurement updating period t , t + Δ t . The discrete form of the motion model is written as:
R W I t + Δ t = R W I t Exp ω ˜ I t b g t η g d t Δ t
v W t + Δ t = v W t + g W Δ t + R W I t a ˜ I t b a t η a d t Δ t
P W t + Δ t = P W t + v W t P W t + Δ t + 1 2 g W Δ t 2 + 1 2 R W I a ˜ I t b a t η a d t Δ t 2
The IMU factor can be written as
x k = h I N S x k 1 , A k + N 0 , Σ k I N S
e k I N S Σ k I N S 2 = x k h I N S x k 1 , A k Σ k I N S 2
where h I N S · denotes the measurement function, A k denotes the IMU measurements, and Σ k I N S denotes the covariance matrix.

3.2. GNSS Factor

Similarly, the cost function for GNSS measurement is written as
e k G N S S Σ k G N N S 2 = z k G N S S h G N S S x k Σ k G N S S 2
where z k G N S S denotes the GNSS measurements, h G N S S · denotes the measurement function, and Σ k G N S S denotes the covariance matrix of the measurement noise.

3.3. NHC Factor

As the measurement model listed in Equations (9)–(11), the cost function of the NHC measurement is written as
e k N H C Σ k N H C 2 = z k N H C h N H C x k Σ k N H C 2
where z k N H C denotes the NHC measurements, h N H C · denotes the measurement function, and Σ k N H C denotes the covariance matrix of the measurement noise.

3.4. Odometer Factor

The cost function of the odometer measurement is written as
e k O d o Σ k N H C 2 = z k O d o h O d o x k Σ k O d o 2
where z k O d o denotes the odometer measurements, h O d o · denotes the measurement function, and Σ k O d o denotes the covariance matrix of the measurement noise.

3.5. FGO

Optimal estimates of the states are obtained through minimizing the cost functions, which is formulated as
x * = arg min Σ k e k I N S Σ k I N S 2 + e k G N S S Σ k G N S S 2
Under GNSS-denied conditions, the optimal states in the FGO-IMU/NHC/Odometer are solved through the formulations listed as
x * = arg min Σ k e k N H C Σ k N H C 2 + e k O d o Σ k N H C 2 + e k I N S Σ k I N S 2

4. Experiments and Results

To assess the performance of the proposed method, we carried out two different experiments. Raw GNSS, IMU, and odometer measurements were collected through our data-collecting platform installed in a ground vehicle. Our previous paper revealed the mode details of the MEMS IMU and data collecting [37], Table 1 lists the specifications of the employed IMU in this experiment. Here, we first assess the FGO-based GNSS/INS performance for ground vehicle position applications; then, FGO-INS/NHC/Odometer integration is evaluated with the collected raw data. We utilize a postprocessing GNSS/INS reference system POS320 as the trajectory reference for the experiments to calculate the position errors.

4.1. FGO-GNSS/INS Performance Assessment

We carried out the field test near the Nanjing University of Science and Technology. Figure 3 presents the trajectory plotted in the Google Map. Figure 4 shows the available satellites for the experiment. It can be seen that the amount of the in-view satellites is satisfactory. Position errors from the GNSS/INS integration methods KF-GNSS/INS and FGO-GNSS/INS are presented in Figure 5 together for comparison. Specifically, Figure 5a shows the east-direction position errors comparison, Figure 5b illustrates the north-direction position errors comparison, and Figure 5c presents the horizontal position errors comparison. Blue curves represent the position errors of the KF-GNSS/INS method, and the red curves represent the position errors of the FGO-GNSS/INS method. It can be observed that the FGO-GNSS/INS obtains superior performance compared with KF-GNSS/INS through the position curves.
Furthermore, the quantitative analysis results of the absolute values of the position errors are listed in Table 2. In terms of the mean values of the absolute position errors, the FGO-GNSS/INS obtains a 52.6%, 46.8%, and 60.7% decrease for east, north, and horizontal position errors compared with that of the KF-GNSS/INS. Regarding the rooted mean square (RMS) position errors, the FGO-GNSS/INS also obtains a 53.6%, 49.5%, and 51.3% decrease. Additionally, the maximum values of the east, north, and horizontal position errors from the FGO-GNSS/INS decreased by 33.1%, 36.2%, and 42.7% compared with that from the KF-GNSS/INS. Furthermore, Figure 6 shows the distribution of the horizontal position errors, and it also supports that the FGO-GNSS/INS has superior performance.
Here, we assumed the position errors are subject to Gaussian distribution, and we analyzed the position errors distribution. Figure 7 presents the distributions of these position errors. In this experiment, the GNSS receiver was developed by us with DSP + FPGA and C++ programming language. It seems that the position errors are not extremely subject to Gaussian distribution. In Figure 7, the upper part of each figure shows the FGO-GNSS position errors distribution, and the bottom part represents the KF-GNSS/INS position errors distribution. It can be observed that the mean values of the FGO-GNSS/INS are decreased, and the corresponding position errors distribution range is reduced.

4.2. FGO-INS/NHC/Odometer under GNSS-Denied Environments

We collected the raw measurements using the exact same ground vehicle in the second field test. The testing trajectory is presented in Figure 8, and the in-view satellite’s amount during the testing is shown in Figure 9. In Figure 9, the red line represents the in-view satellite’s amount of the reference, and the blue line represents the in-view satellite’s amount of our system. We simulated the GNSS-denied environment by removing the antenna from the GNSS receiver. Here, at approximately 75 s, we remove the GNSS antenna, and the available satellite’s amount immediately decreases to zero. Here the dataset is the same as our previously published paper [37].
Latitude and longitude position errors are presented in Figure 10. The red lines represent the position errors from the KF method, and the blue lines represent the position errors from the FGO method. During 0~75 s, the available satellites are regular, the system works under GNSS/INS integration system, and the latitude and longitude errors are smaller than five meters. Under this model, the FGO method slightly decreases the positioning errors. Table 3 and Table 4 illustrate the latitude and longitude position errors during different periods. Specifically, the mean values of the latitude errors decreased by 50.7%, and the mean values of the longitude errors decreased by 49.4%; also, the maximum values of the position errors decreased by 37.2% and 30.9% for latitude and longitude position errors. Then, after 75 s, the GNSS antenna is removed from the system to simulate the GNSS-denied environment. The latitude and longitude position errors from the KF and FGO methods increase. Moreover, the FGO method brings a noticeable decrease in positioning errors. Specifically, the mean values of the latitude errors decreased by 50.1%, and the mean values of the longitude errors decreased by 50.4%; the maximum values of the latitude and longitude position errors decreased by 43.3% and 41.8%. The system works under IMU/odometer/NHC integration mode. After the 165th second, the odometer was excluded from the system, and the system operated under IMU/NHC mode, so positioning errors increased further. The latitude and longitude errors from the KF-IMU/NHC integration are more significant than 20 m. FGO-IMU/NHC integration decreases compared with the KF- IMU/NHC. Specifically, compared with the KF method, the mean values of the latitude errors from the FGO method decreased by 49.5%, and the mean values of the longitude errors from the FGO method decreased by 50.2%; the maximum values of the latitude and longitude position errors from the FGO method decreased by 38.3% and 48.3%. In addition, the cumulative distribution function (CDF) results of these position errors are presented in Figure 11; it is evident that the FGO method contributes to a better distribution of the position errors, including more minor mean and maximum position errors.

5. Limitations and Discussion

The experimental results reveal that the FGO-INS/NHC/Odometer integration can contribute to better outcomes for the KF-INS/NHC/Odometer during signal outage. However, we think there are still the following limitations:
(1)
in the paper, the optimization is conducted using all the past information, and the computation load increases exponentially. Now, it is still hard to implement the FGO in a real-time manner; it is helpful to reduce the computation load with a fixed smoothing window.
(2)
the measurement noises are subject to Gaussian distribution, as the position errors’ distribution plotted in Figure 7 is not strictly subject to standard Gaussian distribution. In addition, due to the environmental influence, the GNSS or INS measurement errors covariance matrix might be changed; it was more feasible for adaptively tuning the errors matrix in the FGO method; in fact, some adaptive KFs have been proposed and demonstrated in dealing with this problem, and some strategies could be adopted and utilized in FGO.
(3)
in urban areas, GNSS measurements might face abnormal measures induced by the multipath or non-line-of-sight (NLOS) signals; it is adequate to add some kernel functions to the FGO to mitigate the adverse effects and improve the robustness of the navigation solutions.

6. Conclusions

Improving the position accuracy for ground vehicles under GNSS-signal-challenging environments is a hot research topic in the community, this paper investigated FGO-GNSS/INS and FGO-INS/NHC/Odometer integration, especially for GNSS signal outages. Two different field experiments were carried out. With analyzing the experimental results, the following findings are concluded: (1) the FGO method is effective for improving the accuracy of the INS navigation solutions compared with that from KF; (2) the FGO method can improve the position accuracy without GNSS compared with KF. This work preliminarily demonstrates that FGO is a better senor fusion method for GNSS/INS integration applications compared with KF. FGO is a feasible method to improve position accuracy under GNSS signal challenging environments. Actually, with the FGO framework, more sensors can be added to the fusion framework to obtain a better position result. For instance, a LiDAR or visual camera can be easily integrated with GNSS and INS, which could adaptively select proper measurements from sensors to compose a feasible integration system and obtain the most optimal navigation solutions.

Author Contributions

Writing—original draft preparation, K.Z.; writing—review and editing, B.W.; methodology, C.J.; validation, Y.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National International Science and Technology Cooperation Base on Railway Vehicle Operation Engineering of Beijing Jiaotong University, grant number BMRV21KF03.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhang, T.; Liu, H.; Chen, Q.; Zhang, H.; Niu, X. Improvement of GNSS carrier phase accuracy using MEMS accelerometer-aided phase-locked loops for earthquake monitoring. Micromachines 2017, 8, 191. [Google Scholar] [CrossRef]
  2. Niu, X.; Ban, Y.; Zhang, Q.; Zhang, T.; Zhang, H.; Liu, J. Quantitative analysis to the impacts of IMU quality in GPS/INS deep integration. Micromachines 2015, 6, 1082–1099. [Google Scholar] [CrossRef]
  3. Wang, H.; Pan, S.; Gao, W.; Xia, Y.; Ma, C. Multipath/NLOS Detection Based on K-Means Clustering for GNSS/INS Tightly Coupled System in Urban Areas. Micromachines 2022, 13, 1128. [Google Scholar] [CrossRef]
  4. Bullock, J.B.; Chowdhary, M.; Rubin, D.; Leimer, D.; Turetzky, G.; Jarvis, M. Continuous indoor positioning using GNSS, Wi-Fi, and MEMS dead reckoning. In Proceedings of the 25th International Technical Meeting of The Satellite Division of the Institute of Navigation (ION GNSS 2012), Nashville, TN, USA, 17–21 September 2012; pp. 2408–2416. [Google Scholar]
  5. Joubert, N.; Reid TG, R.; Noble, F. Developments in Modern GNSS and Its Impact on Autonomous Vehicle Architectures. arXiv 2002, arXiv:2002.00339v2. [Google Scholar]
  6. Hansen, J.M.; Fossen, T.I.; Johansen, T.A. Nonlinear observer for INS aided by time-delayed GNSS measurements: Implementation and UAV experiments. In Proceedings of the 2015 International Conference on Unmanned Aircraft Systems (ICUAS), Denver, CO, USA, 9–12 June 2015; pp. 157–166. [Google Scholar]
  7. Vagle, N.; Broumandan, A.; Lachapelle, G. Multiantenna GNSS and inertial sensors/odometer coupling for robust vehicular navigation. IEEE Internet Things J. 2018, 5, 4816–4828. [Google Scholar] [CrossRef]
  8. Gao, H.; Groves, P.D. Environmental context detection for adaptive navigation using GNSS measurements from a smartphone. Navig. J. Inst. Navig. 2018, 65, 99–116. [Google Scholar] [CrossRef]
  9. Pany, T.; Eissfeller, B. Use of a vector delay lock loop receiver for GNSS signal power analysis in bad signal conditions. In Proceedings of the 2006 IEEE/ION Position, Location, and Navigation Symposium, Coronado, CA, USA, 25–27 April 2006; pp. 893–903. [Google Scholar]
  10. Rost, C.; Wanninger, L. Carrier phase multipath mitigation based on GNSS signal quality measurements. J. Appl. Geod. 2009, 3, 81–87. [Google Scholar] [CrossRef]
  11. Jiang, C.; Chen, Y.; Chen, S.; Bo, Y.; Feng, Z.; Zhou, H. Distributed processing method for multi-GNSS/SINS integration system. IET Sci. Meas. Technol. 2020, 14, 755–761. [Google Scholar] [CrossRef]
  12. Zhu, Z.; Jiang, C.; Bo, Y. Performance Enhancement of GNSS/MEMS-IMU Tightly Integration Navigation System Using Multiple Receivers. IEEE Access 2020, 8, 52941–52949. [Google Scholar] [CrossRef]
  13. El-Sheimy, N.; Nassar, S.; Noureldin, A. Wavelet de-noising for IMU alignment. IEEE Aerosp. Electron. Syst. Mag. 2004, 19, 32–39. [Google Scholar] [CrossRef]
  14. El-Sheimy, N.; Hou, H.; Niu, X. Analysis and modeling of inertial sensors using Allan variance. IEEE Trans. Instrum. Meas. 2007, 57, 140–149. [Google Scholar] [CrossRef]
  15. Hou, H.; El-Sheimy, N. Inertial sensors errors modeling using Allan variance. In Proceedings of the 16th International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GPS/GNSS 2003), Portland, OR, USA, 9–12 September 2003; pp. 2860–2867. [Google Scholar]
  16. Nassar, S.; Niu, X.; Aggarwal, P.; El-Sheimy, N. INS/GPS sensitivity analysis using different Kalman filter approaches. In Proceedings of the Institute of Navigation National Technical Meeting (ION NTM 2006), Monterey, CA, USA, 18–20 January 2006. [Google Scholar]
  17. El-Sheimy, N.; Youssef, A. Inertial sensors technologies for navigation applications: State of the art and future trends. Satell. Navig. 2020, 1, 2. [Google Scholar] [CrossRef]
  18. Du, S.; Sun, W.; Gao, Y. Integration of GNSS and MEMS-Based Rotary INS for Bridging GNSS Outages. In China Satellite Navigation Conference (CSNC) 2015 Proceedings: Volume III; Springer: Berlin/Heidelberg, Germany, 2015; pp. 659–676. [Google Scholar]
  19. Fang, W.; Jiang, J.; Lu, S.; Gong, Y.; Tao, Y.; Tang, Y.; Yan, P.; Luo, H.; Liu, J. A LSTM Algorithm Estimating Pseudo Measurements for Aiding INS during GNSS Signal Outages. Remote Sens. 2020, 12, 256. [Google Scholar] [CrossRef]
  20. Vana, S.; Naciri, N.; Bisnath, S. Low-cost, Dual-frequency PPP GNSS and MEMS-IMU Integration Performance in Obstructed Environments. In Proceedings of the 32nd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+ 2019), Miami, FL, USA, 16–20 September 2019; pp. 3005–3018. [Google Scholar]
  21. Seong, S.M.; Lee, J.G.; Park, C.G. Equivalent ARMA model representation for RLG random errors. IEEE Trans. Aerosp. Electron. Syst. 2000, 36, 286–290. [Google Scholar] [CrossRef]
  22. Narasimhappa, M.; Mahindrakar, A.D.; Guizilini, V.C.; Terra, M.H.; Sabat, S.L. MEMS-Based IMU Drift Minimization: Sage Husa Adaptive Robust Kalman Filtering. IEEE Sens. J. 2019, 20, 250–260. [Google Scholar] [CrossRef]
  23. Narasimhappa, M.; Nayak, J.; Terra, M.H.; Sabat, S.L. ARMA model based adaptive unscented fading Kalman filter for reducing drift of fiber optic gyroscope. Sens. Actuators A Phys. 2016, 251, 42–51. [Google Scholar] [CrossRef]
  24. Huang, L. Auto regressive moving average (ARMA) modeling method for Gyro random noise using a robust Kalman filter. Sensors 2015, 15, 25277–25286. [Google Scholar] [CrossRef]
  25. El-Diasty, M.; El-Rabbany, A.; Pagiatakis, S. An accurate nonlinear stochastic model for MEMS-based inertial sensor error with wavelet networks. J. Appl. Geod. JAG 2007, 1, 201–212. [Google Scholar] [CrossRef]
  26. Radi, A.; Bakalli, G.; Guerrier, S.; El-Sheimy, N.; Sesay, A.B.; Molinari, R. A multisignal wavelet variance-based framework for inertial sensor stochastic error modeling. IEEE Trans. Instrum. Meas. 2019, 68, 4924–4936. [Google Scholar] [CrossRef]
  27. Stebler, Y.; Guerrier, S.; Skaloud, J.; Victoria-Feser, P.M. Generalized method of wavelet moments for inertial navigation filter design. IEEE Trans. Aerosp. Electron. Syst. 2014, 50, 2269–2283. [Google Scholar] [CrossRef]
  28. Xing, H.; Hou, B.; Lin, Z.; Guo, M. Modeling and compensation of random drift of MEMS gyroscopes based on least squares support vector machine optimized by chaotic particle swarm optimization. Sensors 2017, 17, 2335. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Jiang, C.; Chen, S.; Chen, Y.; Zhang, B.; Feng, Z.; Zhou, H.; Bo, Y. A MEMS IMU de-noising method using long short term memory recurrent neural networks (LSTM-RNN). Sensors 2018, 18, 3470. [Google Scholar] [CrossRef] [PubMed]
  30. Jiang, C.; Chen, S.; Chen, Y.; Bo, Y.; Han, L.; Guo, J.; Feng, Z.; Zhou, H. Performance analysis of a deep simple recurrent unit recurrent neural network (SRU-RNN) in MEMS gyroscope de-noising. Sensors 2018, 18, 4471. [Google Scholar] [CrossRef] [PubMed]
  31. Zhu, Z.; Bo, Y.; Jiang, C. A MEMS Gyroscope Noise Suppressing Method Using Neural Architecture Search Neural Network. Math. Probl. Eng. 2019, 2019, 5491243. [Google Scholar] [CrossRef]
  32. Ning, Y.; Wang, J.; Han, H.; Tan, X.; Liu, T. An optimal radial basis function neural network enhanced adaptive robust Kalman filter for GNSS/INS integrated systems in complex urban areas. Sensors 2018, 18, 3091. [Google Scholar] [CrossRef]
  33. Dai, F.; Bian, W.; Wang, Y.; Ma, H. An INS/GNSS integrated navigation in GNSS denied environment using recurrent neural network. Def. Technol. 2022, 16, 334–340. [Google Scholar] [CrossRef]
  34. Doostdar, P.; Keighobadi, J.; Hamed, M.A. INS/GNSS integration using recurrent fuzzy wavelet neural networks. GPS Solut. 2020, 24, 29. [Google Scholar] [CrossRef]
  35. Hosseinyalamdary, S. Deep Kalman filter: Simultaneous multi-sensor integration and modelling; A GNSS/IMU case study. Sensors 2018, 18, 1316. [Google Scholar] [CrossRef]
  36. Gao, X.; Luo, H.; Ning, B.; Zhao, F.; Bao, L.; Gong, Y.; Xiao, Y.; Jiang, J. RL-AKF: An Adaptive Kalman Filter Navigation Algorithm Based on Reinforcement Learning for Ground Vehicles. Remote Sens. 2020, 12, 1704. [Google Scholar] [CrossRef]
  37. Zhu, K.; Guo, X.; Jiang, C.; Xue, Y.; Li, Y.; Han, L.; Chen, Y. MIMU/Odometer Fusion with State Constraints for Vehicle Positioning during BeiDou Signal Outage: Testing and Results. Sensors 2020, 20, 2302. [Google Scholar] [CrossRef]
  38. Chang, L.; Niu, X.; Liu, T. GNSS/IMU/ODO/LiDAR-SLAM Integrated Navigation System Using IMU/ODO Pre-Integration. Sensors 2020, 20, 4702. [Google Scholar] [CrossRef] [PubMed]
  39. Brossard, M.; Barrau, A.; Bonnabel, S. AI-IMU dead-reckoning. IEEE Trans. Intell. Veh. 2020, 5, 585–595. [Google Scholar] [CrossRef]
  40. Peng, K.Y.; Lin, C.A.; Chiang, K.W. Performance analysis of an AKF based tightly-coupled INS/GNSS integrated scheme with NHC for land vehicular applications. Trans. Can. Soc. Mech. Eng. 2013, 37, 503–513. [Google Scholar] [CrossRef]
  41. Chen, Q.; Zhang, Q.; Niu, X. Estimate the Pitch and Heading Mounting Angles of the IMU for Land Vehicular GNSS/INS Integrated System. IEEE Trans. Intell. Transp. Syst. 2021, 22, 6503–6515. [Google Scholar] [CrossRef]
  42. Zhang, X.; Cheng, Y.; Shi, C. Observability analysis of non-holonomic constraints for land-vehicle navigation systems. J. Glob. Position. Syst. 2012, 11, 80–88. [Google Scholar]
  43. Jiang, C.; Chen, Y.; Xu, B.; Jia, J.; Sun, H.; Chen, C.; Duan, Z.; Bo, Y.; Hyyppa, J. Vector Tracking Based on Factor Graph Optimization for GNSS NLOS Bias Estimation and Correction. IEEE Internet Things J. 2022, 9, 16209–16221. [Google Scholar] [CrossRef]
  44. Grisetti, G.; Kümmerle, R.; Strasdat, H.; Konolige, K. g2o: A general framework for (hyper) graph optimization. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 9–13 May 2011. [Google Scholar]
Figure 1. Ground vehicle body coordinates.
Figure 1. Ground vehicle body coordinates.
Micromachines 13 01400 g001
Figure 2. FGO GNSS/INS/NHC/Odometer integration. (a) FGO-GNSS/INS. (b) FGO-IMU/ Odometer/NHC.
Figure 2. FGO GNSS/INS/NHC/Odometer integration. (a) FGO-GNSS/INS. (b) FGO-IMU/ Odometer/NHC.
Micromachines 13 01400 g002
Figure 3. The trajectory of the experiment.
Figure 3. The trajectory of the experiment.
Micromachines 13 01400 g003
Figure 4. Satellite amount.
Figure 4. Satellite amount.
Micromachines 13 01400 g004
Figure 5. Position errors comparisons. (a) East-direction position error. (b) North-direction position error. (c) Horizontal position errors.
Figure 5. Position errors comparisons. (a) East-direction position error. (b) North-direction position error. (c) Horizontal position errors.
Micromachines 13 01400 g005aMicromachines 13 01400 g005b
Figure 6. Cumulative distribution function (CDF) for the horizontal position errors.
Figure 6. Cumulative distribution function (CDF) for the horizontal position errors.
Micromachines 13 01400 g006
Figure 7. Position errors distribution. (a) East-position errors distribution. (b) North-position errors distribution. (c) Horizontal-position errors distribution.
Figure 7. Position errors distribution. (a) East-position errors distribution. (b) North-position errors distribution. (c) Horizontal-position errors distribution.
Micromachines 13 01400 g007
Figure 8. Field test trajectory.
Figure 8. Field test trajectory.
Micromachines 13 01400 g008
Figure 9. Satellite’s amount [37].
Figure 9. Satellite’s amount [37].
Micromachines 13 01400 g009
Figure 10. Position errors. (a) Latitude errors. (b) Longitude errors.
Figure 10. Position errors. (a) Latitude errors. (b) Longitude errors.
Micromachines 13 01400 g010
Figure 11. Position errors distribution. (a) Latitude errors distribution. (b) Longitude-position errors distribution.
Figure 11. Position errors distribution. (a) Latitude errors distribution. (b) Longitude-position errors distribution.
Micromachines 13 01400 g011aMicromachines 13 01400 g011b
Table 1. Inertial measurement unit (IMU) specifications [37].
Table 1. Inertial measurement unit (IMU) specifications [37].
GyroscopeBias stability (degree/h)≤3 degree/h
Scale factor nonlinearity (ppm)≤200 ppm
White noise (degree/h)0.1 degree/h
AccelerometerBias stability (mg)0.1 mg
Scale factor nonlinearity (ppm)≤150 ppm
White noise (mg)0.05 mg
Table 2. Latitude position errors analysis and companions.
Table 2. Latitude position errors analysis and companions.
KFGO
EastNorthHorizontalEastNorthHorizontal
Mean (m)1.711.592.530.810.860.99
RMS (m)1.250.911.190.580.460.58
Maximum (m)4.203.875.502.812.473.15
Table 3. Latitude-position errors analysis and companions.
Table 3. Latitude-position errors analysis and companions.
KFFGO
Time (s)Mean (m)Maximum (m)Mean (m)Maximum (m)
0~75 s1.501.990.741.25
76~165 s7.169.813.575.56
166~250 s9.1422.094.6213.62
Table 4. Longitude-position errors analysis and companions.
Table 4. Longitude-position errors analysis and companions.
KFFGO
Time (s)Mean (m)Maximum (m)Mean (m)Maximum (m)
0~75 s0.771.490.391.03
76~165 s5.047.252.504.22
166~250 s9.8725.104.9212.98
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zhu, K.; Yu, Y.; Wu, B.; Jiang, C. GO-INO: Graph Optimization MEMS-IMU/NHC/Odometer Integration for Ground Vehicle Positioning. Micromachines 2022, 13, 1400. https://doi.org/10.3390/mi13091400

AMA Style

Zhu K, Yu Y, Wu B, Jiang C. GO-INO: Graph Optimization MEMS-IMU/NHC/Odometer Integration for Ground Vehicle Positioning. Micromachines. 2022; 13(9):1400. https://doi.org/10.3390/mi13091400

Chicago/Turabian Style

Zhu, Kai, Yating Yu, Bin Wu, and Changhui Jiang. 2022. "GO-INO: Graph Optimization MEMS-IMU/NHC/Odometer Integration for Ground Vehicle Positioning" Micromachines 13, no. 9: 1400. https://doi.org/10.3390/mi13091400

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop