Next Article in Journal
A High-Capacity Optical Metro Access Network: Efficiently Recovering Fiber Failures with Robust Switching and Centralized Optical Line Terminal
Previous Article in Journal
Three-Dimensional Multi-Modality Registration for Orthopaedics and Cardiovascular Settings: State-of-the-Art and Clinical Applications
Previous Article in Special Issue
The Influence of Micro-Hexapod Walking-Induced Pose Changes on LiDAR-SLAM Mapping Performance
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Data Fusion of Dual Foot-Mounted INS Based on Human Step Length Model

1
Department of Precision Instrument, Tsinghua University, Beijing 100084, China
2
Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(4), 1073; https://doi.org/10.3390/s24041073
Submission received: 4 January 2024 / Revised: 29 January 2024 / Accepted: 1 February 2024 / Published: 7 February 2024
(This article belongs to the Collection Navigation Systems and Sensors)

Abstract

:
Pedestrian navigation methods based on inertial sensors are commonly used to solve navigation and positioning problems when satellite signals are unavailable. To address the issue of heading angle errors accumulating over time in pedestrian navigation systems that rely solely on the Zero Velocity Update (ZUPT) algorithm, it is feasible to use the pedestrian’s motion constraints to constrain the errors. Firstly, a human step length model is built using human kinematic data collected by the motion capture system. Secondly, we propose the bipedal constraint algorithm based on the established human step length model. Real field experiments demonstrate that, by introducing the bipedal constraint algorithm, the mean biped radial errors of the experiments are reduced by 68.16% and 50.61%, respectively. The experimental results show that the proposed algorithm effectively reduces the radial error of the navigation results and improves the accuracy of the navigation.

1. Introduction

The Global Navigation Satellite System (GNSS) is the most common navigation solution in an open outdoor environment, with an accuracy of up to a meter or even higher [1]. However, in an indoor environment or in a special environment where satellite signals cannot be received outdoors, the above satellite-based navigation solution cannot meet people’s needs [2]. Therefore, autonomous navigation solutions that rely only on their own sensors are needed to achieve navigation and positioning in a satellite-denied environment. Autonomous navigation systems play a crucial role in various scenarios, particularly in meeting the safety needs of workers in special situations such as tunnel operations and underground mines, assisting firefighters in rescue work at fire scenes, helping individuals navigate through the wild jungle, and providing guidance in large buildings such as shopping malls, libraries, and museums.
Pedestrian navigation systems are categorized into non-autonomous modes, primarily based on satellite navigation, and autonomous modes, which rely on sensors like the Inertial Measurement Unit (IMU) [3]. Different from the widespread use of GNSS in outdoor environments, indoor navigation and positioning uses more diverse methods. Pascacio et al. [4] conducted a survey and analysis of the main technical means used in indoor navigation and positioning. The proportions of each main technology and their related papers are as follows: Wireless Local Area Network (WLAN) accounts for 53.5 % , IMU accounts for 30.9 % , Ultra Wideband (UWB) accounts for 15.4 % , Bluetooth (Bluetooth) accounts for 2.3 % , 5G accounts for 2.3 % , Radio Frequency Identification (Radio Frequency Identification, RFID) accounts for 2.3 % , and vision cameras account for 1.1 % .
Research has been conducted on pedestrian navigation technology since the 1980s. Currently, it is divided into two categories: Pedestrian Dead Reckoning (PDR) and Inertial Navigation System (INS).
The PDR algorithm can be deployed on different parts of the human body, such as the chest, waist, and feet, and has the advantage of easy installation and application [5]. Marth et al. first designed a personal navigation system composed of a pedestrian dead reckoning module and GPS in 1998. When satellite signals are denied, the system can only use accelerometers and magnetometers for dead reckoning [6]. Yao et al. proposed a more robust method to solve the difficulty of calculating the number of steps for gait detection caused by the traditional PDR in which the person is in the in situ traveling state, the core idea of the method is to recognize the walking patterns of pedestrians, such as normal walking and fast walking [7]. Basso et al. proposed to process vertical acceleration using a phase-locked loop to detect the stride length and number of steps, and then to calculate the step length using a segmented linear relationship with the stride length, as well as estimating the direction of the stride based on lumbar kinematics using geometric features of planar acceleration [8]. Based on the PDR algorithm, Liu et al. proposed a new indoor positioning solution by combining extended Kalman filtering with the Wi-Fi signal round-trip time, and the average positioning error was reduced by 37.4∼67.6% [9].
With the development of deep learning technology, many scholars try to use it to solve the old problems of the traditional PDR algorithm. Edle et al. applied BLSTM-RNN to gait detection to improve the stability and recognition ability of the algorithm [10]. Lin et al. [11] and Luo et al. [12] analyzed the pedestrian directions of forward, backward, left, and right using LSTM and CNN. Wang et al. designed a step estimation network based on LSTM, with a stride error rate of 4.63 % and a walking distance error rate of 1.43 % [13]. Furthermore, Asraf et al. designed PDRNet [14] based on ResNet, and Klein et al. designed StepNet [15,16], which directly uses accelerometer and gyroscope measurement data to output the direction and distance through the neural network. The steps of using accelerometer and gyroscope data to perform gait detection, and then completing step length estimation and heading estimation using the PDR method, are skipped. However, the above-mentioned PDR methods based on deep learning inevitably have the problem of a large computational workload and often require the use of computer graphics cards for calculations. Therefore, under the current circumstances, this solution is still mainly limited to the scope of laboratory research, which is not conducive to the embedded design of pedestrian navigation equipment and cannot be deployed in the short term.
With the continuous improvement of Micro Inertial Measurement Unit (MIMU) accuracy, many researchers have focused their research on INS-based pedestrian navigation solutions. Elwell et al., in 1999, proposed the idea of designing a Zero Velocity Update algorithm using pedestrian step characteristics [17]. Based on this, Foxlin designed the first foot-mounted pedestrian inertial navigation system in 2005 [18]. Borenstein et al. of the University of Michigan proposed the Heuristic Drift Reduction (HDR) method for estimating and eliminating the heading angle drift error [19]. Skog et al. of the Royal Institute of Technology, Sweden, quantitatively analyzed a variety of gait detection algorithms and ZUPT algorithms [20]. They demonstrated that gyroscope-based detection outperforms accelerometer-based detection under specific assumptions. Zhang et al. realized the combined pattern recognition of four gait patterns and four device poses [21]. Meanwhile, Xu et al. investigated an indoor localization algorithm combining IMU and UWB [22]. Garcia et al. proposed a new FootSLAM algorithm using only IMU data, showing the possibility of using human odometers for indoor mapping and precise navigation [23]. Zhang et al. also proposed a yaw angle error self-observation algorithm (YESO) to reduce the yaw angle error and calibrate the yaw angle [24].
Meanwhile, multi-IMU information fusion algorithms have gradually become a hot research topic in recent years. Qian et al. used the IMU of the trunk and lower limbs to form a virtual foot IMU which, in turn, realizes the pedestrian navigation function, and the final positioning accuracy is about 6 % of the travel distance [25]. Based on a zero-speed detector based on hypothesis testing and great likelihood estimation designed using human gait information, Shi Wei et al. designed a Kalman-filtered ellipsoid-constrained algorithm under the maximal step length constraint while walking [26,27]. Xu Yuan et al., on the other hand, solved the problem of poor viewability of heading information in the traditional foot-based heading reference system by designing an indoor personal navigation system combining a foot-based heading reference system and a shoulder-based electronic compass [28,29]. Patel et al. conducted experimental analysis on four different fusion methods of multi-IMU, proving that the navigation accuracy of using five IMU fusion filters has been improved [30]. Niu et al. [31,32], Li et al. [33], and Prateek et al. [34] also studied pedestrian navigation algorithms based on dual foot-mounted IMU. They showed that, by limiting the distance between the two feet, the Kalman filter can be used to constrain the navigation error and obtain better robustness in the system.
However, the above studies did not make full use of human kinematic characteristics to suppress heading angle errors to improve navigation accuracy. In this paper, we built a human step length model using human kinematic data collected by the motion capture system. And based on the established human step length model, we propose the bipedal constraint algorithm to address the issue of heading angle errors accumulating over time in pedestrian navigation systems. The contributions of the paper are as follows:
  • We collected human kinematics data using an optical–inertial fusion motion capture system. A whole-body musculoskeletal model of the human body was created to analyse navigation-related human kinematic parameters and build the human step length model. This provides a parameter basis for the navigation algorithm.
  • We developed an embedded pedestrian navigation system that includes an IMU and a barometer. The system acquires and wirelessly transmits navigation data. We used this system to verify the effectiveness of the navigation algorithm.
  • We proposed the bipedal constraint algorithm to address the issue of the ZUPT algorithm’s inability to constrain the heading angle. The virtual observation quantities and corresponding observation matrices of both the ZUPT algorithm and the bipedal constraint algorithm were constructed for application to the Kalman filter. The experiment demonstrates that the bipedal constraint algorithm effectively limits the heading angle error during navigation and enhances the accuracy of navigation and positioning.
The rest of the paper is organized as follows: in Section 2, we present the human step length model and the bipedal constraint algorithm. In Section 3, we describe the experiment in detail and evaluate the results. In Section 4, we provide a conclusion for our study and talk about future work.

2. Pedestrian Navigation System

The pedestrian navigation system is based on the Strapdown Inertial Navigation System (SINS) and Kalman filter (KF), and uses distance for coupling.

2.1. Strapdown Inertial Navigation System

The core of SINS is to use numerical integration to calculate the attitude, speed, and position of the carrier. Therefore, the SINS algorithm mainly includes three parts: an attitude update algorithm, a speed update algorithm, and a position update algorithm.

2.1.1. Attitude Update Algorithm

The differential equation for the attitude of the carrier in the n-system of geographic coordinates is given by
C ˙ b n = C b n ( ω n b b × )
Here, C b n is the attitude array of the b-system with respect to the n-system. ω n b b is the angular velocity of the b-system with respect to the n-system. Also, according to the law of chain multiplication of matrices, there is
C b ( m ) n ( m ) = C i n ( m ) C b ( m ) i = C n ( m 1 ) n ( m ) C b ( m 1 ) n ( m 1 ) C b ( m ) b ( m 1 )
C b ( m 1 ) n ( m 1 ) and C b ( m ) n ( m ) represent the attitude matrices at t m 1 and t m , respectively. C b ( m ) b ( m 1 ) represents the rotational change of the b-system from moment t m 1 to moment t m using the i-coordinate system as the reference frame. C n ( m 1 ) n ( m ) represents the rotational change of the n-system from moment t m to moment t m 1 using the i-coordinate system as the reference frame. When using the two-subsample cone error compensation algorithm, for C n ( m 1 ) n ( m ) and C b ( m ) b ( m 1 ) , there is
C n ( m 1 ) n ( m ) = M R V T ( ϕ i n ( m ) n ) M R V T ( T ω i n ( m ) n )
C b ( m ) b ( m 1 ) = M R V ( ϕ i b ( m ) b )
ϕ i b ( m ) b = ( Δ θ m 1 + Δ θ m 2 ) + 2 3 Δ θ m 1 × Δ θ m 2
M R V ( ϕ ) = C b i = I + sin ϕ ϕ ( ϕ × ) + ( 1 cos ϕ ) ϕ 2 ( ϕ × ) 2
Here, T = t m t m 1 , ω i n ( m ) n is the angular velocity of the n-system relative to the i-system at this time, Δ θ m 1 and Δ θ m 2 are the two angular increments in the period from t m 1 to t m , and ϕ represents the equipment rotation vector.

2.1.2. Speed Update Algorithm

There is an inertial specific force equation in the n-system as follows:
v ˙ e n n = C b n f s f b ( 2 ω i e n + ω e n n ) × v e n n + g n
Here, f s f b is the accelerometer output specific force, 2 ω i e n × v e n n is the Göttinger’s acceleration, ω e n n × v e n n is the centripetal acceleration due to the motion of the carrier around the center of the earth, and g n is the acceleration due to gravity. Integration leads to the following formula:
v m n ( m ) = v m 1 n ( m 1 ) + Δ v s f ( m ) n + Δ v c o r / g ( m ) n
Here, v m 1 n ( m 1 ) and v m n ( m ) are the velocities of the carrier at the moments t m 1 and t m , respectively, and there are
Δ v s f ( m ) n = t m 1 t m C b n ( t ) f s f b ( t ) d x
Δ v c o r / g ( m ) n = t m 1 t m { [ 2 ω i e n ( t ) + ω e n n ( t ) ] × v e n n ( t ) + g n ( t ) } d t
The numerical integration of Equations (9) and (10) can be approximated as follows:
Δ v s f ( m ) n [ I T 2 ( ω i n ( m 1 / 2 ) n × ) ] C b ( m 1 ) n ( m 1 ) [ Δ v m + 1 2 Δ θ m × Δ v m + 2 3 ( Δ θ m 1 × Δ v m 2 + Δ v m 1 × Δ θ m 2 ) ]
Δ v c o r / g ( m ) n { [ 2 ω i e ( m 1 / 2 ) n + ω e n ( m 1 / 2 ) n ] × v e n ( m 1 / 2 ) n + g m 1 / 2 n } T
Here, Δ v is the specific velocity increment and Δ θ is the angular increment.

2.1.3. Position Update Algorithm

The matrix form of the differential equation for the position of the inertial navigation system is as follows:
p ˙ = M p v v n
Here,
p = L λ h T
M p v = 0 1 / ( R M + h ) 0 sec L / ( R N + h ) 0 0 0 0 1
Here, L, λ , and h represent the longitude, latitude, and altitude. R M represents the principal radii of curvature along the meridional section. R N represents the principal radii of curvature along the prime–vertical normal section. The numerical integration of Equation (13) yielded
p m = p m 1 + M p v ( m 1 / 2 ) ( v m 1 n + v m n ) T 2

2.1.4. Attitude Initialization

When the IMU is stationary, the equation for specific force can be simplified to
0 = C b n f s f b + g n
Transform and expand Equation (17) into the component form:
f s f x b f s f y b f s f z b = C 1 T C 2 T C 3 T 0 0 g
Then,
C 3 = f s f x b / g f s f y b / g f s f z b / g
Equation (19) represents the third row of the attitude matrix C b n . The elements of the first two rows can be chosen arbitrarily, provided that they satisfy the right-hand rule.

2.2. Human Step Length Model

As the error of the pedestrian navigation system accumulates over time, it is feasible to use the motion constraints of pedestrians as error constraints. Based on this, more accurately grasping the kinematic characteristics of pedestrians by establishing a human step length model is one of the key means of improving the positioning accuracy and reliability of autonomous navigation systems.

2.2.1. Data Collection

Data collection is performed following time synchronization and system calibration, utilizing both the Optitrack optical motion capture system and the FOHEART MAGIC inertial motion capture system.
Table 1 shows the data collection program, which involved selecting 10 volunteers to complete the human kinematics data collection. The “Load” refers to the weight a person carries when moving. The data collection modes in this case include walking on a treadmill at speeds of 1, 2, 2.5, 3, 3.5, 4, 4.5, and 5 km/h for one minute each, as well as free-walking and free-jogging for three laps each, resulting in a total of ten modes.

2.2.2. Data Processing

The process of data collection involves five stages: real-time data collection, data pre-processing, conversion to standard data formats, data slicing, and database storage. The human kinematics data collection site is shown in Figure 1.
By calculating the distance between the two feet, the variation pattern of the step length under different traveling speeds and weight loads can be obtained, and then fitted with a linear function:
S t e p L e n g t h = 2.789 × H e i g h t 3.897

2.3. Bipedal Constraint Algorithm Based on Step Length Model

The ZUPT algorithm can effectively limit the correction of velocity state quantities in the navigation system. However, it does not provide sufficient constraints on the position and heading angles. This paper presents a bipedal constraint algorithm based on the step length model for two IMUs located in each foot. The algorithm implements correction constraints on the heading angle and position to enhance the system’s navigation accuracy.
According to the human step length model, there is a maximum distance threshold between the dual feet of a pedestrian while walking. When one of the feet is in a stationary state and the other foot is in a swinging state, if the stationary foot is used as the coordinate origin, the swinging foot is within a ball with the origin as the center and the threshold as the radius. If the distance between the two feet exceeds the threshold range, a virtual position observation can be constructed based on the distance between the feet and the threshold. This observation can then be combined with the Kalman filter to correct the navigation system.
In SINS, the position p consists of the longitude L, latitude λ , and height h. When dealing with the relationship between two IMUs, it is more intuitive and convenient to use the navigation coordinate system based on east, north, and sky. The conversion formula is as follows:
P E = sin L ( R N + h ) P N = λ ( R M + h ) P U = h
The position coordinates are P E for the east, P N for the north, and P U for the sky. Also, noting that the spacing between two IMUs is D, here is
D = P r P l = [ ( P E , r P E , l ) 2 + ( P N , r P N , l ) 2 + ( P U , r P U , l ) 2 ] 1 / 2
Here, l and r represent the left foot IMU and the right foot IMU, respectively. P r and P l represent the positions of the left foot IMU and the right foot IMU, respectively. Assume that when the left foot is in a stationary state and the right foot is in a swinging state, if the distance between the two feet is greater than the set threshold B, then
P ^ r = P l + B D ( P r P l ) = 1 D ( ( D B ) P l + B P r )
R r = σ p 2 I 3
Here, P ^ r is the virtual observation position of the right foot position at this time, σ p represents the variance of position, I represents the identity matrix, and R r is the covariance matrix. After converting the resulting east, north, and sky positions back to longitude, latitude, and altitude via Equation (21), the virtual observations when using the cooperative navigation algorithm are obtained:
Z Bipedal = L L ^ λ λ ^ h h ^
And the corresponding observation matrix is
H Bipedal = 0 3 × 6 I 3 0 3 × 6
To provides an overview of the navigation algorithm. The pseudocode is listed in Algorithm 1.
When a pedestrian walks, their feet alternate between contacting the ground, resulting in a zero-speed state. To determine when both feet are at zero speed, a zero-speed determination is performed, and the ZUPT algorithm is applied to the feet in this state. Additionally, when one foot is stationary and the other is swinging, the system makes a threshold judgment on the distance between the two feet. If the swinging foot exceeds the range of the stationary foot, cooperative navigation constraints are applied to the swinging foot. The system also includes a barometer to provide altitude information for the navigation system to use as a constraint. The altitude constraint is performed in the same way as the zero-speed correction algorithm, that is, when the foot is at zero-speed. In this paper, the bipedal spacing constraint threshold is provided by the human step length model.
Algorithm 1 Bipedal Constraint Algorithm Based on Step Length Model.
Require:  Δ v and Δ θ measured by bipedal IMUs
Ensure: Attitude, speed, and position of bipedal navigation systems
k 0
 SINSl Initial system state and Kalman filter of left foot
 SINSr Initial system state and Kalman filter of right foot
loop
   k k + 1
  if ( S t a n c e l = 1 ) or ( S t a n c e r = 1 ) then
   Perform the ZUPT algorithm on the foot at zero speed
    Z ZUPT = V E V N V U T
    H ZUPT = 0 3 × 3 I 3 × 3 0 3 × 9
   Constrains h S t a n c e = 1 using the barometer
  end if
  if ( S t a n c e = 1 ) ( S t a n c e = 1 ) = 1 then
    D = P r P l
   if D > B then
    Algorithmically constrains feet in non-zero speed states
     P ^ r = P l + B D ( P r P l ) = 1 D ( ( D B ) P l + B P r )
     Z Bipedal = L L ^ λ λ ^ h h ^ T
     H Bipedal = 0 3 × 6 I 3 0 3 × 6
   end if
  end if
end loop

3. Experiment and Results

The effectiveness of the proposed method was confirmed through experiments. The experiment utilized a self-developed pedestrian navigation module with TI’s CC2652P1FRGZR as the main processor and communication processor. The LPD22HBTR collects air pressure data, while the six-axis IMU sensor ASM330LLH collects acceleration and angular velocity data. Additionally, the three-axis geomagnetic sensor MMC5883 is used to collect geomagnetic data. The collected data are encoded in hexadecimal and transmitted to the tablet through the communication module for storage. The parameters of the sensors are shown in Table 2. The pedestrian module can be powered by either a USB port or a battery. Figure 2 shows the foot module prototype, which controls the starting and stopping of the system through a switch.
During the experiment, the navigation modules of both feet were powered on and connected to the tablet. The navigation modules were placed side by side on the ground for 10 s to preheat and initialize, and then installed on the left and right feet, respectively. The experimenter completed two walks in different locations, labeled Walk 1 and Walk 2 (see Figure 3 and Figure 4, respectively), returned to the starting point, stopped collecting data, and recorded the test results.
The experimenter was 24 years old, 183 cm tall, weighed 70 kg, and was not weight-bearing. The maximum stride length during normal walking was obtained using the human step length model. The distance threshold between the two IMUs in the bipedal constraint algorithm was set to B = 1.2 m. Figure 5, Figure 6 and Figure 7 show the result of Walk 1, and Figure 8, Figure 9 and Figure 10 show the result of Walk 2. Walk 1 was undertaken in the corridor on the second floor of Tsinghua University’s FIT building, as shown in Figure 3. Walk 2 was undertaken outside Tsinghua University’s Weiqing building, as shown in Figure 4.
Analyzing the results of the experiment, it can be seen that, although ZUPT alone can be used for speed constraints and preliminary navigation solutions can be performed, it cannot effectively constrain the heading angle error during the navigation process. As the navigation time increases, the trajectories will gradually diverge, and the navigation settlement results of the two feet will gradually expand from each other. This is obvious when walking in a straight line. As the pedestrian walks in a straight line, the navigation results of the two feet gradually deviate from the original heading, and the distance between them gradually increases. When there are turns during walking, the navigation errors accumulated due to heading errors will be more significant, and this error will increase with the increase in turns. In the end, it is impossible to return to the starting point of the trip relying solely on the navigation solution results of ZUPT. After adopting the bipedal constraint algorithm, the INS on the left and right sides provide each other with position observations, and the Kalman filter effectively reduces the errors in the navigation results of the left and right INS due to gyroscope drift. Therefore, it is necessary to introduce the bipedal constraint algorithm to constrain the position and heading angles.
The radial error results of the navigation solutions before and after the introduction of the bipedal constraint algorithm are shown in Table 3.
The left and right biped radial errors of Walk 1 are reduced by 53.07 % and 86.08 % , respectively, the left and right biped radial errors of Walk 2 are reduced by 60.84 % and 45.46 % , respectively, and the mean biped radial errors of Walk 1 and Walk 2 are reduced by 68.16 % and 50.61 % , respectively. And Table 4 shows a comparison of the proposed algorithm with other algorithms. It can be seen that, by introducing the bipedal constraint algorithm, the positioning accuracy of the navigation algorithm has been significantly improved, and our proposed algorithm has better results.

4. Conclusions

In this article, we used motion capture technology to collect human kinematic data from multiple volunteers, and a human step model was established based on this. Secondly, given the defect that the ZUPT algorithm cannot effectively constrain the heading angle, we proposed the bipedal constraint algorithm based on the established human step length model, which was used to construct a virtual observation of the relative position. Real field experiments demonstrated that, by introducing the bipedal constraint algorithm, the mean biped radial errors of Walk 1 and Walk 2 were reduced by 68.16 % and 50.61 % , respectively. The results of the experiments indicate that the algorithm effectively reduces the radial error of the navigation results and improves the navigation accuracy.
In future work, more types of human kinematics data of gaits can be collected to obtain human kinematics conditions under different gaits, and then different constraint algorithms can be proposed for different gaits to further improve the accuracy of the navigation system. Secondly, the algorithm proposed in this article, combined with the ZUPT algorithm, effectively suppress the divergence of navigation errors, but do not completely eliminate it. Considering that the heuristic course correction algorithm also has an effective constraint effect on the course angle, combining the algorithm in this paper with it may lead to better navigation results. In addition, the current algorithm only applies to two feet. In the future, we should consider adding new nodes, such as at the waist and head, to further improve the robustness of the algorithm.

Author Contributions

Conceptualization, J.C. and G.L.; methodology, J.C. and G.L.; software, J.C. and G.L; validation, J.C.; data curation, J.C.; writing—original draft preparation, J.C.; writing—review and editing, J.C., G.L. and M.G.; visualization, J.C.; supervision, M.G.; project administration, M.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key R&D Program of China of grant number 2021YFA0716603.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors on request.

Acknowledgments

The authors would like to thank Tsinghua University.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
IMUInertial Measurement Unit
INSInertial Navigation System
KFKalman filter
ZUPTZero Velocity Update
PDRPedestrian Dead Reckoning

References

  1. Jiang, W.; Li, Y.; Rizos, C.; Cai, B.; Shangguan, W. Seamless Indoor-Outdoor Navigation based on GNSS, INS and Terrestrial Ranging Techniques. J. Navig. 2017, 70, 1183–1204. [Google Scholar] [CrossRef]
  2. Puricer, P.; Kovar, P. Technical Limitations of GNSS Receivers in Indoor Positioning. In Proceedings of the 2007 17th International Conference Radioelektronika, Brno, Czech Republic, 24–25 April 2007; pp. 1–5. [Google Scholar]
  3. Pan, X.; Mu, H.; Hu, X. A Survey of Autonomous Navigation Technology for Individual Soldier. Navig. Position. Timing 2018, 5, 1–11. [Google Scholar]
  4. Pascacio, P.; Casteleyn, S.; Torres-Sospedra, J.; Lohan, E.S.; Nurmi, J. Collaborative Indoor Positioning Systems: A Systematic Review. Sensors 2021, 21, 1002. [Google Scholar] [CrossRef]
  5. Ju, H.; Lee, J.H.; Park, C.G. Pedestrian Dead Reckoning System Using Dual IMU to Consider Heel Strike Impact. In Proceedings of the 2018 18th International Conference on Control, Automation and Systems (ICCAS), Pyeongchang, Republic of Korea, 17–20 October 2018; pp. 1307–1309. [Google Scholar]
  6. Marth, R.; Levi, R.; Durboraw, I.; Beam, K. The integrated navigation capability for the Force XXI Land Warrior. In Proceedings of the IEEE 1998 Position Location and Navigation Symposium (Cat. No. 98CH36153), Palm Springs, CA, USA, 20–23 April 1996; pp. 193–200. [Google Scholar]
  7. Yao, Y.; Pan, L.; Fen, W.; Xu, X.; Liang, X.; Xu, X. A Robust Step Detection and Stride Length Estimation for Pedestrian Dead Reckoning Using a Smartphone. IEEE Sens. J. 2020, 20, 9685–9697. [Google Scholar] [CrossRef]
  8. Basso, M.; Galanti, M.; Innocenti, G.; Miceli, D. Pedestrian Dead Reckoning Based on Frequency Self-Synchronization and Body Kinematics. IEEE Sens. J. 2017, 17, 534–545. [Google Scholar] [CrossRef]
  9. Liu, X.; Zhou, B.; Huang, P.; Xue, W.; Li, Q.; Zhu, J.; Qiu, L. Kalman Filter-Based Data Fusion of Wi-Fi RTT and PDR for Indoor Localization. IEEE Sens. J. 2021, 21, 8479–8490. [Google Scholar] [CrossRef]
  10. Edel, M.; Koppe, E. An advanced method for pedestrian dead reckoning using BLSTM-RNNs. In Proceedings of the 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Banff, AB, Canada, 13–16 October 2015; pp. 1–6. [Google Scholar]
  11. Lin, J.; Zou, C.; Lan, L.; Gu, S.; An, X. Deep heading estimation for pedestrian dead reckoning. J. Phys. Conf. Ser. 2020, 1656, 012009. [Google Scholar] [CrossRef]
  12. Luo, Y.; Guo, C.; Su, J.; Guo, W.; Zhang, Q. Learning-Based Complex Motion Patterns Recognition for Pedestrian Dead Reckoning. IEEE Sens. J. 2021, 21, 4280–4290. [Google Scholar] [CrossRef]
  13. Wang, Q.; Ye, L.; Luo, H.; Men, A.; Zhao, F.; Huang, Y. Pedestrian Stride-Length Estimation Based on LSTM and Denoising Autoencoders. Sensors 2019, 19, 840. [Google Scholar] [CrossRef]
  14. Asraf, O.; Shama, F.; Klein, I. PDRNet: A Deep-Learning Pedestrian Dead Reckoning Framework. IEEE Sens. J. 2022, 22, 4932–4939. [Google Scholar] [CrossRef]
  15. Klein, I. Smartphone Location Recognition: A Deep Learning-Based Approach. Sensors 2019, 20, 214. [Google Scholar] [CrossRef]
  16. Klein, I.; Asraf, O. StepNet—Deep Learning Approaches for Step Length Estimation. IEEE Access 2020, 8, 85706–85713. [Google Scholar] [CrossRef]
  17. Elwell, J. Inertial navigation for the urban warrior. In Proceedings of the SPIE the International Society for Optical Engineering, Orlando, FL, USA, 5–9 April 1999; Volume 3709, pp. 196–204. [Google Scholar]
  18. Foxlin, E. Pedestrian Tracking with Shoe-Mounted Inertial Sensors. IEEE Comput. Graph. Appl. 2005, 25, 38–46. [Google Scholar] [CrossRef]
  19. Borenstein, J.; Ojeda, L.; Kwanmuang, S. Heuristic Reduction of Gyro Drift for Personnel Tracking Systems. J. Navig. 2009, 62, 41–58. [Google Scholar] [CrossRef]
  20. Skog, I.; Handel, P.; Nilsson, J.O.; Rantakokko, J. Zero-Velocity Detection—An Algorithm Evaluation. IEEE Trans. Biomed. Eng. 2010, 57, 2657–2666. [Google Scholar] [CrossRef]
  21. Zhang, H.; Yuan, W.; Shen, Q.; Li, T.; Chang, H. A Handheld Inertial Pedestrian Navigation System with Accurate Step Modes and Device Poses Recognition. IEEE Sens. J. 2014, 15, 1421–1429. [Google Scholar] [CrossRef]
  22. Xu, Y.; Chen, X.; Cheng, J.; Zhao, Q.; Wang, Y. Improving tightly-coupled model for indoor pedestrian navigation using foot-mounted IMU and UWB measurements. In Proceedings of the 2016 IEEE International Instrumentation and Measurement Technology Conference Proceedings, Taipei, Taiwan, 23–26 May 2016; pp. 1–5. [Google Scholar]
  23. Garcia Puyol, M.; Bobkov, D.; Robertson, P.; Jost, T. Pedestrian Simultaneous Localization and Mapping in Multistory Buildings Using Inertial Sensors. IEEE Trans. Intell. Transp. Syst. 2014, 15, 1714–1727. [Google Scholar] [CrossRef]
  24. Zhang, X.; Zhang, R.; Guo, M.; Mi, L.; Song, M.; Zhang, Y. Yaw error self-observation algorithm for pedestrian navigation via foot-mounted inertial navigation system. J. Chin. Inert. Technol. 2015, 23, 457–466. [Google Scholar]
  25. Qian, W.; Zeng, Q.; Wan, J.; Xiong, Z. Pedestrian navigation method based on kinematic mechanism of human lower limb. J. Chin. Inert. Technol. 2015, 23, 24–28. [Google Scholar]
  26. Shi, W.; Wang, Y. Dual-MIMU navigation position correction method by inequality constrained Kalman filter. J. Chin. Inert. Technol. 2017, 25, 6. [Google Scholar]
  27. Shi, W.; Wang, Y.; Shu, J. Error correcting method based on adaptive step-length constraint for dual MIMU pedestrian navigation system. J. Chin. Inert. Technol. 2021, 29, 8. [Google Scholar]
  28. Xu, Y.; Chen, X.; Wang, Y.; Ma, S. Improved indoor pedestrian navigation method using low-cost foot-mounted AHRS and shoulder-mounted compass. J. Chin. Inert. Technol. 2016, 24, 325–329. [Google Scholar]
  29. Xu, Y.; Chen, X.; Li, Q.; Tang, J. Indoor pedestrian navigation based on double-IMU framework. J. Chin. Inert. Technol. 2015, 23, 714–717. [Google Scholar]
  30. Patel, U.N.; Faruque, I.A. Multi-IMU Based Alternate Navigation Frameworks: Performance & Comparison for UAS. IEEE Access 2022, 10, 17565–17577. [Google Scholar]
  31. Niu, X.; Li, Y.; Kuang, J.; Zhang, P. Fusing the Data of Dual Foot-Mounted INS Based on a Heuristic Equality Constraint. In Proceedings of the 2018 Ubiquitous Positioning, Indoor Navigation and Location-Based Services (UPINLBS), Wuhan, China, 22–23 March 2018; pp. 1–7. [Google Scholar]
  32. Niu, X.; Li, Y.; Kuang, J.; Zhang, P. Data Fusion of Dual Foot-Mounted IMU for Pedestrian Navigation. IEEE Sens. J. 2019, 19, 4577–4584. [Google Scholar] [CrossRef]
  33. Li, J.; Zhou, G.; Liu, X.; Guan, J.; Cheng, Z. Dual MIMU Pedestrian Navigation Scheme Based on Equality Constraint Kalman Filtering. Piezoelectrics Acoustooptics 2015, 37, 237–241. [Google Scholar]
  34. Prateek, G.V.; Girisha, R.; Hari, K.V.S.; Handel, P. Data Fusion of Dual Foot-Mounted INS to Reduce the Systematic Heading Drift. In Proceedings of the 2013 4th International Conference on Intelligent Systems, Modelling and Simulation, Bangkok, Thailand, 29–31 January 2013; pp. 208–213. [Google Scholar]
Figure 1. Data collection site and marked points: (a) shows the data collection site and (b) shows the marked points.
Figure 1. Data collection site and marked points: (a) shows the data collection site and (b) shows the marked points.
Sensors 24 01073 g001
Figure 2. Navigation module prototype.
Figure 2. Navigation module prototype.
Sensors 24 01073 g002
Figure 3. Tsinghua University’s FIT building (Walk 1).
Figure 3. Tsinghua University’s FIT building (Walk 1).
Sensors 24 01073 g003
Figure 4. Tsinghua University’s Weiqing building (Walk 2).
Figure 4. Tsinghua University’s Weiqing building (Walk 2).
Sensors 24 01073 g004
Figure 5. Displacement trajectory of Walk 1: (a) is the displacement trajectory with only the ZUPT algorithm and (b) is the displacement trajectory with ZUPT combined with the bipedal constraint algorithm.
Figure 5. Displacement trajectory of Walk 1: (a) is the displacement trajectory with only the ZUPT algorithm and (b) is the displacement trajectory with ZUPT combined with the bipedal constraint algorithm.
Sensors 24 01073 g005
Figure 6. Attitude angle of Walk 1 without bipedal constraint algorithm.
Figure 6. Attitude angle of Walk 1 without bipedal constraint algorithm.
Sensors 24 01073 g006
Figure 7. Attitude Angle of Walk 1 with bipedal constraint Algorithm.
Figure 7. Attitude Angle of Walk 1 with bipedal constraint Algorithm.
Sensors 24 01073 g007
Figure 8. Displacement trajectory of Walk 2: (a) is the displacement trajectory with only the ZUPT algorithm and (b) is the displacement trajectory with ZUPT combined with the bipedal constraint algorithm.
Figure 8. Displacement trajectory of Walk 2: (a) is the displacement trajectory with only the ZUPT algorithm and (b) is the displacement trajectory with ZUPT combined with the bipedal constraint algorithm.
Sensors 24 01073 g008
Figure 9. Attitude angle of Walk 2 without bipedal constraint algorithm.
Figure 9. Attitude angle of Walk 2 without bipedal constraint algorithm.
Sensors 24 01073 g009
Figure 10. Attitude angle of Walk 2 with bipedal constraint algorithm.
Figure 10. Attitude angle of Walk 2 with bipedal constraint algorithm.
Sensors 24 01073 g010
Table 1. Data collection program.
Table 1. Data collection program.
No.SexHeight/cmLoad/kg
1Male1650, 10, 15
2Male1700, 10, 15
3Male1750, 10, 15
4Male1800, 10, 15
5Male1850, 10, 15
6Male1900, 10, 15
7Female1580, 5
8Female1650, 5
9Female1700, 5
10Female1750, 5
Table 2. Specification of the sensors.
Table 2. Specification of the sensors.
SpecificationBarometerAccelerometerGyroscope
Full scale1260 hpa±16 g±4000 dps
Bias stability--3 deg/h
Noise0.75 pa / Hz 60 μ g / Hz 5 mdps / Hz
Temperature−40∼+85 °C−40∼+105 °C
Table 3. Experimental results.
Table 3. Experimental results.
ExperimentRadial Error without Algorithm (m)Radial Error with Algorithm (m)Improvement
Left FootRight FootMeanLeft FootRight FootMeanLeft FootRight FootMean
Walk 19.39997.91668.65834.41081.10222.7565 53.07 % 86.08 % 68.16 %
Walk 21.84673.67032.75850.72312.00171.3624 60.84 % 45.46 % 50.61 %
Table 4. Comparison of four algorithms in terms of position error.
Table 4. Comparison of four algorithms in terms of position error.
AlgorithmProposed by
Xu [28,29]
Proposed by
Shi [26,27]
Proposed by Niu [31,32]Proposed in This Paper
ImprovementAbout 30%41.46%About 50%68.16%/50.61%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chen, J.; Liu, G.; Guo, M. Data Fusion of Dual Foot-Mounted INS Based on Human Step Length Model. Sensors 2024, 24, 1073. https://doi.org/10.3390/s24041073

AMA Style

Chen J, Liu G, Guo M. Data Fusion of Dual Foot-Mounted INS Based on Human Step Length Model. Sensors. 2024; 24(4):1073. https://doi.org/10.3390/s24041073

Chicago/Turabian Style

Chen, Jianqiang, Gang Liu, and Meifeng Guo. 2024. "Data Fusion of Dual Foot-Mounted INS Based on Human Step Length Model" Sensors 24, no. 4: 1073. https://doi.org/10.3390/s24041073

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop