Next Article in Journal
Road-Scene Parsing Based on Attentional Prototype-Matching
Next Article in Special Issue
Application of Continuous Wavelet Transform and Artificial Naural Network for Automatic Radar Signal Recognition
Previous Article in Journal
An Approach to Task Representation Based on Object Features and Affordances
Previous Article in Special Issue
A Wi-Fi Indoor Positioning Method Based on an Integration of EMDT and WKNN
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Concept of Using the Decision-Robustness Function in Integrated Navigation Systems

by
Krzysztof Czaplewski
1,* and
Bartosz Czaplewski
2
1
Department of Navigation, Faculty of Navigation, Gdynia Maritime University, 81-374 Gdynia, Poland
2
Department of Teleinformation Networks, Faculty of Electronics, Telecommunications and Informatics, Gdansk University of Technology, 80-233 Gdansk, Poland
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(16), 6157; https://doi.org/10.3390/s22166157
Submission received: 16 June 2022 / Revised: 1 August 2022 / Accepted: 12 August 2022 / Published: 17 August 2022
(This article belongs to the Collection Navigation Systems and Sensors)

Abstract

:
The diversity and non-uniformity of the positioning systems available in maritime navigation systems often impede the watchkeeping officer in the selection of the appropriate positioning system, in particular, in restricted basins. Thus, it is necessary to introduce a mathematical apparatus to suggest, in an automated manner, which of the available systems should be used at the given moment of a sea trip. Proper selection of the positioning system is particularly important in integrated navigation systems, in which the excess of navigation information may impede the final determinations. In this article, the authors propose the use of the decision-robustness function to assist in the process of selecting the appropriate positioning system and reduce the impact of navigation observations encumbered with large errors in self-positioning accuracy. The authors present a mathematical apparatus describing the decision function (a priori object), with the determination of decision-assistance criteria, and the robustness function (a posteriori object), with different types of attenuation function. In addition, the authors present a computer application integrating both objects in the decision-robustness function. The study was concluded by a test showing the practical application of the decision-robustness function proposed in the title.

1. Introduction

Researchers have been fascinated by the coexistence of humans, fauna and flora from the beginning of life on Earth. The more we learn about the relationships between them, the better we understand the deep coexistence of such different worlds. In addition, as science and technology develop, we will need to integrate and jointly use apparently independent systems. In general, a system is an assembly of mutually-coupled components that serves a specific purpose and is considered detached from the environment for a specific purpose (descriptive, research or other). Based on the general definition, each component, or subsystem it includes, works to ensure system functionality and integration. Similarly, in different navigation type areas, the integration of apparently independent systems has been visible for years, of which the joint objective is to ensure a high safety level. To detail the above definition for the purposes of navigation, it may be stated [1] that a system is “…a combination of equipment and software which use interconnected controls and displays to present a comprehensive site of navigational information to the mariner…”.
In 1996, the International Maritime Organisation adopted performance standards [2] for integrated navigation bridge systems (IBSs). The IBS is any combination of systems interconnected to enable centralised access to information or the execution of commands by system components to perform two or more of the following operations [1]: passage execution, communications, machinery control, loading, discharging and cargo control, safety and security.
Contemporary integrated navigation systems (INSs) may be defined [3,4] as complex navigation systems capable of performing at least the following tasks: collision and excessive approach prevention, ship route monitoring and, simultaneously, enabling the navigator to plan, monitor and safely navigate the ship. It should be assumed that INSs are independent navigation systems used for self-positioning and other purposes. At present, satellite systems [5] and radar systems [6,7] are predominantly used in maritime navigation.
The predominance of global navigation satellite systems (GNSSs) is due to advantages such as positioning accuracy, availability and reliability. Unfortunately, the satellite systems included in GNSSs are increasingly prone to noise; hence their reliability may be lower than expected by the users. The causes and types of noise have been described, for example, by [8,9,10]. At this point, one should note the purposeful operation of GNSS jamming and spoofing systems and equipment. Although much time has been dedicated to the methods of handling spoofing and jamming [11,12], some authors, e.g., [13,14], note the requirement to have a different positioning system as an alternative to the GNSS, which may be essential for navigation and object positioning assistance.
On the other hand, radar systems, by definition, have a lower positioning accuracy; however, they are a very good alternative to satellite systems in confined basins. However, it was generally believed until recently that radar-based positioning has low accuracy and is relatively labour intensive. Contemporary technology and the development of data-processing methods, combined with modern IT systems, enable a significant increase in positioning accuracy, as well as reliability and rate.
In this article, the authors present the results of another stage of their research on the adaptation, for the purposes of maritime navigation, of the method of robust estimation proposed in [15], which uses bi-factor equivalent weights to equalise geodetic observations. The result of this research is the proposition to use automated decision-robustness functions in the systems, aimed at identifying the “useful” positioning systems, from the perspective of international resolutions, and reducing the impact of observations, encumbered with large errors, on the final self-positioning of the ship at sea. The article presents the robust estimation methods applicable to maritime navigation and the proposition to automate the selection of the navigation system to use for ship positioning. The entirety was subject to theoretical tests, of which one is presented in this article.
The authors’ contribution to the literature is:
  • a new concept of using the decision-robustness function in maritime navigation;
  • a new technique for selecting the best navigation system based on the concept of the decision-robustness function;
  • new possibilities of using the function in one-man-bridge systems or in autonomous vehicle algorithms;
  • increasing the range of available methods in the automation of navigation processes thanks to the new concept of the decision function.
The decision-robustness function was introduced to the literature for the first time in [16]. Novelty in this article is:
  • the adaptation of the decision-robustness function to the needs of maritime navigation;
  • the possibility of using the decision-robustness function to solve typical navigation tasks.
The structure of the article is as follows. Section 2 describes the related work. A mathematical description of the proposed model is included in Section 3. Section 4 contains the results of the experiments. Conclusions are included in Section 5.

2. Related Work

No INS component will operate properly without the algorithms that integrate and utilise the output of INS components. Attempts at integrating the navigation information from different positioning systems have been undertaken in the past [17,18]. The work [17] addresses the issue of safety in areas with very high traffic of ships at sea. This paper discusses a solution that integrates data from coastal radar stations, AIS and vision systems in order to determine the position of ships. A degree of error is discussed which depends on the specific system used. In order to increase the precision of position fixing, the authors of [17] proposed two geodesic methods of estimation and one innovative method for VTS systems.
Our proposed method has its origin in [16]. This publication is the result of the habilitation work of the main author and contains the theoretical foundations of the solution developed and proposed in this paper. In [16] one can find details on positioning with interactive navigational structures implementation.
Other research centres have also attempted to implement known mathematical methods for the joint use of navigation information from different navigation systems. For example, refs. [19,20] presented the application of the adaptive interacting multiple model (AIMM) filter method and the expanded Kalman filter (EKF) for the integration of navigation information from GNSSs and INSs. The authors of [19,20] proposed new methods to avoid the weaknesses of EKF, i.e., instability and significant computational requirements. One of the most important advantages of [19] is that this solution was verified on a real ship.
There are no solutions in the literature similar to the method described in this paper. In particular, the decision function is innovative. Thus, there are no publications in the literature for direct comparison with the method proposed in this paper. Therefore, the last few related works described in this section focuses on the description of complementary methods, rather than competing, methods.
The authors of [21] raised the problem of ship traffic in ports in the presence of dangerous cargo. The method described in [21] is an analytical and methodological scheme for calculating the risk. It was stated that port regulations arose out of general experience of experts and not from quantitative methods. The aim was to show that the analytical method of risk determination can help in defining port policy regulations. The authors of [21] presented a multi-stage methodology based on expert study and real-time simulations, the result of which is the characteristics of the ship’s safe approach, i.e., parameters such as velocity, approaching angle and more. The method proposed in this paper can cooperate with the method presented in [21] in two ways. On the one hand, our proposed method may provide a decision on the best navigation system at a given moment, which will be one of the input data for the method from [21]. On the other hand, the output parameters of the method described in [21] could influence the more advanced forms of the decision function.
The work published in [22] is similar to our proposed method in that it also describes an automated method to solve the problem of the precision of the geographic coordinates of a vessel at sea. In [22] the problem of precision of measured radar distance to the edge of the echo is raised in cases where there are multiple radar echoes, or the observed vessel is so large that the edge of the echo cannot be considered as the vessel’s position. An analytical method for correcting radar distance has been introduced, assuming that the radar echo has an elliptical shape. The results of [22] support the process of determining the ship position in VTS systems with increased accuracy. Although the purpose of [22] is aligned with the purpose of our article, work [22] focuses on only one type of navigation system, namely radars, and the idea of our proposed method is to select the best system from a collection of multiple navigation systems. On the other hand, effective determining radar distances significantly affect the quality of determining the observation position. In this regard, conclusions drawn from [22] may have an impact on the future forms of the decision function.
To ensure the continuity and reliability of the navigation process, many alternative navigation systems have been examined in recent years, including vision, radar, laser, ultrasound, ultra-wide band (UWB) and eLoran sensors [23,24]. In coastal areas and areas featuring multiple landmarks (radar and navigation marks), systems using vision or radar sensors have become particularly important [25,26]. The use of camera images, e.g., mounted on unmanned aerial vehicles (UAV), is particularly interesting. For example, the authors of [27] proposed a method to correct spatial orientation angle based on a shoreline image for use in coastal and port environments. The use of this type of tool, such as passive cameras, develops the interdisciplinary aspect of navigation, reaching to the achievements of image processing, signal processing and robotics. Nowadays, image-based navigation should be seen as another potential source of data for position-fixing algorithms. Although these solutions are not directly included in this article, since we focus on GNSS and radar in the following chapters, the set of navigation systems supported by our proposed method could be extended to include visual or laser systems in the future.

3. Description of Mathematical Model

3.1. Robust Estimation Task and Its Solution

In measurement practice, one sometimes encounters situations in which measurement results are encumbered with large errors. In general, these errors result from regular misreading of navigation equipment indications, misidentification of the observed navigation marks or a change in hydro-meteorological conditions during the acquisition of measurement data. In such situations, geodetic robust estimation methods may be used, known and well described in the source literature [28,29]. At present, as many navigation systems are available, their diversity may impede safe navigation instead of supporting it. On the other hand, joint use of the navigation data from different navigation positioning system types should be considered. For this, we assumed access to navigation information from differential GPS (DGPS) and radar measurements, and we assumed bi-dimensional ship positioning ( X P , Y P ) . Furthermore, the position coordinates were included in the vector X = [ X P , Y P ] T . In addition, following the generally accepted formation principles of observation equation systems [30], we combined observations from two independent positioning systems in one observation equation system:
y R 1 + v R 1 = F R 1 X 1 , X 2 , , X r y R i + v R i = F R i X 1 , X 2 , , X r y D 1 + v D 1 = F D 1 X 1 , X 2 , , X r y D j + v D j = F D j X 1 , X 2 , , X r y + v = F X
where y R = y R 1 , y R 2 , , y R n T is the radar observation vector, while y D = y D 1 , y D 2 , , y D n T is the DGPS observation vector, with combined results in the vector y = y R , y D T . v R = v R 1 , v R 2 , , v R n T is understood as the radar observation correction vector, while v D = v D 1 , v D 2 , , v D n T is understood as the DGPS observation correction vector which, combined, enables the formation of the vector v = v R , v D T . Vector v is a vector of random observation errors with the covariance matrix, C v , and the expected value vector, E ( v ) = 0 . If it is assumed that the antenna of the radar and GNSS receiver (in this case: DGPS) is placed on the ship in the same position, with known approximate coordinates, then one may form the vector X 0 = X P 0 , Y P 0 T and replace the vector y + v = F X with the linear observation equation in the following form:
v = F X y = F X 0 + d X y = F X X X = X 0 d X + F X 0 y = A d X + l
The value d X is the vector of unknown coordinate increases, so that X = X 0 + d X . The matrix:
A = F X X X = X 0 = F R 1 X X P F R 1 X Y P F R i X X P F R i X Y P F D 1 X X P F D 1 X Y P F D j X X P F D j X Y P X = X 0
is a known matrix of factors, while
l = F X 0 y
is the vector of free expressions. Considering the above, one may form the estimation task known in geodesy [30] as:
v = A d X + l C y = σ 0 2 Q y = σ 0 2 P y 1 min d X ξ d X = v T P y v = v T P y v
where v = v R v D is the completed observation corrections vector, C y is the observation results covariance matrix, Q y is the known co-factors matrix, σ 0 2 is the unknown variance factor and P y = D i a g P R , P D is the completed observations weight matrix.
The classic form of the estimation task enables the following solution to be presented: d X = A T P y A 1 A T P y l ; the final estimation of the ship position coordinates may be obtained from the following relationship: X = X 0 + d X . However, this approach considers the situation in which we use observations that are not encumbered with large errors or that are compliant with the requirements of international organisations related to the selection of navigation system types in a specific sea basin. In other cases, it is proposed to use the decision-attenuation function, which is a particular bi-factor of the equivalent weight matrix described in [15]. The theoretical basis for the formation and application of the decision-robustness function is described in [16]. In the case of practical navigation problems, it is possible to specify, even before the estimation (a priori), those components of the set of observations that should have no impact on the final determination (e.g., non-compliant with formal and legal requirements or identified false radar echo, for which the observation was automated). As assumed in [16], these observations correspond to zero values in the decision function. In the robust estimation process, the replacement of the decision function with the more general attenuation function eventually leads to the desired results. However, when a priori information on unacceptable observations is available, one may propose a different, more reasonable solution in practical terms. The basis for this proposition is the combination of the decision function (a priori object) and the attenuation function (a posteriori object). This way, the decision-robustness function is obtained [16]:
t ˜ y , υ = t y t υ
with general properties:
t ˜ y , υ = 0 for   y   unacceptable   a   priori t υ for   y   participating   in   estimation
The decision-attenuation function may be the basis for the formation of the decision-robustness matrix:
T ˜ ( y , v ) = T ( y ) T ( v )
where T y is the decision matrix based on the decision function t y (a priori object) and T v is the attenuation matrix based on the attenuation function t v (a posteriori object).
Based on the decision-robustness matrix, the following equivalent weight matrix is obtained:
P ˜ y = T ( y ) T ( v ) P y T ( y ) T ( v ) = T ( y ) T ( v ) P y T ( v ) P y T ( y ) = T ( y ) P y T ( y )
Assuming that p ˜ i = t y , v i p i , i = 1 , , n , the equivalent matrix for independent navigation observations (in the considered problem, from different navigation systems) will take the following form:
P ˜ y = T ˜ y , v P y = p ˜ 1 p ˜ 2 p ˜ n = t y , v 1 p 1 t y , v 2 p 2 t y , v n p n
Following the above assumptions, the final estimation task will take the following form:
v = A d X + l C ˜ y = σ 0 2 P ˜ y 1 min d X ξ d X = v T P ˜ y v = v T P ˜ y v
The diagonal components of the correction vector covariance matrix estimator v in the form of C ^ v = m 0 2 P y 1 A A T P y A 1 A T are squares of the mean determination errors of the appropriate corrections, v i . In accordance with [30], it turns out that due to the existence of large errors, even if weight values are selected properly, one may expect a high value of large errors or high values of the variance factor estimator, m 0 2 . Thus, special methods of robust estimation of the variance factor should be used, as proposed in, e.g., [31,32]. The occurring overestimates of mean errors, m v ^ , may disrupt the identification of outlying observations because the values of standardised correction estimators in the form of v ^ ¯ = v ^ m v ^ will be underestimated. Hence, assuming that m 0 2 = 1 , the covariance matrix estimator of the correction vector will take the following form:
C ^ v = P y 1 A A T P y A 1 A T
In view of such assumptions, the standardised corrections occurring in attenuation functions are in practice replaced with standardised estimators in the following form:
v ^ ¯ i = v ^ i m v ^ i = v ^ i C ^ v i i
As the equivalent weight matrix, P ˜ y , depends on standardised corrections, the estimation task solution (Equation (11)) and thus the determined increases d X of the ship coordinates vector, X 0 , is iterative. The first step in this process is estimation using the classic least squares method, which is estimation using the original weight matrix P y . The next step is estimation using the least squares method, by application of the continuously modified weights attenuated by functions with the values calculated based on the corrections obtained in the previous step. The iteration ends in such an equation, in which the obtained correction values no longer differ significantly from the values from the previous equation. The general characteristics of the applied attenuation function and decision function are presented further in this article.

3.2. Decision Function as an a Priori Object

The research presented in the article refers to the proprietary concept of using the “decision-robustness function” applicable to the navigation process conducted in the coastal zone. Sea basins in coastal zones are considered as surface- or depth-restricted basins [33,34]. Restrictions in coastal zones, as well as international resolutions on navigation accuracy depending on the type of human activity conducted at sea and navigation areas, almost impose the requirement to use methods that connect to the surrounding ground navigation infrastructure (radar and navigation marks and identified dangerous objects), of which the relatively close distance to the ship will have an impact on the decision-making process in the selection of the positioning system and type of observations and measurement frequency.
As mentioned above, the coastal zone is characterised by the existence of ship navigation marks. These marks include stationary and floating navigation marks, port and coast marks, designated traffic separation zone marks, waterways, isolated dangers and basins closed for navigation. They have their intended purpose and contribute to higher safety, so it is recommended, by international regulations, to use them for navigation. The available navigation infrastructure is known to the navigator on the ship, and the detailed description is included in navigation sources, such as the Admiralty Sailing Directions [35], Admiralty List of Radio Signals and Admiralty Light and Fog Signals [36]. Contrary to the satellite systems, the position determined based on these marks is directly connected to the dangers in the basin.
In this study, we attempted to use the systems included in the GNSS and the radar system (radar on the ship and characteristic echoes around the basin). The information on the GNSS receiver positioning accuracy at a given moment is always available, whereas no such current information is available for the radar system on the ship. The accuracy of positioning based on independent radar measurements, of which the statistical errors are in a normal distribution, may be characterised using a practical measure often used in analyses, i.e., the mean error. As the mean error is the function of measurement accuracy and the so-called geometric factor, of which the value depends on the ship position relative to navigation marks (radar echoes), it is reasonable to have its distribution in the considered basin.
The mean error, as the measure of positioning accuracy, will have an impact on the operation of the decision function used at the stage of selecting the type of navigation system for ship positioning. It may be assumed as a component for determining the selection of the system. For this purpose, the error value should be determined at every point of the investigated sea basin and, based on these values (e.g., by interpolation), the contour line limiting the accuracy areas should be determined, in which the mean positioning error will be in the assumed ranges. The authors will address this area in the next stage of research, aimed at the development of the method presented in this article. To validate the proposed theoretical solutions, a constant mean radar observation error was assumed, which will be discussed further in the article.
On the other hand, as mentioned in the introduction, it is important to ensure a high navigation safety level. In restricted basins, this level may be maintained in different ways. One of the components determining the high safety level is to ensure the appropriate basin depth under the ship keel. In the remainder of this article, the authors will focus on this component as the second criterion in determining the selection of the ship’s self-positioning system.
In the analysis of the needs and requirements to ensure safe and efficient navigation in integrated navigation systems, the decision function will implement the assumed set of undertakings to use a specific positioning system for the self-positioning of the ship. Such a set of undertakings may vary, but it will always depend on the availability of specific positioning systems and safety requirements in the area.
The concept of using a decision function as an a priori object in this article will be limited to the INS analysis of two criteria: (1) the mean positioning error value of one of two available positioning systems; (2) compliance with the safe depth under keel requirement in the restricted basin in the function of the mean ship position error.
The comparative analysis of the mean error representative of the individual positioning systems in the function of the predicted position of the ship in a restricted basin should provide an unambiguous suggestion of the system to use at the given point of the trip. The practical comparative analysis will be reduced to determine if the area of the circle determined by the mean positioning error coincides with the part of the sea basin in which the depth is too small to navigate safely. The analysis enables determining the value of the decision function, which forms Equation (6) for each observation, the given navigation system involved in ship positioning. The function may have the following values: t ( y ) = 0 when the two mentioned areas coincide or t ( y ) = 1 when the areas are separated. When t ( y ) = 0 , the analysed positioning system is omitted, and the usability of the next available system is analysed. When t ( y ) = 1 , the given system is acceptable to use in the process of ship positioning. Then, one may start forming the a posteriori object and building the decision-robustness matrix defined by Equation (8). Then, finally, one may resolve the estimation task specified by Equation (11).

3.3. Attenuation Function as an a Posteriori Object

In navigation practice, one sometimes encounters situations in which measurement results are encumbered with large errors. In general, these errors result from regular mistakes in the identification of marks and the reading of indications of navigation equipment, as well as distortion in data transmission or processing. In most general terms, such errors are referred to as large errors and the observations encumbered with them are referred to as outlying observations. Using such observations in the ship’s self-positioning process may lead to false positioning, with an impact on navigation safety. It seems natural to modify the observation weight as described, e.g., in [37,38] by attenuating the outlying observations. Attenuation is achieved by the determination of the equivalent weight obtained as the product of the original weight and the attenuation function [37,38]:
p i = t v i p i
where p i is the equivalent weight for the i-th observation; p i is the original weight for the i-th observation; t v i is the attenuation function that assumes the value of 1 for standardised corrections v ¯ = v / σ in the acceptable range of v ¯ Δ v ¯ or the value from the range of t v i 0 , 1 , depending on the assumed attenuation function, when the corrections for the completed observations are out of the assumed range of Δ v ¯ = k , k ; and Δ v ¯ is the acceptable range for random corrections, of which the values are high but still acceptable in the estimation process.
The most used attenuation functions in geodesy are the Huber function, the Hampel function and the Danish function.
The Huber attenuation function [37] has the following form (for v ¯ = v / σ and Δ v ¯ = k , k ):
t v ¯ = 1 for v ¯ Δ v ¯ 0 for v ¯ Δ v ¯
hence the following weight function:
p = t v ¯ p = p for v ¯ Δ v ¯ 0 for v ¯ Δ v ¯
This function is very radical because it assigns zero values to all weights outside the assumed range, Δ v ¯ . The Huber function is shown in Figure 1.
In matters related to the navigation process, in which the object is in motion, it is not always feasible to reject or repeat the observation because the object is changing position, and it is almost impossible (and sometimes, due to the time loss, it is pointless) to return to the position in which the observation encumbered with the large error was completed. When the observations available are scarce, it is preferable to deliberately determine one’s position using observations encumbered with errors than not to determine it at all.
Due to the possible decision error margin, the less radical (compared to the above-described) Hampel function is used [38]. In this function, two additional intermediate ranges (Figure 2) are introduced, in which the attenuation function t v i values decrease in a linear manner. The Hampel function takes the following form [38]:
t v ¯ = 1 for v ¯ k , k v ¯ k b k k b for v ¯ k , k b 0 for v ¯ > k b
hence the following weight function:
p = t v ¯ p = p for v ¯ k , k v ¯ k b k k b p for v ¯ k , k b 0 for v ¯ > k b
where k b is the limit of additional ranges. The Hampel function is shown in Figure 2.
Although the Hampel function is less radical than the Huber function, it may still “remove” observations encumbered with large errors in the point coordinates determination process. Thus, this function may be useless for navigation as well.
The Danish function has similar properties to the Hampel function, except that, outside the acceptable range of Δ v ¯ the function decreases exponentially. Thus, there is no need to distinguish intermediate ranges and their limits. The Danish attenuation function has the following form [39]:
t v ¯ = 1 for v ¯ k , k exp l v ¯ k g for v ¯ > k
hence the following weight function:
p = t v ¯ p = p for v ¯ k , k exp l v ¯ k g p for v ¯ > k
The values of the attenuation parameters l , g should be selected experimentally. Usually, in the first steps of the iteration process of the estimation task, l = 0.01 ÷ 0.1 and g = 2 are assumed. An improper selection of parameter values causes an unnecessary increase in the number of iteration process steps. The Danish function is shown in Figure 3.
Due to the non-existence of intermediate limits, this function is most useful in the navigation process. The Danish function enables all available observations in the estimation to be used, although they are encumbered with large errors.

4. Experimental Results

4.1. Computer Application

For the purposes of the validation and visualisation of the proposed method, a computer application with a graphical user interface (GUI) was developed. The application was written in the C# object-oriented language, under NET 4.7.2 framework, in Windows Forms. The application was designed for running in MS Windows 10 or higher. The development environment was MS Visual Studio 2019.
The purpose of this application is to visualise the artificial geographical area with marked radar observations, DGPS observations and positions calculated at different moments and then to execute the decision function and robustness function for the requested inputs. In functional terms, the application may be divided into the following cooperating modules: (1) the a priori object module, including sub-modules: map settings, observation settings and time control, map visualisation and observation and the decision function; (2) the a posteriori object module; (3) the fix positions module.
Figure 4 presents the a priori object module GUI. With regards to map settings, the user of the application may define the limits of the visualised geographical area in Gauss–Krüger rendering and then draw the shape of the coastline and up to three isobaths by moving the cursor over the chart in the central part of the GUI. One of three isobaths will be the threshold for the decision function. The user may save or load map settings to/from the file.
Then, the user should input radar observations, DGPS observations and calculated positions. A single DGPS observation entry consists of the time stamp, geographical coordinates and mean error value (circle radius). A single radar observation entry consists of the time stamp, radar echo distance, radar echo geographical coordinates and mean error. A single calculated position entry consists of a time stamp and geographical coordinates. The user may enter observations manually in accordance with the predetermined application syntax or load them from the file. The observations are visualised automatically on the chart after acknowledgement. The timeline for the entered observations is generated automatically based on time stamps. It enables controlling the passage of time and visualises the motion of the ship. The user may pause, resume, reset and change the time passage rate, as well as the less significant display options.
The central part of the GUI features two charts. The first visualises the entire geographical area, radar echoes, DGPS observation from the current time instant, the position calculated for the current time instant and, optionally, the ship’s route consisting of the positions calculated for all time stamps. The second is a zoom-in view of the first chart, centred on the calculated position, or DGPS observation if the calculated position is not available, for the current instant of the sea trip. From both charts, the user may read the geographical coordinates by clicking on the cursor.
For the decision function, the calculations are made on an ongoing basis for the situation currently shown on the chart. The application presents the decision function values for individual observations. The decision function value for the DGPS observation is 0 if the threshold observation is in the error radius or the observation coordinates exceeded the threshold isobath. If none of the above applies, then the decision function value is 1. It is possible to expand the application to implement more advanced rules for the decision function or use the electronic chart rendering from the electronic chart display and information system (ECDIS) [40].
Figure 5 presents the a posteriori object module GUI. This module automatically acquires the required data from the a priori object module. This tab enables the user to perform calculations for robust estimation and determine the corrections to observation for any instant on the timeline independently. The program performs pre-calculations automatically. The user may change the function parameters at any stage independently, and the program will update the calculation results dynamically after each change. In the end, the user may export the results to the fix positions module.
Figure 6 presents the fix positions module GUI. The final tab includes the table with the equalised ship position coordinates with mean positioning errors and the navigation system used.

4.2. Practical Use of the Decision-Robustness Function in Maritime Navigation

We assumed that the ship moves in a basin, of which the coastline with depth isobaths is shown in Figure 7.
At the following stages of the trip, the ship reaches the calculated positions marked in Figure 7, of which the rectangular Gauss–Krüger coordinates are presented in Table 1.
In each position, the identification of the available navigation systems was completed. In the presented test, the number of available systems was reduced to two (DGPS and radar observations). The following constant fix position error values were assumed: m P i G N S S = 10 m for i = 1 , , 5 (for the GNSS) and m P i R = 10 m for i = 1 , , 5 (for radar observations).
Then, following the assumptions presented above, the analysis was completed to determine the decision function value (the a priori object). The analysis results for the a priori object are shown in Figure 8.
The analysis resulted in the data presented in Table 2.
Considering that the position determined using satellite systems may be more accurate than using radar observation, it was assumed as a rule that in Positions #2, #4 and #5, where t ( y ) = 1 , the fix position for further navigation will be the position from the GNSS receiver. In addition, it was considered that the process of building robustness against large errors is included in the algorithms of positioning using satellite measurements, and the coordinates of the fix position of the ship are the final coordinates (Table 3).
However, in Positions #1 and #3, the decision function value for the GNSS is t ( y ) = 0 , so the position from the GNSS is not considered in the navigation, but the fix position will be determined using radar observations because the decision function value for this system is t ( y ) = 1 . For further calculations in both positions, radar observations were used, of which the coordinates are listed in Table 4.
The radar observations used for further calculations are the measured radar distances (Table 5). Assuming that radar observations may be encumbered with large errors, in the resolution of the estimation task (Equation (11)), the observations of Echo #R5 in Positions #1 and #3 were encumbered with large errors.

4.2.1. Determination of Fix Position #1

In accordance with the robust estimation method, it was first identified whether, and which, observations were encumbered with large errors. To this end, the correction covariance matrix was determined, in (12), and the acceptable range of standardised corrections was specified, Δ v ^ ¯ = 2.0 ; 2.0 . The acceptable range was determined for the trust level γ = 95 % . The standardised corrections determined according to (13) at the initial (identification) stage were as follows: v ^ ¯ 1 = 12.0016 Δ v ^ ¯ ,   v ^ ¯ 2 = 5.3154 Δ v ^ ¯ ,   v ^ ¯ 3 = 3.7877 Δ v ^ ¯ ,   v ^ ¯ 4 = 3.2280 Δ v ^ ¯ ,   v ^ ¯ 5 = 15.8022 Δ v ^ ¯ .
All observations were encumbered with larger errors than assumed (the corrections were out of the assumed range). Thus, it was necessary to “process” the observations using the mathematical apparatus described with Equations (9)–(11), re-determine the correction covariance matrix C ^ v and then standardise corrections v ^ ¯ i for i = 1 , , 5 . The results of the robust estimation procedure may be analysed based on Table 6.
During the subsequent iterations, Echo #R5 was encumbered with large errors (which follows the above-described assumptions). For the analysis, it was assumed that the distance was d # R 5 = 3600 m ; however, the actual distance was d # R 5 = 3385.39 m . The finally-equalised position coordinates of the ship (Position #1) were:
X ^ # 1 = X # 1 0 + d ^ X # 1 = 6 , 044 , 630.76 358 , 462.92 + 0.113 0.92 = 6 , 044 , 630.65 358 , 462.83
with a mean error of m # 1 = 0.67 m .

4.2.2. Determination of Fix Position #3

Similar to Position #1, it was first identified whether, and which, observations were encumbered with large errors. To this end, the correction covariance matrix was determined C ^ v , and the acceptable range of standardised corrections was specified v ^ ¯ i . The acceptable range was also determined for the trust level γ = 95 % . The standardised corrections determined according to (13) at the initial (identification) stage were as follows: v ^ ¯ 1 = 6.0593 Δ v ^ ¯ ,   v ^ ¯ 2 = 4.2616 Δ v ^ ¯ ,   v ^ ¯ 3 = 7.1601 Δ v ^ ¯ ,   v ^ ¯ 4 = 4.0534 Δ v ^ ¯ ,   v ^ ¯ 5 = 11.0565 Δ v ^ ¯ .
In addition, for Position #3, all observations were encumbered with larger errors than assumed (the corrections were out of the assumed range for standardised corrections). Thus, in this case, the mathematical apparatus can be used to determine the a posteriori object values, re-determine the correction covariance matrix C ^ v and then standardised corrections v ^ ¯ i for i = 1 , , 5 . The results for Position #3 are listed in Table 7.
During the subsequent iterations, it may be determined that Echo #R5 was encumbered with large errors in this case as well. For the analysis, it was assumed that the distance was d # R 5 = 10 , 300 m ; however, the actual distance was d # R 5 = 10 , 110.56 m . The finally equalised position coordinates of the ship (Position #3) were:
X ^ # 3 = X # 3 0 + d ^ X # 3 = 6 , 051 , 460.48 361 , 197.74 + 3.664 0.382 = 6 , 051 , 464.14 361 , 198.12
with a mean error of m # 3 = 17.4 m .
The application of the decision-robustness function enabled the selection of the appropriate positioning system to determine the fix positions of the ship (Table 8) and using radar observations to detect the ones encumbered with large errors and reduce their impact on the final determinations.

5. Conclusions

The diversity and availability of positioning systems in navigation often lead the watchkeeping officer not to analyse which of the available systems would be best used at the given moment but to select the system that enables the easiest determination of the fix position of the ship at sea. At present, satellite systems comprising GNSS are predominantly used. It does not mean, however, that they are the best solution at every stage of the sea trip. Thus, it is worth conducting research aimed at automating the positioning system selection process at every stage of the trip.
The article presents a method of selecting one of the many available (and IMO-compliant [4]) navigation positioning systems. The selection analysis covered the satellite system and the radar system. As can be deduced from the described test, the satellite system, despite its high accuracy, will not always be better than the observations obtained from radar. The reason is that the mean error of determining the ship’s position using the GNSS is always the radius of the circle inside which the position is located. However, it is not possible to determine, without additional analyses, whether this is the actual geographical position of the vessel at sea. However, using radar observations, the ship’s position will always be at sea. If, for a given navigation task, the accuracy of the radar system is sufficient to determine the ship’s position, it is better to use the radar system, not the satellite system, because the position has not been determined on land.
The application of the decision-robustness function in integrated navigation systems is an intelligent tool that may assist not only in the identification and reduction of the impact of observations encumbered with large errors but also in the selection of the appropriate navigation system for self-positioning in restricted basins at any given moment, to ensure the high quality of the determinations.
A popular measure of accuracy in navigation tasks is the mean ship positioning error. This measure enables a comparison of the positioning quality and then the selection of the positioning system, which is part of the INS. It would be useful for the navigator to know the numerical value of this parameter relative to ground positioning systems (e.g., radar-based) at any point in the basin in which the ship moves. A possible visual presentation would be to apply the mean error value contour lines on the sea chart. The authors will address this area in the next stage of research, aimed at the development of the method presented in this article and the acquisition of the fullest possible information on the accuracy measures with an impact on the proper operation of the a priori object described in this article.
Special situational cases (for example, for a radar system: weather, distribution of surrounding reference objects etc.) not described in this paper could be reflected in the parameters of the decision function, which in general could be variable depending on weather conditions. In the presented paper, it has a relatively simple fixed form, but further stages of research could and will focus on more complex decision functions automatically controlled during the voyage. It is conceivable that the parameters of the decision function could change depending on the reading from, for example, the meteorological sensors.

Author Contributions

Conceptualisation, K.C.; methodology, K.C.; software, B.C.; validation, K.C. and B.C.; formal analysis, K.C.; investigation, K.C. and B.C.; resources, B.C.; writing—original draft preparation, K.C. and B.C.; visualisation, B.C.; supervision, K.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded from the statutory activities of Gdynia Maritime University, a grant entitled “Research related to the development of the e-navigation concept within maritime transport telematics in the context of the integration of terrestrial and satellite navigation systems and the development of spatial information systems technologies, including their impact on the safety of maritime and inland navigation” (grant no. WN/2021/PZ/01).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Alexander, L.; Ryan, J.F.; Casey, M.J. Integrated Navigation System: Not a Sum of Its Parts. In Proceedings of the Canadian Hydrographic Conference, Ottawa, ON, Canada, 25–27 May 2004; p. 297. [Google Scholar]
  2. IMO. Recommendation on Performance Standards for Integrated Bridge Systems (IBS); IMO Resolution MSC.64(67), Annex 1, 4; IMO: London, UK, 1996. [Google Scholar]
  3. IMO. Adoption of New and Amended Performance Standards; IMO Resolution MSC.64(67); IMO: London, UK, 1996. [Google Scholar]
  4. IMO. Adoption of the Revised Performance Standards for Integrated Navigation Systems (INS); IMO Resolution MSC.252(83); IMO: London, UK, 2007. [Google Scholar]
  5. Czaplewski, K. Global Positioning System: Political Support, Directions of Development, and Expectations. TransNav Int. J. Mar. Navig. Saf. Sea Transp. 2015, 9, 229–232. [Google Scholar] [CrossRef]
  6. Wąż, M. Navigation Based on Characteristic Points from Radar Images. Sci. J. Marit. Univ. Szczec. 2010, 20, 140–145. [Google Scholar]
  7. Naus, K.; Wąż, M.; Szymak, P.; Gucma, L.; Gucma, M. Assessment of ship position estimation accuracy based on radar navigation mark echoes identified in an Electronic Navigational Chart. Measurement 2021, 169, 108630. [Google Scholar] [CrossRef]
  8. Hein, G.W. Status, perspectives and trends of satellite navigation. Satell. Navig. 2020, 1, 22. [Google Scholar] [CrossRef] [PubMed]
  9. Zrinjski, M.; Barković, D.; Matika, K. Razvoj i modernizacija GNSS-a. Geod. List 2019, 73, 45–65. [Google Scholar]
  10. DeLaPena, C.A. Military Communications & Positioning, Navigation, and Timing Overview with GPS Update. In Proceedings of the 26th National Space-Based Positioning, Navigation & Timing Advisory Board Meeting, Annapolis, MD, USA, 4–5 May 2022. [Google Scholar]
  11. Zhang, J.; Cui, X.; Xu, H.; Lu, M. A Two-Stage Interference Suppression Scheme Based on Antenna Array for GNSS Jamming and Spoofing. Sensors 2019, 19, 3870. [Google Scholar] [CrossRef]
  12. Kwon, K.-C.; Shim, D.-S. Performance Analysis of Direct GPS Spoofing Detection Method with AHRS/Accelerometer. Sensors 2020, 20, 954. [Google Scholar] [CrossRef]
  13. Narins, M.; Enge, P.; Peterson, B.; Lo, S.; Chen, Y.-H.; Akos, D.; Lombardi, M. The Need for a Robust, Precise Time and Frequency Alternative to GNSS. In Proceedings of the 25th International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS 2012), Nashville, TN, USA, 20–24 September 2012; pp. 2057–2062. [Google Scholar]
  14. Han, S.; Gong, Z.; Meng, W.; Li, C.; Gu, X. Future Alternative Positioning, Navigation, and Timing Techniques: A Survey. IEEE Wirel. Commun. 2016, 23, 154–160. [Google Scholar] [CrossRef]
  15. Yang, Y.; Song, L.; Xu, T. Robust estimator for correlated observations based on bifactor equivalent weights. J. Geod. 2002, 76, 353–358. [Google Scholar] [CrossRef]
  16. Czaplewski, K. Positioning with Interactive Navigational Structures Implementation. Monograph. Annu. Navig. 2004, 7, 119. [Google Scholar]
  17. Czaplewski, K.; Wąż, M.; Zienkiewicz, M.H. A Novel Approach of Using Selected Unconventional Geodesic Methods of Estimation on VTS Areas. Mar. Geod. 2019, 42, 447–468. [Google Scholar] [CrossRef]
  18. Wilk, A.; Koc, W.; Specht, C.; Judek, S.; Karwowski, K.; Chrostowski, P.; Czaplewski, K.; Dabrowski, P.S.; Grulkowski, S.; Licow, R.; et al. Digital Filtering of Railway Track Coordinates in Mobile Multi–Receiver GNSS Measurements. Sensors 2020, 20, 5018. [Google Scholar] [CrossRef]
  19. Zhang, C.; Guo, C.; Zhang, D. Data Fusion Based on Adaptive Interacting Multiple Model for GPS/INS Integrated Navigation System. Appl. Sci. 2018, 8, 1682. [Google Scholar] [CrossRef]
  20. Jiang, C.; Zhang, S.-B.; Zhang, Q.Z. Adaptive Estimation of Multiple Fading Factors for GPS/INS Integrated Navigation Systems. Sensors 2017, 17, 1254. [Google Scholar] [CrossRef]
  21. Vidmar, P.; Perkovič, M.; Gucma, L.; Łazuga, K. Risk Assessment of Moored and Passing Ships. Appl. Sci. 2020, 10, 6825. [Google Scholar] [CrossRef]
  22. Czaplewski, K.; Świerczyński, S. A Method of Increasing the Accuracy of Radar Distance Measurement in VTS Systems for Vessels with Very Large Dimensions. Remote Sens. 2021, 13, 3066. [Google Scholar] [CrossRef]
  23. Hofmann-Wellenhof, B.; Legat, K.; Wieser, M. Image-based navigation. In Navigation; Springer: Vienna, Austria, 2013. [Google Scholar]
  24. Groves, P.D. The PNT boom, future trends in integrated navigation. Inside GNSS 2013, 8, 44–49. [Google Scholar]
  25. Veth, M.J. Navigation using images, a survey of techniques. J. Inst. Navig. 2011, 58, 127–139. [Google Scholar] [CrossRef]
  26. Naus, K.; Wąż, M. Precision in Determining Ship Position using the Method of Comparing an Omnidirectional Map to a Visual Shoreline Image. J. Navig. 2016, 69, 391–413. [Google Scholar] [CrossRef]
  27. Naus, K.; Szymak, P.; Piskur, P.; Niedziela, M.; Nowak, A. Methodology for the Correction of the Spatial Orientation Angles of the Unmanned Aerial Vehicle Using Real Time GNSS, a Shoreline Image and an Electronic Navigational Chart. Energies 2021, 14, 2810. [Google Scholar] [CrossRef]
  28. Yang, Y.; Cheng, M.; Shum, C.; Tapley, B.D. Robust estimation of systematic errors of satellite laser range. J. Geod. 1999, 73, 345–349. [Google Scholar] [CrossRef]
  29. Wisniewski, Z. Concept of Adjustment Methods in Navigation; Polish Naval Academy: Gdynia, Poland, 2002. (In Polish) [Google Scholar]
  30. Wiśniewski, Z. Adjustment Methods in Navigation and Hydrography; Polish Naval Academy: Gdynia, Poland, 2003. (In Polish) [Google Scholar]
  31. Duchnowski, R. Robust estimation of variance coefficient (VR-estimation) for dependent observations. Geod. Kartogr. 2000, 49, 131–143. [Google Scholar]
  32. Wiśniewski, Z. The most effective estimator of variance coefficient in geodetic observation systems. Geod. Kartogr. 1999, 48, 105–131. [Google Scholar]
  33. Gucma, S. Inżynieria Ruchu Morskiego; Wydawnictwo Okrętownictwo i Żegluga: Gdańsk, Poland, 2001. (In Polish) [Google Scholar]
  34. Gucma, S. Nawigacja Pilotażowa; Wydawnictwo Fundacji Promocji Przemysłu Okrętowego i Gospodarki Morskiej: Gdańsk, Poland, 2004. (In Polish) [Google Scholar]
  35. UKHO. Sailing Directions-Nord Sea (West Pilot), 12th ed.; UKHO: London, UK, 2021. [Google Scholar]
  36. UKHO. Available online: https://www.admiralty.co.uk/ (accessed on 20 May 2022).
  37. Huber, P.J. Robust Statistics; John Wiley & Sons: New York, NY, USA, 1981. [Google Scholar]
  38. Hampel, F.R.; Ronchetti, E.M.; Rousseeuw, P.J.; Stahel, W.A. Robust Statistics. The Approach Based on Influence Functions; John Wiley & Sons: New York, NY, USA, 1986. [Google Scholar]
  39. Krarup, K.; Kubik, K. The Danish Method: Experience and Philosophy; Series A, Issue 98; Deutsche Geodätische Kommission bei der Bayerischen Akademie Wissen: München, Germany, 1983; pp. 131–134. [Google Scholar]
  40. Weintrit, A. Clarification, Systematization and General Classification of Electronic Chart Systems and Electronic Navigational Charts Used in Marine Navigation. Part 1-Electronic Chart Systems. TransNav Int. J. Mar. Navig. Saf. Sea Transp. 2018, 12, 471–482. [Google Scholar] [CrossRef]
Figure 1. Huber attenuation function.
Figure 1. Huber attenuation function.
Sensors 22 06157 g001
Figure 2. Hampel attenuation function.
Figure 2. Hampel attenuation function.
Sensors 22 06157 g002
Figure 3. Danish attenuation function.
Figure 3. Danish attenuation function.
Sensors 22 06157 g003
Figure 4. “A priori object” tab in the application for the verification and visualisation of the proposed method.
Figure 4. “A priori object” tab in the application for the verification and visualisation of the proposed method.
Sensors 22 06157 g004
Figure 5. “A posteriori object” tab in the application for the verification and visualisation of the proposed method.
Figure 5. “A posteriori object” tab in the application for the verification and visualisation of the proposed method.
Sensors 22 06157 g005
Figure 6. “Fix positions” tab in the application for the verification and visualisation of the proposed method.
Figure 6. “Fix positions” tab in the application for the verification and visualisation of the proposed method.
Sensors 22 06157 g006
Figure 7. Visualisation of the test basin.
Figure 7. Visualisation of the test basin.
Sensors 22 06157 g007
Figure 8. Graphic rendering of the determination of the decision function value (magenta—GNSS, dark blue—calculated position, blue—safe area for navigation, light blue—dangerous area for navigation).
Figure 8. Graphic rendering of the determination of the decision function value (magenta—GNSS, dark blue—calculated position, blue—safe area for navigation, light blue—dangerous area for navigation).
Sensors 22 06157 g008
Table 1. Coordinates of the ship calculated positions during the test.
Table 1. Coordinates of the ship calculated positions during the test.
Ship’s PositionsX (m)Y (m)
#16,044,630.76358,462.92
#26,048,890.43359,497.90
#36,051,460.48361,197.74
#46,053,586.87363,475.51
#56,054,839.70365,398.69
Table 2. Decision function values for the individual calculated positions.
Table 2. Decision function values for the individual calculated positions.
Ship’s PositionsGNSSRadar
#1 t ( y ) = 0 t ( y ) = 1
#2 t ( y ) = 1 t ( y ) = 1
#3 t ( y ) = 0 t ( y ) = 1
#4 t ( y ) = 1 t ( y ) = 1
#5 t ( y ) = 1 t ( y ) = 1
Table 3. Coordinates of the fix position from the GNSS receiver.
Table 3. Coordinates of the fix position from the GNSS receiver.
Ship’s PositionsX (m)Y (m)
#26,048,733.2359,533.2
#46,053,600.4363,533.4
#56,054,855.5365,474.5
Table 4. Coordinates of radar echoes used in the test.
Table 4. Coordinates of radar echoes used in the test.
Radar EchoX (m)Y (m)
#R16,052,469.34358,694.38
#R26,045,676.69341,307.40
#R36,059,266.78376,133.21
#R46,047,000.12377,600.23
#R56,041,466.54359,666.50
Table 5. Radar observations used in calculations.
Table 5. Radar observations used in calculations.
Ship’s Positions d R   ( m )
#1#R17842.00
#R217,187.00
#R322,945.00
#R419,283.00
#R53600.00
#3#R12700.00
#R220,714.00
#R316,852.00
#R416,998.00
#R510,300.00
Table 6. Results of the application of the a posteriori object to radar observations in Position #1.
Table 6. Results of the application of the a posteriori object to radar observations in Position #1.
Step
of Iteration
Parameters of the Attenuation
Function
Values of the Attenuation Function
for Individual Observations
Values of Standardised
Corrections for
Individual Observations
l g t ( v ¯ 1 ) t ( v ¯ 2 ) t ( v ¯ 3 ) t ( v ¯ 4 ) t ( v ¯ 5 ) | v ¯ 1 | | v ¯ 2 | | v ¯ 3 | | v ¯ 4 | | v ¯ 5 |
10.210.1350.5150.6990.7820.0631.5281.1581.8930.8354.931
20.4211110.0321.0070.2890.2630.2543.800
30.6311110.030.9510.2700.2500.2443.690
40.8511110.000020.0230.0390.0400.0680.086
Table 7. Results of the application of the a posteriori object to radar observations in Position #3.
Table 7. Results of the application of the a posteriori object to radar observations in Position #3.
Step
of Iteration
Parameters of the Attenuation
Function
Values of the Attenuation Function
for Individual Observations
Values of Standardised Corrections
for Individual Observations
l g t ( v ¯ 1 ) t ( v ¯ 2 ) t ( v ¯ 3 ) t ( v ¯ 4 ) t ( v ¯ 5 ) | v ¯ 1 | | v ¯ 2 | | v ¯ 3 | | v ¯ 4 | | v ¯ 5 |
10.210.4440.6360.3560.6630.1632.3562.5052.7172.0415.915
20.220.9750.9500.90210.0470.9450.6631.0940.5083.915
30.6311110.0150.3670.2460.3340.1372.277
44.50.00511110.0110.3010.2030.2460.0962.008
Table 8. Results of the application of the a posteriori object to radar observations in Position #3.
Table 8. Results of the application of the a posteriori object to radar observations in Position #3.
Ship’s PositionsX (m)Y (m)
#16,044,630.6358,462.8
#26,048,733.2359,533.2
#36,051,464.1361,198.1
#46,053,600.4363,533.4
#56,054,855.5365,474.5
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Czaplewski, K.; Czaplewski, B. The Concept of Using the Decision-Robustness Function in Integrated Navigation Systems. Sensors 2022, 22, 6157. https://doi.org/10.3390/s22166157

AMA Style

Czaplewski K, Czaplewski B. The Concept of Using the Decision-Robustness Function in Integrated Navigation Systems. Sensors. 2022; 22(16):6157. https://doi.org/10.3390/s22166157

Chicago/Turabian Style

Czaplewski, Krzysztof, and Bartosz Czaplewski. 2022. "The Concept of Using the Decision-Robustness Function in Integrated Navigation Systems" Sensors 22, no. 16: 6157. https://doi.org/10.3390/s22166157

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop