Next Article in Journal
Double-Tap Interaction as an Actuation Mechanism for On-Demand Cueing in Parkinson’s Disease
Next Article in Special Issue
A Clamping Force Estimation Method Based on a Joint Torque Disturbance Observer Using PSO-BPNN for Cable-Driven Surgical Robot End-Effectors
Previous Article in Journal
Non-Destructive Soluble Solids Content Determination for ‘Rocha’ Pear Based on VIS-SWNIR Spectroscopy under ‘Real World’ Sorting Facility Conditions
Previous Article in Special Issue
An Audification and Visualization System (AVS) of an Autonomous Vehicle for Blind and Deaf People Based on Deep Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fuzzy Functional Dependencies as a Method of Choice for Fusion of AIS and OTHR Data

by
Medhat Abdel Rahman Mohamed Mostafa
1,
Miljan Vucetic
2,*,
Nikola Stojkovic
3,
Nikola Lekić
2 and
Aleksej Makarov
2
1
School of Electrical Engineering and Computer Science, European University, 28 Carigradska St., 11000 Belgrade, Serbia
2
Vlatacom Institute, 5 Milutina Milankovica Blv., 11070 Belgrade, Serbia
3
School of Electrical Engineering, University of Belgrade, Serbia and Vlatacom Institute, 101801 Beograd, Serbia
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(23), 5166; https://doi.org/10.3390/s19235166
Submission received: 2 October 2019 / Revised: 16 November 2019 / Accepted: 19 November 2019 / Published: 26 November 2019
(This article belongs to the Special Issue Smart Sensors and Devices in Artificial Intelligence)

Abstract

:
Maritime situational awareness at over-the-horizon (OTH) distances in exclusive economic zones can be achieved by deploying networks of high-frequency OTH radars (HF-OTHR) in coastal countries along with exploiting automatic identification system (AIS) data. In some regions the reception of AIS messages can be unreliable and with high latency. This leads to difficulties in properly associating AIS data to OTHR tracks. Long history records about the previous whereabouts of vessels based on both OTHR tracks and AIS data can be maintained in order to increase the chances of fusion. If the quantity of data increases significantly, data cleaning can be done in order to minimize system requirements. This process is performed prior to fusing AIS data and observed OTHR tracks. In this paper, we use fuzzy functional dependencies (FFDs) in the context of data fusion from AIS and OTHR sources. The fuzzy logic approach has been shown to be a promising tool for handling data uncertainty from different sensors. The proposed method is experimentally evaluated for fusing AIS data and the target tracks provided by the OTHR installed in the Gulf of Guinea.

1. Introduction

An exclusive economic zone (EEZ) is a 200 nmi (approximately 370 km)-wide area which spreads from territorial waters towards the open sea in which a coastal state has exclusive rights to exploit biological and mineral sea resources. The control of this zone posers technological, financial and organizational challenges. As parts of an integrated maritime surveillance (IMS) system, different types of electronic sensors and telecommunication systems can be used for monitoring the zone. However, the range of microwave and optical sensors depends on their working wavelengths and is limited due to atmospheric signal weakening and the Earth’s curvature—distance to horizon. High-frequency (HF) radars operating at decameter wavelengths (3–30 MHz) use vertically polarized surface waves to detect and track targets beyond the horizon, enabling over-the-horizon (OTH) surveillance. Therefore, HF-OTH radars are well suited for EEZ surveillance [1,2].
For effective EEZ tracking, a fusion of data from multiple sensors is needed. In this case, term fusion means integration of data from at least two sensors. Most often, image of maritime situation beyond the horizon is provided by using fusion of data received from HF-OTHR and an automated identification system (AIS) that can be a land-based AIS (LAIS) or a satellite-based AIS (SAIS) [3].
Data fusion received from HF-OTHR and AIS provides extraction of paths which are not confirmed by AIS. This allows for detecting targets that are non-cooperative and which either pose a military threat or conduct illegal activities (such as smuggling) inside the EEZ [4,5].
In this paper we use real data from the HF-OTHR system installed in the Gulf of Guinea obtained with the pertaining detection and tracking software [6,7,8,9], and the current AIS data in order to perform data fusion. It is important to note that the Gulf of Guinea is among the most challenging environments for the targeted application. There are two major reasons for this:
  • HF noise levels in that area are among the highest in world [10], and
  • Absence of a strong regulatory institution (such as European Maritime Safety Agency—EMSA in Europe) sometimes leads to unpredictable behavior of participants in the maritime traffic. This causes a very high latency and questionable quality of AIS data.
Since our goal is fusion of the tracking data provided by different sensors for the same targets, we have employed the fuzzy functional dependency (FFD) concept in order to associate AIS data and OTHR tracks. Methods based on numerical statistics were used in the previous research on AIS and OTHR data fusion [8,11]. However, intensive traffic flows call for more reliable integration methods. Nowadays, artificial intelligence tools such as fuzzy approaches and neural networks have been applied to data fusion problems and resulted in higher fusion accuracy. A simple idea of the AIS and OTHR data fusion based on the fuzzy sets was brought forward in [12] and used in handling inaccuracy when computing association grades for different vectors. The fuzzy C-means clustering method was used in [13] for correlating tracks without merging them. Neural networks were proposed for improvement of AIS and OTHR data fusion [14,15], but the methods employed were rather complicated. In general, these approaches neglected ships which were either not equipped with AIS or unwilling to emit AIS information. Furthermore, the validity of the presented approaches was checked against research data without considering the latency of AIS messages.
In this work, we present a fuzzy-based method for addressing imprecision characterized by these types of sensors. The proposed approach offers better insight in numerical processing than neural networks. AIS and OTHR tracks are loaded into a relational database in order to perform advanced database operations such as data cleaning, filtering and record matching. Actually, FFDs have been used to define data integration constraints among two databases because they take similarity into account. Therefore, to address the development of fusion method, it is necessary to prepare data for processing and analyze different challenges appearing in real scenarios. This approach provides complete picture of maritime situation enabling the detection of possible threats to maritime nation’s interests in EEZ, as well as better insight in events within it. The performance of the introduced method is experimentally tested and discussed. It is worth noting that this paper relies on concepts described in [11], but utilizes a different decision-making algorithm based on fuzzy concept.
This article is structured as follows. In Section 2 the research background is described. Section 3 presents methods of measuring the similarity between AIS and OTHR records. Section 4 gives the algorithm overview and implementation steps. Experimental results are discussed in Section 5. Finally, the paper ends with the conclusions presented in Section 6.

2. Background

In this section we considered functional dependencies (FDs), which are a basic concept for data fusion and data cleaning, between AIS records and OTHR tracks. Functional dependencies are one of the fundamentals of Codd’s relational model used as a tool for the database design based on the normalization theory and redundancy elimination. An interpretation of FD, denoted by XY, in the relation R defined over the set of attributes attr(R) is the following: if two tuples t1 and t2 have the same value on the attribute X, then they also have the same value on attribute Y. It reads as X determines Y or Y is functionally dependent on X. But, in many practical problems data are not strictly equal. For example, OTHR by its nature involves some level of inaccuracy. In our case, it measures the range, azimuth and radial speed of targets with accuracy expressed in terms of the corresponding resolution cells. In this work, the range resolution cell of OTHR is 1.5 km, angular resolution is 10° and the radial velocity resolution is 0.32 m/s. The accuracy of measurement quantities is in the range of 0.5 to 1.5 respective resolution cells. Matching the AIS and OTHR data means that we have to find similar records. One of the challenging problems in our work is measuring similarities among AIS records and OTHR tracks considering their respective attributes. The main idea is to find the intensity of similarity in order to detect the same targets and possible threats. This assumption leads us to extending FDs to fuzzy functional dependencies. The equality relation used in the above canonical FDs is replaced by a similarity or proximity relation in FFDs as a measure of closeness [16]. The extension enables the specification of new application areas such as data fusion of AIS and OTHR. Today, FDs defined in various ways [17] are not used only for database design purposes, but also in other challenging applications such as data cleaning [18], record matching [19], query relaxation [20], and knowledge discovery [21].
In order to impose fuzzy data dependency, we introduce the definition of FFD X θ Y [22]:
min I (≈(t1(X), t2(X), ≈ (t1(Y), t2(Y)) ≥ θ
where t1, t2R (values of tuples t1 and t2 for attributes X and Y respectively in relation R), “≈” is the closeness measure, I is a fuzzy implications operator, min denotes the “and” operator and θ ∈ [0, 1] is the strength of the dependency. The definition of FFD states that if t1(X) is similar to t2(X) then t1(Y) is also similar to t2(Y) with the strength of dependency θ, where X, Y are two sets of attributes in R, X, Yattr(R). Different similarity functions are employed to compare values of considered attributes. In the last two decades several definitions of FFDs have been introduced [23]. Recently, a new method has been developed for computing FFDs by [24].
In case of AIS and OTHR data fusion, t1 and t2 are records representing AIS object and OTHR track respectively. Record matching is performed by means of FFD, i.e., a fuzzy measure on [0, 1] is used to compute how similar the AIS object and an OTHR track are, considering common attributes from the corresponding databases and their aggregation. The first step is calculating closeness of the considered attributes using the defined similarity measures. The strength of dependency θ is a real number within the range [0, 1], describing the degree of similarity between an AIS object and an OTHR track. In order to detect the parameter θ, an aggregation of similarities per observed attributes is applied. The average aggregation function is suggested for calculating the strength of the dependency among AIS and OTHR records. Additionally, this function can provide flexibility in terms of weighting attributes when some of them are more important than others. Thus, in the next section, we will describe a step-by-step procedure for fusion of AIS and OTHR records.
An important aspect related to FD and FFDs is the presence of inference rules enabling the possibility of deriving the new dependencies from the existing ones [25]. This straightforwardly provides an efficient way to derive relations between other attributes in data analysis. These inference rules are based on Armstrong’s axioms. Inference rules must be sound (rules generate valid dependencies) and complete (valid dependencies can be generated by only these rules). For example, we list the inference rules for FFDs (analogously to FDs):
  • Inclusive rule: If X θ 1 Y holds, and θ1θ2, then X θ 2 Y holds.
  • Reflexive rule: If YX, then X Y holds.
  • Augmentation rule: {X θ Y} | = XZ θ YZ.
  • Transitivity rule: {X θ 1 Y, Y θ 2 Z} | = X min ( θ 1 , θ 2 ) Z.
  • Union rule: {X θ 1 Y, X θ 2 Z} | = X min ( θ 1 , θ 2 ) YZ.
  • Pseudotransitivity rule: {X θ 1 Y, WY θ 2 Z} | = WX min ( θ 1 , θ 2 ) Z.
  • Decomposition rule: If X θ Y holds, and ZY, then X θ Z holds.

3. Research Methodology

Our methodology described here answers the question as to how OTHR and AIS data are fused. Our main goal is to detect records referring to the same targets in a database. For that purpose, we explore the connection between FFDs and the problem of OTHR tracks and AIS data fusion. By matching records from two databases, we perform data analysis per common attributes in order to fuse related records. As an example, if tuple t1 representing AIS record and tuple t2 referring to OTHR track have similar values per common attributes, then they are candidates to represent the same vessel in the observed area. FFDs are used to quantify the closeness or remoteness of OTHR and AIS records. They specify a subset of tuples on which the dependency holds.
Initially, the source databases which need to be integrated have unique identifiers. The primary keys for OTHR tracks and AIS data are ID_Number and Maritime Mobile Service Identity (MMSI), respectively [26]. The use of primary keys eases matching as compared to a situation when alternative attributes need to be found in databases without unique identifiers. Obviously, there is FD between unique identifiers and other attributes in the source databases: ID_NumberA, and MMSIB, where A, B are sets of attributes in source relations r1 and r2. However, in the case of OTHR and AIS data integration there is a FFD (ID_Number, MMSI) θ C. where (ID_Number, MMSI) is a composite key (integration pair), θ parameter reflecting degree of similarity and C is set of common attributes in source relations: Timestamp, Latitude, Longitude, Velocity and Ship Course. This FFD is examined through the matching process between AIS and OTHR records in order to evaluate the closeness of observed tuples. Due to the inaccuracy and the inconsistency of data provided by OTHR and AIS platforms, we evaluate the closeness of records in order to detect FFDs which are possible candidates for associating related targets.
The parameter θ (the strength of fuzzy functional dependency) is calculated as follows:
θ = 1 5 ( c t i m e + c l o n g + c l a t + c v e l + c c o u r s e )
In fact, for each common attribute we calculate how close two attribute values are. Then, we aggregate and normalize the closeness values of common attributes. The records from OTHR and AIS source databases with the highest θ value are candidates for target association. In order to calculate the closeness values c for the attributes Time (ctime), Longitude (clong), Latitude (clat), Velocity (cvel) and Course (ccourse) the following equations are used:
c v e l = 1 | v A I S v O T H R | v m a x
where vAIS and vOTHR represent the target’s speed reported by AIS and OTHR networks respectively, while vAISvOTHR is their difference. The variable vmax denotes the maximum speed of target communicated by OTHR and AIS systems, i.e., vmax = max ( v A I S m a x , v O T H R m a x ). cvel represents the speed matching value for the corresponding records from AIS and OTHR databases.
c c o u r s e = 1 | C A I S C O T H R | C m a x
where CAIS and COTHR represent the target’s course reported by AIS and OTHR networks respectively, CAIS − COTHR is their difference and Cmax is maximum course provided for all the targets by OTHR and AIS databases, Cmax = max( C A I S m a x , C O T H R m a x ). ccourse is the matching coefficient for the course attribute between two attribute values representing records from AIS and OTHR.
c l o n g = 1 | L o n g A I S L o n g O T H R | L o n g m a x
c l a t = 1 | L a t A I S L a t O T H R | L a t m a x
where LongAIS (LatAIS) and LongOTHR (LatOTHR) represent the target’s longitude (latitude) reported by AIS and OTHR networks respectively, LongAISLongOTHR (LatAISLatOTHR) is their difference and Longmax (Latmax) is maximum value of longitude (latitude) in OTHR and AIS databases. Longitude and latitude are expressed as decimal values (degrees). Closeness between AIS and OTHR records for longitude (latitude) position is shown as clong (clat).
c t i m e = 1 | t A I S t O T H R | t i n t e r v a l ( s e c )
where tAIS and tOTHR represent timestamps of data creation by AIS and OTHR sensors respectively and tAIStOTHR is their difference. Timestamps tAIS and tOTHR are converted to seconds due to efficient computation. The interval of time (tinterval) represents the length of the observed time frame and it is also expressed in seconds. The interval is measured as time duration between two AIS messages.
Presented processing logic is triggered by newly received AIS message. We suppose that we operate with fairly precise AIS data. Furthermore, for every AIS record OTHR candidates are ranked by strength of dependency θ in the record matching process. This procedure is shown in the next Section.

4. Algorithm

In terms of data fusion from AIS and OTHR sensors, we present an algorithm based on aforementioned methodology. This algorithm with steps describing record matching is shown in Figure 1.
Algorithm initialization is triggered by the reception of AIS message. OTHR dataflow is periodic with repetition cycle of 33 s, while AIS system in this geographical area does not provide consistent message delivery. This is particularly the case with Satellite AIS transmissions where latency is even measured in hours. OTHR tracks representing the paths of targets must be stored in the database in order to perform record matching with AIS data. Sometimes, it can be a repository with a long history due to high latency of AIS message delivery. History of OTHR tracks helps in overcoming this issue. The raw messages of AIS and OTHR networks (XML and text file respectively) are converted and imported into MySQL databases. This approach allows efficient data manipulation, storing and flexible searching of data by time, position or target ID. Data is organized into tables according to OTHR and AIS sensors. Both tables have attributes related to target ID (ID_Number for OTHR and MMSI for AIS), position (Longitude and Latitude), Course, Velocity and Timestamp of data creation.
After the data is loaded and stored into databases, the first step is pre-processing of OTHR tracks and AIS measurements. This stage involves data filtering and validation for the purpose of completing the state of information. First, it includes data filtering by time. When a new AIS message is received, algorithm deletes old and unneeded OTHR tracks (older than the oldest AIS record and beyond the message time frame). Second, OTHR covers a static (fixed) area, while the AIS continuously changes its covering area. This pre-processing activity is focused on filtering AIS records that are outside the coverage area of OTHR. It is based on geographical coordinates of the data (latitude and longitude). Third, in order to avoid matching of possibly false targets with real AIS data, the Tracker Confidence attribute in OTHR database is used as a criterion for elimination of unconfirmed targets. Tracker Confidence attribute describes reliability of OTHR data [11]. Then data validation is also done over filtered records due to possibility of several detections for the same target in OTHR and AIS databases. Because of data validation, additional logic is applied for analyzed tracks (i.e., OTHR targets with velocity exceeding maximal possible speed of movement (>30 m/s) are excluded). Finally, algorithm performs the data uniformity task. This means that reported radial velocity and azimuth (angle radar—target relative to true north (TN)) registered with OTHR sensor cannot be used for fusion. For that purpose, we use approximations of target course and velocity of OTHR tracks in order to use the same units of measurement for record matching with AIS data. In addition, timestamps are converted to seconds due to closeness calculation. All aforementioned steps are performed over MySQL databases using data extraction queries. The advantage of storing data in relational form is simplicity of data manipulation, keeping of long history of OTHR tracks and further processing.
In the second step, processing logic based on FFDs is applied in the pre-processed tables. Actually, the algorithm searches for a set of possible associating candidates for each AIS point (record). The parameter θ is calculated using Equation (2). In this way, for every AIS point we compute a list of candidates for integration. Finally, for every AIS record OTHR integration candidates are ranked by the strength of the dependency θ. We determined experimentally the threshold value of the parameter θ for finding AIS-OTHR pairs. The criteria of θ > 0.80 is applied.
Next step analyses results obtained in the previous activity: the association is done for a given pair of tracks based on the highest value of the parameter θ. The previous step is repeated for every new AIS message. If a pair of AIS and OTHR tracks within N cycles is found, then the algorithm confirms the association and passes the pair for fusion to it. Note that, despite the AIS point being treated as fused point, on every new appearance of AIS data, record matching and analyses of OTHR track candidates are repeated. This allows corrections in integration process and better resolution of difficulties and confusing situations (i.e., when multiple targets are close to each other).
In the last step, fused targets are marked as integrated pairs (ID_Number, MMSI). Association with an OTHR track is declared and AIS point is treated as the fused point.

5. Experiment and Discussion

In this section, the experimental results of the above proposed algorithm for data fusion between AIS and OTHR sensors are shown. As described in previous sections, the algorithm is triggered by reception of AIS message. Then the time frame of the AIS message is analyzed and data pre-processing is done in accordance with the steps for data filtering, validation and uniformity. It means that unnecessary (filtering by time) OTHR tracks are eliminated, AIS points outside the radar coverage area are not considered. Due to the absence of a strong regulatory institution, data provided by AIS can be of questionable quality (i.e., there are duplicate entries for the same targets). Before all aforementioned actions, we illustrate a picture of OTHR tracks and AIS targets as shown in Figure 2.
In Figure 2, the following situations can be recognized:
  • Target leaving the radar coverage area;
  • Target entering the radar coverage area;
  • AIS data outside of the radar coverage area;
  • Multiple targets reported by AIS inside of one radar resolution cell. This situation is quite regular since resolution cell can be very large in comparison to the vessel size. In the presented scenario’ two oil platforms with all corresponding vessels near them are shown. In practice, we mark these zones for a better understanding of maritime situation;
  • Vessels detected by OTHR, but not transmitting AIS data. Although this situation is rare in developed countries, in the Gulf of Guinee it is quite common and can present a security threat;
  • Vessels transmitting AIS data, but not detected by OTHR. This situation usually occurs when a smaller vessel delivers AIS data, although it may also present OTHR’s missed target (there is no sensor with 100% detection probability);
  • Vessels labeled as 7a, 7b, 7c, 7d and 7e in the radar coverage area represent successful data fusion between AIS and OTHR sensors. Fusion parameters are calculated for them and shown in Figure 3.
The white points in Figure 2 are potential detections generated by OTHR. A large number of detections is a consequence of a complex environment in which OTHR operates, which contains high amounts of radar clutter. A high amount of clutter causes a large number of false detections and possibly missed detections of real radar targets. In our case, the sea swell is the main cause of radar clutter seen between 5 and 40 km away, at azimuth angles of ±10°. External radio sources such as Radio Frequency Interference (RFI) are also seen in two directions: −20° and −45°. A group of false detections comes from ionospheric interference, 10 km to 20 km wide, at the latitude of about 5.5°, covering azimuth angles from 10° to 60°. The clutter elimination (filtering) is performed during the pre-processing step.
As an example, a vessel labeled as 7a in the Figure 2. will be used to demonstrate the fusion process. In order to calculate the dependency strength θ, it is necessary to predict velocity and course of OTHR tracks using approximation and average measurements. OTHR target speed is approximated based on the difference in the distance registered by the radar and the period of time detection (Δt = 33 s) for the two neighboring positions. Projected OTHR target velocity is equal to the average value of the approximate speed measures over an observed time frame. Approximation of the course for OTHR ships is calculated by using WGS84 terrestrial reference system. To demonstrate the calculation of the dependency strength θ, let us consider the following AIS and OTHR records given in Table 1 and Table 2 representing targets in Figure 2.
Using Equations (3)–(7) we calculate closeness between attributes of AIS target and OTHR track inside a defined time frame as shown in Table 3:
Finally, we compute the dependency strength of the FFD between records by using Equation (8):
θ = c t i m e + c l o n g + c l a t + c v e l + c c o u r s e 5 = 4.9127 5 = 0.9825
Iterating through all OTHR records and matching with pointed AIS target, we get a pair (ID_Number, MMSI) for possible association (the highest value of parameter θ). In our case, AIS target with MMSI = 636,091,031 and OTHR track with ID_Number = 9471 are candidates for fusion. In order to increase the possibility of correct matching, we repeat the procedure described for newly received AIS message and calculate the dependency strength in this iteration as well. The results of matching for the fused pairs or targets within a time frame of 1 h (from 16:33 h to 17:33 h) are shown in Figure 3.
In the described experiment, there were 20+ vessels with AIS data and 13 OTHR targets. After AIS data outside of OTHR coverage area were filtered out, only 13 vessels reported by AIS remained for possible fusion. Results of data fusion for vessels labeled as 7a, 7b, 7c, 7d and 7e are depicted in Figure 3. Time axis provides more informative maritime picture. By using the MMSI code it is possible to obtain detailed information about the ship [27] as shown in Figure 4. It is important to note that cases 7b and 7c from Figure 2 are also represented as recognized targets and all the data are fused accordingly despite a significant AIS latency (7c) and later OTHR detection (7b). This is illustrated in Figure 3 where AIS message latency of a detected vessel is indicative (cyan squares) and first OTHR detections of vessel labeled as 7b were received long after the reception of AIS data (white squares). It is interesting to consider the fusion in the case of vessel labeled as 7e. The AIS target is fused with two different OTHR tracks due to the interruption of OTHR detection (blue squares in Figure 3). Since all objects around oil platforms are detected by OTHR as one, the OTHR track can be fused with only one AIS with the most likely attributes, while the other AIS will remain unfused. This should be marked for the operators of the maritime monitoring system.
AIS data that cannot be associated with any of the OTHR tracks will also stay unfused as well as OTHR tracks which cannot be associated with any AIS data (non-cooperative targets that pose potential threats). After all processing is done, complete operational picture in the OTHR coverage area is shown in Figure 5. It is worth mentioning that maritime situation presented in Figure 5 is formed after 4 h of collecting and processing data delivered by available sensors.
There are critical and confusing situations such as when multiple targets are close to each other, which present a real challenge for any fusion procedure. In our work, we suggest an algorithm designed to autocorrect faulty AIS-OTHR fusion candidates through repeated iterations. This autocorrection happens when targets are moving away from each other. On the other hand, when there are multiple non-moving targets in small areas, usually in front of harbors and oil platforms, the finite resolution of OTHR prevents proper detection of vessels. Operators usually consider such OTHR detections as redundant or unnecessary. These areas are marked as illustrated in Figure 5 and often excluded from OTHR tracking. Furthermore, the correctness of fusion can be tested by estimating the AIS target’s radar cross-section parameter, based on its position and orientation with respect to OTHR, as well as the ship size information, available from third-party sources. By comparing the measured Signal-to-Noise (SNR) of OTHR detection with pre-set experimental tables, it is possible to estimate the ship size class and perhaps to resolve to which AIS target the observed OTHR track is most likely to be associated. Thus, intensive research will be needed in future.
Figure 5 illustrates a complete maritime picture at OTH distances in the OTHR coverage area.

6. Conclusions

In this article, a method of fusing information obtained from AIS and OTHR sensors based on the fuzzy functional dependency approach has been presented. We describe a computational algorithm that focuses on the fuzzy decision making technique. It associates OTHR target tracks with available AIS ID records within the observed message time frame. Actually, the algorithm computes the record matching based on fuzzy dependency between AIS data and OTHR tracks. As shown, a number of iterations which take into account the similarity between database tuples, increases the odds for correct data fusion. This novel fuzzy-based method reveals the complementarity of two different sensors and enhances their integration. The integrated information provides a more informative maritime situational awareness. The reception of the AIS message is unsteady, especially in case of satellite transmission, causing difficulty in data fusion and analysis, as well as missing information. OTHR tracks not being fused with any AIS data can be identified as non-cooperative targets. Identification of these targets is a matter of future consideration. The performance of the proposed algorithm has been evaluated using real data. The experiment has shown promising results.
Future work is intended for applying this method to a larger-scale application problem (multiple OTHRs and multiple AIS sources covering a much larger geographical area). In addition, the application of decision-making theory is recognized as a possible direction for the method improvement.

Author Contributions

Conceptualization, M.A.R.M.M. and M.V.; methodology, M.V.; formal analysis, M.A.R.M.M.; investigation, N.S. and N.L. resources, N.S. and A.M.; data curation, M.V.; writing—original draft preparation, M.A.R.M.M. and M.V.; writing—review and editing, M.V. and A.M.; visualization, N.L.; project administration, N.L.

Funding

This research was funded by Vlatacom Institute. The APC was funded by Vlatacom Institute.

Conflicts of Interest

The authors declare no conflict of interest

References

  1. Sevgi, L.D.; Ponsford, A.M. An HF Radar Base Integrated Maritime Surveillance System. In Proceedings of the 3rd International Multiconference IMACS/IEEE CSCC’99, Athens, Greece, 4–8 July 1999; pp. 5801–5806. [Google Scholar]
  2. Anderson, S.J. Optimizing HF Radar Siting for Surveillance and Remote Sensing in the Strait of Malacca. IEEE Trans. Geosci. Remote Sens. 2013, 51, 1805–1816. [Google Scholar] [CrossRef]
  3. Braca, P.; Maresca, S.; Grasso, R.; Bryan, K.; Hortsmann, J. Maritime surveillance with multiple over-the-horizon HFSW radars: An overview of recent experimentation. IEEE Aerosp. Electron. Syst. Mag. 2015, 30, 4–18. [Google Scholar] [CrossRef]
  4. Ding, Z.; Kannappan, G.; Benameur, K.; Kirubarajan, T.; Farooq, M. Wide area integrated maritime surveillance: An updated architecture with data fusion. In Proceedings of the 6th International Conference of Information Fusion–FUSION 2003, Cairns, Australia, 8–11 July 2003; pp. 1324–1333. [Google Scholar]
  5. Cimino, G.; Arcieri, G.; Horn, S.; Bryan, K. Technical Report CMRE-FR-2014-017, Sensor Data Management to Achieve Information Superiority in Maritime Situational Awareness; NATO Science and Technology Organization Centre for Maritime Research and Experimentation: La Spezia, Italy, 2014. [Google Scholar]
  6. Dzvonkovskaya, A.; Gurgel, K.-W.; Rohling, H.; Schlick, T. Low power high frequency surface wave radar application for ship detection and tracking. In Proceedings of the Radar 2008 Conference, Adelaide, Australia, 16–18 April 2008; pp. 654–659. [Google Scholar]
  7. Dzvonkovskaya, A.; Rohling, H. HF Radar Performance Analysis Based on AIS Ship Information. In Proceedings of the IEEE Radar Conference, Washington, DC, USA, 10–14 May 2010; pp. 1239–1244. [Google Scholar]
  8. Nikolic, D.; Stojkovic, N.; Popovic, Z.; Tosic, N.; Lekic, N.; Stankovic, Z.; Doncov, N. Maritime Over the Horizon Sensor Integration: HFSWR Data Fusion Algorithm. Remote Sens. 2019, 11, 852. [Google Scholar] [CrossRef]
  9. Stojković, N.; Nikolić, D.; Džolić, B.; Tošić, N.; Orlić, V.; Lekić, N.; Todorović, B. An Implementation of Tracking Algorithm for Over-The-Horizon Surface Wave Radar. In Proceedings of the Telfor 2016, Belgrade, Serbia, 22–23 November 2016. [Google Scholar]
  10. Radio Noise. Recommendation ITU-R P. 372-13; CCIR: Geneva, Switzerland, 2016. [Google Scholar]
  11. Nikolic, D.; Stojkovic, N.; Lekic, N. Maritime over the Horizon Sensor Integration: High Frequency Surface-Wave-Radar and Automatic Identification System Data Integration Algorithm. Sensors 2018, 11, 1147. [Google Scholar] [CrossRef]
  12. Chang, L.; Xiaofei, S. Study of Data Fusion of AIS and Radar. In Proceedings of the International Conference of Soft Computing and Pattern Recognition, Malacca, Malaysia, 4–7 December 2009; pp. 674–677. [Google Scholar] [CrossRef]
  13. Jidong, S.; Xiaoming, L. Fusion of Radar and AIS Data. In Proceedings of the 7th International Conference on Signal Processing ICSP’O4, Bejing, China, 31 August–4 September 2004; pp. 2604–2607. [Google Scholar] [CrossRef]
  14. Xiaorui, H.; Changchuan, L. A Preliminary Study on Targets Association Algorithm of Radar and AIS Using BP Neural Network. Procedia Eng. 2011, 15, 1441–1445. [Google Scholar] [CrossRef]
  15. Jiachun, Z.; Zongheng, C. A Study of Radar and AIS Object Data Fusion Based on AFS_RBF’s Neural Network. J. Jimei Univ. Nat. Science 2005, 10, 216–220. [Google Scholar]
  16. Shenoi, S.; Melton, A. Proximity relations in the fuzzy relational database model. Fuzzy Sets Syst. 1989, 100, 51–62. [Google Scholar] [CrossRef]
  17. Caruccio, L.; Deufemia, V.; Polese, G. Relaxed Functional Dependencies—A Survey of Approaches. IEEE Trans. Knowl. Data Eng. 2016, 28, 147–165. [Google Scholar] [CrossRef]
  18. Bohannon, P.; Fan, W.; Geerts, F.; Jia, X.; Kementsietsidis, A. Conditional Functional Dependencies for Data Cleaning. In Proceedings of the IEEE 23rd International Conference on Data Engineering, Istanbul, Turkey, 11–15 April 2007; pp. 746–755. [Google Scholar]
  19. Fan, W.; Gao, H.; Jia, X.; Li, J.; Ma, S. Dynamic constraints for record matching. VLDB J. 2011, 20, 495–520. [Google Scholar] [CrossRef]
  20. Nambiar, U.; Kambhampati, S. Mining approximate functional dependencies and concept similarities to answer imprecise queries. In Proceedings of the 7th International Workshop Web Databases, Paris, France, 17–18 June 2004; pp. 73–78. [Google Scholar]
  21. Hudec, M.; Vučetić, M.; Vujošević, M. Comparison of linguistic summaries and fuzzy functional dependencies related to data mining. In Biologically-Inspired Techniques for Knowledge Discovery and Data Mining; Alam, S., Dobbie, G., Koh, Y.S., Rehman, S., Eds.; IGI Global: Hershey, PA, USA, 2014; pp. 174–203. ISBN 1466660783. [Google Scholar]
  22. Chen, G.; Kerre, E.E.; Vandenbulcke, J. Normalization based on fuzzy functional dependency in a fuzzy relational data model. Inf. Syst. 1996, 21, 299–310. [Google Scholar] [CrossRef]
  23. Vučetić, M.; Vujošević, M. A literature overview of functional dependencies in fuzzy relational database models. Tech. Technol. Educ. Manag. 2012, 7, 1593–1604. [Google Scholar]
  24. Vucetic, M.; Hudec, M.; Vujošević, M. A new method for computing fuzzy functional dependencies in relational database systems. Expert Syst. Appl. 2013, 40, 2738–2745. [Google Scholar] [CrossRef]
  25. Sözat, M.I.; Yazici, A. A complete axiomatization for fuzzy functional and multivalued dependencies in fuzzy database relations. Fuzzy Sets Syst. 2001, 117, 161–181. [Google Scholar] [CrossRef]
  26. ITU Recommendation. M.585–7. Assignment and Use of Identities in the Maritime Mobile Service; ITU: Geneva, Switzerland, March 2015. [Google Scholar]
  27. Ships Database. Available online: https://www.marinetraffic.com/sr/ais/details/ships/shipid:757561 (accessed on 2 October 2019).
Figure 1. Algorithm for the fusion of automatic identification system (AIS) data and over-the-horizon radar (OTHR) tracks.
Figure 1. Algorithm for the fusion of automatic identification system (AIS) data and over-the-horizon radar (OTHR) tracks.
Sensors 19 05166 g001
Figure 2. Maritime situation of the OTHR coverage area with reported AIS data in the Gulf of Guinea site (yellow—OTHR targets, red—AIS points, white—radar clutter).
Figure 2. Maritime situation of the OTHR coverage area with reported AIS data in the Gulf of Guinea site (yellow—OTHR targets, red—AIS points, white—radar clutter).
Sensors 19 05166 g002
Figure 3. Results obtained for targets association over repeated iterations. Time interval from 16:33 h to 17:33 (3600 s).
Figure 3. Results obtained for targets association over repeated iterations. Time interval from 16:33 h to 17:33 (3600 s).
Sensors 19 05166 g003
Figure 4. Fused AIS point with OTHR track—Dafne ex Emirates Asante [27].
Figure 4. Fused AIS point with OTHR track—Dafne ex Emirates Asante [27].
Sensors 19 05166 g004
Figure 5. The results of experiment—complete operational picture for maritime surveillance (yellow—OTHR targets, red—AIS points, blue—fused data).
Figure 5. The results of experiment—complete operational picture for maritime surveillance (yellow—OTHR targets, red—AIS points, blue—fused data).
Sensors 19 05166 g005
Table 1. AIS point.
Table 1. AIS point.
MMSIUTC TimeLatitude (deg)Longitude (deg)Course (deg)Velocity (m/s)
636,091,03116:48:10
(60,490 s)
6.1424353.229788247.19.36
Table 2. OTHR track.
Table 2. OTHR track.
ID_NumberUTC TimeLatitude (deg)Longitude (deg)Course (deg)Velocity (m/s)
947116:48:05
(60,485 s)
6.1288103.234660248.689.77
Table 3. Closeness between AIS and OTHR attribute values.
Table 3. Closeness between AIS and OTHR attribute values.
ctimeclatclongccoursecvel
0.99860.99790.9990.95820.959

Share and Cite

MDPI and ACS Style

Mohamed Mostafa, M.A.R.; Vucetic, M.; Stojkovic, N.; Lekić, N.; Makarov, A. Fuzzy Functional Dependencies as a Method of Choice for Fusion of AIS and OTHR Data. Sensors 2019, 19, 5166. https://doi.org/10.3390/s19235166

AMA Style

Mohamed Mostafa MAR, Vucetic M, Stojkovic N, Lekić N, Makarov A. Fuzzy Functional Dependencies as a Method of Choice for Fusion of AIS and OTHR Data. Sensors. 2019; 19(23):5166. https://doi.org/10.3390/s19235166

Chicago/Turabian Style

Mohamed Mostafa, Medhat Abdel Rahman, Miljan Vucetic, Nikola Stojkovic, Nikola Lekić, and Aleksej Makarov. 2019. "Fuzzy Functional Dependencies as a Method of Choice for Fusion of AIS and OTHR Data" Sensors 19, no. 23: 5166. https://doi.org/10.3390/s19235166

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop