Next Article in Journal
Single Step 2-Port Device De-Embedding Algorithm for Fixture-DUT-Fixture Network Assembly
Previous Article in Journal
Secured Big Data Analytics for Decision-Oriented Medical System Using Internet of Things
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Feature Evaluation and Comparison in Radar Emitter Recognition Based on SAHP

1
Nanjing Research Institute of Electronics Technology, Nanjing 210039, China
2
School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China
*
Author to whom correspondence should be addressed.
Electronics 2021, 10(11), 1274; https://doi.org/10.3390/electronics10111274
Submission received: 27 February 2021 / Revised: 30 April 2021 / Accepted: 15 May 2021 / Published: 27 May 2021
(This article belongs to the Section Computer Science & Engineering)

Abstract

:
In the field of radar emitter recognition, with the wide application of modern radar, the traditional recognition method based on typical five feature parameters cannot achieve satisfactory recognition results in a complex electromagnetic environment. Currently, many new feature extraction methods are presented, but few approaches have been applied for feature evaluation or performance comparison. To deal with this problem, a feature evaluation and selection method was proposed based on set pair analysis (SPA) theory and analytic hierarchy process (AHP). The main idea of this method is to use SPA theory to solve problems regarding the construction of the decision matrix based on AHP, as it relies heavily on expert’s subjective experience. The aim was to improve the objectivity of the evaluation. To check the effectiveness of the proposed method, six feature parameters were selected for a comprehensive performance evaluation. Then, the convolutional neural network (CNN) was introduced to validate the recognition capability based on the evaluation results. Simulation results demonstrated that the proposed method could achieve the feature analysis and evaluation more reasonably and objectively.

1. Introduction

In modern warfare, radar emitter recognition is an important part of an electronic support system (ESM). The recognition level has become an important symbol by which to measure the technology level of the reconnaissance equipment [1,2]. With the rapid development of new radar technology and the wide use of modern radar, the electromagnetic environment is becoming more and more complex. The traditional recognition methods are based on the typical five parameters, which include radio frequency (RF), pulse repetition interval (PRI), pulse width (PW), angle of arrival (AOA), and pulse amplitude (PA). However, the traditional recognition methods cannot meet the needs of emitter recognition in current radar signal environment with the attributes of high density, high complex waveforms, and broadband spectrum agility [3,4,5]. Therefore, many experts and scholars have made great efforts to find new features to compensate for the shortcomings of the typical five parameters. In recent studies, many new features have been successfully applied in emitter recognition, such as entropy [6], resemblance coefficient [7], dual spectrum features [8,9], fingerprint characteristics [10], and so on. However, in face of multiple features, how to evaluate and choose these features are the urgent problems to be solved in practical emitter recognition.
Currently, many performance evaluation methods on emitter signals recognition have been successfully applied, such as the technique for order preference by similarity to ideal solution (TOPSIS) [11], intuitionistic fuzzy network [12], the relative entropy, and elimination choice translation methods [13]. These methods can obtain a reasonable evaluation order of the effectiveness evaluation on emitter signals recognition. However, there is little research on the evaluation of emitter signal features. Therefore, it becomes important to seek the method for emitter signal feature evaluation. The analytic hierarchy process (AHP) [14,15,16] is a systematic analysis method applied on feature evaluation extensively. It can transform the unstructured description of a complex problem to a structured description effectively. Meanwhile, it is a powerful tool to study the decision-making problems of complex systems with multiple objectives, criteria, and attributes. Zhu et al. [17] proposed a method of radar emitter feature evaluation based on the AHP theory. In [17], the decision matrix is constructed by the expert scoring to obtain the evaluation order of the emitter signal features. Xu et al. [18] proposed a radar emitter signal feature evaluation method based on AHP-interval-TOPSIS. The purpose of this method is to minimize the subjectivity of the decision matrix construction. These evaluation methods based on AHP provide a new perspective for feature evaluation. However, both of them have two common problems. One is that the method relies on the expert’s subjective experience excessively in the processing of the decision matrix construction. The second is the feature parameters uncertainty of the measured radar emitter signals. Due to the complex electromagnetic environment and types of jammings, the measured feature parameters always have distortions compared to their true values. These problems bring about many difficulties to feature evaluation in emitter recognition.
Aiming at the problems of feature evaluation methods based on the AHP mentioned above, a new feature evaluation method is proposed combining set pair analysis (SPA) [19,20] and AHP in this paper. This approach adopts SPA to construct the decision matrix, which makes full use of the advantages of SPA theory in describing the certainty and uncertainty of the set. It can improve the objectivity of the decision matrix and scientific index weight setting. In order to validate the effectiveness of the proposed method, six features were selected for comprehensive evaluation. Then, the CNN classifier was introduced to check the recognition capability based on the evaluation results. Simulation results show that the proposed method is effective and feasible. It can achieve the feature evaluation more objectively.
The rest of this paper is organized as follows. In Section 2, the algorithm of the feature evaluation based on AHP is given, and the feature evaluation model is constructed in terms of the practical application of emitter recognition. In Section 3, the principle of SPA theory is introduced to construct the comprehensive evaluation of the decision matrix. Section 4 features comprehensive evaluations that are carried out based on the set pair analytic hierarchy process (SAHP). Then, the CNN classifier is utilized to validate the recognition performance based on the evaluated features. Finally, conclusions are drawn in Section 5.

2. Algorithm of Feature Evaluation by AHP

The main idea of the feature evaluation algorithm based on AHP is using the AHP to establish the feature evaluation model, then constructing the judgment matrix to determine the weight of each of the features to be evaluated. The specific implementation steps of the feature evaluation method by AHP are given as below.
Step 1: Build a feature evaluation model.
In this paper, the feature evaluation model includes three layers: the target layer, criteria layer, and index layer. The target layer is the feature to be evaluated. The criteria layer is the criterion for evaluating this feature. According to the practical application of emitter recognition, the evaluated feature needs to have the advantages of simple operation, high accuracy, and strong noise immunity. Thus, complexity, accuracy, and robustness are taken as the evaluation criterions in the criteria layer. In the index layer, seven indexes are selected to describe the feature-specific performance. These indexes are time complexity, spatial complexity, recognition accuracy, separation between clusters, compactness within cluster, noise immunity, and stability.
A model of the feature evaluation system can be show in Figure 1.
Step 2: Construct the judgment matrix in each layer.
The judgment matrix is constructed according to the Saaty-relative importance hierarchy table [17,21]. The Saaty-relative importance hierarchy table is shown in Table 1.
Step 3: Calculate the weight of the judgment matrix, and then check the consistency of the judgment matrix.
For checking the consistency, the compatibility index (CI), random consistency index (RI), and compatibility ratio (CR) proposed in [17] have been introduced.
C I = ( λ max n ) ( n 1 )
C R = C I R I
where λ max denotes the maximum eigenvalue of the judgment matrix, n denotes the order of the judgment matrix, CI is the compatibility index, and RI is the random consistency index.
According to [21], the relationship between n and RI is given as below: when n = 2, RI = 0; when n = 3, RI = 0.58; when n = 4, RI = 0.96.
The rules of consistency testing are as follows. If CR < 0.1, the judgment matrix can be accepted. If CR ≥ 0.1, the judgment matrix should be readjusted in step 2 until it meets the rules of the consistency testing (CR < 0.1).
Step 4: Calculate the weight of each indexes in the criteria layer and index layer.

3. Algorithm of Feature Evaluation by SAHP

3.1. Principle of SPA

Set pair analysis (SPA) [22,23,24] is a new method for processing the certainty and uncertainty problem. It has been widely used in mathematics, physics, and many other fields. The key idea of SPA is using the connection function to describe the identities, differences and opposites of two sets (set A and set B) in a set pair. The connection function of set A and set B can be expressed as below.
U A B = S N + F N i + P N j
where S, F, and P denote the number of the identities, the difference, and opposites, N is the total number of set pair features, N = S + F + P. i is the difference coefficient, i [ 1 , 1 ] . j denotes the inverse coefficient, j = 1 .
Define a = S N , b = F N , c = P N ; Then, a, b, and c are called the identical degree, the difference degree, and the opposite degree between set A and set B.
In Equation (3), the connection function of the set pair can be seen and can describe the certainty and uncertainty. Where S and P are certainty, F is uncertainty. As specified in radar emitter recognition, as the electromagnetic environment is complex, the parameters of the emitter signals measured are always an uncertainty. Therefore, it is feasible to use SPA theory to evaluate the features of the emitter signals.

3.2. Feature Evaluation Based on SAHP

The SAHP algorithm, primarily founded on SPA and AHP, uses the AHP to get the weight vector of each layer. Then, SPA theory is introduced to solve the issue regarding heavy reliance on an expert’s subjective experience in the feature comprehensive evaluation based on AHP. As mentioned above, SPA theory is adopted to build a new decision matrix to improve the objectivity of the evaluation. It is noted that in the following text, constructing the decision matrix is mainly based on the identity between the measurement values and the true values of different features, not on the difference and opposites of the set pair.
The steps of constructing the decision matrix based on SPA are given as below.
Step 1: Build the model of decision matrix D
Suppose F is the target scheme set and X is the index set of the evaluated feature, then the mapping relationship between F and X is shown as below.
F = X · D
where F i = ( f 1 , f 2 , , f n ) , i = 1 , 2 , , n . X j = ( x 1 , x 2 , , x m ) , j = 1 , 2 , , m . n is the total number of the features. m is the total number of the evaluated indexes. D is the decision matrix given, which is given as below.
D = [ d 11 d 12 d 1 n d 21 d 22 d 2 n d m 1 d m 2 d m n ]
where d i j denotes the attribute mapping between the true value and the measured value on the ith feature of the jth index.
Step 2: Establish the evaluation scheme of decision matrix D
Suppose T = ( T 1 , T 2 , , T n ) is the optimal solution of the feature to be evaluated. When the index in decision matrix D is considered as the profitability index, T i is defined as T i = max ( d i j ) . On the contrary, when the index in decision matrix D is considered as the cost index, T i is defined as T i = min ( d i j ) .
Step 3: Analyze the identity of decision matrix D.
The identical degree matrix ξ = ( S i j ) m × n is constructed by computing the identical degree of the different indexes between the scheme set F and the optimal scheme set T. When the index is considered as the profitability index, S i j is defined as S i j = d i j / T i . While the index is considered as the cost index, S i j is defined as S i j = T i / d i j .
Step 4: Calculate the comprehensive evaluation results of the evaluated features.
According to the feature evaluation method by AHP, W = ( ω 1 , ω 2 , , ω m ) in the index layer can be obtained. Then, the comprehensive evaluation decision matrix E can be computed as below:
E = ( ω 1 , ω 2 , , ω m ) · [ S 11 S 12 S 1 n S 21 S 22 S 2 n S m 1 S m 2 S m n ]
where E is the comprehensive evaluation degree vector of all features to be evaluated.

4. Simulation

In this section, two simulations are presented to verify the validity and correctness of the proposed method. One uses SAHP to evaluate the comprehensive performance of each feature, compared with those by AHP. The second uses the evaluated features based on SAHP to check the effectiveness of the radar emitter recognition. In these two simulations, the features selected to be evaluated are the RF, PRI, PW, AOA, resemblance coefficient feature (RCF) in [25], and coherent feature (CF) in [26].

4.1. Validation of Features Evaluation Algorithm by SAHP

4.1.1. Weight Vector Calculation

From Figure 1 and Table 1, the judgment matrices (A, B1, B2, and B3) can be constructed as below:
A = [ 1 1 / 6 1 / 4 6 1 3 4 1 / 3 1 ]
B 1 = [ 1 3 1 / 3 1 ]       B 2 = [ 1 5 7 1 / 5 1 2 1 / 7 1 / 2 1 ]       B 3 = [ 1 1 / 2 2 1 ]
where a 12 = B 1 / B 2 = 1 / 6 denotes the influence of complexity on the feature evaluation is clearly weaker than that of the accuracy. B 12 = C 1 / C 2 = 3 denotes that the influence of time complexity is slightly more important on the feature evaluation than that of the spatial complexity. The meaning of other elements in matrices A, B1, B2, and B3 can be deduced in the same way.
The maximum eigenvalue and the normalized eigenvector of the judgment matrix A can be computed as below.
λ max = 3.0536 ,   ω A = [ 0.0852   0.6442   0.2706 ]
For the judgment matrix A, the order is 3. According to Equations (1) and (2), C I A and C R A can be computed as below.
C I A = 0.0268 ,   C R A = 0.0462
where C R A < 0.1 , it denotes that the judgment matrix A can meet the rules of consistency testing.
The weight of B1, B2, and B3 can be computed in the same way. The results are listed in Table 2.
In Table 2, the last column is the weights of each index in the index layer. The weights are W = (0.0639, 0.0213, 0.4746, 0.1107, 0.0623, 0.0902, 0.1804).

4.1.2. Feature Evaluation based on AHP

The comprehensive score of the evaluated features based on AHP can be computed as below:
W i = i = 1 m w · k i
where m is total number of the indexes, w is the weight of ith index, k i is the score of ith index by the expert scoring standard, i = 1 , 2 , , m . According to [17], the expert scoring standard is listed in Table 3.
The comprehensive evaluation results of each feature based on AHP are listed in Table 4.
From Table 4, it can be seen that the final score order of six features is CF > RCF > RF > PRI > AOA > PW.

4.1.3. Feature Evaluation Based on SAHP

As mentioned above, the difference between two algorithms is the construction method of the decision matrix. In the feature evaluation algorithm by AHP, the decision matrix is constructed according to the expert’s scoring. While in the feature evaluation algorithm by SAHP, the decision matrix is constructed according to quantitative analysis between the true dates and the measured dates. Quantitative analyses [27] of each index by SAHP are given as follows.
(1) Time complexity (C1). The mean value of the feature extraction time in different signal-to-noise ratios (SNRs) is utilized to describe the time complexity.
(2) Computational complexity (C2). This is measured by the resource consumption in the feature extraction.
(3) Recognition accuracy (C3). This is measured by the recognition accuracy of the feature in signal sorting.
(4) Separation among clusters (C4). This is measured by the probability of combined batches on the feature used for emitter signal sorting. The lower probability of combined batches for signal sorting, the higher separation of the clusters.
(5) Compactness within the cluster (C5). Considering the overlapping distribution of the signal features, the sum of the Euclidean distance among all samples in signal feature distribution is used to reflect the compactness within the cluster of the feature. The smaller the sum of Euclidean distance, the higher separation within the cluster.
(6) Noise immunity (C6) is calculated as follows. The parameters of the evaluated feature are measured across different SNRs (from 0 to 15 dB, every 3 dB) and the mean value of them is computed. Then, the Euclidean distance of all mean values are added to describe the jumping of the feature value across different SNRs, and the Euclidean distance is utilized to describe the performance of noise immunity.
(7) Stability (C7). This is the adaptability of the feature in different scenarios. It can be measured by the measurement error of different signal types in the same SNR.
Four types of signals are taken as the simulation experiment signals. There signals are continuous wave (CW) signal, linear frequency modulation (LFM) signal, binary phase shift keying (BPSK) signal, and quad-phase shift keying (QPSK) signal. The decision matrix is constructed as below.
D = [ 0.1 1.5 0.3 2.1 37 52 0.13 0.21 0.09 0.16 0.54 0.52 0.928 0.93 0.884 0.922 0.937 0.948 4160.3 3522.2 2248.1 3132.8 5532.3 5928.4 93.7 118.1 245.6 92.9 88.3 107.8 0.26 0.27 0.35 0.30 0.24 0.23 0.98 0.78 0.75 0.83 0.64 0.56 ]
The evaluation scheme of decision matrix is as follows. The recognition accuracy (C3) and the separation between clusters (C4) of the feature are defined as the profitability index, while the others are defined as the cost index. The target scheme set of feature evaluation can be computed as below.
T = ( 0.1 , 0.13 , 0.948 , 5928.4 , 88.3 , 0.23 , 0.56 )
The identical degree matrix can be computed as below.
ξ = [ 1 0.0667 0.0333 0.4762 0.0027 0.0019 0.6923 0.4285 1 0.5625 0.1667 0.1731 0.9789 0.9810 0.9325 0.9725 0.9884 1 0.7018 0.5941 0.3792 0.5284 0.9331 1 0.9424 0.7477 0.3595 0.9505 1 0.8191 0.8846 0.8518 0.6571 0.7667 0.9583 1 0.5714 0.7180 0.7467 0.6747 0.8750 1 ]
According to Equation (8), the comprehensive evaluation decision matrix can be computed as below.
E = ( 0.8625 , 0.7977 , 0.7435 , 0.7852 , 0.8827 , 0.9107 )
Simulations are carried out based on a dual core processor. The main frequency of the processor is 4 GHz and the memory is 16 GB. The evaluation results based on SAHP are shown in Table 5. Meanwhile, these are also compared with the evaluation results based on AHP.
From Table 5, it can be seen that the evaluation results of each feature based on AHP and SAHP are different in numerical value. However, the ranks of each weight based on the two methods are the same. In the feature evaluation algorithm by SAHP, each element in the decision matrix is calculated according to the practical experimental dates. Thus, it is more reasonable and objective in the feature evaluation.

4.2. Emitter Recognition Based on the Evaluated Features

In order to check the effectiveness of the feature evaluation results based on SAHP, the convolutional neural network (CNN) classifier is taken for radar emitter recognition. Four features are selected respectively to form one-dimensional, two-dimensional, three-dimensional, and four-dimensional feature vectors for the classifier. These features are RF, PRI, RCF, and CF. The structure diagram of CNN [28] in this experiment is shown in Figure 2.
In this experiment, a CNN with an optimized 5C-2S-7C-2S network is employed according to [29]. The optimized parameters of the CNN are C1 = 5, S2 = 2, C3 = 7, and S4 = 2. The training parameters of the CNN are as below. The training is iterated five times, the training data is divided into three segments, the learning rate is 0.01, the weight decay is 0.0005, and the momentum constant is 0.8.

4.2.1. Performance Evaluation of Simulation 1

Simulation 1: Three radar emitters were utilized to check the recognition capability based on the evaluation results. The working mode of three emitters was the same: PRI staggering. All testing samples were taken from the emitter sample repository. Signal parameters are listed in Table 6.
In Simulation 1, 240 samples were utilized for training and 120 samples were taken for testing. The recognition results by the CNN in different SNRs are shown in Table 7.
As shown in Table 7, when a one-dimensional feature is used for emitter recognition, the recognition accuracy based on the CF feature is the highest. When the multi-dimensional features are utilized for recognition, it can be found that if the feature vector contains the CF feature, the recognition accuracy is obviously higher than the feature vector without the CF feature. That is, the CF feature has the higher recognition accuracy. Simulation results are consistent with the qualitative analysis results.

4.2.2. Performance Evaluation of Experiment 2

Simulation 2: Three radar emitters with different working modes were utilized to evaluate the recognition capability based on the evaluation results. The working mode of emitter1 is PRI staggering. The working mode of emitter2 is frequency agility. The working mode of emitter3 is PRI jittering. All testing samples were taken from the emitter sample repository. The signal parameters of three emitters are listed in Table 8.
In simulation 2, 360 samples were utilized for training and 240 samples were taken for testing. The recognition results of the different feature vectors based on CNN in different SNRs are shown in Figure 3.
From Figure 3, we can observe that the recognition results are similar to the recognition results in Table 7. When the feature vector contains the CF feature, the recognition accuracy was significantly improved. Therefore, we can conclude that the proposed feature evaluation method by SAHP is effective in this paper.

5. Conclusions

This paper proposes a new feature evaluation method based on SAHP, which combines the SPA theory with AHP. The main idea of the proposed method is to use the SPA theory to establish the decision matrix. This can improve the objectivity of the decision matrix in comparison to the AHP algorithm. Simulations were carried out to verify the validity of the proposed feature evaluation method. Through the simulation results, it can be concluded that the proposed method can not only achieve the feature evaluation more objectively, but it can also provide a new idea for feature comparison and evaluation in radar emitter recognition. Nevertheless, the computation amount of the proposed method is larger than that of the evaluation algorithm by AHP. In further work, the model of constructing the decision matrix based on the SAHP will be optimized to reduce the calculation complexity. Meanwhile, many other features will be taken to be evaluated to verify the robustness of the proposed method.

Author Contributions

Conceptualization, L.J., M.H. and X.Z.; methodology, J.X. and Y.G.; software, J.X. and L.T.; validation, J.X. and Y.G.; formal analysis, J.X.; investigation, L.J. and M.H.; resources, J.X.; data curation, J.X., L.T. and Y.G.; writing—original draft preparation, J.X.; writing—review and editing, X.Z.; visualization, J.X.; supervision, Y.G.; project administration, J.X. and L.T.; funding acquisition, L.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key R&D Program of China (2019YFE0113200) and the National Natural Science Foundation of China under grants 62072229, 62071220, 61976113 and U1936201.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Satija, U.; Trivedi, N.; Biswal, G.; Ramkumar, B. Specific emitter identification based on vibrational mode decomposition and spectral features in signal hop and relaying scenarios. IEEE Trans. Inf. Forensics Secur. 2019, 14, 581–591. [Google Scholar] [CrossRef]
  2. Zhai, Y.T.; Fang, S.J.; Cheng, Z.X. Radar Emitter Recognition Based on Ambiguity Function Contour Plot. In Proceedings of the 2019 IEEE 7th International Conference on Computer Science and Network Technology (ICCSNT), Dalian, China, 19–20 October 2019; pp. 232–235. [Google Scholar]
  3. Gao, X.Y.; Zhang, W.B.; Ji, H.B.; Ou, Y.C. New radar emitter identification method. J. Image Graph. 2020, 25, 1171–1179. [Google Scholar]
  4. Zhou, Z.W.; Huang, G.M.; Wang, X.B. Specific emitter identification based on joint collaborative representation. Syst. Eng. Electron. 2019, 41, 724–729. [Google Scholar]
  5. Pan, Y.W.; Yang, S.H.; Peng, H.; Li, T.Y.; Wang, W.Y. Specific Emitter Identification Using Signal Trajectory Image. J. Electron. Inf. Technol. 2020, 42, 941–949. [Google Scholar]
  6. Bai, H.; Zhao, Y.J.; Shen, W.; Xu, Y.G. Radar emitter recognition based on rényi entropy of time-frequency distribution. J. Circuits Syst. 2013, 18, 437–442. [Google Scholar]
  7. Zhang, G.X.; Jin, W.D.; Hu, L.Z. Resemblance Coefficient Based Feature Selection Algorithm for Radar Emitter Signal Recognition. Signal Process. 2005, 21, 663–667. [Google Scholar]
  8. Gui, Y.C.; Yang, J.A.; Wang, J. A Transmitter Recognition Algorithm Based on Dual Spectrum Feature Fusion. J. Detect. Control 2016, 38, 91–95. [Google Scholar]
  9. Ren, D.F.; Zhang, T.; Han, J. Communication Emitter Identification Based on Bi-spectrum and Feature Selection. J. Inf. Eng. Univ. 2018, 19, 410–415. [Google Scholar]
  10. Zhang, M.; Luo, Z.H.; Huang, J.G.; Sui, C.Y.; Zhang, Z.X. A Fingerprint Extraction Method Based on I/Q Imbalance. Acta Electron. Sin. 2020, 48, 717–722. [Google Scholar]
  11. Xu, J.; He, M.H.; Yu, C.L. Effectiveness Evaluation of Radar Emitter Signal Recognition Based on I2TOPSIS. J. Signal Process. 2015, 31, 253–258. [Google Scholar]
  12. Liu, M.Q.; Meng, Y.; Zhang, W.D. Method for comprehensive evaluation of effectiveness of radar emitter signal recognition. J. Xidian Univ. 2019, 46, 1–8. [Google Scholar]
  13. Yang, Z.; He, M.H.; Han, J.; Zhang, Z. Effectiveness evaluation of radar emitter signal recognition based on RE-ELECTRE. J. Air Force Early Warn. Acad. 2017, 31, 85–89. [Google Scholar]
  14. Wang, H.; He, M.H.; Xu, J. Performance evaluation for radar signal recognition based on AHP. In Proceedings of the NCIS-CMSP2012, Shanghai, China, 7–8 December 2012; pp. 554–561. [Google Scholar]
  15. Ma, J.L.; Ma, L.Y.; Fang, D. Analysis of Performance Index System of Missile Guidance Control System Based on Simulation Environment. Ship Electron. Eng. 2019, 39, 115–119. [Google Scholar]
  16. Ji, J.L.; Wang, M.L.; Han, H.H.; Tian, H.L. Application of AHP Method for Top End of Anti-Missile System Positions Air Defense. Fire Control Command Control 2017, 44, 126–130. [Google Scholar]
  17. Zhu, B.; Jin, W.D.; Yu, Z.B. Complex System RES Feature Evaluation Based on AHP. Comput. Eng. 2012, 38, 239–241. [Google Scholar]
  18. Xu, J.; He, M.H.; Han, J. Effectiveness assessment of radar emitter signal recognition based on AHP-interval-TOPSIS. J. Air Force Early Warn. Acad. 2014, 28, 243–245, 253. [Google Scholar]
  19. Jiang, Y.L.; Zhao, K.Q. Application and development of set pair analysis in artificial intelligence: A survey. CAAI Trans. Intell. Syst. 2019, 14, 28–43. [Google Scholar]
  20. Wang, J.; Su, W. Comprehensive Optimum Seeking Method Based on the Set Pair Analysis and Hierarchy for Architectural Design. In Proceedings of the 2018 International Conference on Computational Science and Engineering (ICCSE), Qingdao, China, 3–4 November 2018; pp. 1–5. [Google Scholar]
  21. Fan, X.; Fang, Y.Q.; Cheng, Z.D. Performance Evaluation for Tracking Algorithm Based on AHP. J. Proj. Rocket. Missiles Guid. 2013, 33, 101–105. [Google Scholar]
  22. Cheng, Y.; Hu, B.; Dong, W. Supportability Evaluation of Radar Equipment Based on SPA-AHM. Mod. Def. Technol. 2018, 46, 115–121, 150. [Google Scholar]
  23. Li, L.J.; Li, F.; Ding, J.J.; Xia, D.D. Effectiveness evaluation of identification features of ballistic targets based on SPA-AHP. J. Air Force Early Warn. Acad. 2017, 31, 257–260. [Google Scholar]
  24. Ju, W.; Zhou, Y.L.; Yan, Z.R. Preferable Selection of Offensive Mine-laying Plans for Unmanned Aerial Underwater Vehicles Based on SPA and AHP. Ordnance Ind. Autom. 2017, 36, 5–8. [Google Scholar]
  25. Liu, K.; Han, J.B.; Huang, Q.H. Sorting Radar Signal Based on the Improved Resemblance Coefficient and Singular Spectrum Entropy. Mod. Radar 2015, 37, 80–85. [Google Scholar]
  26. Xue, J.; Tang, L.; Zhang, X.G.; Jin, L. Radar Signal Sorting Method Based on Radar Coherent Characteristic. Electronics 2020, 9, 1144. [Google Scholar] [CrossRef]
  27. Zhu, B.; Jin, W.D.; Yu, Z.B.; Zhu, J.Q. Feature evaluation for advanced radar emitter signals based on SPA-FAHP. J. Comput. Appl. 2014, 34, 1834–1838. [Google Scholar]
  28. Jin, Q.; Wang, H.Y.; Yan, M. Radar Emitter Signal Recognition Based on Deep Convolutional Network. Mod. Deference Technol. 2019, 47, 154–160. [Google Scholar]
  29. Leng, P.F.; Xu, C.Y. Specific Emitter Identification Based on Deep Reinforcement Learning. Acta Armamentarii 2018, 39, 2420–2426. [Google Scholar]
Figure 1. A model of the feature evaluation system.
Figure 1. A model of the feature evaluation system.
Electronics 10 01274 g001
Figure 2. Structure diagram of CNN.
Figure 2. Structure diagram of CNN.
Electronics 10 01274 g002
Figure 3. Recognition results by CNN in different SNRs.
Figure 3. Recognition results by CNN in different SNRs.
Electronics 10 01274 g003
Table 1. Saaty-relative importance hierarchy table.
Table 1. Saaty-relative importance hierarchy table.
Hierarchy ValueMeaning
1Indictator i and indicator j are equally important
3Indictator i is slightly more important than indicator j
5Indictator i is more important than indicator j
7Indictator i is obviously more important than indicator j
9Indictator i is absolutely more important than indicator j
2, 4, 6, 8Between the hierarchy values mentioned above
Table 2. The weight of each layer’s elements in relation to the target layer.
Table 2. The weight of each layer’s elements in relation to the target layer.
ElementB1B2B3Weight of Target Layer
0.08520.64420.2706
C10.7500------0.0639
C20.2500------0.0213
C3---0.7396---0.4746
C4---0.1666---0.1107
C5---0.0938---0.0623
C6------0.33330.0902
C7------0.66670.1804
Table 3. Expert scoring standard.
Table 3. Expert scoring standard.
Score Interval1–0.80.8–0.60.6–0.40.4–0.20.2–0
ratingexcellentgoodaveragepoorbad
Table 4. The comprehensive results of each feature by AHP.
Table 4. The comprehensive results of each feature by AHP.
IndexWeightExpert’s Scoring
RFPRIPWAOARCFCF
C10.06390.900.800.880.830.750.65
C20.02130.880.860.900.820.650.69
C30.47460.800.750.650.670.880.92
C40.11070.750.680.570.630.850.81
C50.06230.850.710.630.850.650.77
C60.09020.750.650.580.680.760.85
C70.18040.770.850.810.710.740.80
Comprehensive score0.79850.75690.68470.70060.81610.8515
Table 5. Evaluation results based on AHP and SAHP.
Table 5. Evaluation results based on AHP and SAHP.
MethodRFPRIPWAOARCFCF
AHP0.79850.75690.68470.70060.81610.8515
SAHP0.86250.79770.74350.78520.88270.9107
Rank346521
Table 6. Signal parameters of simulation 1.
Table 6. Signal parameters of simulation 1.
EmitterPARF (MHz)AOAPW (μs)PRI (μs)Pulse Number
Emitter112748.8°1158, 64, 70120
Emitter212750°1158, 64120
Emitter312751.2°1164, 70120
Table 7. Recognition results by CNN in different SNRs (%).
Table 7. Recognition results by CNN in different SNRs (%).
FeaturesSNR (dB)
−5051015
One dimensionalRF30.2731.8932.3132.5833.93
PRI29.1329.2730.2832.8633.08
RCF53.0753.5953.8454.1254.27
CF70.8772.2376.9978.1579.61
Two dimensional(RF,PRI)32.3933.2133.5234.2934.39
(RF,RCF)32.5833.8434.0234.5634.80
(RF,CF)87.4590.8592.0393.2995.39
(PRI,RC)59.2761.2161.8963.4563.73
(PRI,CF)91.5892.2894.5696.1397.21
(RCF,CF)88.0389.1690.0290.4192.65
Three dimensional(RF,PRI,RCF)53.4054.0254.9655.0455.07
(RF,PRI,CF)90.3993.5197.6599.1399.28
(RF,RCF,CF)89.4194.2898.6899.52100
(PRI,RCF,CF)90.5894.8198.8799.98100
Four dimensional(RF,PRI,RCF,CF)91.6995.9699.12100100
Table 8. Signal parameters of simulation 2.
Table 8. Signal parameters of simulation 2.
EmitterPARF (MHz)AOAPW (μs)PRI (μs)Pulse Number
Emitter112548.8°1070, 75200
Emitter2125, 2950°1370200
Emitter312951.2°1070 ± 5200
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Xue, J.; Tang, L.; Zhang, X.; Jin, L.; Hao, M.; Gui, Y. Feature Evaluation and Comparison in Radar Emitter Recognition Based on SAHP. Electronics 2021, 10, 1274. https://doi.org/10.3390/electronics10111274

AMA Style

Xue J, Tang L, Zhang X, Jin L, Hao M, Gui Y. Feature Evaluation and Comparison in Radar Emitter Recognition Based on SAHP. Electronics. 2021; 10(11):1274. https://doi.org/10.3390/electronics10111274

Chicago/Turabian Style

Xue, Jian, Lan Tang, Xinggan Zhang, Lin Jin, Ming Hao, and Youlin Gui. 2021. "Feature Evaluation and Comparison in Radar Emitter Recognition Based on SAHP" Electronics 10, no. 11: 1274. https://doi.org/10.3390/electronics10111274

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop