Next Article in Journal
Improved Environmental Stimulus and Biological Competition Tactics Interactive Artificial Ecological Optimization Algorithm for Clustering
Next Article in Special Issue
Binary Restructuring Particle Swarm Optimization and Its Application
Previous Article in Journal
The Task Decomposition and Dedicated Reward-System-Based Reinforcement Learning Algorithm for Pick-and-Place
Previous Article in Special Issue
Augmented Harris Hawks Optimizer with Gradient-Based-Like Optimization: Inverse Design of All-Dielectric Meta-Gratings
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Improved Dipper-Throated Optimization for Forecasting Metamaterial Design Bandwidth for Engineering Applications

by
Amal H. Alharbi
1,
Abdelaziz A. Abdelhamid
2,3,
Abdelhameed Ibrahim
4,*,
S. K. Towfek
5,6,
Nima Khodadadi
7,*,
Laith Abualigah
8,9,10,11,
Doaa Sami Khafaga
1 and
Ayman EM Ahmed
12
1
Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
2
Department of Computer Science, College of Computing and Information Technology, Shaqra University, Shaqra 11961, Saudi Arabia
3
Department of Computer Science, Faculty of Computer and Information Sciences, Ain Shams University, Cairo 11566, Egypt
4
Computer Engineering and Control Systems Department, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt
5
Computer Science and Intelligent Systems Research Center, Blacksburg, VA 24060, USA
6
Department of Communications and Electronics, Delta Higher Institute of Engineering and Technology, Mansoura 35111, Egypt
7
Department of Civil and Architectural Engineering, University of Miami, Coral Gables, FL 33146, USA
8
Hourani Center for Applied Scientific Research, Al-Ahliyya Amman University, Amman 19328, Jordan
9
MEU Research Unit, Middle East University, Amman 11831, Jordan
10
School of Computer Sciences, Universiti Sains Malaysia, Gelugor 1800, Penang, Malaysia
11
Computer Science Department, Prince Hussein Bin Abdullah Faculty for Information Technology, Al al-Bayt University, Mafraq 25113, Jordan
12
Faculty of Engineering, King Salman International University, El-Tor 11341, Egypt
*
Authors to whom correspondence should be addressed.
Biomimetics 2023, 8(2), 241; https://doi.org/10.3390/biomimetics8020241
Submission received: 15 April 2023 / Revised: 23 May 2023 / Accepted: 2 June 2023 / Published: 7 June 2023

Abstract

:
Metamaterials have unique physical properties. They are made of several elements and are structured in repeating patterns at a smaller wavelength than the phenomena they affect. Metamaterials’ exact structure, geometry, size, orientation, and arrangement allow them to manipulate electromagnetic waves by blocking, absorbing, amplifying, or bending them to achieve benefits not possible with ordinary materials. Microwave invisibility cloaks, invisible submarines, revolutionary electronics, microwave components, filters, and antennas with a negative refractive index utilize metamaterials. This paper proposed an improved dipper throated-based ant colony optimization (DTACO) algorithm for forecasting the bandwidth of the metamaterial antenna. The first scenario in the tests covered the feature selection capabilities of the proposed binary DTACO algorithm for the dataset that was being evaluated, and the second scenario illustrated the algorithm’s regression skills. Both scenarios are part of the studies. The state-of-the-art algorithms of DTO, ACO, particle swarm optimization (PSO), grey wolf optimizer (GWO), and whale optimization (WOA) were explored and compared to the DTACO algorithm. The basic multilayer perceptron (MLP) regressor model, the support vector regression (SVR) model, and the random forest (RF) regressor model were contrasted with the optimal ensemble DTACO-based model that was proposed. In order to assess the consistency of the DTACO-based model that was developed, the statistical research made use of Wilcoxon’s rank-sum and ANOVA tests.

1. Introduction

Metamaterials have been addressed in a lot of research in various fields. Applications of metamaterials also include metamaterial antenna, in which metamaterials are utilized to improve their performance. The size of the electromagnetic antenna affects its radiation loss and quality factor. However, a tiny antenna with low cost and high efficiency is preferred for an integrated antenna. The metamaterial can create small antennas with improved bandwidth and gain. It can also help to minimize their electrical size and increase their directivity. Metamaterial antennas can solve the bandwidth limitation of small antennas. Simulation software is employed to estimate the effect of metamaterial on the antenna characteristics, including its gain and bandwidth. During simulation, the metamaterial antenna is adjusted by trial and error to fulfill the expected parameters. However, this process can take much longer than expected. Machine learning (ML) and algorithms can be used to forecast antenna characteristics as an alternative to simulation software. ML is a branch of artificial intelligence extensively used in different engineering applications in making decisions or predictions. This study addresses the challenge of using optimized ML models to forecast the metamaterial antenna’s gain and bandwidth [1,2].
Metamaterial antenna has been studied extensively in the literature, as it has unusual properties [3,4]. These properties enhance the abilities of the original material and their engagement in the industry [5]. Metamaterial antennas are derived from a field of science engineering known as computational electromagnetics. Computational electromagnetics is based on optimizing methods and computation for designing antennas. However, traditional design paradigms comprising model designs, parameter sweep, trial-and-error methods, and optimization algorithms are time-consuming and use a large amount of computing resources. Furthermore, if the design requirements change, simulations must be rerun, preventing the scientists from focusing on their actual demands. As a result, we have considered machine learning to fill in the gaps in our search for a quick, efficient, and automated design strategy.
Over the past few years, there has been an increase in research focused on combining machine learning techniques with metaheuristics to solve combinatorial optimization problems. This integration aims to enhance the efficiency, effectiveness, and resilience of metaheuristics during their search process and ultimately improve their performance in terms of solution quality, convergence rate, and robustness. In addition, there are several techniques developed to tackle the different optimization problems [6,7,8,9]. Optimization problems can be found in almost any field of study [10]. Some of the most popular areas are medicine [11], engineering problems [12,13,14], image processing [15], feature selection [16], etc. [17,18].
Recently, the utilization of ML in computational electromagnetics has attracted the research community’s attention [19,20,21,22]. The most important benefit of ML-aided electromagnetics lies in the ability to create an underlying relationship between the system input parameters and the desired outcomes; consequently, the computational burden in experimental real-time processing is shifted to the offline training stage [23]. The application of ML in metamaterial antenna design is a promising approach to deal with its high complexity and computational burden [24,25]. In [26], a joint design for antenna selection was proposed, using two deep learning models to forecast the selected antennas and estimate the hybrid beamformers. Another work utilized KNN and SVM for multiclass classification of the antenna selection in multiple-input, multiple-output (MIMO) systems [27].
In [25], ANN was employed to predict the selected antennas having a minimum signal-to-noise ratio (SNR) among the users. The authors of [24] used SVM and naive Bayes as a hybrid ML model for forecasting a secure-based antenna on the wiretap channel. In [21], SVM was utilized with several antennas in multiuser communication systems. The authors suggested an antenna allocation system based on the support vector machine. In [20], the authors built a support vector regression model trained on data collected from a microwave simulator to design the feed in a rectangular patch antenna. In this research, the performance of the ensemble ML approach is investigated in forecasting the bandwidth of the metamaterial antenna. An optimization technique is utilized to estimate the optimal weights of the learning model. Furthermore, a binary version of the proposed algorithm is introduced to select the best features from the input dataset.
There are several ML algorithms, such as k-nearest neighbor (KNN) [28], artificial neural network (ANN) [27], decision tree [29], and support vector machine (SVM). The main concept of these algorithms is building a learning model that can generalize and predict unseen data. For example, ANN is an intelligent learning model that simulates the biological nervous system [27]. One of the most common architectures of feedforward ANN is called multilayer perceptron (MLP), which comprises an input layer, a set of hidden layers, and an output layer. Ensemble ML is based on combining two or more ML models to improve the performance of the base ML models [30], including ANN, KNN, and SVM. The main principle of ensemble learning is estimating an output by averaging the output values of the base ML models. In average-based ensemble learning, every base model contributes the same weight to the computation. This may result in an undesired performance of the ensemble methods. An efficient performance can be yielded by using an optimization technique to calculate the weights of the base models.
The proposed system is illustrated in Figure 1. The system includes three main stages: data preprocessing for inputting the missing values and normalization of the data values; feature selection; and the regression stage through optimized ensemble learning for forecasting the bandwidth of the metamaterial antenna. The proposed framework is applied to publicly available metamaterial forecasting datasets from the Kaggle platform [31].
In this study, machine learning is incorporated into antenna design. The electromagnetic properties of an antenna that have been established via a series of experimental simulations are used to train a machine learning system. The ML algorithm helps design a metamaterial antenna that delivers the closest results based on the designer’s requirements. The following objectives will be yielded through this study:
  • Developing an ML model using the ensemble learning approach for forecasting the bandwidth of the metamaterial antenna.
  • Developing metaheuristic optimization techniques to establish an efficient ensemble ML model.
  • Developing an optimization algorithm to select the significant features from the input dataset.
  • Comparing the performance of the proposed model with the state-of-the-art ML models in forecasting bandwidth of the metamaterial antenna.
The following structure can be used for the remaining parts of the paper. Section 2 presents the related work. In Section 3, we will go over a general summary of the materials and procedures. Section 4 explains the mathematical methodology for estimating the bandwidth of metamaterial antennas using the DTACO model in depth. In Section 5, we will discuss some experimental simulations and various situations for comparison. Section 6 summarizes the advantages and disadvantages of the suggested method when it is used in real life. Section 7 of the paper is where the conclusion and future work can be found.

2. Related Work

The frequency selective surface (FSS)-based filtering antenna Filtenna was given computationally efficient optimization recommendations in [32]. The Filtenna enhances and filters signals at a certain frequency. It is challenging to build Filtenna FSS elements because of the numerous variables and intricate interrelations that affect scattering responses. An accurate model of unit cell behavior is created by the authors using a deep learning method called modified multilayer perceptron (M2LP). Filtenna FSS elements are optimized by the M2LP model. The proposed approach reduces the computational cost of optimization by 90% when compared to direct electromagnetic (EM)-driven design. An experimental Filtenna prototype demonstrates the efficacy of the method. Without incurring additional computing overhead, the unit cell model may generate FSS and Filtenna in many frequency ranges. The authors of [33] suggested limiting antenna response sensitivity updates to dominant directions in parameter space to hasten antenna tuning. The dominant directions are determined by problem-specific information, or more precisely, how estimated antenna characteristics vary when moving through the one-dimensional affine subspaces encompassed by these directions. The processing costs of full-wave electromagnetic (EM) simulations used in antenna optimization are decreased via local optimization. The results show a 60% speedup over reference approaches without sacrificing quality. The method is evaluated against accelerated versions of trust region algorithms and various antenna topologies.
It is essential to optimize the features of the antenna system. While parametric analyses are common, more exact numerical techniques are required for optimal designs in complex problems with multiple variables, goals, and constraints. The reliability and cost of computation for EM-driven optimization are problematic. Without a solid starting point or multimodal objective function, local numerical algorithms may find it challenging to identify effective designs for EM simulations, which are expensive to run. The reliability of an antenna can be increased by following a recent strategy that suggests matching design objectives (such as center frequencies) with the antenna’s actual operational parameters at each design iteration [34]. With this modification, a local search is now feasible, and the objectives are gradually being brought closer to the initial targets. Through the use of a specification management system and variable-resolution optimization framework, this research proposes a trustworthy and economical antenna-tuning technique. Depending on the discrepancy between the actual and desired operating conditions and algorithm convergence, the algorithm adaptively modifies EM model fidelity. When compared to a single-fidelity method, starting the search with the lowest-fidelity model and gradually raising it results in computational cost savings of roughly 60%.
The work in [35] addressed reflectarray (RA) design difficulties, which have advantages over traditional antenna arrays but narrow bandwidths and losses. Inverse surrogate modeling reduces computing costs for the independent adjustment of many unit cells in an alternate RA design technique. A few reference reflection phase-optimized anchor points alter the unit cells. Anchor point optimization uses minimum-volume unit cell regularization for solution uniqueness. The provided method lowers RA design computation to a few dozen cell EM analyses. The method is illustrated and tested. A fully adaptive regression model (FARM) was proposed in [36] for accurate transistor scattering and noise parameter modeling utilizing artificial neural networks (ANNs), particularly deep learning. Characteristics, designable parameters, biasing conditions, and frequency are complex, making transistor modeling difficult. A tree Parzen estimator automatically determines all network components and processing functions in the FARM technique to match input data and network architecture. Three microwave transistors are used to validate the strategy, which outperforms ANN-based methods in modeling accuracy.
Microwave component design increasingly relies on numerical optimization. Circuit theory techniques can produce good beginning designs, but electromagnetic cross-coupling and radiation losses require fine parameter tweaking. Gradient-based EM-driven design closure processes work well when the initial design is near the optimum. If the starting design is not optimal, the search process may converge to a poor local optimum. Simulation-based optimization is computationally expensive. Research in [37] proposed a new parameter-tuning method using variable-resolution EM models and a recently published design specification management methodology. The design specification management approach automates design objective modification during the search process, boosting robustness to bad starting points. Algorithm convergence and performance specification disagreement determine simulation model fidelity. Lower-resolution EM simulations in the early optimization phase can save up to 60% computationally compared to a gradient-based search with design specification management and numerical derivatives. Three microstrip circuit tests demonstrate computational speedup without compromising design quality.
Surrogate modeling is preferred for difficult antenna design projects that need expensive full-wave electromagnetic simulations. Traditional metamodeling methodologies cannot handle nonlinear antenna characteristics across a large range of system parameters due to the curse of dimensionality. Performance-driven modeling frameworks that build surrogates from antenna performance numbers rather than geometric factors can overcome this issue [38]. This method dramatically reduces model setup costs without losing design utility. This study provides a domain confinement-based variable-fidelity electromagnetic simulation modeling framework. The final surrogate is generated using co-kriging, which combines simulation data of diverse fidelities. Three microstrip antennas validate this approach, showing reliable models with much lower CPU costs than conventional and performance-driven modeling methods.
Quantifying fabrication tolerances and uncertainties in antenna design helps antennas resist manufacturing errors and material parameter fluctuations. Industrial settings require this. Geometric parameters can degrade electrical and field properties, causing frequency shifts and impedance matching. Maximizing manufacturing yield requires computationally intensive full-wave electromagnetic analysis to improve antenna performance in the presence of uncertainty. The curse of dimensionality has plagued surrogate modeling methods used to overcome these issues [39]. This work provides a low-cost antenna yield optimization method. It carefully defines the domain of the statistical analysis metamodel, which consists of a few influential directions controlling antenna responses in the relevant frequency bands. Circuit response variability assessment automates these directions. A small domain volume reduces surrogate model setup cost while improving yield. Three antenna topologies validate the proposed strategy, which outperforms multiple benchmark methods with surrogate models. Electromagnetic-driven Monte Carlo simulations prove the yield optimization’s reliability.
Adaptive algorithms dynamically adjust their search strategies based on problem characteristics or optimization progress. Hybrid algorithms combine multiple optimization techniques to leverage their strengths and compensate for their weaknesses. Considering adaptive or hybrid algorithms can enhance the optimization process by adapting to the specific requirements and challenges of the metamaterial design problem. Metaheuristic algorithms such as dipper-throated optimization and ant colony optimization can effectively handle complex optimization problems such as metamaterial design. These algorithms provide a broader exploration of the design space and can help find global optima.

3. Materials and Methods

3.1. Dipper-Throated Optimization (DTO)

Dipper-throated passerines are rare. They dive, hunt, and swim well. Their flexible, tiny wings let them fly straight and rapidly without glides or pauses. The dipper-throated bird (DTO) method assumes birds fly and swim to find food, with N f s denoting the number of birds. Bird locations are N f s and velocities are B V . B P and B V are represented as follows [40]:
B P = B P 1 , 1 B P 1 , 2 B P 1 , 3 B P 1 , d B P 2 , 1 B P 2 , 2 B P 2 , 3 B P 2 , d B P 3 , 1 B P 3 , 2 B P 3 , 3 B P 3 , d B P n , 1 B P n , 2 B P n , 3 B P n , d
where B P i , j is the ith bird position in jth dimension. The agents are considered initially uniformly distributed.
B V = B V 1 , 1 B V 1 , 2 B V 1 , 3 B V 1 , d B V 2 , 1 B V 2 , 2 B V 2 , 3 B V 2 , d B V 3 , 1 B V 3 , 2 B V 3 , 3 B V 3 , d B V n , 1 B V n , 2 B V n , 3 B V n , d
where B V i , j is the ith velocity of bird in jth dimension. The values of the objective function, f n , are determined as follows:
f = f 1 ( B P 1 , 1 , B P 1 , 2 , B P 1 , 3 , , B P 1 , d ) f 2 ( B P 2 , 1 , B P 2 , 2 , B P 2 , 3 , , B P 2 , d ) f 3 ( B P 3 , 1 , B P 3 , 2 , B P 3 , 3 , , B P 3 , d ) f n ( B P n , 1 , B P n , 2 , B P n , 3 , , B P n , d )
Then, the objective function values are ordered from lowest to highest in increasing order. It has been determined that B P b e s t is the first best solution. It is anticipated that the remaining responses will pertain to typical birds. B P n d is an abbreviation for follower birds. It has been decided that the B P G b e s t solution is the best one possible overall.
The location of the swimming bird shifts as it swims, as follows:
B P n d ( t + 1 ) = B P b e s t ( t ) C 1 . | C 2 . B P b e s t ( t ) B P n d ( t ) |
where the C 1 and C 2 parameters are determined as C 1 = 2 c . r 1 c and C 2 = 2 r 1 for c = 2 ( 1 t T m a x 2 ) , which is updated from 2 to 0 exponentially. r 1 is updated randomly within [ 0 , 1 ] and T m a x is maximum iterations.
The positions of the flying birds are updated as follows:
B P n d ( t + 1 ) = B P n d ( t ) + B V ( t + 1 )
The velocities of the flying birds are changed as follows:
B V ( t + 1 ) = C 3 B V ( t ) + C 4 r 2 ( B P b e s t ( t ) B P n d ( t ) ) + C 5 r 2 ( B P G b e s t B P n d ( t ) )
where C 3 is a weight value, C 4 and C 5 are constants. r 2 is updated randomly within [ 0 , 1 ] . The DTO algorithm is broken down into its component parts and detailed in Algorithm 1.
Algorithm 1 DTO Algorithm
  1:
Initialize birds’ positions as B P i ( i = 1 , 2 , . . . , n ) , birds’ velocities as B V i ( i = 1 , 2 , . . . , n ) , iterations T m a x , objective function f n , other DTO parameters, t = 1
  2:
Calculate  f n for each bird B P i
  3:
Find the best bird B P b e s t
  4:
while t T m a x  do
  5:
   for ( i = 1 : i < n + 1 ) do
  6:
       if ( R < 0.5 ) then
  7:
          Update swimming birds’ positions as
 
               B P n d ( t + 1 ) = B P b e s t ( t ) C 1 . | C 2 . B P b e s t ( t ) B P n d ( t ) |
  8:
       else
  9:
          Update flying birds’ velocities as
 
               B V ( t + 1 ) = C 3 B V ( t ) + C 4 r 2 ( B P b e s t ( t ) B P n d ( t ) ) + C 5 r 2 ( B P G b e s t B P n d ( t ) )
10:
          Update flying birds’ positions as
 
               B P n d ( t + 1 ) = B P n d ( t ) + B V ( t + 1 )
11:
       end if
12:
   end for
13:
   Update  f n for each bird B P i
14:
   Update parameters, t = t + 1
15:
   Update the best bird B P b e s t
16:
   Set  B P G b e s t = B P b e s t
17:
end while
18:
Return B P G b e s t

3.2. Ant Colony Optimization (ACO)

Ant foraging inspired the ACO algorithm. Ant colonies can always determine the best route from the nest to the food supply. While foraging, ants generate pheromones that other ants can detect. The shorter path has more pheromones since they evaporate over time. Thus, the ant swarm can choose an optimal path and migrate toward high pheromone intensity [41].
ACO parameters, including maximum iterations T m a x , number of ants m, pheromone evaporation factor ρ , heuristic factor α , predicted heuristic factor β , and intensity value Q, are initialized. Path routing memory matrices, heuristic information, and pheromones should also be initialized. ACO involves choosing the best path. ACO uses roulette wheel selection. This strategy bases selection on fitness. In classic ACO, the probability selection rule for the kth ant traveling from ith to jth position is defined as follows:
P i j m = [ τ ( i , j ) ] α [ η ( i , j ) ] β S J m ( i ) [ τ ( i , S ) ] α [ η ( i , S ) ] β , ( i , j ) J m 0 o t h e r w i s e
where for ant m, J m is the selectable grid collection in the next iteration. The P i j m parameter indicates the transition probability for every optional path from ith to jth position. τ ( i , j ) indicates the pheromone concentration value on point ( i , j ) and η ( i , j ) is the heuristic information visibility. η ( i , j ) is calculated as 1 d i j , which is the Euclidean distance from ith to jth point.
After each ant has constructed a path from starting point to the destination point, the concentration of pheromones on each edge of the path will be changed using the overall distance traveled by the path. After that, the global pheromone concentration will be brought up to date following the completion of an iterative search by all of the ants. The updating rule for the concentration of pheromones is displayed as follows.
τ t + 1 m ( i , j ) = ( 1 ρ ) τ t m ( i , j ) + m = 1 M Δ τ t m ( i , j ) ,
Δ τ t m ( i , j ) = Q L m , i f a n t m t r a v e l s f r o m n o d e i t o n o d e j 0 o t h e r w i s e
where τ t m ( i , j ) indicates the pheromone concentration from the ith to jth point, while Δ τ t m ( i , j ) is the pheromone concentration variation. ρ is the global pheromone evaporation factor with a value in [0, 1]. ( 1 ρ ) represents the pheromone residual coefficient. Q indicates pheromone intensity, which is a constant, and L m is the mth ant total length in the current iteration. The ACO algorithm is broken down into steps and detailed in Algorithm 2.
Algorithm 2 ACO Algorithm
  1:
Initialize ants’ positions, concentration of pheromones as τ i , j , with m ants, iterations T m a x , objective function f n , other ACO parameters, t = 1
  2:
Calculate f n for each ant
  3:
while  t T m a x  do
  4:
   for ( i = 1 : i < m + 1 ) do
  5:
         Update the probability as
          P i j m = [ τ ( i , j ) ] α [ η ( i , j ) ] β S J m ( i ) [ τ ( i , S ) ] α [ η ( i , S ) ] β
  6:
         Update ants’ positions; each ant moves from point ith to point jth based on the probability of its movements.
  7:
         Update the pheromone concentration variation as
          Δ τ t m ( i , j )
  8:
         Update the pheromone concentration as
          τ t + 1 m ( i , j ) = ( 1 ρ ) τ t m ( i , j ) + m = 1 M Δ τ t m ( i , j )
  9:
   end for
10:
   Update  f n for each ant
11:
   Update ACO parameters, t = t + 1
12:
   Update the best ant
13:
end while
14:
Return best ant position

4. Proposed Methodology

4.1. Proposed DTACO Algorithm

Algorithm 3 presents the suggested dipper-throated-based ant colony optimization (DTACO) algorithm step by step. The DTACO algorithm balances the benefits of the DTO and ACO algorithms while addressing their drawbacks to produce the best overall result. The beginning steps of the algorithm involve setting the positions of certain specified n agents x i ( i = 1 , 2 , , n ) and their velocities v i ( i = 1 , 2 , , n ) . Additionally, the maximum number of permissible iterations for the execution process is set by this T m a x , objective function f n , and the DTO and ACO parameters. The term R D T A C O indicates a random value between 0 and 1.
If R D T A C O > 0.5 , the DTACO algorithm updates the agents’ positions and agents’ velocities as follows. The positions of the swimming agent will be updated if R < 0.5 by
x ( t + 1 ) = x b e s t ( t ) C 1 . | C 2 . x b e s t ( t ) x ( t ) |
If R 0.5 , the agents are considered flying agents, and then the positions will be changed as
x ( t + 1 ) = x ( t ) + v ( t + 1 )
where v ( t + 1 ) , and updated velocity is calculated for each agent as follows:
v ( t + 1 ) = C 3 v ( t ) + C 4 r 2 ( x b e s t ( t ) x n d ( t ) ) + C 5 r 2 ( x G b e s t x ( t ) )
If R D T A C O 0.5 , the DTACO algorithm will update the probability selection rule for the kth ant traveling from ith to jth position as follows.
P i j m = [ τ ( i , j ) ] α [ η ( i , j ) ] β S J m ( i ) [ τ ( i , S ) ] α [ η ( i , S ) ] β
where P i j m is the transition probability for every optional path from the ith to the jth position. τ ( i , j ) is the pheromone concentration value on point ( i , j ) and η ( i , j ) is the heuristic information visibility.
Algorithm 3 Proposed DTACO Algorithm
  1:
Initialize agents’ positions, x i ( i = 1 , 2 , , m ) , with m agents, agents’ velocities, v i ( i = 1 , 2 , , m ) , iterations T m a x , objective function f n , parameters, R D T A C O , t = 1
  2:
Obtain f n for agents
  3:
Find the best agent x b e s t
  4:
while t T m a x do
  5:
   if ( R D T A C O > 0.5 ) then
  6:
     for ( i = 1 : i < m + 1 ) do
  7:
        if ( R < 0.5 ) then
  8:
            Update the swimming agent position by
             x ( t + 1 ) = x b e s t ( t ) C 1 . | C 2 . x b e s t ( t ) x ( t ) |
  9:
        else
10:
            Update the flying agent velocity by
             v ( t + 1 ) = C 3 v ( t ) + C 4 r 2 ( x b e s t ( t ) x ( t ) ) + C 5 r 2 ( x G b e s t x ( t ) )
11:
            Update the flying agent position by
             x ( t + 1 ) = x ( t ) + v ( t + 1 )
12:
        end if
13:
     end for
14:
   else
15:
     for ( i = 1 : i < m + 1 ) do
16:
        Update the probability as
         P i j m = [ τ ( i , j ) ] α [ η ( i , j ) ] β S J m ( i ) [ τ ( i , S ) ] α [ η ( i , S ) ] β
17:
        Update ants’ positions; each ant moves from point ith to point jth based on the probability of its movements.
18:
        Update the pheromone concentration variation as
         Δ τ t m ( i , j )
19:
        Update the pheromone concentration as
         τ t + 1 m ( i , j ) = ( 1 ρ ) τ t m ( i , j ) + m = 1 M Δ τ t m ( i , j )
20:
     end for
21:
   end if
22:
   Obtain  f n for agents
23:
   Update parameters, t = t + 1
24:
   Find best agent x b e s t
25:
   Set  x G b e s t = x b e s t
26:
end while
27:
Return best agent x G b e s t
After constructing a path from the starting point to the destination point by each ant, the concentration of pheromones on each edge of the path is changed using the overall distance traveled by the path. After completing an iterative search by all ants, the global pheromone concentration will be updated as follows:
τ t + 1 m ( i , j ) = ( 1 ρ ) τ t m ( i , j ) + m = 1 M Δ τ t m ( i , j ) ,
where Δ τ t m ( i , j ) is the pheromone concentration variation. ρ is the global pheromone evaporation factor with a value in [0, 1]. ( 1 ρ ) represents the pheromone residual coefficient. Q indicates pheromone intensity, which is a constant, and L m is the mth ant total length in the current iteration.
The following is an expression of the computational difficulty posed by the DTACO algorithm within the context of this work. The level of complexity is defined as follows for iterations with a maximum of t m a x and m agents:
  • Initialize parameters of the DTACO algorithm: O(1).
  • Calculate f n for each agent: O(m).
  • Find the best agent: O (m).
  • Update agents’ positions: O( t m a x × m ).
  • Update agents’ velocities: O( t m a x × m ).
  • Update agents’ positions: O( t m a x × m ).
  • Update probability: O( t m a x × m ).
  • Update agents’ positions: O( t m a x × m ).
  • Update pheromone concentration variation: O( t m a x × m ).
  • Update pheromone concentration: O( t m a x × m ).
  • Update parameters, t = t + 1 : O( t m a x ).
  • Obtain best agent x b e s t : O( t m a x ).
  • Set x G b e s t = x b e s t : O( t m a x ).
  • Obtain global best agent x G b e s t : O(1)
As a result of the above examination of the DTACO method, the complexity of the calculation has been determined to be O( t m a x × m ), but it will be O( t m a x × m × d ) for the d dimension.

4.2. Proposed Binary DTACO Algorithm

In the event that there are problems with feature selection, the solutions produced by the DTACO algorithm will be purely binary, taking the form of values of 0 or 1. In order to make the process of selecting features from the dataset more manageable, the continuous values returned by the proposed DTACO method will be converted to a binary representation of [0, 1]. This investigation makes use of an equation that is derived based on the S i g m o i d function and is shown below [40]:
x ( t + 1 ) = 1 if S i g m o i d ( n ) 0.5 0 o t h e r w i s e , S i g m o i d ( n ) = 1 1 + e 10 ( n 0.5 ) ,
where x ( t + 1 ) represents a binary solution. The S i g m o i d function scales the solutions to binary ones. For S i g m o i d ( n ) 0.5 , the value will be 1; otherwise, the value will be 0. The n indicates the proposed algorithm’s solution. The algorithm known as binary DTACO (bDTACO) is outlined in further detail in Algorithm 4.
Algorithm 4 Proposed Binary DTACO Algorithm
  1:
Initialize parameters
  2:
Obtain f n for agents
  3:
Find best agent
  4:
Change solutions to binary [ 0 , 1 ]
  5:
while t T m a x do
  6:
   if ( R D T A C O > 0.5 ) then
  7:
     for ( i = 1 : i < m + 1 ) do
  8:
        if ( R < 0.5 ) then
  9:
          Update the swimming agent position
10:
        else
11:
          Update the flying agent velocity
12:
          Update the flying agent position
13:
        end if
14:
     end for
15:
   else
16:
     for ( i = 1 : i < m + 1 ) do
17:
        Update the probability
18:
        Update ants’ positions
19:
        Update the pheromone concentration variation
20:
        Update the pheromone concentration
21:
     end for
22:
   end if
23:
   Obtain  f n for agents
24:
   Update parameters
25:
   Find best agent x b e s t
26:
   Set  x G b e s t = x b e s t
27:
   Change updated solution to binary by Equation (15)
28:
end while
29:
Return best agent x G b e s t

5. Experimental Results

The entire purpose of this part is to provide a thorough examination of the investigation’s findings. The investigations were carried out in two different contexts. The proposed binary DTACO algorithm’s feature selection capabilities for the dataset under test are covered in the first scenario, and the algorithm’s regression capabilities are demonstrated in the second scenario. The DTACO algorithm was analyzed and compared to other algorithms that are considered to be state-of-the-art, including DTO [40], ACO [41], particle swarm optimization (PSO) [42], the grey wolf optimizer (GWO) [43], the genetic algorithm (GA) [43], and the whale optimization algorithm (WOA) [44]. Both scenarios are described below. A presentation of the DTACO algorithm configuration can be found in Table 1. This presentation includes all of the experiment’s relevant parameters. It is essential to provide details about the numerous parameters that will be used to determine the behavior and performance of the algorithm. These settings include population size (number of agents), the termination criterion (number of iterations), and other important characteristics for optimization m to select the significant features from the input dataset.
Table 2 presents the comparative algorithms’ setup. To evaluate optimization techniques and parameters fairly, many aspects were considered. First, we considered the search space size, constraints, and objective function. Choosing a problem-specific algorithm can improve performance. Second, parameter choice affects algorithm performance. We considered convergence speed and exploration–exploitation trade-offs while tuning parameters for the issue and method. For fair comparisons, ten runs with varied random seeds were applied, statistical analysis was performed, and an appropriate dataset was tested. A fair comparison of DTO, ACO, GWO, PSO, GA, and WOA optimization algorithms and parameter selection yielded meaningful insights and informed decision making. The computational budget was established based on the number of function calls made during optimization. Each optimizer was run ten times for 80 iterations, and the number of search agents was set to 10. Setting a specific computational budget ensured that all the compared algorithms had an equal opportunity to explore and exploit the search space within the given limitations. This approach allows for a fair and standardized evaluation, facilitating meaningful comparisons between optimization algorithms.

5.1. Dataset

The dataset is freely available and can be utilized in constructing a machine learning model for improved radiation efficiency of an antenna [31]. The dimensions of a patch antenna, the dimensions of the slots in the patch antenna, the operating frequency, and finally, the matching S11 parameter are all included in this dataset. The HFSS program was utilized in the construction of the antenna as well as the collection of the dataset. Ansys HFSS is a software tool utilized to design and simulate high-frequency electronic devices. This 3D electromagnetic (EM) simulation software is specifically tailored for creating and evaluating various products, including antennas, antenna arrays, filters, connectors, and printed circuit boards. Its primary purpose is to provide accurate modeling and analysis capabilities for the development of these high-frequency electronic systems. The radiation frequency of the tested dataset is maintained at 2.4 GHz, making it compatible with Bluetooth and wireless local area network (WLAN) operations. Figure 2 presents a heat map that can be used to gain insight into the manner in which the variables are connected.

5.2. Feature Selection Scenario

When selecting features from the dataset that was put through its paces, the binary implementation of the DTACO method that was proposed is the one that comes into play. In the first scenario, a discussion of the outcomes of the feature selection carried out using the DTACO algorithm described in this paper is included. The binary DTACO (bDTACO) method is analyzed and contrasted with the binary DTO (bDTO), binary ACO (bACO), binary PSO (bPSO), binary GWO (bGWO), and binary GA (bGA).
With the assistance of the objective equation, also known as f n , the binary DTACO method is able to determine the level of quality possessed by a given solution. In the equation that follows, f n is used as a variable in the expressions for a number of selected features (v), the total number of features (V), and a classifier’s error rate ( E r r ).
f n = h 1 E r r + h 2 | v | | V |
where the significance of the provided feature to the population is indicated by the formula h 2 = 1 h 1 , and the value of h 1 might fall anywhere in the range [0, 1]. If it is possible to supply a subset of features that are capable of providing a low classification error rate, then the approach can be called acceptable. The k-nearest neighbor technique, also referred to as kNN, is a straightforward classification method that is frequently put into practice. In this method, the employment of the k-nearest neighbor classifier assures that the chosen attributes are of good quality. The only criterion that is used in the process of determining classifiers is the distance that is considered to be the shortest between the query instance and the training instances. This experiment does not make use of any models for the K-nearest neighbor technique in any way.
The effectiveness of the suggested strategy for feature selection is evaluated in accordance with the standards presented in Table 3. This table also includes a column labeled "M" that contains the total number of iterations performed by both the proposed optimizer and its rivals. The symbol S j is used to designate the best solution, and the size of the best solution vector is denoted by the value s i z e ( S j ) . The total number of points for the test set is denoted by the letter N. The predicted values is denoted by the term V n ^ , while the actual values are denoted by the term V n .
The results of feature selection using the proposed and compared algorithms are presented in Table 4. As shown in Table 1, these outcomes are based on 80 iterations over 10 runs for 10 agents. With an average error of (0.5027) and a standard deviation of (0.4055), the given bDTACO technique performed as expected. The next best algorithms are bDTO, with a score of (0.5265); bACO, with a score of (0.5308); bGWO, with a score of (0.5472); bGA, with a score of (0.5694); bWOA, with a score of (0.5708); and finally, bPSO, with a score of (0.571), which accomplish the lowest minimal average error in the feature selection process for the data that have been evaluated. When it comes to feature selection, the bPSO algorithm is the weakest one available.
Figure 3 displays the box plot that was generated based on the average error for the bDTACO algorithm, as well as the bDTO algorithm, the bACO algorithm, the bPSO algorithm, the bGWO algorithm, the bGA algorithm, and the bWOA algorithm. The quality of the bDTACO algorithm, as determined by utilizing the objective function described in Equation (16), is displayed in the figure. Figure 4 presents the quantile–quantile (QQ) plots, residual plots, and heat map for both the given bDTACO and the methods that were compared for the data that were analyzed. These plots show the relationship between the data and the quantiles and quantile differences.
This statistical analysis uses one-way ANOVA and Wilcoxon signed-rank tests to determine the average error of the suggested binary DTACO algorithm. The Wilcoxon test determines p-values for comparing the suggested approach to other methods. This statistical test can assess if the suggested algorithm outperforms other algorithms with a p-value of less than 0.05. The analysis of variance (ANOVA) test was also performed to determine if the suggested algorithm differed significantly from the others. Table 5 shows the ANOVA test results for the proposed algorithm vs. the methods compared, and Table 6 shows the Wilcoxon signed-rank test results. The statistical analysis uses ten rounds of each method to achieve reliable comparisons.

5.3. Regression Scenario

In the second scenario, the proposed optimal ensemble DTACO model was compared against basic MLP regressor, SVR, and random forest regressor models over 10 runs and 80 iterations with 10 agents. In order to evaluate the effectiveness of the regression models that were applied in order to anticipate the bandwidth of the metamaterial antenna, additional measurements were used. These metrics include relative root-mean-squared error (RRMSE), Nash–Sutcliffe efficiency (NSE), mean absolute error (MAE), mean bias error (MBE), Pearson’s correlation coefficient (r), coefficient of determination (R2), and determined agreement (WI). the total number of observations in the dataset is represented by the N parameter. The nth estimated and observed bandwidth are represented by ( V n ^ ) and ( V n ), and ( V n ^ ¯ ) and ( V n ) represents the arithmetic means of the estimated and observed values. The evaluation criteria for predictions are shown in Table 7.
The findings of the suggested optimizing ensemble DTACO-based model compared to those of the fundamental models are presented in Table 8. When compared to the RF, which had an RMSE of (0.041033), the given DTACO-based model produced the best results, with an RMSE of (0.003871). MLP, on the other hand, reported an RMSE of (0.045691), which was the poorest possible outcome.
The results of the suggested DTACO-based model’s regression are compared with the results of the DTO, ACO, WOA, GWO, GA, and PSO-based models to demonstrate the effectiveness of the presented algorithm. Table 9 provides a description of the DTACO-based model that was proposed together with the RMSE results of other models based on ten separate runs. This description includes the minimum, median, maximum, and mean average errors.
Figure 5 displays the box plot calculated using the root-mean-squared error for the proposed DTACO-based model as well as the DTO, ACO, PSO, GWO, GA, and WOA-based models. The quality of the optimized ensemble DTACO-based model, as shown in the figure, was determined with the help of the objective function described in Equation (16). Figure 6 depicts the histogram of the root-mean-squared error (RMSE) for both the DTACO-based model that was presented and the other models. Figure 7 shows the ROC curve of the presented DTACO algorithm versus the DTO algorithm. Figure 8 presents the QQ plots, residual plots, and heat map for both the DTACO-based model that was provided and the models that were compared for the data that were investigated. Both sets of plots are based on the analyzed data. These figures demonstrate that the given optimized ensemble DTACO-based model has the potential to outperform the models that were compared.
Table 10 contains the outcomes of the ANOVA test that was performed on the proposed ensemble DTACO and the models that were compared. Table 11 contains a comparison of the proposed optimized ensemble DTACO and the models that were compared using the Wilcoxon signed-rank test. The statistical analysis was carried out by utilizing ten individual iterations of each of the algorithms that are being presented and evaluated. This ensures that the comparisons are exact and that the results of the study are reliable.

6. Discussion

This section summarizes the advantages and disadvantages of the suggested method when it is used in real life. The suggested method provides a better way to optimize estimating the bandwidth of a metamaterial design. It gives a methodical way to optimize the design factors of metamaterials, which leads to designs that work better and are more efficient. The method is especially useful for figuring out the bandwidth of different metamaterial designs. This is of the utmost importance in engineering applications, where it is important to make sure that developed metamaterials can work within the stated frequency range. When making metamaterials work and perform better, having an exact bandwidth prediction can be very helpful. The fact that the method has been changed to be used in engineering shows that it can be used in real-world situations and is fit for them. It is a useful tool for optimizing metamaterial design because it was made to solve problems and meet the needs of engineering uses. The described method gives designers more options for how to make things because it lets them optimize a number of factors that affect the bandwidth of metamaterials. During the optimization process, it can take into account a number of different design variables and constraints. This lets engineers look into a wide range of choices. The proposed method aims to make the optimization process more productive. By using its newly improved method, it might be possible to reduce the amount of computing time and resources needed to optimize metamaterial design. This would make it easier to use in the real world.
The suggested method focuses on improving the designs of metamaterials and predicting the bandwidth of these designs. Even though this is useful for engineering uses that use metamaterials, it may not be directly applicable to other domains or design problems because of how metamaterials work. The method will only work if accurate models and simulations of the metamaterials are being considered. Wrong or insufficient models may lead to less-than-ideal results or wrong bandwidth estimates. When different design variables and limits are considered, optimizing metamaterial designs can be difficult and time-consuming. The suggested method may still run into problems when dealing with complicated optimization problems, and may not always promise to find the global optimum. One might need the right computer resources, software tools, and experience for the suggested method to work. Engineers and researchers must consider the things mentioned here when applying the method to real-world situations.

7. Conclusions and Future Work

Metamaterials are unusual. They have several constituents and repeating patterns at a smaller wavelength than the phenomena they affect. Metamaterials can control electromagnetic waves by blocking, absorbing, amplifying, or bending them. Metamaterials are used in microwave invisibility cloaks, invisible submarines, revolutionary electronics, microwave components, filters, and negative-refractive-index antennas. This paper improved dipper-throated-based ant colony optimization (DTACO) to predict metamaterial antenna bandwidth. The first case examined the proposed binary DTACO algorithm’s feature selection for the dataset being reviewed, while the second scenario tested its regression. Studying both scenarios’ circumstances, DTACO was compared to the state-of-the-art DTO, ACO, PSO, GWO, and WOA algorithms. The optimal ensemble DTACO-based model was compared to the basic MLP, SVR, and random forest regressor models. The statistical research used Wilcoxon’s rank-sum and ANOVA tests to evaluate the DTACO-based model’s consistency. Because of the versatility of this method, the DTACO-based regression model can be modified and evaluated for a wide variety of datasets in work that will be performed in the future. DTACO will be evaluated with well-known benchmark functions such as CEC17-19, so that DTACO can be compared with other well-known metaheuristic algorithms in future work.

Author Contributions

Methodology, N.K. and D.S.K.; Software, S.K.T. and N.K.; Validation, S.K.T. and N.K.; Formal analysis, D.S.K.; Writing—original draft, A.I. and S.K.T.; Writing—review & editing, A.H.A., A.A.A., L.A. and A.E.A.; Supervision, A.A.A. All authors have read and agreed to the published version of the manuscript.

Funding

Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2023R120), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

Authors thanks Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2023R120), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

kNNk-Nearest Neighbors
MLPMultilayer Perceptron
SVRSupport Vector Regression
RFRandom Forest
DTODipper-Throated Optimization
ACOAnt Colony Optimization
PSOParticle Swarm Optimization
WOAWhale Optimization Algorithm
GWOGrey Wolf Optimizer

References

  1. Grady, N.K.; Heyes, J.E.; Chowdhury, D.R.; Zeng, Y.; Reiten, M.T.; Azad, A.K.; Taylor, A.J.; Dalvit, D.A.R.; Chen, H.T. Terahertz Metamaterials for Linear Polarization Conversion and Anomalous Refraction. Science 2013, 340, 1304–1307. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Shabanpour, J.; Beyraghi, S.; Ghorbani, F.; Oraizi, H. Implementation of conformal digital metasurfaces for THz polarimetric sensing. arXiv 2021, arXiv:2101.02298. [Google Scholar] [CrossRef]
  3. Smith, D.R.; Padilla, W.J.; Vier, D.C.; Nemat-Nasser, S.C.; Schultz, S. Composite Medium with Simultaneously Negative Permeability and Permittivity. Phys. Rev. Lett. 2000, 84, 4184–4187. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Shabanpour, J. Full Manipulation of the Power Intensity Pattern in a Large Space-Time Digital Metasurface: From Arbitrary Multibeam Generation to Harmonic Beam Steering Scheme. Ann. Phys. 2020, 532, 2000321. [Google Scholar] [CrossRef]
  5. Ghorbani, F.; Beyraghi, S.; Shabanpour, J.; Oraizi, H.; Soleimani, H.; Soleimani, M. Deep neural network-based automatic metasurface design with a wide frequency range. Sci. Rep. 2021, 11, 7102. [Google Scholar] [CrossRef]
  6. Kaveh, A.; Talatahari, S.; Khodadadi, N. Stochastic paint optimizer: Theory and application in civil engineering. Eng. Comput. 2020, 38, 1921–1952. [Google Scholar] [CrossRef]
  7. El Sayed, M.; Abdelhamid, A.A.; Ibrahim, A.; Mirjalili, S.; Khodadad, N.; Al duailij, M.A.; Alhussan, A.A.; Khafaga, D.S. Al-Biruni Earth Radius (BER) Metaheuristic Search Optimization Algorithm. Comput. Syst. Sci. Eng. 2023, 45, 1917–1934. [Google Scholar]
  8. Abdollahzadeh, B.; Gharehchopogh, F.S.; Khodadadi, N.; Mirjalili, S. Mountain gazelle optimizer: A new nature-inspired metaheuristic algorithm for global optimization problems. Adv. Eng. Softw. 2022, 174, 103282. [Google Scholar] [CrossRef]
  9. Khodadadi, N.; Snasel, V.; Mirjalili, S. Dynamic arithmetic optimization algorithm for truss optimization under natural frequency constraints. IEEE Access 2022, 10, 16188–16208. [Google Scholar] [CrossRef]
  10. Khodadadi, N.; Abualigah, L.; Mirjalili, S. Multi-objective stochastic paint optimizer (MOSPO). Neural Comput. Appl. 2022, 34, 18035–18058. [Google Scholar] [CrossRef]
  11. Atteia, G.; El-kenawy, E.S.M.; Samee, N.A.; Jamjoom, M.M.; Ibrahim, A.; Abdelhamid, A.A.; Azar, A.T.; Khodadadi, N.; Ghanem, R.A.; Shams, M.Y. Adaptive Dynamic Dipper Throated Optimization for Feature Selection in Medical Data. Cmc-Comput. Mater. Contin. 2023, 75, 1883–1900. [Google Scholar] [CrossRef]
  12. Khodadadi, N.; Abualigah, L.; Al-Tashi, Q.; Mirjalili, S. Multi-objective chaos game optimization. Neural Comput. Appl. 2023, 35, 14973–15004. [Google Scholar] [CrossRef]
  13. El-Kenawy, E.S.M.; Mirjalili, S.; Khodadadi, N.; Abdelhamid, A.A.; Eid, M.M.; El-Said, M.; Ibrahim, A. Feature selection in wind speed forecasting systems based on meta-heuristic optimization. PLoS ONE 2023, 18, e0278491. [Google Scholar] [CrossRef]
  14. Khodadadi, N.; Talatahari, S.; Gandomi, A.H. ANNA: Advanced neural network algorithm for optimization of structures. In Proceedings of the Institution of Civil Engineers-Structures and Buildings; 2023; pp. 1–23. Available online: https://www.icevirtuallibrary.com/doi/full/10.1680/jstbu.22.00083 (accessed on 15 April 2023).
  15. Khazalah, A.; Prasanthi, B.; Thomas, D.; Vello, N.; Jayaprakasam, S.; Sumari, P.; Abualigah, L.; Ezugwu, A.E.; Hanandeh, E.S.; Khodadadi, N. Image Processing Identification for Sapodilla Using Convolution Neural Network (CNN) and Transfer Learning Techniques. In Classification Applications with Deep Learning and Machine Learning Technologies; Springer: Berlin/Heidelberg, Germany, 2022; pp. 107–127. [Google Scholar]
  16. Al-Tashi, Q.; Mirjalili, S.; Wu, J.; Abdulkadir, S.J.; Shami, T.M.; Khodadadi, N.; Alqushaibi, A. Moth-flame optimization algorithm for feature selection: A review and future trends. In Handbook of Moth-Flame Optimization Algorithm; CRC Press: London, UK, 2022; pp. 11–34. [Google Scholar]
  17. Mirjalili, S.Z.; Sajeev, S.; Saha, R.; Khodadadi, N.; Mirjalili, S.M.; Mirjalili, S. Evolutionary Population Dynamic Mechanisms for the Harmony Search Algorithm. In Proceedings of the 7th International Conference on Harmony Search, Soft Computing and Applications: ICHSA 2022, Seoul, South Korea, 23–24 February 2022; Springer: Berlin/Heidelberg, Germany, 2022; pp. 185–194. [Google Scholar]
  18. Khodadadi, N.; Mirjalili, S.M.; Mirjalili, S.Z.; Mirjalili, S. Chaotic Stochastic Paint Optimizer (CSPO). In Proceedings of the 7th International Conference on Harmony Search, Soft Computing and Applications: ICHSA 2022, Seoul, South Korea, 23–24 February 2022; Springer: Berlin/Heidelberg, Germany, 2022; pp. 195–205. [Google Scholar]
  19. Vu, T.X.; Chatzinotas, S.; Nguyen, V.D.; Hoang, D.T.; Nguyen, D.N.; Renzo, M.D.; Ottersten, B. Machine Learning-Enabled Joint Antenna Selection and Precoding Design: From Offline Complexity to Online Performance. IEEE Trans. Wirel. Commun. 2021, 20, 3710–3722. [Google Scholar] [CrossRef]
  20. Ulker, S. Support Vector Regression Analysis for the Design of Feed in a Rectangular Patch Antenna. In Proceedings of the 2019 3rd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), Ankara, Turkey, 11–13 October 2019. [Google Scholar] [CrossRef]
  21. Lin, H.; Shin, W.Y.; Joung, J. Support Vector Machine-Based Transmit Antenna Allocation for Multiuser Communication Systems. Entropy 2019, 21, 471. [Google Scholar] [CrossRef] [Green Version]
  22. Prado, D.R.; Lopez-Fernandez, J.A.; Arrebola, M.; Goussetis, G. Efficient Shaped-Beam Reflectarray Design Using Machine Learning Techniques. In Proceedings of the 2018 15th European Radar Conference (EuRAD), Madrid, Spain, 26–28 September 2018. [Google Scholar] [CrossRef] [Green Version]
  23. Sun, H.; Chen, X.; Shi, Q.; Hong, M.; Fu, X.; Sidiropoulos, N.D. Learning to Optimize: Training Deep Neural Networks for Interference Management. IEEE Trans. Signal Process. 2018, 66, 5438–5453. [Google Scholar] [CrossRef]
  24. He, D.; Liu, C.; Quek, T.Q.S.; Wang, H. Transmit Antenna Selection in MIMO Wiretap Channels: A Machine Learning Approach. IEEE Wirel. Commun. Lett. 2018, 7, 634–637. [Google Scholar] [CrossRef]
  25. Ibrahim, M.S.; Zamzam, A.S.; Fu, X.; Sidiropoulos, N.D. Learning-Based Antenna Selection for Multicasting. In Proceedings of the 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), Kalamata, Greece, 25–28 June 2018. [Google Scholar] [CrossRef]
  26. Elbir, A.M.; Mishra, K.V. Joint Antenna Selection and Hybrid Beamformer Design Using Unquantized and Quantized Deep Learning Networks. IEEE Trans. Wirel. Commun. 2020, 19, 1677–1688. [Google Scholar] [CrossRef] [Green Version]
  27. Joung, J. Machine Learning-Based Antenna Selection in Wireless Communications. IEEE Commun. Lett. 2016, 20, 2241–2244. [Google Scholar] [CrossRef]
  28. Bhatia, N.; Vandana. Survey of Nearest Neighbor Techniques. arXiv 2010, arXiv:1007.0085. [Google Scholar]
  29. Myles, A.J.; Feudale, R.N.; Liu, Y.; Woody, N.A.; Brown, S.D. An introduction to decision tree modeling. J. Chemom. 2004, 18, 275–285. [Google Scholar] [CrossRef]
  30. Al-Hajj, R.; Assi, A.; Fouad, M. Short-Term Prediction of Global Solar Radiation Energy Using Weather Data and Machine Learning Ensembles: A Comparative Study. J. Sol. Energy Eng. 2021, 143, 051003. [Google Scholar] [CrossRef]
  31. Dataset Containing Antenna Parameters. Available online: https://www.kaggle.com/datasets/shreyasinha/dataset-containing-antenna-parameters (accessed on 10 January 2023).
  32. Mahouti, P.; Belen, A.; Tari, O.; Belen, M.A.; Karahan, S.; Koziel, S. Data-Driven Surrogate-Assisted Optimization of Metamaterial-Based Filtenna Using Deep Learning. Electronics 2023, 12, 1584. [Google Scholar] [CrossRef]
  33. Pietrenko-Dabrowska, A.; Koziel, S. Rapid antenna optimization with restricted sensitivity updates by automated dominant direction identification. Knowl.-Based Syst. 2023, 268, 110453. [Google Scholar] [CrossRef]
  34. Koziel, S.; Pietrenko-Dabrowska, A. Improved-Efficacy EM-Driven Optimization of Antenna Structures Using Adaptive Design Specifications and Variable-Resolution Models. IEEE Trans. Antennas Propag. 2023, 71, 1863–1874. [Google Scholar] [CrossRef]
  35. Koziel, S.; Belen, M.A.; Çalişkan, A.; Mahouti, P. Rapid Design of 3D Reflectarray Antennas by Inverse Surrogate Modeling and Regularization. IEEE Access 2023, 11, 24175–24184. [Google Scholar] [CrossRef]
  36. Calik, N.; Güneş, F.; Koziel, S.; Pietrenko-Dabrowska, A.; Belen, M.A.; Mahouti, P. Deep-learning-based precise characterization of microwave transistors using fully-automated regression surrogates. Sci. Rep. 2023, 13, 1445. [Google Scholar] [CrossRef]
  37. Koziel, S.; Pietrenko-Dabrowska, A.; Raef, A.G. Knowledge-based expedited parameter tuning of microwave passives by means of design requirement management and variable-resolution EM simulations. Sci. Rep. 2023, 13, 334. [Google Scholar] [CrossRef]
  38. Pietrenko-Dabrowska, A.; Koziel, S.; Golunski, L. Two-stage variable-fidelity modeling of antennas with domain confinement. Sci. Rep. 2022, 12, 17275. [Google Scholar] [CrossRef]
  39. Pietrenko-Dabrowska, A.; Koziel, S.; Golunski, L. Low-cost yield-driven design of antenna structures using response-variability essential directions and parameter space reduction. Sci. Rep. 2022, 12, 15185. [Google Scholar] [CrossRef]
  40. El-kenawy, E.S.M.; Albalawi, F.; Ward, S.A.; Ghoneim, S.S.M.; Eid, M.M.; Abdelhamid, A.A.; Bailek, N.; Ibrahim, A. Feature Selection and Classification of Transformer Faults Based on Novel Meta-Heuristic Algorithm. Mathematics 2022, 10, 3144. [Google Scholar] [CrossRef]
  41. Wu, L.; Huang, X.; Cui, J.; Liu, C.; Xiao, W. Modified adaptive ant colony optimization algorithm and its application for solving path planning of mobile robot. Expert Syst. Appl. 2023, 215, 119410. [Google Scholar] [CrossRef]
  42. Bello, R.; Gomez, Y.; Nowe, A.; Garcia, M.M. Two-Step Particle Swarm Optimization to Solve the Feature Selection Problem. In Proceedings of the Seventh International Conference on Intelligent Systems Design and Applications (ISDA 2007), Rio de Janeiro, Brazil, 20–24 October 2007; pp. 691–696. [Google Scholar] [CrossRef]
  43. El-Kenawy, E.S.M.; Eid, M.M.; Saber, M.; Ibrahim, A. MbGWO-SFS: Modified Binary Grey Wolf Optimizer Based on Stochastic Fractal Search for Feature Selection. IEEE Access 2020, 8, 107635–107649. [Google Scholar] [CrossRef]
  44. Eid, M.M.; El-kenawy, E.S.M.; Ibrahim, A. A binary Sine Cosine-Modified Whale Optimization Algorithm for Feature Selection. In Proceedings of the 2021 National Computing Colleges Conference (NCCC), Taif, Saudi Arabia, 27–28 March 2021. [Google Scholar] [CrossRef]
Figure 1. The proposed framework for forecasting gain and bandwidth of metamaterial antenna.
Figure 1. The proposed framework for forecasting gain and bandwidth of metamaterial antenna.
Biomimetics 08 00241 g001
Figure 2. Heat map of the metamaterial antenna forecasting dataset.
Figure 2. Heat map of the metamaterial antenna forecasting dataset.
Biomimetics 08 00241 g002
Figure 3. The proposed bDTACO method, together with the bDTO, bACO, bPSOm bGWO, bGA, and bWOA algorithms, are compared using a box plot that is based on the average error for each algorithm.
Figure 3. The proposed bDTACO method, together with the bDTO, bACO, bPSOm bGWO, bGA, and bWOA algorithms, are compared using a box plot that is based on the average error for each algorithm.
Biomimetics 08 00241 g003
Figure 4. Quantile–quantile plots and residual plots, as well as a heat map, for the bDTACO that was presented and the methods that were compared.
Figure 4. Quantile–quantile plots and residual plots, as well as a heat map, for the bDTACO that was presented and the methods that were compared.
Biomimetics 08 00241 g004
Figure 5. The box plot of the proposed DTACO-based model and DTO, ACO, PSO, GWO, GA, and WOA-based models based on the RMSE.
Figure 5. The box plot of the proposed DTACO-based model and DTO, ACO, PSO, GWO, GA, and WOA-based models based on the RMSE.
Biomimetics 08 00241 g005
Figure 6. Histogram of the root-mean-squared error (RMSE) for both the DTACO-based model that was presented and the other models.
Figure 6. Histogram of the root-mean-squared error (RMSE) for both the DTACO-based model that was presented and the other models.
Biomimetics 08 00241 g006
Figure 7. ROC curve of the presented DTACO algorithm versus the DTO algorithm.
Figure 7. ROC curve of the presented DTACO algorithm versus the DTO algorithm.
Biomimetics 08 00241 g007
Figure 8. For both the models that were compared and the model that was presented using DTACO, there were QQ plots, residual plots, and heat maps.
Figure 8. For both the models that were compared and the model that was presented using DTACO, there were QQ plots, residual plots, and heat maps.
Biomimetics 08 00241 g008
Table 1. The DTACO algorithm’s configuration settings.
Table 1. The DTACO algorithm’s configuration settings.
Parameter (s)Value (s)
# Agents10
# Iterations80
# Runs10
Dimension# features
η [0, 1]
η [0, 1]
Mutation probability0.5
Exploration percentage70
Pheromone evaporation factor ( ρ )0.1
Pheromone factor ( α )1
Heuristic factor ( β )1
Intensity value (Q)0.2
h 1 of f n 0.99
h 2 of f n 0.01
Table 2. Compared algorithms’ various configuration parameters.
Table 2. Compared algorithms’ various configuration parameters.
AlgorithmParameter (s)Value (s)
DTO η [0, 1]
η [0, 1]
Mutation probability0.5
Exploration percentage70
Birds10
Iterations80
ACOPheromone evaporation factor ( ρ )0.1
Pheromone factor ( α )1
Heuristic factor ( β )1
Intensity value (Q)0.2
Ants10
Iterations80
GWOa2 to 0
Wolves10
Iterations80
PSOAcceleration constants[2, 2]
Inertia W m i n , W m a x [0.6, 0.9]
Particles10
Iterations80
GACross over0.9
Mutation ratio0.1
Selection mechanismRoulette wheel
Agents10
Iterations80
WOAr[0, 1]
a2 to 0
Whales10
Iterations80
Table 3. Feature selection evaluation criteria.
Table 3. Feature selection evaluation criteria.
MetricFormula
Best fitness m i n i = 1 M S i
Worst fitness m a x i = 1 M S i
Average error 1 M j = 1 M 1 N i = 1 N m s e ( V i ^ V i )
Average fitness 1 M i = 1 M S i
Average fitness size 1 M i = 1 M s i z e ( S i )
Standard deviation 1 M 1 i = 1 M S i M e a n 2
Table 4. Proposed binary DTACO versus other optimization algorithms.
Table 4. Proposed binary DTACO versus other optimization algorithms.
bDTACObDTObACObPSObGWObGAbWOA
Average error0.50270.52650.53080.54720.5710.56940.5708
Average Select size0.47280.80610.61520.67280.67280.70730.8362
Average Fitness0.58320.60770.61080.59940.59780.64970.6056
Best Fitness0.4850.56120.51410.51970.57810.56840.5697
Worst Fitness0.58350.67120.62920.58660.64580.6660.6458
Standard deviation Fitness0.40550.42840.41180.41020.40960.44640.4118
Table 5. The outcomes of the ANOVA test for the suggested algorithm and the algorithms under comparison.
Table 5. The outcomes of the ANOVA test for the suggested algorithm and the algorithms under comparison.
SSDFMSF (DFn, DFd)p Value
Treatment (between columns)0.0466760.007779F (6, 63) = 311.2p < 0.0001
Residual (within columns)0.001575630.000025--
Total0.0482569---
Table 6. Wilcoxon signed-rank test results of the proposed bDTACO and other optimization algorithms.
Table 6. Wilcoxon signed-rank test results of the proposed bDTACO and other optimization algorithms.
bDTACObDTObACObPSObGWObGAbWOA
Theoretical median0000000
Actual median0.50270.52650.53080.54720.5710.56940.5708
Number of values10101010101010
Wilcoxon signed-rank test
Sum of signed ranks (W)55555555555555
Sum of positive ranks55555555555555
Sum of negative ranks0000000
p value (two-tailed)0.0020.0020.0020.0020.0020.0020.002
Exact or estimate?ExactExactExactExactExactExactExact
Significant (alpha = 0.05)?YesYesYesYesYesYesYes
How big is the discrepancy?
Discrepancy0.50270.52650.53080.54720.5710.56940.5708
Table 7. Evaluation criteria for predictions.
Table 7. Evaluation criteria for predictions.
MetricFormula
RMSE 1 N n = 1 N ( V n ^ V n ) 2
RRMSE R M S E n = 1 N V n ^ × 100
MAE 1 N n = 1 N | V n ^ V n |
MBE 1 N n = 1 N ( V n ^ V n )
NSE 1 n = 1 N ( V n V n ^ ) 2 n = 1 N ( V n V n ^ ¯ ) 2
WI 1 n = 1 N | V n ^ V n | n = 1 N | V n V n ¯ | + | V n ^ V n ^ ¯ |
R2 1 n = 1 N ( V n V n ^ ) 2 n = 1 N n = 1 N V n ) V n 2
r n = 1 N ( V n ^ V n ^ ¯ ) ( V n V n ¯ ) n = 1 N ( V n ^ V n ^ ¯ ) 2 n = 1 N ( V n V n ¯ ) 2
Table 8. Proposed optimizing ensemble DTACO model versus basic models’ results.
Table 8. Proposed optimizing ensemble DTACO model versus basic models’ results.
RMSEMAEMBErR2RRMSENSEWI
MLP0.0456910.0346970.0030410.9794180.95926014.0201770.9587700.911594
SVR0.0429580.0335540.0057640.9819500.96422513.1815720.9635550.914505
RF0.0410330.029360−0.0019950.9839230.96810429.8564230.9667470.925193
Ensemble DTACO0.0038710.006723−0.0002370.9990480.9980963.0289310.9980760.982871
Table 9. Description of the proposed DTACO-based model and other models’ results from RMSE.
Table 9. Description of the proposed DTACO-based model and other models’ results from RMSE.
bDTACObDTObACObPSObGWObGAbWOA
Number of values10101010101010
Minimum0.003770.0048680.005880.006710.006990.007860.00799
Maximum0.003890.006680.0063880.0083710.0075990.0090790.00998
Range0.000120.0018120.0005080.0016610.0006090.0012190.00199
Mean0.0038620.0056990.0059620.0068920.0071330.0081370.008929
Std. deviation3.29  × 10 5 0.0004290.0001780.0005220.0002360.0004770.000587
Std. error of Mean1.04  × 10 5 0.0001365.64  × 10 5 0.0001657.47  × 10 5 0.0001510.000186
Harmonic mean0.0038620.005670.0059570.0068620.0071260.0081140.008893
Skewness−2.9270.65322.0753.111.2531.436−0.2714
Kurtosis9.0764.7093.4319.739−0.11020.49660.8392
Table 10. The outcomes of the ANOVA test for the comparison models and the suggested ensemble DTACO.
Table 10. The outcomes of the ANOVA test for the comparison models and the suggested ensemble DTACO.
SSDFMSF (DFn, DFd)p Value
Treatment (between columns)0.00016960.00002808F (6, 63) = 175.9p < 0.0001
Residual (within columns)1.01  × 10 5 631.596  × 10 7 --
Total0.00017969---
Table 11. Comparison between the models that were compared using the Wilcoxon signed-rank test and the proposed ensemble DTACO.
Table 11. Comparison between the models that were compared using the Wilcoxon signed-rank test and the proposed ensemble DTACO.
bDTACObDTObACObPSObGWObGAbWOA
Theoretical median0000000
Actual median0.003870.005680.005880.006710.006990.007860.00899
Number of values10101010101010
Wilcoxon signed-rank test
Sum of signed ranks (W)55555555555555
Sum of positive ranks55555555555555
Sum of negative ranks0000000
p value (two-tailed)0.0020.0020.0020.0020.0020.0020.002
Exact or estimate?ExactExactExactExactExactExactExact
Significant (alpha = 0.05)?YesYesYesYesYesYesYes
How big is the discrepancy?
Discrepancy0.003870.005680.005880.006710.006990.007860.00899
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Alharbi, A.H.; Abdelhamid, A.A.; Ibrahim, A.; Towfek, S.K.; Khodadadi, N.; Abualigah, L.; Khafaga, D.S.; Ahmed, A.E. Improved Dipper-Throated Optimization for Forecasting Metamaterial Design Bandwidth for Engineering Applications. Biomimetics 2023, 8, 241. https://doi.org/10.3390/biomimetics8020241

AMA Style

Alharbi AH, Abdelhamid AA, Ibrahim A, Towfek SK, Khodadadi N, Abualigah L, Khafaga DS, Ahmed AE. Improved Dipper-Throated Optimization for Forecasting Metamaterial Design Bandwidth for Engineering Applications. Biomimetics. 2023; 8(2):241. https://doi.org/10.3390/biomimetics8020241

Chicago/Turabian Style

Alharbi, Amal H., Abdelaziz A. Abdelhamid, Abdelhameed Ibrahim, S. K. Towfek, Nima Khodadadi, Laith Abualigah, Doaa Sami Khafaga, and Ayman EM Ahmed. 2023. "Improved Dipper-Throated Optimization for Forecasting Metamaterial Design Bandwidth for Engineering Applications" Biomimetics 8, no. 2: 241. https://doi.org/10.3390/biomimetics8020241

Article Metrics

Back to TopTop