Next Article in Journal
Exploring Anisotropic Mechanical Characteristics in 3D-Printed Polymer Biocomposites Filled with Waste Vegetal Fibers
Next Article in Special Issue
Recent Developments in Iterative Algorithms for Digital Metrics
Previous Article in Journal
Sensitive Data Privacy Protection of Carrier in Intelligent Logistics System
Previous Article in Special Issue
On (α,p)-Cyclic Contractions and Related Fixed Point Theorems
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Application to Activation Functions through Fixed-Circle Problems with Symmetric Contractions

1
Department of Mathematics, Division of Science and Technology, University of Education, Lahore 54770, Pakistan
2
Department of Mathematics, Government College University, Katchery Road, Lahore 54000, Pakistan
3
Abdus Salam School of Mathematical Sciences, Government College University, Lahore 54600, Pakistan
4
Center for Mathematical Research, University of Sanya, Sanya 572022, China
5
Faculty of Mechanical Engineering, University of Belgrade, Kraljice Marije 16, 11120 Beograd, Serbia
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Symmetry 2024, 16(1), 69; https://doi.org/10.3390/sym16010069
Submission received: 6 December 2023 / Revised: 28 December 2023 / Accepted: 29 December 2023 / Published: 4 January 2024
(This article belongs to the Special Issue New Trends in Fixed Point Theory with Emphasis on Symmetry)

Abstract

:
In this paper, our main aim is to present innovative fixed-point theorems that provide solutions to the fixed-circle problem with symmetric contractions. We accomplish this by employing operator enrichment techniques within the context of Banach spaces. Furthermore, we demonstrate the practical application of these theorems by showcasing their relevance to the rectified linear unit (ReLU) activation function. By exploring the connection between fixed points and activation functions, our work contributes to a deeper understanding of the behavior and properties of these fundamental mathematical concepts.

1. Introduction

The initial breakthrough in addressing the fixed-circle problem was achieved in a study conducted in [1], which proposed a solution specifically for metric spaces. Since then, subsequent research has focused on exploring new solutions for both metric spaces and generalized metric spaces. For example, Özgür et al. [1] introduced fixed-circle results using the Caristi-type contraction on metric spaces. This approach was further developed by researchers in [2,3], who proved new fixed-circle theorems by employing Wardowski’s technique and classical contractive conditions. The fixed-circle problem was also investigated in the context of S-metric spaces in studies conducted in [4,5], where a modified Khan-type contractive condition was utilized to establish a novel fixed-circle theorem in another study [6]. Additionally, generalized fixed-circle results were obtained for Sb-metric spaces and parametric N b -metric spaces, incorporating a geometric perspective. Furthermore, Mlaiki et al. [7] proposed investigating fixed-circle theorems on extended M b -metric spaces. In 2020, Taş extended the concept of fixed circles to include Jaggi-type, Dass–Gupta-type-I, and Dass–Gupta-type-II bilateral contractions. For a more comprehensive understanding of this research direction, we recommend referring to the studies conducted in [1,2,3,4,5,6,8,9,10] and the references therein.
Activation functions play a crucial role in neural networks as they significantly influence decision-making processes. Therefore, selecting the most suitable activation function is essential for effective network analysis. Several studies, such as [11,12], have provided comprehensive analyses of different activation functions and their real-world applications. It is worth noting that commonly used activation functions, including the Ramp function, ReLU function, and LeakyReLU function, have fixed-point sets consisting of fixed discs and fixed circles [10,13,14,15,16]. Fixed-circle theorems have been established and extended to various aspects, including discontinuous activation functions, as well as rectified linear unit activation functions employed in neural networks. Theoretical studies on neural networks often utilize well-known fixed-point theorems like the Banach fixed-point theorem and Brouwer’s fixed-point theorem. For instance, Li et al. [17] demonstrated the existence of a fixed point for every recurrent neural network using a geometric approach, with Brouwer’s fixed-point theorem ensuring the existence of a fixed point. This study highlights the significance of adopting a geometric viewpoint and leveraging theoretical fixed-point results in practical applications.
Operator enrichment techniques have emerged as a new avenue in fixed-point theory, inspired by Krasnoselskii’s fixed-point theorem [18] for nonexpansive operators. These techniques have motivated the exploration of various enriched classes of operators, such as enriched contractions and enriched ϕ -contractions [19], enriched Kannan contractions [20], enriched Chatterjea operators [21], enriched nonexpansive operators in Hilbert spaces [22], enriched multivalued contractions [23], enriched Ćirić–Reich–Rus contractions [24], enriched cyclic contractions [25], enriched modified Kannan pairs [26], and enriched quasi contractions [27]. Notably, Abbas et al. [23] established fixed-point results by imposing the condition that the orbital subset is a complete subset of a normed space (Theorem 3 of [23]), while Gronicki and Bisht [28] considered enriched Ćirić–Reich–Rus contraction operators and proved a fixed-point theorem by imposing the condition that the average operator is an asymptotically regular operator (Theorem 3.1 of [28]).
Motivated by the research mentioned above, this paper presents innovative solutions to the fixed-circle problem by utilizing Caristi-type, general Jaggi-type bilateral, general Dass–Gupta-type-I, and Dass–Gupta-type-II bilateral contractions enriched with operators. In Section 2, a brief survey related to the fixed-circle problem is provided. Section 3 then modifies the known contractive conditions, specifically the Jaggi-type bilateral contraction and the Dass–Gupta-type bilateral contraction, in order to derive new fixed-circle (fixed-disc, common fixed-circle, common fixed-disc) results. Additionally, Section 4 demonstrates the practical effectiveness of our theoretical findings by applying them to rectified linear units activation functions, thus highlighting their reliance on fixed circles.

2. Definition of the Problem

Consider a metric space ( X h ^ , ) and a self-operator T : X h ^ X h ^ . A point g ˚ X h ^ that satisfies T g ˚ = g ˚ is known as a fixed point of T . We can denote the set of all fixed points of T as F i x ( T ) .
Self-operators can have either a unique fixed point or multiple fixed points. For example, let us consider the metric space ( R , ) with the function : R × R [ 0 , + ) defined as ( g ˚ , ϑ ) = | g ˚ ϑ | , where g ˚ , ϑ R . Now, consider the self-operators T : R R and S : R R defined as T ( g ˚ ) = 1 g ˚ and S ( g ˚ ) = g ˚ 2 4 g ˚ + 6 , respectively, for all g ˚ R . In this case, T has a unique fixed point g ˚ 0 = 1 2 , while S has two fixed points g ˚ 1 = 2 and g ˚ 2 = 3 . When a self-operator has multiple fixed points, it raises the question of the geometric properties of these fixed points.
This question is known as the “fixed-circle problem” and has been extensively studied from a geometric perspective. The problem was initially discussed in [1] and has gained significant importance in both theoretical mathematical studies and various practical applications.
Now, let us define the notion of a fixed circle. Consider the metric space ( X h ^ , ) , and let T : X h ^ X h ^ be an operator. A circle C g ˚ 0 , r is defined as the set of all points g ˚ X h ^ such that ( g ˚ , g ˚ 0 ) = r , where g ˚ 0 X h ^ is the center and r 0 is the radius of the circle C g ˚ 0 , r .
Now, we can formally state the fixed-circle problem ([1]) in the context of a metric space. Let T : X h ^ X h ^ be an operator and C g ˚ 0 , r be a circle. If T g ˚ = g ˚ for every g ˚ C g ˚ 0 , r , then the circle C g ˚ 0 , r is referred to as the fixed circle of T .

3. A Survey of Recent Solutions

In 2017, Özgür and Taş initiated the study of fixed circles and proved the results for Caristi-type contractions on a metric space in [1].
The main results in [1] are stated as follows:
Theorem 1
 ([1]). Consider a metric space ( X h ^ , ) and let C g ˚ 0 , r be any circle on X h ^ . Let us define the operator ϕ : X h ^ [ 0 , + ) as ϕ ( g ˚ ) = ( g ˚ , g ˚ 0 ) , for all g ˚ X h ^ . If there exists a self-operator T on X h ^ satisfying the following conditions for all g ˚ C g ˚ 0 , r ,
(C1)
( g ˚ , T g ˚ ) ϕ ( g ˚ ) ϕ ( T g ˚ ) ;
(C2)
( T g ˚ , g ˚ 0 ) r ,
then the circle C g ˚ 0 , r is a fixed circle for T .
Theorem 2
 ([1]). Consider a metric space ( X h ^ , ) and let C g ˚ 0 , r be any circle on X h ^ . Let us define the operator ϕ : X h ^ [ 0 , + ) as ϕ ( g ˚ ) = ( g ˚ , g ˚ 0 ) , for all g ˚ X h ^ . If there exists a self-operator T on X h ^ satisfying the following conditions for all g ˚ C g ˚ 0 , r ,
(C1)*
( g ˚ , T g ˚ ) ϕ ( g ˚ ) + ϕ ( T g ˚ ) 2 r ;
(C2)*
( T g ˚ , g ˚ 0 ) r ,
then the circle C g ˚ 0 , r is a fixed circle for T .
Theorem 3
 ([1]). Consider a metric space ( X h ^ , ) and let C g ˚ 0 , r be any circle on X h ^ . Let us define the operator ϕ : X h ^ [ 0 , + ) as ϕ ( g ˚ ) = ( g ˚ , g ˚ 0 ) , for all g ˚ X h ^ . If there exists a self-operator T on X h ^ satisfying the following conditions for all g ˚ C g ˚ 0 , r and some h [ 0 , 1 )
(C1)**
( g ˚ , T g ˚ ) ϕ ( g ˚ ) ϕ ( T g ˚ ) ;
(C2)**
h ( g ˚ , T g ˚ ) + ( T g ˚ , g ˚ 0 ) r ,
then the circle C g ˚ 0 , r is a fixed circle for T .
For more results in this direction, we refer the reader to [2,3,4,5,8] and the references mentioned therein. These fixed circle results made a significant contribution in fixed-point theory.
In 2020, Taş [10] extended the concept of fixed circles to Jaggi-type, Dass–Gupta-type-I, and Dass–Gupta-type-II bilateral contractions in [10].
The main definitions and results of [10] are the following:
Definition 1
 ([10]). If there exist functions ϕ : X h ^ ( 0 , + ) and g ˚ 0 X h ^ such that for all g ˚ X h ^ { g ˚ 0 } ,
( g ˚ , T g ˚ ) > 0 ( g ˚ , T g ˚ ) ϕ ( g ˚ ) ϕ ( T g ˚ ) R T ( g ˚ 0 , g ˚ ) ,
where
R T ( g ˚ , σ ˚ ) = max ( g ˚ , σ ˚ ) , ( g ˚ , T g ˚ ) ( σ ˚ , T σ ˚ ) ( g ˚ , σ ˚ ) .
then T is called a Jaggi-type bilateral g ˚ 0 -contractive operator.
Theorem 4
 ([10]). Let T : X h ^ X h ^ be a Jaggi-type bilateral g ˚ 0 -contractive operator with g ˚ 0 X h ^ and r defined as
r = inf ( g ˚ , T g ˚ ) ϕ ( g ˚ ) : g ˚ T g ˚ , g ˚ X h ^ .
If T g ˚ 0 = g ˚ 0 , then T fixes the circle C g ˚ 0 , r .
Definition 2
 ([10]). If there exists a function ϕ : X h ^ ( 0 , + ) and g ˚ 0 X h ^ such that for all g ˚ X h ^ { g ˚ 0 } ,
( g ˚ , T g ˚ ) > 0 ( g ˚ , T g ˚ ) [ ϕ ( g ˚ ) ϕ ( T g ˚ ) ] Q T ( g ˚ , g ˚ 0 )
where,
Q T ( g ˚ , σ ˚ ) = max ( g ˚ , σ ˚ ) , ( 1 + ( g ˚ , T g ˚ ) ) ( σ ˚ , T σ ˚ ) 1 + ( g ˚ , σ ˚ ) .
then T is called a Dass–Gupta-type-II bilateral g ˚ 0 -contractive operator.
Theorem 5
 ([10]). Let T : X h ^ X h ^ be a Dass–Gupta-type-II bilateral g ˚ 0 -contractive operator with g ˚ 0 X h ^ and r defined as in Equation (2). If T g ˚ 0 = g ˚ 0 , then T fixes the circle C g ˚ 0 , r .

4. New Fixed-Circle Theorems

Throughout this paper, we denote ( X h ^ , · ) as the normed space over the field R (the set of all real numbers). Let T : X h ^ X h ^ be a given operator and ω ( 0 , 1 ) . An operator T ω given by
T ω ( g ˚ ) = ( 1 ω ) g ˚ + ω T g ˚ for all g ˚ X h ^ ,
is called an averaged operator of T . Note that
F i x ( T ) = F i x ( T ω ) .

4.1. Fixed Circle Results for Caristi-Type Contractions

Throughout this section, we denote ϕ : X h ^ [ 0 , + + ) as an operator defined by
ϕ ( g ˚ ) = g ˚ g ˚ 0 , for all g ˚ X h ^ .
We start with the following result.
Theorem 6.
Let ( X h ^ , · ) be a normed space and T : X h ^ X h ^ . Assume that there exists b [ 0 , + + ) such that following conditions are satisfied for each g ˚ C g ˚ 0 , r ;
( C 1 )
1 b + 1 g ˚ T g ˚ ϕ ( g ˚ ) ϕ b g ˚ + T g ˚ b + 1 ;
( C 2 )
1 b + 1 ( 1 + b ) g ˚ 0 b g ˚ T g ˚ r .
Then, C g ˚ 0 , r is the fixed circle of T .
Proof. 
Let us denote ω = 1 1 + b . Clearly, 0 < ω < 1 for any g ˚ C g ˚ 0 , r and condition ( C 1 ) becomes
ω g ˚ T g ˚ ϕ ( g ˚ ) ϕ 1 ω 1 g ˚ + T g ˚ ω , ω g ˚ ω T g ˚ ϕ ( g ˚ ) ϕ 1 ω g ˚ + ω T g ˚ , g ˚ ( g ˚ ω g ˚ + ω T g ˚ ) ϕ ( g ˚ ) ϕ ( T ω g ˚ ) ,
which can be written equivalently as
g ˚ T ω g ˚ ϕ ( g ˚ ) ϕ ( T ω g ˚ ) .
Based on the same procedure, for any g ˚ C g ˚ 0 , r , the condition ( C 2 ) becomes
g ˚ 0 T ω g ˚ r ,
which can also be written as
ϕ T ω g ˚ = g ˚ 0 T ω g ˚ r .
By using (7) and (6), we get
0 g ˚ T ω g ˚ ϕ ( g ˚ ) r = 0 .
Thus, we get g ˚ = T ω g ˚ for all g ˚ C g ˚ 0 , r . Hence, C g ˚ 0 , r is a fixed circle for T .
Example 1.
Let ( Y , μ ) be a finite measure space. The classical Lebesgue space X ^ h = L 2 ( Y , μ ) is defined as the set of all Borel measurable functions f : Y R such that Y | f ( y ) | 2 d μ ( y ) < + . It is known that X ^ h , equipped with the norm f X ^ h = Y | f | 2 d μ 1 2 , is a Banach space. Let α be a constant, and consider the Borel measurable function g ( y ) = α for all y Y , satisfying
g g ˚ 0 r .
Define the operator T : L 2 ( Y , μ ) L 2 ( Y , μ ) as follows:
T g ˚ = g ˚ if g ˚ C g ˚ 0 , r , 2 g g ˚ otherwise .
Taking b = 1 , we have ω = 1 2 . It follows from the proof of Theorem 6 that the contractive conditions ( C 1 ) and ( C 2 ) are equivalent to (7) and (6), respectively. On the other hand, for ω = 1 2 , the averaged operator T 1 2 becomes
T 1 2 g ˚ = g ˚ if g ˚ C g ˚ 0 , r , g otherwise .
It can be easily seen that conditions (7) and (6) are satisfied. Clearly, C g ˚ 0 , r is a fixed circle of T .
Theorem 7.
Let ( X h ^ , · ) be a normed space and T : X h ^ X h ^ . Assume that there exists b [ 0 , + + ) such that following conditions are satisfied for each g ˚ C g ˚ 0 , r ;
( C 1 ) *
1 b + 1 g ˚ T g ˚ ϕ ( g ˚ ) + ϕ b g ˚ + T g ˚ b + 1 2 r ;
( C 2 ) *
1 b + 1 ( b + 1 ) g ˚ 0 ( b g ˚ + T g ˚ ) r .
Then, C g ˚ 0 , r is the fixed circle of T .
Proof. 
We omit the proof since it follows the same pattern as the proof of Theorem 6. □
Theorem 8.
Let ( X h ^ , · ) be a normed space and T : X h ^ X h ^ . Assume that there exist b [ 0 , + + ) and h [ 0 , 1 ) such that following conditions are satisfied for each g ˚ C g ˚ 0 , r ;
( C 1 ) * *
1 b + 1 g ˚ T g ˚ ϕ ( g ˚ ) ϕ b g ˚ + T g ˚ b + 1 ;
( C 2 ) * *
h b + 1 g ˚ T g ˚ + 1 1 + b ( b + 1 ) g ˚ 0 ( b g ˚ + T g ˚ ) r .
Then, C g ˚ 0 , r is the fixed circle of T .
Proof. 
Let us denote ω = 1 1 + b . Based on the same procedure as in proof of Theorem 6, the contractive condition ( C 1 ) * * becomes
g ˚ T ω g ˚ ϕ ( g ˚ ) ϕ ( T ω g ˚ ) , for all g ˚ C g ˚ 0 , r .
Similarly, for the value of ω = 1 1 + b , the condition ( C 2 ) * * can also be written equivalently in the form of
h g ˚ T ω g ˚ + g ˚ 0 T ω g ˚ r , for all g ˚ C g ˚ 0 , r .
Using the conditions (8) and (9), we obtain
g ˚ T ω g ˚ ϕ ( g ˚ ) ϕ ( T ω g ˚ ) = g ˚ g ˚ 0 g ˚ 0 T ω g ˚ = r g ˚ 0 T ω g ˚ h g ˚ T ω g ˚ + g ˚ 0 T ω g ˚ g ˚ 0 T ω g ˚ = h g ˚ T ω g ˚ ,
which is contradiction to our assumption since h [ 0 , 1 ) . Therefore, we get T ω g ˚ = g ˚ and C g ˚ 0 , r is the fixed circle of T .
Remark 1.
If we take b = 0 in Theorems 6–8, we obtain Theorems 1–3, respectively, of [1] in the setting of normed spaces.

4.2. Fixed Circle/Disc Results for Bilateral-Type Contractions

We introduce the following idea.
Definition 3.
An operator T : X h ^ X h ^ is called a general Jaggi-type bilateral symmetric contraction if there is an operator ξ : X h ^ ( 0 , + ) and there exist b [ 0 , + ) and g ˚ 0 X h ^ such that for all g ˚ X h ^ { g ˚ 0 } , we have
1 b + 1 g ˚ T g ˚ > 0 1 b + 1 g ˚ T g ˚ ξ ( g ˚ ) ξ T g ˚ + b g ˚ 1 + b R T * ( g ˚ , g ˚ 0 ) ,
where
R T * ( g ˚ , g ˚ 0 ) = max g ˚ g ˚ 0 , g ˚ T g ˚ g ˚ 0 T g ˚ 0 ( b + 1 ) 2 g ˚ g ˚ 0 ,
provided that for all 1 b + 1 g ˚ T g ˚ > 0 , we have ξ ( T g ˚ + b g ˚ b + 1 ) < ξ ( g ˚ ) .
In order to denote the involvement of parameters in (10), we shall also call T a ( b , g ˚ 0 , ξ ) -general Jaggi-type bilateral symmetric contraction.
Theorem 9.
Let T : X h ^ X h ^ be a ( b , g ˚ 0 , ξ ) -general Jaggi-type bilateral symmetric contraction and r be defined as
r = inf g ˚ T g ˚ ( b + 1 ) ξ ( g ˚ ) : g ˚ T g ˚ , g ˚ X h ^ .
Then, T fixes the circle C g ˚ 0 , r , provided that T g ˚ 0 = g ˚ 0 .
Proof. 
Let us denote ω = 1 b + 1 . Clearly, ω ( 0 , 1 ) . The contractive condition (10) becomes
ω g ˚ T g ˚ > 0 g ˚ T ω g ˚ ξ ( g ˚ ) ξ T g ˚ + 1 ω 1 g ˚ 1 / ω R T * * ( g ˚ , g ˚ 0 ) ,
which can be equivalently written as
g ˚ T ω g ˚ > 0 g ˚ T ω g ˚ { ξ ( g ˚ ) ξ T ω g ˚ } R T * * ( g ˚ , g ˚ 0 ) ,
where
R T * * ( g ˚ , g ˚ 0 ) = max g ˚ g ˚ 0 , g ˚ T ω g ˚ g ˚ 0 T ω g ˚ 0 g ˚ g ˚ 0 .
Moreover, also notice that for the value of ω = 1 b + 1 , we get
r = inf g ˚ T ω g ˚ ξ ( g ˚ ) : g ˚ T g ˚ , g ˚ X h ^ .
We divide the proof into two following cases.
Case (i):
Assume that r = 0 . Then, in this case, we have C g ˚ 0 , r = { g ˚ 0 } . Clearly, T fixes C g ˚ 0 , r .
Case (ii):
Assume that r > 0 . Clearly, we have R T * ( g ˚ , g ˚ 0 ) = | | g ˚ g ˚ 0 | | . Indeed, | | g ˚ T ω g ˚ | | > 0 .
By using (14) and R T * * ( g ˚ , g ˚ 0 ) = | | g ˚ g ˚ 0 | | , we obtain
| | g ˚ T ω g ˚ | | ξ ( g ˚ ) ξ T ω g ˚ | | g ˚ g ˚ 0 | | , = ξ ( g ˚ ) ξ T ω g ˚ r ξ ( g ˚ ) ξ T ω g ˚ | | g ˚ T g ˚ | | ( b + 1 ) ξ ( g ˚ ) = ξ ( g ˚ ) ξ ( T ω g ˚ ) | | g ˚ T ω g ˚ | | ξ ( g ˚ ) = 1 ξ ( T ω g ˚ ) ξ ( g ˚ ) | | g ˚ T ω g ˚ | | ,
and therefore, we have
| | g ˚ T ω g ˚ | | 1 ξ ( T ω g ˚ ) ξ ( g ˚ ) | | g ˚ T ω g ˚ | | .
Note that 1 ξ ( T ω g ˚ ) ξ ( g ˚ ) < 1 . Therefore, condition (15) becomes
| | g ˚ T ω g ˚ | | 1 ξ ( T ω g ˚ ) ξ ( g ˚ ) | | g ˚ T ω g ˚ | | < | | g ˚ T ω g ˚ | | .
which is a contradiction, so our supposition is wrong and we have T ω g ˚ = g ˚ . Hence, T g ˚ = g ˚ for all g ˚ C g ˚ 0 , r ; that is, T fixes the circle C g ˚ 0 , r .
Corollary 1.
Assume T satisfies all the assumptions of Theorem 9. If T g ˚ 0 = g ˚ 0 , then T fixes the disc D g ˚ 0 , r .
Proof. 
The proof is obvious and hence omitted. □
Definition 4.
An operator T : X h ^ X h ^ is called a general Dass–Gupta-type-I bilateral symmetric contraction if there is an operator ξ : X h ^ ( 0 , 1 ) and there exist b [ 0 , + ) and g ˚ 0 X h ^ such that for all g ˚ X h ^ { g ˚ 0 } , we have
1 b + 1 g ˚ T g ˚ > 0 1 b + 1 g ˚ T g ˚ ξ ( g ˚ ) ξ T g ˚ + b g ˚ 1 + b Q T * ( g ˚ 0 , g ˚ ) ,
where
Q T * ( g ˚ 0 , g ˚ ) = max g ˚ g ˚ 0 , ( b + 1 + g ˚ 0 T g ˚ 0 ) g ˚ T g ˚ ( b + 1 ) 2 ( 1 + g ˚ g ˚ 0 ) .
provided that for all 1 b + 1 g ˚ T g ˚ > 0 , we have ξ ( T g ˚ + b g ˚ b + 1 ) < ξ ( g ˚ ) .
In order to denote the involvement of parameters in (17), we shall also call T a ( b , g ˚ 0 , ξ ) -Dass–Gupta-type-I bilateral symmetric contraction.
We state the following theorem for the class of ( b , g ˚ 0 , ξ ) -Dass–Gupta-type-I bilateral symmetric contractions.
Theorem 10.
Let T : X h ^ X h ^ be a ( b , g ˚ 0 , ξ ) -Dass–Gupta-type-I bilateral symmetric contraction and r be defined as (11). Then, T fixes the circle C g ˚ 0 , r , provided that T g ˚ 0 = g ˚ 0 .
Proof. 
Let us denote ω = 1 b + 1 . Clearly, ω ( 0 , 1 ) . The contractive condition (17) becomes
g ˚ T ω g ˚   > 0   g ˚ T ω g ˚   ξ ( g ˚ ) ξ T ω g ˚ Q T * * ( g ˚ 0 , g ˚ ) ,
where
Q T * * ( g ˚ 0 , g ˚ ) = max | | g ˚ g ˚ 0 | | , ( 1 + | | g ˚ 0 T ω g ˚ 0 | | ) | | g ˚ T ω g ˚ | | 1 + | | g ˚ g ˚ 0 | | .
Moreover,
r = inf g ˚ T ω g ˚ ξ ( g ˚ ) : g ˚ T g ˚ , g ˚ X h ^ .
We divide the proof into the following two cases.
Case (i):
Assume that r = 0 . Then, in this case, we have C g ˚ 0 , r = { g ˚ 0 } . Clearly, T fixes C g ˚ 0 , r .
Case (ii):
Assume that r > 0 . Clearly, we have Q T * * ( g ˚ 0 , g ˚ ) = max r , | | g ˚ T ω g ˚ | | 1 + r . Indeed, g ˚ T ω g ˚ .
By using (18) and Q T * * ( g ˚ 0 , g ˚ ) = max r , | | g ˚ T ω g ˚ | | 1 + r , we obtain
| | g ˚ T ω g ˚ | | ξ ( g ˚ ) ξ T ω g ˚ max r , | | g ˚ T ω g ˚ | | 1 + r , ξ ( g ˚ ) ξ T ω g ˚ max | | g ˚ T ω g ˚ | | ξ ( g ˚ ) , | | g ˚ T ω g ˚ | | 1 + r , = 1 ξ ( g ˚ ) ξ ( g ˚ ) ξ ( T ω g ˚ ) max | | g ˚ T ω g ˚ | | , | | g ˚ T ω g ˚ | | ξ ( g ˚ ) 1 + r , = 1 ξ ( g ˚ ) ξ ( T ω g ˚ ) | | g ˚ T ω g ˚ | | .
Since ξ ( g ˚ ) ξ ( T ω g ˚ ) > 0 , we have
| | g ˚ T ω g ˚ | | 1 ξ ( g ˚ ) ξ ( T ω g ˚ ) | | g ˚ T ω g ˚ | | < | | g ˚ T ω g ˚ | |
or
| | g ˚ T ω g ˚ | | < | | g ˚ T ω g ˚ | | .
which is a contradiction, so our supposition is wrong and we have T ω g ˚ = g ˚ . Hence, T g ˚ = g ˚ ; that is, T fixes the circle C g ˚ 0 , r .
Remark 2.
If we take b = 0 in Theorems 9 and 10, we obtain Theorems 3.2 and 3.10 in [10], respectively, in the setting of normed spaces.
Corollary 2.
Assume T satisfies all the assumptions of Theorem 10. If T g ˚ 0 = g ˚ 0 , then T fixes the disc D g ˚ 0 , r .
Remark 3.
If we take b = 0 in Corollaries 1 and 2, we obtain Corollaries 3.3 and 3.11 in [10], respectively, in the setting of normed spaces.
Definition 5.
An operator T : X h ^ X h ^ is called a general ( b , g ˚ 0 , ϕ ) -Dass–Gupta-type-II bilateral symmetric contraction if there is an operator ξ : X h ^ ( 0 , + ) and there exist b [ 0 , + ) and g ˚ 0 X h ^ such that for all and g ˚ X h ^ { g ˚ 0 } , we have
1 b + 1 g ˚ T g ˚ > 0 1 b + 1 g ˚ T g ˚ ξ ( g ˚ ) ξ T g ˚ + b g ˚ 1 + b Q T * ( g ˚ , g ˚ 0 ) .
where
Q T * ( g ˚ , g ˚ 0 ) = max g ˚ g ˚ 0 , ( b + 1 + g ˚ T g ˚ ) g ˚ 0 T g ˚ 0 ( b + 1 ) 2 ( 1 + g ˚ g ˚ 0 ) .
provided that for all 1 b + 1 g ˚ T g ˚ > 0 , we have ξ ( T g ˚ + b g ˚ b + 1 ) < ξ ( g ˚ ) .
In order to denote the involvement of parameters in (20), we shall also call T a ( b , g ˚ 0 , ξ ) -Dass–Gupta-type-II bilateral symmetric contractions.
We state the following theorem for the class of ( b , g ˚ 0 , ξ ) -Dass–Gupta-type-II bilateral symmetric contraction.
Theorem 11.
Let T : X h ^ X h ^ be a ( b , g ˚ 0 , ϕ ) -Dass–Gupta-type-II bilateral symmetric contraction and r be defined as (11). Then, T fixes the circle C g ˚ 0 , r , provided that T g ˚ 0 = g ˚ 0 .
Proof. 
We omit the proof because it follows from similar arguments as used in the proof of Theorem 10. □
Corollary 3.
Assume T satisfies all the assumptions of Theorem 11. If T g ˚ 0 = g ˚ 0 , then T fixes the disk D g ˚ 0 , r .
Now, we present an example which supports our result.
Example 2.
Let X h ^ = R be the usual metric space and T : X h ^ X h ^ be defined by
T g ˚ = g ˚ ; g ˚ [ 1 , 1 ] , g ˚ ; g ˚ ( , 1 ) ( 1 , + ) .
Let
ξ ( g ˚ ) = 1 ; g ˚ [ 1 , 1 ] , 2 | g ˚ | ; g ˚ ( , 1 ) ( 1 , + ) .
If we take g ˚ = 2 , then T ( 2 ) = 2 and thus we have | g ˚ T g ˚ | = 4 > 0 . However, ξ ( 2 ) ξ ( 2 ) = 2 | 2 | 2 | 2 | = 0 and hence for | g ˚ T g ˚ | > 0 , we have 4 0 . Thus, T does not satisfy the condition of Definition 1.
If we take b = 1 , then ω = 1 2 . In this case, we obtain
T 1 2 g ˚ = g ˚ ; g ˚ [ 1 , 1 ] , 0 ; g ˚ ( , 1 ) ( 1 , + ) .
Moreover, the contractive condition (10) reduces to
g ˚ T 1 2 g ˚ > 0 g ˚ T 1 2 g ˚ ξ ( g ˚ ) ξ T 1 2 g ˚ R T * * ( g ˚ , g ˚ 0 ) ,
where
R T * * ( g ˚ , g ˚ 0 ) = max g ˚ g ˚ 0 , g ˚ T 1 2 g ˚ g ˚ 0 T 1 2 g ˚ 0 g ˚ g ˚ 0 ,
provided that for all g ˚ T 1 2 g ˚ > 0 , we have ξ ( T 1 2 g ˚ ) < ξ ( g ˚ ) .
Clearly, T is a ( 1 , 0 , ξ ) -general Jaggi-type bilateral symmetric contraction. Indeed, for g ˚ ( , 1 ) ( 1 , + ) , we have 1 2 | g ˚ T 1 2 g ˚ |   =   | g ˚ |   > 0 , and
| g ˚ T 1 2 g ˚ |   =   | g ˚ |   2 | g ˚ |     1 | g ˚ | = [ ξ ( g ˚ ) ξ ( T 1 2 g ˚ ) ] R T * * ( g ˚ , 0 ) .
We get
r = inf g ˚ T g ˚ 2 ξ ( g ˚ ) : g ˚ T g ˚ , g ˚ ( , 1 ) ( 1 , + ) = inf g ˚ T 1 2 g ˚ ξ ( g ˚ ) : g ˚ T g ˚ , g ˚ ( , 1 ) ( 1 , + ) = inf | g ˚ | 2 | g ˚ | : g ˚ T g ˚ , g ˚ ( , 1 ) ( 1 , + ) = 1 2
Hence, T satisfies the conditions of Theorem 9 and Corollary 1. Consequently, T fixes C 0 , 1 2 = { 1 2 , 1 2 } and D 0 , 1 2 = [ 1 2 , 1 2 ] .
Example 3.
Let X h ^ = R be the usual metric space and T : X h ^ X h ^ be defined by
T g ˚ = g ˚ ; g ˚ [ 2 , + ) , g ˚ ; g ˚ ( , 2 ) .
Let
ξ ( g ˚ ) = 1 / 2 ; g ˚ [ 2 , + ) , | g ˚ | ; g ˚ ( , 2 ) .
If we take g ˚ = 3 , then T ( 3 ) = 3 and thus we have | g ˚ T g ˚ | = 6 > 0 . However, ξ ( 3 ) ξ ( 3 ) = | 3 | | 3 | = 0 and hence for | g ˚ T g ˚ | > 0 , we have 6 0 . Thus, T does not satisfy the condition of Definition 2.
If we take b = 1 , then ω = 1 / 2 . In this case, we obtain
T 1 2 g ˚ = g ˚ ; g ˚ [ 2 , + ) 0 ; g ˚ ( , 2 ) .
Moreover, the contractive condition (20) reduces to
| g ˚ T 1 2 g ˚ |   >   0   | g ˚ T 1 2 g ˚ |     ξ ( g ˚ ) ξ T 1 2 g ˚ Q T * * ( g ˚ , g ˚ 0 ) ,
where
Q T * * ( g ˚ , g ˚ 0 ) = max g ˚ g ˚ 0 , 1 + g ˚ T 1 2 g ˚ g ˚ 0 T 1 2 g ˚ 0 g ˚ g ˚ 0 ,
provided that for all g ˚ T 1 2 g ˚ > 0 , we have ξ ( T 1 2 g ˚ ) < ξ ( g ˚ ) .
Clearly, T is a ( 1 , 0 , ξ ) -general Dass–Gupta-type-II bilateral symmetric contraction. Indeed, for g ˚ ( , 2 ) , we have 1 / 2 | g ˚ T 1 2 g ˚ |   =   | g ˚ |   >   0 , and
| g ˚ T 1 2 g ˚ |   =   | g ˚ |     [ | g ˚ | 1 / 2 ] | g ˚ |   =   [ ξ ( g ˚ ) ξ ( T g ˚ ) ] Q T * * ( g ˚ , 0 ) .
We get
r = inf g ˚ T g ˚ 2 ξ ( g ˚ ) : g ˚ T g ˚ , g ˚ ( , 2 ) = inf g ˚ T 1 2 g ˚ ξ ( g ˚ ) : g ˚ T g ˚ , g ˚ ( , 2 ) = inf | g ˚ | | g ˚ | : g ˚ T g ˚ , g ˚ ( , 2 ) = 1 .
Hence, T satisfies the conditions of Theorem 11 and Corollary 3. Consequently, T fixes C 0 , 1 = { 1 , 1 } and disk D 0 , 1 = [ 1 , 1 ] .

5. Application

Fixed-circle theorems are relevant to activation functions in neural networks because they offer valuable insights into the behavior of iterative processes and their convergence. Activation functions have a vital role in determining the output of a neuron based on its input within a neural network.
By examining fixed-circle theorems, we can analyze the characteristics of activation functions in terms of fixed points or stable cycles. These theorems establish conditions under which iterative processes, such as forward propagation in a neural network, converge to a fixed point or cycle.
Comprehending the properties of fixed-circle theorems can aid in the design and selection of appropriate activation functions for neural networks. It enables us to evaluate the convergence properties of the network and ensure that the learning process attains the desired solution.
In conclusion, the connection between fixed-circle theorems and activation functions lies in their ability to provide insights into the convergence behavior of neural networks, enabling us to choose suitable activation functions for effective and efficient learning.
Activation functions are pivotal in neural networks as they facilitate learning and interpretation. Their primary function is to transform the input signal of a node in the neural network into an output signal. There are numerous examples of activation functions being utilized in neural networks, with “rectified linear units (ReLUs)” [10,29] being one of the most widely used activation functions.
Now, we consider the following activation function
N P R e L U ( g ˚ ) = T ( g ˚ ) = g ˚ ; g ˚ 0 α g ˚ + ω g ˚ g ˚ ω ; g ˚ < 0 ,
where α , ω ( 0 , 1 ) .
Note that,
T ω g ˚ = g ˚ ; g ˚ 0 α g ˚ ; g ˚ < 0 .
The average operator satisfies Theorem 9 on the usual metric space with g ˚ 0 = 1 and the function ξ : X h ^ ( 0 , + ) as
ξ ( g ˚ ) = 1 ; g ˚ = 0 | g ˚ | ; g ˚ 0
for all g ˚ R . Indeed, for g ˚ ( + , 0 ) , we get
| | g ˚ T ω g ˚ | | = | ( 1 α ) g ˚ |   >   0 ,
R T * * ( 1 , r ) = max | | 1 g ˚ | | , | | 1 T ω 1 | | | | g ˚ T ω g ˚ | | | | 1 g ˚ | | = | 1 g ˚ |
and
| | g ˚ T ω g ˚ | | =   | g ˚ | | 1 α | , <   | g ˚ | | 1 α | | 1 g ˚ | = ( | g ˚ | | α g ˚ | ) | 1 g ˚ | , = [ ξ ( g ˚ ) ξ ( α g ˚ ) ] | 1 g ˚ | = [ ξ ( g ˚ ) ξ ( T 1 / 3 g ˚ ) ] R T * * ( 1 , g ˚ ) .
Hence, T ω g ˚ is a Jaggi-type bilateral g ˚ 0 -contractive operator. Furthermore, we obtain
r = inf | | g ˚ T ω g ˚ | | ξ ( g ˚ ) : g ˚ T ω g ˚ , g ˚ R = 1 α
Hence, the average operator T ω g ˚ satisfies the conditions of Theorem 9, so the operator T , which is the activation function P R e L U ( g ˚ ) , fixes the circle C 1 , 1 α = α , 2 α and the disc D 1 , 1 α = [ α , 2 α ] .

6. Conclusions and Future Directions

In this study, we have introduced a comprehensive class of contractive operators called Caristi-type contractions. We have also defined and explored general Jaggi-type bilateral-type contractions, Dass–Gupta-type-I bilateral contractions, and Dass–Gupta-type-II bilateral contractions. These newly defined classes of contractions provide a broader framework for analyzing and studying various types of contractive operators.
We have derived several fixed-circle theorems for different types of contractions. Theorems 6–11 present these results for general Jaggi-type bilateral contractions, Caristi-type contractions, general Dass–Gupta-type-I bilateral contractions, and Dass–Gupta-type-II bilateral contractions, respectively. These theorems demonstrate the versatility and applicability of our approach across different types of symmetric contraction operators.
To support our results, we have provided Examples 2 and 3, which illustrate the effectiveness and applicability of our theorems. These examples highlight the fact that our newly defined contractions are genuine generalizations of other contractions studied in the literature. The obtained results are generalizations of corresponding results in the literature and can be applied to other research areas.
Furthermore, we have showcased the practical application of our main result, Theorem 9, in the context of a novel activation function for neural networks. By demonstrating the effectiveness of this new approach, we contribute to the advancement of neural network research and its potential for improving the performance of various applications.
In terms of future research, it would be interesting to explore the applicability of the contractions defined by Definitions 4 and 5 in the context of partial metric spaces and m-metric spaces. Investigating fixed-circle theorems in these more general settings would further expand our understanding of the geometric properties of fixed points.
Overall, our study provides valuable insights into the theory of contractive operators and opens up new avenues for research and application in various mathematical and applied fields.

Author Contributions

Conceptualization, R.A., M.A., S.R. and M.Z.; formal analysis, S.R., M.D. and M.Z.; investigation, R.A. and M.Z.; writing—original draft preparation, H.S. and M.Z.; writing—review and editing, M.D., S.R. and M.Z.; funding acquisition, M.Z. All authors have read and approved the final manuscript.

Funding

Mi Zhou was partially supported by Key Research and Development Project of Hainan Province (Grant No. ZDYF2023GXJS007); the High-Level Project of Hainan Provincial Natural Science Foundation (Grant No. 621RC602); Sanya City Science and Technology Innovation Special Project (Grant No. 2022KJCX22); and the Key Special Project of University of Sanya (Grant No. USY22XK-04).

Data Availability Statement

Data are contained in the article.

Acknowledgments

The authors are thankful to the reviewers for their useful comments and constructive remarks, which helped to improve the presentation of the paper.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Özgür, N.Y.; Taş, N. Some fixed-circle theorems on metric spaces. Bull. Malays. Math. Sci. Soc. 2019, 42, 1433–1449. [Google Scholar] [CrossRef]
  2. Taş, N.; Özgür, N.Y.; Mlaiki, N. On the Fixed Circle Problem on Metric Spaces and Related Results. Axioms 2023, 12, 401. [Google Scholar]
  3. Taş, N.; Özgür, N.Y.; Mlaiki, N. New types of Fc-contractions and the fixed-circle problem. Mathematics 2018, 6, 188. [Google Scholar] [CrossRef]
  4. Özgür, N.Y.; Taş, N.; Çelik, U. New fixed-circle results on S-metric spaces. Bull. Math. Anal. Appl. 2017, 9, 10–23. [Google Scholar]
  5. Özgür, N.Y.; Taş, N. Fixed-circle problem on S-metric spaces with a geometric viewpoint. Facta Univ. (NIS) Ser. Math. Inform. 2019, 34, 459–472. [Google Scholar] [CrossRef]
  6. Taş, N. Various types of fixed-point theorems on S-metric spaces. J. Balikesir Univ. Insti. Sci. Tech. 2018, 20, 211–223. [Google Scholar] [CrossRef]
  7. Mlaiki, N.; Özgür, N.Y.; Mukheimer, A.; Taş, N. A new extension of the Mb-metric spaces. J. Math. Anal. 2018, 9, 118–133. [Google Scholar]
  8. Özgür, N.Y.; Taş, N. Some fixed-circle theorems and discontinuity at fixed circle. Aip Conf. Proc. 2018, 1926, 020048. [Google Scholar]
  9. Hussainy, A.; Al-Sulami, H.; Hussain, N.; Farooq, H. Newly fixed disc results using advanced contractions on F-metric space. J. Appl. Anal. Comp. 2020, 10, 2313–2322. [Google Scholar] [CrossRef]
  10. Taş, N. Bilateral-type solutions to the fixed-circle problem with rectified linear units application. Turkish J. Math. 2020, 44, 1330–1344. [Google Scholar] [CrossRef]
  11. Szandała, T. Review and Comparison of Commonly Used Activation Functions for Deep Neural Networks. In Bio-Inspired Neurocomputing. Studies in Computational Intelligence; Bhoi, A., Mallick, P., Liu, C.M., Balas, V., Eds.; Springer: Singapore, 2021; Volume 903. [Google Scholar]
  12. Zhang, L. Implementation of fixed-point neuron models with threshold, ramp and sigmoid activation functions. IOP Conf. Ser. Mater. Sci. Eng. 2017, 224, 012054. [Google Scholar] [CrossRef]
  13. Rhoades, B.E. Some theorems on weak contractive maps. Nonlinear Anal. 2001, 47, 2683–2693. [Google Scholar] [CrossRef]
  14. Todd, M.J. The computation of fixed points and applications. In Lecture Notes in Econom. and Math. Systems; Springer: Berlin, Germany; New York, NY, USA, 1976; Volume 124. [Google Scholar]
  15. Cromme, L.J. Fixed point theorems for discontinuous functions and applications. Nonlinear Anal. 1997, 30, 1527–1534. [Google Scholar] [CrossRef]
  16. Jachymski, J. Equivalent conditions and the Meir-Keeler type theorems. J. Math. Anal. Appl. 1995, 194, 293–303. [Google Scholar] [CrossRef]
  17. Li, L.K. Fixed point analysis for discrete-time recurrent neural networks. In Proceedings of the IJCNN International Joint Conference on Neural Networks, Baltimore, MD, USA, 7–11 June 1992; Volume 4, pp. 134–139. [Google Scholar]
  18. Krasnoselskii, M.A. Two remarks on the method of successive approximations. Uspekhi Mat. Nauk 1955, 10, 123–127. [Google Scholar]
  19. Berinde, V.; Păcurar, M. Approximating fixed points of enriched contractions in Banach spaces. J. Fixed Point Theory Appl. 2020, 22, 38. [Google Scholar] [CrossRef]
  20. Berinde, V.; Păcurar, M. Kannan’s fixed point approximation for solving split feasibility and variational inequality problems. J. Comput. Appl. Math. 2020, 386, 113217. [Google Scholar] [CrossRef]
  21. Berinde, V.; Păcurar, M. Approximating fixed points of enriched Chatterjea contractions by Krasnoselskii iterative algorithm in Banach spaces. J. Fixed Point Theory Appl. 2021, 23, 66. [Google Scholar] [CrossRef]
  22. Berinde, V. Approximating fixed points of enriched nonexpansive mappings by Krasnoselskii iteration in Hilbert spaces. Carpathian J. Math. 2019, 35, 293–304. [Google Scholar] [CrossRef]
  23. Abbas, M.; Anjum, R.; Berinde, V. Enriched multivalued contractions with applications to differential inclusions and dynamic programming. Symmetry 2021, 13, 1350. [Google Scholar] [CrossRef]
  24. Berinde, V.; Păcurar, M. Fixed point theorems for Ćirić-Reich-Rus contractions in Banach spaces and convex metric spaces. Carpathian J. Math. 2021, 37, 173–184. [Google Scholar] [CrossRef]
  25. Abbas, M.; Anjum, R.; Iqbal, H. Generalized enriched cyclic contractions with application to generalized iterated function system. Chaos Solitons Fractals 2022, 154, 111591. [Google Scholar] [CrossRef]
  26. Anjum, R.; Abbas, M. Common Fixed point theorem for modified Kannan enriched contraction pair in Banach spaces and its Applications. Filomat 2021, 35, 2485–2495. [Google Scholar] [CrossRef]
  27. Abbas, M.; Anjum, R.; Berinde, V. Equivalence of Certain Iteration Processes Obtained by Two New Classes of Operators. Mathematics 2021, 9, 2292. [Google Scholar] [CrossRef]
  28. Górnicki, J.; Bisht, R.K. Around averaged mappings. J. Fixed Point Theory Appl. 2021, 23, 48. [Google Scholar] [CrossRef]
  29. Özdemir, N.; Iskender, B.B.; Özgür, N.Y. Complex valued neural network with Möbius activation function. Commun. Nonlinear Sci. Numer. Simul. 2011, 16, 4698–4703. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Anjum, R.; Abbas, M.; Safdar, H.; Din, M.; Zhou, M.; Radenović, S. Application to Activation Functions through Fixed-Circle Problems with Symmetric Contractions. Symmetry 2024, 16, 69. https://doi.org/10.3390/sym16010069

AMA Style

Anjum R, Abbas M, Safdar H, Din M, Zhou M, Radenović S. Application to Activation Functions through Fixed-Circle Problems with Symmetric Contractions. Symmetry. 2024; 16(1):69. https://doi.org/10.3390/sym16010069

Chicago/Turabian Style

Anjum, Rizwan, Mujahid Abbas, Hira Safdar, Muhammad Din, Mi Zhou, and Stojan Radenović. 2024. "Application to Activation Functions through Fixed-Circle Problems with Symmetric Contractions" Symmetry 16, no. 1: 69. https://doi.org/10.3390/sym16010069

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop