Next Article in Journal
Optimal Prefetching in Random Trees
Next Article in Special Issue
Gender Classification Using Proposed CNN-Based Model and Ant Colony Optimization
Previous Article in Journal
Practices of the Random Variable Proposed in the Chilean Mathematics Curriculum of Secondary Education
Previous Article in Special Issue
Automatic Superpixel-Based Clustering for Color Image Segmentation Using q-Generalized Pareto Distribution under Linear Normalization and Hunger Games Search
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Learning Impulsive Pinning Control of Complex Networks

by
Alma Y. Alanis
1,*,
Daniel Ríos-Rivera
1,
Edgar N. Sanchez
2 and
Oscar D. Sanchez
1,*
1
Computer Sciences Department, Universidad de Guadalajara, Guadalajara 44430, Mexico
2
Electrical Engineering Department, CINVESTAV, Unidad Guadalajara, Zapopan 45017, Mexico
*
Authors to whom correspondence should be addressed.
Mathematics 2021, 9(19), 2436; https://doi.org/10.3390/math9192436
Submission received: 24 August 2021 / Revised: 16 September 2021 / Accepted: 28 September 2021 / Published: 1 October 2021

Abstract

:
In this paper, we present an impulsive pinning control algorithm for discrete-time complex networks with different node dynamics, using a linear algebra approach and a neural network as an identifier, to synthesize a learning control law. The model of the complex network used in the analysis has unknown node self-dynamics, linear connections between nodes, where the impulsive dynamics add feedback control input only to the pinned nodes. The proposed controller consists of the linearization for the node dynamics and a reorder of the resulting quadratic Lyapunov function using the Rayleigh quotient. The learning part of the control is done with a discrete-time recurrent high order neural network used for identification of the pinned nodes, which is trained using an extended Kalman filter algorithm. A numerical simulation is included in order to illustrate the behavior of the system under the developed controller. For this simulation, a 20-node complex network with 5 different node dynamics is used. The node dynamics consists of discretized versions of well-known continuous chaotic attractors.

1. Introduction

The study of complex networks is of great importance for the scientific community due to the interconnected nature of the modern world and the wide range of meaningful applications [1,2,3,4]. In the dynamical systems area, a complex network can be seen as a group of interconnected systems, which have their own characteristics and dynamics. When working with these systems, it is often desired that the system follows a reference signal by an adequate controller. Methods and techniques in control theory used to drive the system to stability around an equilibrium point are numerous and varied [5]. Selecting a particular method to accomplish this goal depends solely on the designer or the considered system. For complex networks, a technique named pinning control is often used, in which only a fraction of the network nodes is controlled [6]. This control method for complex networks has been intensively studied. In [7], for example, a complex network with different chaotic node dynamics was controlled using inverse optimal control and V-stability; the latter changes the problem to a linear algebra one. This change performs the gain selection process more easily.
A control technique not exclusive to complex networks is the impulsive one, in which the control input is applied at a defined time instant [8]. Published works on synchronization and control of complex networks via impulsive control have previously been carried out. In [9], the authors propose a control algorithm where the complex network has the same node dynamics in all of its nodes, which is similar to the proposal in [10]. In [11], the algorithm considers different node dynamics in its nodes, without pinning control. A previous study was undertaken where we examined the impulsive control of discrete-time complex dynamical networks with an experimental approach rather than an analytical one [12].
Alternatively, learning control algorithms are capable of estimating unknown information of a given system. This is particularly useful since we do not always have all system information at our disposal. With an optimal learning technique, we can emulate the performance of the deterministic approach. Neural networks have a wide range of applications depending on their configuration [13], and one of them is the learning control approach that recreates the dynamics of nonlinear systems using the corresponding measurements as the neural identifiers [14,15]. The output of these neural identifiers can then be used to compute the desired control input. Previous studies have used neural networks for controlling complex networks, as in [16,17,18], focusing on continuous-time applications.
The aim of this research is pin control of a discrete-time complex network with different node dynamics and an impulsive control input, introducing a linear algebra approach for easy gain selection, which is the main contribution of this paper. Additionally, to synthesize the control law a learning control methodology is used based on a neural identifier. Studies of impulsive pin control of discrete-time complex networks with different nodes are scarce, and the objective of this research is to fill that gap. Moreover, a priori knowledge of node dynamics is not required because of the use of neural identifiers. The proposed scheme was tested under stressful conditions, such as chaotic dynamics. Our previous work on this topic did not include stability analysis of the whole network, so this study represents a considerable advance.
This paper is organized as follows: Firstly, we summarize required mathematical preliminaries where we establish the model used for the complex network, the concept of the Rayleigh quotient and the model of the used neural network. Then, we present the analysis for the proposed controller. Later, we introduce the recurrent high order neural network and its parameters. After that, we include a numerical simulation in order to illustrate the applicability of the proposed controller. Finally, we state the respective conclusions.

2. Preliminaries

In this section, we describe the mathematical tools used for analysis and simulations.

2.1. Complex Networks

The model for an impulsively controlled discrete-time complex network can be written as [12]:
X k + 1 = f X k + G B X k + U k , X k ,
where X k = x 1 k x 2 k x N k is the state of the complex network with N nodes, x i k R n , for i = 1 , , N , is the state of each i -th node. The function f X k = f 1 x 1 k f 2 x 2 k f N x N k contains all of the nodes self-dynamics f i x i k . Matrix G = g i j = c i j a ^ i j represents the connections of the network nodes, with c i j as the connection strength between nodes i and j . Constant a ^ i j = 1 if there is a connection between node i and node j , and a ^ = 0 if there is no such connection. Matrix B R n × n represents the way the state components are connected between the different nodes. Control input is U k , X k = Κ k X k , where Κ k is a block diagonal matrix of the form:
Κ k = κ 1 k I n κ 2 k I n κ N k I n ,
where I n is an identity matrix of the n -th order, κ i k is a real constant at k = t k , which is the time instant defined for the control impulse, and κ i k = 0 when k t k . Furthermore, in accord with pinning control, some κ i k are always zero.
Equation (1) is obtained through a finite difference discretization of a first order time derivative as:
d X d t X k + 1 X k T ,
where T is a sampling time. For notation simplicity, the corresponding summed term X k and sampling time T are absorbed by the rest of the terms in (1).

2.2. The Rayleigh Quotient

The Rayleigh Quotient R A is defined as:
R A = x * A x x * x ,
where x is some vector and A is a square matrix of appropriate dimensions. The quotient (4) has a real value satisfying λ m i n R A λ m a x , with λ m i n and λ m a x as the minimum and maximum eigenvalues of the Hermitian matrix A [19]. This means that for a real symmetric matrix A , the quadratic form x A x is bounded as follows:
λ m i n x x x A x λ m a x x x .

2.3. Discrete-Time Recurrent High Order Neural Network (RHONN) Model

The learning part of the control algorithm is done with the use of neural networks, with a neural identifier using a discrete-time RHONN, which is described by [15]:
x ^ i k + 1 = w i k z i x k , u k , i = 1 , , n ,
where x ^ i k is the state of the i -th neuron at time-step k , n is the dimension of the state, w i k is the adaptable weight vector, and z x k , u k is a high order non-linear function defined by the designer. This type of network can be trained by using the extended Kalman filter (EKF) algorithm, implemented with the following equations [15,20]:
K k = P k H k R k + H k P k H k 1 ,
w k + 1 = w k + K k e k ,
P k + 1 = P k K k H k P k + Q k
where matrix K k is the Kalman gain, P k is the error covariance matrix, R k is the measurement error covariance, Q k is the process error covariance, e k = y k y ^ k is the error signal between the desired output y k and the neural network output y ^ k , and we will define H k = z x k , u k [12,15].

3. Proposed Control Structure

Consider a complex network as the one described by (1). We can linearize the nodes self-dynamics using the Jacobian, so Equation (1) is rewritten as:
X k + 1 = F X k + G B X k + Κ k X k ,
where F is a block diagonal matrix of the form:
F = F 1 F 2 F N ,
where matrix F i R n × n represents the linearized dynamics of node i .
Theorem 1.
The discrete-time complex network with pinning control described in (1) is stable at equilibrium point zero if
lim k j = 0 k ln α j = ,
where α k is the largest eigenvalue of matrix A k A k , with
A k = F + G B + Κ k .
Proof. 
By substituting with (13), linearized network dynamics in (10) can be written as:
X k + 1 = A k X k .
Now, we propose the quadratic Lyapunov function V X k = X k X k , so we have:
V X k + 1 = X k A k A k X k .
Substituting (5) in (15) we obtain:
V X k + 1 α k X k X k ,
where α k is the largest eigenvalue of matrix A k A k . Inequality (16) can be written as:
V X k + 1 α k V X k .
By solving for V X k we get:
V X k j = 0 k α j V X 0 = e ln j = 0 k α j V X 0 = e j = 0 k ln α j V X 0 .
Hence, if the sum j = 0 k ln α j approaches , V X k decreases, and the system (1) is stable at the equilibrium point zero. This finishes the proof of Theorem. □
We can modify the eigenvalues of matrix A k A k by varying the elements of the design matrix Κ k until the condition stated in (12) is fulfilled for a desired impulsive time scheme.
The proposed scheme for the neural control is as shown in Figure 1, where the identified state X ^ k is substituted in the control input U k , X k = Κ k X k in (1), so the control input can be selected as:
U k , X ^ k = Κ k X ^ k ,
where X ^ k = x ^ 1 k x ^ 2 k x ^ N k , and x ^ i k is obtained with the equations of Section 2.3 if node i is a pinned node and x ^ i k = 0 if node i is not a pinned node.

4. Numerical Simulation and Discussion

To illustrate the proposed controller performance, we do a simulation following the control scheme of Figure 1 using the 20-node complex network, illustrated in Figure 2, with 5 different discretized versions of known continuous chaotic attractors. These systems are selected because of their apparent randomness which can be useful to test our learning control scheme.
Using a sample time T = 0.001 , the node self-dynamics are:
f i x i k = x i 1 k + T a 1 x i 2 k a 1 x i 1 k x i 2 k + T c 1 x i 1 k x i 1 k x i 3 k x i 2 k x i 3 k + T x i 1 k x i 2 k b 1 x i 3 k ,
which is a discretized version of the Lorenz model with constants a 1 = 10 , b 1 = 8 3 , and c 1 = 28 , as in [21], for i = 1 , 6 , 11 , 16 . Additionally, we consider:
f i x i k = x i 1 k + T a 2 x i 2 k a 2 x i 1 k x i 2 k + T c 2 a 2 x i 3 k x i 1 k c 2 x i 2 k x i 3 k + T x i 1 k x i 2 k b 2 x i 3 k ,
which is a discretized version of the Chen model with constants a 2 = 35 , b 2 = 3 , and c 2 = 28 , as in [22], for i = 2 , 7 , 12 , 17 . We include as well:
f i x i k = x i 1 k + T a 3 x i 2 k a 3 x i 1 k x i 2 k + T c 3 x i 2 k x i 1 k x i 3 k x i 3 k + T x i 1 k x i 2 k b 3 x i 3 k ,
which is a discretized version of the Lü model with constants a 3 = 36 , b 3 = 3 , and c 3 = 15 , as in [23], for i = 3 , 8 , 13 , 18 . Furthermore, we use:
f i x i k = x i 1 k + T a 4 x i 2 k a 4 x i 1 k + x i 2 k x i 3 k x i 2 k + T c 4 x i 1 k x i 1 k x i 3 k x i 2 k x i 3 k + T x i 1 k x i 2 k b 4 x i 3 k ,
which is a discretized version of the Qi model with constants a 4 = 35 , b 4 = 7 , and c 4 = 25 , as in [24], for i = 4 , 9 , 14 , 19 . Finally, we include:
f i x i k = x i 1 k + T a 5 x i 2 k a 5 h x i 1 k x i 2 k + T x i 1 k x i 2 k + x i 3 k x i 3 k + T b 5 x i 2 k ,
which is a discretized version of the Chua model with constants a 5 = 9.35 , b 5 = 14.79 , and:
h x i 1 k = m 1 x i 1 k + 0.5 m 0 m 1 x i 1 k + 1 x i 1 k 1 ,
with m 0 = 1 7 and m 1 = 2 7 as in [25].
The network connections for the network in Figure 2 are described by the matrix:
G = c A ^ 1 A ^ 12 A ^ 12 A ^ 2 ,
where c = 100 T is the connection strength, equal for all nodes, and:
A ^ 1 = 7 1 1 1 1 0 1 1 0 0 1 9 1 1 0 1 1 0 0 0 1 1 13 1 1 1 0 0 1 1 1 1 1 12 1 1 0 0 1 1 1 0 1 1 5 0 1 0 0 0 0 1 1 1 0 5 0 1 0 0 1 1 0 0 1 0 6 1 0 0 1 0 0 0 0 1 1 7 1 1 0 0 1 1 0 0 0 1 5 0 0 0 1 1 0 0 0 1 0 5 ,
A ^ 2 = 4 1 0 0 0 0 0 0 0 0 1 3 0 0 0 0 0 0 0 0 0 0 4 0 1 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 1 0 3 0 0 0 0 0 0 0 0 0 0 4 0 1 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 1 0 4 1 0 0 0 0 0 0 0 0 1 3 0 0 0 0 0 0 0 0 0 0 3 ,
A ^ 12 = 0 0 1 0 0 0 0 0 0 0 1 1 0 0 0 1 0 0 1 0 0 0 1 1 1 0 1 1 1 0 1 0 1 1 0 1 0 0 0 1 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 1 0 0 1 0 0 0 1 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 1 0 0 0 0 0 1 1 0 0 0 .
Matrix B is an identity matrix, whose dimensions are equal to the state order.
Based on (6), we implement the next RHONN for identification of the pinned nodes state elements:
x ^ i 1 k + 1 = w i 11 k φ x i 2 k + w i 21 k φ x i 1 k + w i 31 k φ x i 2 k φ x i 3 k ,
x ^ i 2 k + 1 = w i 12 k φ x i 1 k + w i 22 k φ x i 1 k φ x i 3 k + w i 32 k φ x i 2 k ,
x ^ i 3 k + 1 = w i 13 k φ x i 1 k φ x i 2 k + w i 23 k φ x i 3 k + w i 33 k φ x i 2 k ,
with
φ x i j k = 0.1 tanh 0.05 x i j k .
The weights are obtained using Equations (7)–(9), with:
P i 0 = 10 0 0 0 10 0 0 0 10 ,
H i 1 k = φ x i 2 k φ x i 1 k φ x i 2 k φ x i 3 k ,
H i 2 k = φ x i 1 k φ x i 1 k φ x i 3 k φ x i 2 k ,
H i 3 k = φ x i 1 k φ x i 2 k φ x i 3 k φ x i 2 k ,
R i k = R i = 10 ,
Q i k = Q i = 0.1 0 0 0 0.1 0 0 0 0.1 .
By doing the analysis described in Section 3, linearizing around equilibrium point X ¯ = 0 , for the uncontrolled system we get a maximum eigenvalue α k t k = 1.0326 , and by pinning nodes 3 and 4 with a control gain κ i k = 500 T we get a maximum eigenvalue of α k = t k = 0.9620 , setting the time of the control impulse as t k = 2 n T , for n = 1 , 2 , , , we can stabilize the system at state zero. Additionally, we replace the node state with the identified state for the pinned nodes as stated in (19). The simulation follows the next outline, at the beginning of the simulation the nodes are not connected to each other and they are also not controlled, at T k = 2 the nodes are connected according to (26), and at T k = 4 pinned nodes 3 and 4 are controlled as previously described.
Figure 3 shows the results of the numerical simulation done in MATLAB®. As can be seen in Figure 3, the proposed control scheme drives all of the network node state variables to zero. The control impulses can cause oscillation, being more noticeable for x i 3 k at T k = 4 , nonetheless, the stabilization goal is achieved.

5. Conclusions

The linearization approach proves to be a viable solution for the pinned control of complex networks as illustrated via simulations. The matrices resulting from such linearization make it easier to select the respective control gains. The neural network identifier for the pinned nodes dynamics is a powerful tool as illustrated by the included simulations; the same identifier structure is used for all the pinned nodes.
Different meaningful applications may be controlled using the proposed approach, such as robotic and biomedical systems.
Future work may center on using the passivity degree for the node dynamics as the V-stability approach [12,26] and avoid the use of linearized dynamics. Furthermore, the development of analysis for complex networks with time-varying connections is also an important topic for future research.

Author Contributions

D.R.-R.: Studied the state of the art, methodology, implementation, the simulation results; A.Y.A.: Supervision, project administration, review, editing, funding acquisition; E.N.S.: Methodology, funding acquisition. O.D.S. review, editing, funding acquisition. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Acknowledgments

The authors also thank Universidad de Guadalajara and CINVESTAV, Unidad Guadalajara for the support in this research.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chen, G.; Wang, X.; Li, X. Fundamentals of Complex Networks: Models, Structures and Dynamics, 1st ed.; Wiley: Singapore, 2015. [Google Scholar]
  2. Newman, J. The Structure and Function of Complex Networks. SIAM Rev. 2003, 45, 167–256. [Google Scholar] [CrossRef] [Green Version]
  3. Newman, M.; Barabási, A.; Watts, D. The Structure and Dynamics of Networks, 1st ed.; Princeton University Press: Princeton, NJ, USA, 2006. [Google Scholar]
  4. Aldana, M. Complex networks. In Proceedings of the XV Summer School in Physics, Morelos, Mexico, 30 July–11 August 2007. [Google Scholar]
  5. Khalil, H. Nonlinear Systems, 3rd ed.; Prentice-Hall: Hoboken, NJ, USA, 2002. [Google Scholar]
  6. Li, X.; Wang, X.; Chen, G. Pinning a complex dynamical network to its equilibrium. IEEE Trans. Circuits Syst.-I Regul. Pap. 2004, 51, 2074–2087. [Google Scholar] [CrossRef]
  7. Vega, C.; Sanchez, E.; Alzate, R. Inverse optimal pinning control for synchronization of complex networks with nonidentical chaotic nodes. IFAC-Pap. Online 2018, 51, 235–239. [Google Scholar] [CrossRef]
  8. Haddad, W.; Chellaboina, V.; Nersesov, S. Impulsive and Hybrid Dynamical Systems, 1st ed.; Princeton University Press: Princeton, NJ, USA, 2006. [Google Scholar]
  9. Sun, W.; Lü, J.; Chen, S.; Yu, X. Pinning impulsive control algorithms for complex network. Chaos 2014, 24, 013141. [Google Scholar] [CrossRef] [PubMed]
  10. Lu, J.; Ho, D.; Cao, J. A unified synchronization criterion for impulsive dynamical networks. Automatica 2010, 46, 1215–1221. [Google Scholar] [CrossRef]
  11. Zhang, Q.; Lu, J. Control the Complex Networks with Different Dynamical Nodes by Impulse. In Proceedings of the 6th International Symposium on Neural Networks, ISNN 2009, Wuhan, China, 26–29 May 2009. [Google Scholar] [CrossRef]
  12. Ríos-Rivera, D.; Alanis, A.Y.; Sanchez, E.N. Neural Impulsive Pinning Control for Complex Networks Based on V-Stability. Mathematics 2020, 8, 1388. [Google Scholar] [CrossRef]
  13. Haykin, S. Neural Networks: A Comprehensive Foundation, 2nd ed.; Pearson Education: Delhi, India, 2005. [Google Scholar]
  14. Alanis, A.; Sanchez, E.; Loukianov, A.; Hernandez, E. Discrete-time recurrent high order neural networks for nonlinear identification. J. Frankl. Inst. 2010, 347, 1253–1265. [Google Scholar] [CrossRef]
  15. Sanchez, E.; Alanis, A.Y.; Loukianov, A.G. Discrete-Time High Order Neural Control: Trained with Kalman Filtering, 1st ed.; Springer-Verlag: Berlin, Germany, 2008. [Google Scholar]
  16. Vega, C.; Sanchez, E.; Suarez, O. Synchronization of complex networks with nonidentical nodes via discrete-time neural invers optimal pinning control. In Proceedings of the 2018 IEEE Latin American Conference on Computational Intelligence (LA-CCI), Guadalajara, Mexico, 7–9 November 2018. [Google Scholar] [CrossRef]
  17. Vega, C.; Sanchez, E.; Suarez, O. Discrete-time neural sliding-mode pinning control for synchronization of complex networks. In Proceedings of the 2019 16th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE), Mexico City, Mexico, 11–13 September 2019. [Google Scholar] [CrossRef]
  18. Suarez, O.; Vega, C.; Sanchez, E.; Chen, G.; Elvira-Ceja, J.; Rodriguez, D. Neural sliding-mode pinning control for output synchronization for uncertain general complex networks. Automatica 2020, 112, 108694. [Google Scholar] [CrossRef]
  19. MIT Mathematics. Available online: https://math.mit.edu/~stevenj/ (accessed on 20 January 2021).
  20. Puskorius, G.; Feldkamp, L. Parameter-Based Kalman Filter Training: Theory and Implementation. In Kalman Filtering and Neural Networks, 1st ed.; Haykin, S., Ed.; John Wiley & Sons, Inc.: New York, NY, USA, 2001; pp. 23–68. [Google Scholar]
  21. Lorenz, E. Deterministic nonperiodic flow. J. Atmos. Sci. 1963, 20, 130–141. [Google Scholar] [CrossRef] [Green Version]
  22. Chen, G.; Ueta, T. Yet another chaotic attractor. Int. J. Bifurc. Chaos 1999, 9, 1465–1466. [Google Scholar] [CrossRef]
  23. Lü, J.; Chen, G. A new chaotic attractor coined. Int. J. Bifurc. Chaos 2002, 12, 659–661. [Google Scholar] [CrossRef]
  24. Qi, G.; Chen, G.; Du, S.; Chen, Z.; Yuan, Z. Analysis of a new chaotic system. Phys. A Stat. Mech. Appl. 2005, 352, 295–308. [Google Scholar] [CrossRef]
  25. Elhadj, Z.; Clinton, J. The unified chaotic system describing the Lorenz and Chua systems. Ser. Elec. Energ. 2010, 23, 345–355. [Google Scholar] [CrossRef] [Green Version]
  26. Xiang, J.; Chen, G. On the V-stability of complex dynamical networks. Automatica 2007, 43, 1049–1057. [Google Scholar] [CrossRef]
Figure 1. Proposed control scheme using a neural identifier for the pinned nodes.
Figure 1. Proposed control scheme using a neural identifier for the pinned nodes.
Mathematics 09 02436 g001
Figure 2. 20-node network used in the numerical simulation.
Figure 2. 20-node network used in the numerical simulation.
Mathematics 09 02436 g002
Figure 3. Complex network state variables where x i j k for i = 1 , , N and j = 1 , 2 , 3 is the state variable of the i -th node of dimension 3.
Figure 3. Complex network state variables where x i j k for i = 1 , , N and j = 1 , 2 , 3 is the state variable of the i -th node of dimension 3.
Mathematics 09 02436 g003
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Alanis, A.Y.; Ríos-Rivera, D.; Sanchez, E.N.; Sanchez, O.D. Learning Impulsive Pinning Control of Complex Networks. Mathematics 2021, 9, 2436. https://doi.org/10.3390/math9192436

AMA Style

Alanis AY, Ríos-Rivera D, Sanchez EN, Sanchez OD. Learning Impulsive Pinning Control of Complex Networks. Mathematics. 2021; 9(19):2436. https://doi.org/10.3390/math9192436

Chicago/Turabian Style

Alanis, Alma Y., Daniel Ríos-Rivera, Edgar N. Sanchez, and Oscar D. Sanchez. 2021. "Learning Impulsive Pinning Control of Complex Networks" Mathematics 9, no. 19: 2436. https://doi.org/10.3390/math9192436

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop