Next Article in Journal
Correct and Stable Algorithm for Numerical Solving Nonlocal Heat Conduction Problems with Not Strongly Regular Boundary Conditions
Previous Article in Journal
Graph Embedding Method Based on Biased Walking for Link Prediction
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Efficient Algorithm for the Multi-Scale Solution of Nonlinear Fractional Optimal Control Problems

by
Araz Noori Dalawi
,
Mehrdad Lakestani
* and
Elmira Ashpazzadeh
Department of Applied Mathematics, Faculty of Mathematical Sciences, University of Tabriz, Tabriz 5166616471, Iran
*
Author to whom correspondence should be addressed.
Mathematics 2022, 10(20), 3779; https://doi.org/10.3390/math10203779
Submission received: 11 September 2022 / Revised: 26 September 2022 / Accepted: 11 October 2022 / Published: 13 October 2022
(This article belongs to the Section Computational and Applied Mathematics)

Abstract

:
An efficient algorithm based on the wavelet collocation method is introduced in order to solve nonlinear fractional optimal control problems (FOCPs) with inequality constraints. By using the interpolation properties of Hermite cubic spline functions, we construct an operational matrix of the Caputo fractional derivative for the first time. Using this matrix, we reduce the nonlinear fractional optimal control problem to a nonlinear programming problem that can be solved with some suitable optimization algorithms. Illustrative examples are examined to demonstrate the important features of the new method.

1. Introduction

A multi-dimensional FOCP with Caputo fractional derivative is defined by
Min J ( ξ , f ( ξ ) , u ( ξ ) ) = 0 1 G ( ξ , f ( ξ ) , u ( ξ ) ) d ξ ,
subject to
u ( ξ ) = H ( ξ , f ( ξ ) , 0 C D ξ α f ( ξ ) ) , α 0 , n 1 < α n , 0 ξ 1 ,
R j ( ξ , f ( ξ ) , 0 C D ξ α f ( ξ ) , u ( ξ ) ) 0 , j = 1 , 2 , , v ,
f ( i ) ( 0 ) = d i , i = 0 , 1 , , n 1 .
where J is the performance index,
u ( ξ ) = [ u 1 ( ξ ) , u 2 ( ξ ) , , u q ( ξ ) ] T
and
f ( ξ ) = [ f 1 ( ξ ) , f 2 ( ξ ) , , f p ( ξ ) ] T
are control and state vector functions, respectively, 0 C D ξ α f denotes the Caputo fractional derivative of a function f, f ( i ) denotes the i-th derivative of f, and H, G, and R j are generally nonlinear and smooth functions.
Finding the optimal solutions of complex systems in engineering, science, operations research, economics, and finance is an important aspect that promotes and encourages research in the optimal control field [1]. It has been an important part of experimental flow science throughout the last century [2]. FOCPs have received special attention from scientists due to their appearance in many branches of science [3,4,5]. Finding exact solutions for these types of problems is difficult or almost impossible. Thus, the search for efficient numerical simulations of these problems has become a major topic for mathematicians. The purpose of numerically solving FOCPs is to find control and state functions so that the performance index can be minimized. In recent years, various algorithms and methods have been employed to obtain approximate solutions to FOCPs.
Alavi et al. [6] used an operational matrix of Mott polynomials to solve fractional optimal control problems. The authors of [7] used the Legendre orthonormal polynomial to solve fractional optimal control problems in the Caputo sense. A spectral method using shifted Chebyshev polynomials was used in [8] to solve fractional optimal control with the Caputo–Katugampola derivative. Ghanbari et al. [9] used generalized fractional-order Chebyshev wavelets to solve fractional optimal control problems. A numerical approach based on Jacobi polynomials and the Ritz method was presented in [10] in order to solve nonlinear fractional optimal control problems. Soradi-Zeid [11] solved a class of fractional optimal control problems via Legendre wavelets. Taherpour et al. [12] used the Bernoulli polynomial method to solve fractional optimal control problems. We refer interested readers to [13,14,15,16,17,18,19,20] in order to study previous research for the numerical solutions of optimal control problems.
Most of above-mentioned references are based on polynomial expansions. Walter Gautschi [21] showed that the condition number of such a conversion grows as ( 1 + 2 ) N , where N is the degree of the polynomial. This is satisfactory for the very small N < 10 employed in the authors’ numerical examples, but is not strongly recommended for larger N. The main advantage of our method is that the order of the polynomials is fixed and never grows; by increasing the level of the space J, we can get more exact results.
Another advantage of our method is the Hermitian interpolation property of cubic Hermite spline functions. This means that one can expand a function using these bases such that not only are the values of the approximated function in the node points equal to the exact function, but the values of the first derivatives of it are also equal to the exact function at the node points. So, one can expect that these functions can solve such a problem effectively.
Recently, due to the fact that wavelet bases have very interesting properties, such as fast algorithms and sparse multi-scale representation, their use in fractional optimization problems has attracted the attention of mathematicians. The authors of [18,22,23,24,25,26,27,28,29,30,31,32,33] extended spectral techniques based on wavelet bases in order to solve FOCPs.
In this article, a different approach to the approximate fractional optimization problem (1)–(4) is introduced. Using biorthogonal Hermite cubic spline multiwavelets (BHCSMs), a collocation method is presented such that it can be implemented efficiently. The operational matrix of the Caputo fractional derivative (OMCFD) for the BHCSMs introduced in this work is our tool for achieving this goal. By using this matrix, the solution of the FOCPs is reduced to the solution of algebraic equations. Some examples are presented, and the results are compared to those of some existing methods in the literature to show and demonstrate the benefits of computing with the presented method. Organization of the paper: In Section 2, some basic definitions of the fractional calculus used for this study are briefly presented. In Section 3, we introduce the BHCSMs and construct the operational matrix of the Caputo fractional derivative for these bases. In Section 4, we give a numerical method based on the BHCSMS for the solution of Equations (1)–(4). An error bound for our expansion and method is given in Section 5. Three examples are examined to show the accuracy of our method. Finally, our conclusions are given.

2. Mathematical Basis of Fractional Calculus

This section of the article is devoted to a brief introduction of the main concepts in the field of fractional calculus that will be used in the rest of the paper.
Definition 1.
The Riemann–Liouville fractional integral of order α 0 of a function f is defined as [5]
0 I ξ α f ( ξ ) = 1 Γ ( α ) 0 ξ ( ξ z ) α 1 f ( z ) d z , α > 0 , f ( ξ ) , α = 0 .
Definition 2.
The Caputo fractional derivative of order α > 0 of a function f is defined as
0 C D ξ α f ( ξ ) = 1 Γ ( n α ) 0 ξ ( ξ z ) n α 1 d n d z n f ( z ) d z , n 1 < α < n , f ( n ) ( ξ ) , α = n .
Some properties of the Caputo fractional derivative and Riemann–Liouville fractional integration are described as follows [34]:
0 C D ξ α 0 I α f ( ξ ) = f ( ξ ) , α > 0 , f ( ξ ) C [ 0 , 1 ] ,
0 I ξ α f ( ξ ) = f ( ξ ) i = 0 α 1 ξ i i ! d i f d ξ i ( 0 ) , n 1 < α n , f ( ξ ) C α [ 0 , 1 ] .
0 C D ξ α ( ξ i ) = 0 , α N 0 , i < α , Γ ( i + 1 ) Γ ( i + 1 α ) ξ i α , o t h e r w i s e .

3. Multi-Scale Representation

Wavelets have taken an important place in computational mathematics, and especially in the numerical solutions of mathematical equations, such as ODEs and PDEs. As the reader is aware, one of the effective ways of constructing wavelets is the use of multiresolution analysis (MRA). MRA is a family of nested spaces that satisfy certain conditions [35],
{ 0 } V 1 V 0 V 1 L 2 ( Ω ) ,
where Ω is a bounded interval or is equal to R . Here, we briefly introduce the BHCSMs.
Given J Z + { 0 } , let the subspace V J be spanned by a set of bases as follows:
V J : = { 2 ϕ J , 0 1 | [ 0 , 1 ] , 2 ϕ J , 2 J 1 | [ 0 , 1 ] } { ϕ J , b k | b B , k = 1 , 2 } ,
where B : = { 1 , , 2 J 1 } and ϕ J , b k : = ϕ k ( 2 J . b ) , and the scaling functions ϕ 1 and ϕ 2 for the multiwavelet system are defined as
ϕ 1 ( ξ ) = 1 3 ξ 2 2 ξ 3 , ξ [ 1 , 0 ] , 1 3 ξ 2 + 2 ξ 3 , ξ [ 0 , 1 ] , 0 , o . w ,
and
ϕ 2 ( ξ ) = ξ + 2 ξ 2 + ξ 3 , ξ [ 1 , 0 ] , ξ 2 ξ 2 + ξ 3 , ξ [ 0 , 1 ] , 0 , o . w .
We note that ϕ 1 , ϕ 2 C 1 ( R ) , and the Hermite interpolation is fulfilled as follows:
ϕ 1 ( κ ) = δ 0 , κ , ( ϕ 1 ) ( κ ) = 0 , ϕ 2 ( κ ) = 0 , ( ϕ 2 ) ( κ ) = δ 0 , κ , κ Z ,
where δ j , k is the Kronecker delta.
Suppose that ϕ = ( ϕ 1 , ϕ 2 ) is a vector of the scaling functions, so it satisfies the matrix form of refinement equations as:
ϕ ( ξ ) = κ Z H κ ϕ ( 2 ξ κ ) ,
where the coefficient matrices are given as
H 1 = 1 / 2 3 / 4 1 / 8 1 / 8 , H 0 = 1 0 0 1 / 2 , H 1 = 1 / 2 3 / 4 1 / 8 1 / 8 ,
and H κ = 0 , κ { 1 , 0 , 1 } . In addition, it can be shown that the vector of scaling functions ϕ satisfies the symmetry property as follows:
ϕ ( ξ ) = S ϕ ( ξ ) ,
where
S = 1 0 0 1 .
This means that the scaling function ϕ 1 is symmetric and ϕ 2 is antisymmetric. Using (12) and (14), we obtain
H κ = S H κ S , κ Z .
Based on the the biorthogonality of our multiwavelets, there exists a vector of new scaling function ϕ ˜ = ( ϕ ˜ 1 , ϕ ˜ 2 ) , which is called the dual multi-generator and is orthogonal to the vector function ϕ in the following sense:
ϕ , ϕ ˜ ( . κ ) = δ 0 , κ I 2 , κ Z ,
where I 2 is the identity matrix of size 2. The new vector function ϕ ˜ produces another space V ˜ J L 2 ( R ) that is orthogonal to V J in the sense defined in (16). By using the two-scale relations for the primal and dual scaling functions in relation (16), we get the discrete duality relation
Z H H ˜ + 2 κ T = 2 δ 0 , κ I 2 , κ Z .
The entries of matrices H , Z are given as [36]:
H ˜ 2 = 7 64 5 64 87 128 31 64 , H ˜ 1 = 1 2 3 16 99 32 37 32 , H ˜ 0 = 39 32 0 0 15 8 , H ˜ 1 = 1 2 3 16 99 32 37 32 , H ˜ 2 = 7 64 5 64 87 128 31 64 ,
and H ˜ κ = 0 for κ { 2 , , 2 } .
For simplicity, we rearrange the basis functions of the subspace V J as
φ = { φ 1 , φ 2 , , φ 2 J + 1 } ,
whose members are defined as
φ 2 κ + ( 1 ) : = ϕ J , κ , f o r = 1 , 2 , κ B ,
and φ 1 : = 2 ϕ J , 0 1 | [ 0 , 1 ] , φ 2 J + 1 : = 2 ϕ J , 2 J 1 | [ 0 , 1 ] . Now, we can project a function f L 2 [ 0 , 1 ] in the subspace V J as
f ( ξ ) P J f ( ξ ) = = 1 2 J + 1 c φ ( ξ ) ,
where P J is the projection operator in the space V J , and the coefficients c , = 1 , , 2 J + 1 are calculated using the Hermitian interpolation property of BHCSMS as
c 2 l = f ( l 2 J ) , c 2 l + 1 = 2 J f ( l 2 J ) , l = 1 , , 2 J 1 , c 1 : = 1 2 f ( 0 ) , c 2 J + 1 : = 1 2 f ( 1 ) .
Let
Φ J ( ξ ) = φ 1 ( ξ ) , φ 2 ( ξ ) , , φ 2 J + 1 ( ξ ) T ,
and
C = c 1 , c 2 , , c 2 J + 1 T ,
so the projection relation (18) can be written as
f ( ξ ) C T Φ J ( ξ ) .
The multiwavelets corresponding to our multi-scaling functions satisfy the following refinement relation [36]:
ψ 1 ( x ) = ϕ 1 ( 2 x ) 1 2 ( ϕ 1 ( 2 x + 1 ) + ϕ 1 ( 2 x 1 ) ) 23 12 ( ϕ 2 ( 2 x + 1 ) ϕ 2 ( 2 x 1 ) ) , ψ 2 ( x ) = 37 22 ϕ 2 ( 2 x ) + 91 88 ( ϕ 2 ( 2 x + 1 ) + ϕ 2 ( 2 x 1 ) ) + 1 8 ( ϕ 1 ( 2 x + 1 ) ϕ 1 ( 2 x 1 ) ) .
Note that functions ϕ 1 , ϕ 2 , ψ 1 , and ψ 2 are supported inside the interval [ 1 , 1 ] . The functions ϕ 1 and ψ 1 are symmetric with respect to the origin, and the functions ϕ 2 and ψ 2 are antisymmetric with respect to the origin. In addition, the lowest orders of the vanishing moments of both the mother wavelets ψ 1 and ψ 2 are 2.
Suppose that the space W J is generated by the entries of vector Ψ J , which is given as
Ψ J : = { 2 ψ J , 0 1 | [ 0 , 1 ] , 2 ψ J , 2 J 1 | [ 0 , 1 ] } { ψ J , κ k | κ B , k = 1 , 2 } ,
where ψ J , κ k : = ψ k ( 2 J . κ ) .
For spaces V j and W j , we have
V j 1 V j a n d V j = V j 1 + W j 1 = V j 0 + W j 0 + + W j 1 , 0 j 0 < j N .
A Riesz wavelet basis for V J is given by E J 0 , J = Φ J 0 j = J 0 J 1 Ψ j , so each function f ( ξ ) on L 2 [ 0 , 1 ] is approximated with the wavelet basis as
f ( ξ ) E J 0 , J T ( ξ ) D ,
Since the calculation of the wavelet coefficients D in the above expansion is complicated, especially for higher levels of J, to overcome this difficulty, we define the wavelet transformation matrix T as
E J 0 , J ( ξ ) = T Φ J ( ξ ) ,
where matrix T is given as
T = A J 0 + 1 × A J 0 + 2 × . . . × A J B J 0 + 1 × A J 0 + 2 × . . . × A J B J 2 × A J 1 × A J B J 1 × A J B J .
and the matrices A j , B j , j = J 0 + 1 , , J can be found by using the two-scale relations (12) and (23), respectively [37].

The Operational Matrix of the Caputo Fractional Derivative

The Caputo fractional derivative of the vector given in relation (20) can be approximated as
0 C D t α Φ J ( ξ ) D α Φ J ( ξ ) ,
where D α is the Caputo fractional operational matrix of the derivative for Hermite cubic splines.
Let α > 0 . Then, by using the definition of the Caputo fractional derivative of order α > 0 , we have
0 C D t α ϕ 1 ( 2 J t k ) = 1 Γ ( n α ) 0 t ( t x ) n α 1 d n d t n ϕ 1 ( 2 J x k ) d x , 0 C D t α ϕ 2 ( 2 J t k ) = 1 Γ ( n α ) 0 t ( t x ) n α 1 d n d t n ϕ 2 ( 2 J x k ) d x .
Using the definition of ϕ 1 ( x ) and ϕ 2 ( x ) , we get
ϕ 1 ( 2 J x k ) = 1 3 ( 2 J x k ) 2 2 ( 2 J x k ) 3 k 1 2 J x k 2 J , 1 3 ( 2 J x k ) 2 + 2 ( 2 J x k ) 3 k 2 J x k + 1 2 J 0 o . w k = 0 , , 2 J
ϕ 2 ( 2 J x k ) = ( 2 J x k ) + 2 ( 2 J x k ) 2 + ( 2 J x k ) 3 k 1 2 J x k 2 J ( 2 J x k ) 2 ( 2 J x k ) 2 + ( 2 J x k ) 3 k 2 J x k + 1 2 J 0 o . w k = 1 , , 2 J 1
If t k 1 2 J , then the above equations imply that 0 C D α ϕ 1 ( 2 J t k ) = 0 and 0 C D t α ϕ 2 ( 2 J t k ) = 0 .
If t ( k 1 2 J , k 2 J ) , then we have
a 1 ( t , k ) : = 0 C D t α ϕ 1 ( 2 J t k ) = 1 Γ ( n α ) k 1 2 J t ( t x ) n α 1 d n d x n 1 3 ( 2 J x k ) 2 2 ( 2 J x k ) 3 d x , a 2 ( t , k ) : = 0 C D t α ϕ 2 ( 2 J t k ) = 1 Γ ( n α ) k 1 2 J t ( t x ) n α 1 d n d x n ( ( 2 J x k ) + 2 ( 2 J x k ) 2 + ( 2 J x k ) 3 ) d x .
If t ( k 2 J , k + 1 2 J ) , then
b 1 ( t , k ) : = 0 C D t α ϕ 1 ( 2 J t k ) = 1 Γ ( n α ) k 1 2 J k 2 J ( t x ) n α 1 d n d x n ( 1 3 ( 2 J x k ) 2 2 ( 2 J x k ) 3 ) d x + 1 Γ ( n α ) k 2 J t ( t x ) n α 1 d n d x n ( 1 3 ( 2 J x k ) 2 + 2 ( 2 J x k ) 3 ) d x , b 2 ( t , k ) : = 0 C D t α ϕ 2 ( 2 J t k ) = 1 Γ ( n α ) k 1 2 J k 2 J ( t x ) n α 1 d n d x n ( ( 2 J x k ) + 2 ( 2 J x k ) 2 + ( 2 J x k ) 3 ) d x + 1 Γ ( n α ) k 2 J t ( t x ) n α 1 d n d x n ( ( 2 J x k ) 2 ( 2 J x k ) 2 + ( 2 J x k ) 3 ) d x .
If t k + 1 2 J , then
c 1 ( t , k ) : = 0 C D t α ϕ 1 ( 2 J t k ) = 1 Γ ( n α ) k 1 2 J k 2 J ( t x ) n α 1 d n d x n ( 1 3 ( 2 J x k ) 2 2 ( 2 J x k ) 3 ) d x + 1 Γ ( n α ) k 2 J k + 1 2 J ( t x ) n α 1 d n d x n ( 1 3 ( 2 J x k ) 2 + 2 ( 2 J x k ) 3 ) d x , c 2 ( t , k ) : = 0 C D t α ϕ 2 ( 2 J t k ) = 1 Γ ( n α ) k 1 2 J k 2 J ( t x ) n α 1 d n d x n ( ( 2 J x k ) + 2 ( 2 J x k ) 2 + ( 2 J x k ) 3 ) d x + 1 Γ ( n α ) k 2 J k + 1 2 J ( t x ) n α 1 d n d x n ( ( 2 J x k ) 2 ( 2 J x k ) 2 + ( 2 J x k ) 3 ) d x
The above integrals can be evaluated explicitly in terms of α , J, and k for all values of k = 0 , , 2 J for a given J. We used the library function int that is available in Maple to evaluate the above integrals analytically. So, the Caputo fractional derivatives 0 C D t α ϕ 1 ( 2 J t k ) and 0 C D t α ϕ 2 ( 2 J t k ) are obtained as follows:
ϖ 1 ( t , k ) : = 0 C D t α ϕ 1 ( 2 J t k ) = 0 , t k 1 2 J , a 1 ( t , k ) , k 1 2 J t < k 2 J , b 1 ( t , k ) , k 2 J t < k + 1 2 J , c 1 ( t , k ) , t k + 1 2 J ,
and
ϖ 2 ( t , k ) : = 0 C D t α ϕ 2 ( 2 J t k ) = 0 , t k 1 2 J , a 2 ( t , k ) , k 1 2 J t < k 2 J , b 2 ( t , k ) , k 2 J t < k + 1 2 J , c 2 ( t , k ) , t k + 1 2 J .
Employing Equations (29) and (30), we have
0 C D t α Φ J ( t ) = ϖ 1 ( t , 0 ) ϖ 1 ( t , 1 ) ϖ 2 ( t , 1 ) ϖ 1 ( t , 2 J 1 ) ϖ 2 ( t , 2 J 1 ) ϖ 1 ( t , 2 J ) D α Φ J ( t )
Now, by expanding the entries of the vector function 0 C D t α Φ J ( t ) with the multiscaling functions, we can get the operational matrix of the Caputo fractional derivative.

4. Multiwavelet Collocation Method for FOCPs with Inequality Constraints

Let us now develop our method to discretize the FOCPs with inequality constraints. To this end, let
f ( ξ ) = [ f 1 ( ξ ) , f 2 ( ξ ) , , f l ( ξ ) ] T , u ( ξ ) = [ u 1 ( ξ ) , u 2 ( ξ ) , , u q ( ξ ) ] T ,
Φ ^ J ( ξ ) = I l Φ J ( ξ ) , Φ ^ J , q ( ξ ) = I q Φ J ( ξ ) ,
where we used Kronecker product [38] ⊗, identity matrices I l R l × l and I q R q × q , and matrices Φ ^ J ( ξ ) and Φ ^ J , q ( ξ ) with dimension N l × l and N q × q , respectively. Applying Equation (22),each of f i ( ξ ) , i = 1 , , l and each of u j ( ξ ) , j = 1 , , q can be approximated in terms of Hermite cubic splines scaling functions as
f i ( ξ ) Φ J T ( ξ ) F i , i = 1 , , l
u j ( ξ ) Φ J T ( ξ ) U j , j = 1 , , q ,
Applying the operational matrix of the fractional Caputo derivative D α and Equation (33), each of the fractional state rates 0 C D ξ α f i ( ξ ) , i = 1 , , l can be approximated as
0 C D ξ α f i ( ξ ) Φ ^ J T ( ξ ) D α T F .
Now, by considering Equations (32) and (33) and the approximations given in (34)–(36), we get
f ( ξ ) Φ ^ J T ( ξ ) F ,
0 C D ξ α f ( ξ ) Φ ^ J T ( ξ ) D ^ α T F ,
u ( ξ ) Φ ^ J , q T ( ξ ) U ,
where F and U are vectors of order M l × 1 and M q × 1 , respectively, M = 2 ( 2 J + 1 ) , D ^ α = D l D α , and F ¯ i , i = 0 , , α 1 are known matrices.
In order to discretize the performance index J in Equation (1), we approximate G ( ξ , f ( ξ ) , u ( ξ ) ) by usingbiorthogonal wavelets as
G ( ξ , Φ ^ J T ( ξ ) F , Φ ^ J , q T ( t ) U ) = Φ J T ( ξ ) V ,
where
V = [ ϑ 1 , ϑ 2 , , ϑ N ] T ,
and the elements ϑ i are obtained as in Equation (19). We substitute the approximation given in (40) into (1) and get
J = 0 1 Φ J T ( ξ ) V d ξ = P V ,
where P = 0 1 Φ J T ( ξ ) d ξ . Using Equation (39), the dynamic constraint (2) may be written in the form
Φ ^ J , q T ( ξ ) U = H ( ξ , Φ ^ J T ( ξ ) F , Φ ^ J T ( ξ ) D ^ α T F ) .
We substitute the approximations given in Equations (39) and (38) into (3) and obtain
R j ( ξ , Φ ^ J T ( ξ ) D ^ α T F , Φ ^ J T ( ξ ) F , Φ ^ J , q T ( ξ ) U ) 0 , j = 1 , , v .
It should be noted that we do not need to change the inequality constraints by adding slack variables, which increases the number of decision variables. Actually, in nonlinear programming problems, handling inequalities is generally easier than handling equalities [15]. So, we collocate Equation (43) at the shifted Chebyshev–Radau points ξ i as
ξ i = 1 2 cos ( ( i 1 ) π M ) + 1 2 , i = 1 , 2 , , M .
Therefore, using (41)–(43), the minimization problem (1), together with the conditions (2)–(4), is reduced to a nonlinear programming problem (NLP):
M i n J = P V , s . t Φ ^ J , q T ( ξ ) U = H ( ξ i , Φ ^ J T ( ξ i ) F , Φ ^ J T ( ξ i ) D ^ α T F ) R j ( ξ i , Φ ^ J T ( ξ i ) D ^ α T F , Φ ^ J T ( ξ i ) F , Φ ^ J , q T ( ξ i ) U ) 0 , j = 1 , , v .
Many well-developed NLP techniques can be used to solve this minimization problem (see, for example, [39,40,41]). After finding the unknown vectors U and F, an approximate expansion of the state and control functions based on Hermite cubic spline multiwavelets is gained by using (37) and (39), respectively. Moreover, we get an approximate value for the optimal value of the performance index by substituting the results in (41).
Remark 1.
To solve the problem using Hermite cubic spline multiwavelets, it is necessary to replace vector Φ J ( ξ ) with vector T 1 E J 0 , J ( ξ ) in all obtained approximations.

5. Estimation of Error

It follows from Theorem 2 in [42], the expansion error for relation (18) is bounded as follows.
Theorem 1.
Suppose that the function f : [ 0 , 1 ] R is continuously differentiable four times; then, we have
e J ( ξ ) : = | f ( ξ ) P J f ( ξ ) | = O ( 2 J ) .
Proof. 
See [42]. □
As in Theorem (1), for the control function u ( ξ ) , we can conclude that
| u ( ξ ) P J u ( ξ ) | = O ( 2 J ) .
To obtain an estimation for the error of the performance index, we provide the following theorem.
Theorem 2.
Let G : R 3 R be sufficiently continuously differentiable; further let there be a constant Ω such that
| G ( ξ , f 1 , u ) G ( ξ , f 2 , u ) | Ω | f 1 f 2 |
Suppose that u * ( ξ ) and f * ( ξ ) are the optimal control and state functions, respectively, which minimize the performance index J with the optimal value J * . If u ^ ( ξ ) , f ^ ( ξ ) , and J ^ are the approximations of the optimal control function, state function, and the performance index obtained with the proposed technique, one thus obtains
| J * J ^ | = O ( 2 J ) .
Proof. 
Suppose that one has
J * = 0 1 G ( ξ , f * ( ξ ) , u * ( ξ ) ) d ξ ,
and
J ^ = P V .
By subtracting (47) from (46) and employing Theorem 1 and Equation (45), we have
| J * J ^ | = | 0 1 G ( ξ , f * ( ξ ) , u * ( ξ ) ) d ξ P V | = = | 0 1 G ( ξ , f * ( ξ ) , u * ( ξ ) ) d ξ 0 1 G ( ξ , f ^ ( ξ ) , u * ( ξ ) ) d ξ + 0 1 G ( ξ , f ^ ( ξ ) , u * ( ξ ) ) d ξ P V | | 0 1 G ( ξ , f * ( ξ ) , u * ( ξ ) ) d ξ 0 1 G ( ξ , f ^ ( ξ ) , u * ( ξ ) ) d ξ | + | 0 1 G ( ξ , f ^ ( ξ ) , u * ( ξ ) ) d ξ P V | 0 1 Ω | ( f * ( ξ ) f ^ ( ξ ) | d ξ + O ( 2 J ) O ( 2 J ) + O ( 2 J ) O ( 2 J ) .
This completes the proof. □

6. Numerical Experiments

Here, we discuss the numerical solution of some examples to show that our method supports our theoretical results.
Example 1.
First, we examine the following time-invariant problem:
M i n J ( f , u ) = 1 2 0 1 ( f 2 ( ξ ) + u 2 ( ξ ) ) d ξ ,
subject to
0 C D α f ( ξ ) = f ( ξ ) + u ( ξ ) , f ( 0 ) = 1 .
The purpose of solving this example is to find the control variable u ( ξ ) that can find the minimum value of the quadratic performance index J. For α = 1 , the exact solution of this problem is given in [42] as:
f ( ξ ) = C h ( 2 ξ ) + β S h ( 2 ξ ) , u ( ξ ) = ( 1 + 2 β ) C h ( 2 ξ ) + ( 2 + β ) S h ( 2 ξ ) , β = C h ( 2 ) + 2 S h ( 2 ) 2 C h ( 2 ) + S h ( 2 ) 0.98 .
The solution of this problem is obtained by employing our method at different levels of J. In Figure 1, the approximate solutions of the problem for various values of α with J = 6 are demonstrated. In Figure 1, it can be seen that as α tends to 1, the approximate solutions for f ( ξ ) and u ( ξ ) approach the exact solutions of the problem in the case of α = 1 .
In Table 1, we show the distances between the results obtained by our method for the state variable x ( t ) and its exact value at some points when α = 1 , and we compare them with the results obtained in [25,32,42] for J = 4 and 5. Table 2 reports the minimum value of J for different values J when α = 1 .
Example 2.
Consider the two-dimensional minimization problem described by [27] as
M i n J ( ξ , f ( ξ ) , u ( ξ ) ) = 0 1 ( f 1 ( ξ ) 1 ξ 3 2 ) 2 + ( f 2 ( ξ ) ξ 5 2 ) 2 + ( u ( ξ ) 3 π 4 ξ + ξ 5 2 ) 2 d ξ
subject to
0 C D 0.5 f 1 ( ξ ) = f 2 ( ξ ) + u ( ξ ) ,
0 C D 0.5 f 2 ( ξ ) = f 1 ( ξ ) + 15 π 16 ξ 2 ξ 3 2 1 ,
with the initial condition
f 1 ( 0 ) = 1 , f 2 ( 0 ) = 0 .
The exact optimal solutions for this problem are given as
f 1 ( ξ ) = 1 + ξ 3 2 , f 2 ( ξ ) = ξ 5 2 , u ( ξ ) = 3 π 4 ξ ξ 5 2 .
and the minimum value of J is 0.
Here, we approximate the conditions (49) and (50) as
Φ J T ( ξ ) D 0.5 T F 1 = Φ J T ( ξ ) F 2 + Φ J T ( ξ ) U , Φ J T ( ξ ) D 0.5 T F 1 = Φ J T ( ξ ) F 2 + Φ J T ( ξ ) U .
So, we get
D 0.5 T F 1 = F 2 + U ,
D 0.5 T F 1 = F 2 + U .
For this problem, because of the linearity of the constraints, we replace relation (42) with (51) and (52). We apply our method in various levels of J, and we get the approximation results reported in Table 3. In this table, we provide a comparison between the optimal value of J obtained with this new method for J = 1 , 2 , , 6 and the values of J reported in [27,37]. In addition, the plots of the approximate and exact state and control functions are shown in Figure 2.
Example 3.
Now, let us find the optimal solutions of a nonlinear FOCP in which
M i n J = 0 1 ln 2 f ( ξ ) d ξ ,
subject to
0 C D α f ( ξ ) = ln ( 2 ) ( f ( ξ ) + u ( ξ ) ) ,
and the inequality constraints
| u ( ξ ) | 1 , u ( ξ ) + f ( ξ ) 2 ,
with the initial condition
f ( 0 ) = 0 .
Here, we apply the method proposed in Section 4 in order to solve this nonlinear FOCP. We evaluated the approximate solutions for the state variable with α = 0.8 , 0.9 , 1 and J = 1 , and these are presented in Figure 3. In this figure, one can find that, as α tends to 1, the numerical state variable solutions tend to the analytical solution. In the particular case, the exact performance index for α = 1 is J = 0.30682 . Table 4 shows the numerical results obtained with the proposed method, the results obtained with the methods presented in [28,29,37,43], and the exact solution.
For future work, we will use our idea to solve FDEs, try to find operational matrix for other definitions of fractional derivatives, and solve similar problems.

7. Concluding Remarks

In this research, we proposed a multiwavelet collocation method for solving nonlinear FOCPs with inequality constraints. To this end, the operational matrix of the Caputo fractional derivative is first constructed for Hermite cubic biorthogonal multiwavelets; such a matrix is introduced for the first time in this work. This matrix allows us to reduce a nonlinear FOCP to an algebraic system of nonlinear equations, which greatly simplifies the problem. We considered three numerical examples in order to test the proposed method. The efficiency and accuracy of the introduced method in comparison with those of analytical solutions and some other numerical methods were determined.
In future work, we will apply our method in order to solve fractional differential equations and fractional optimal control problems with other definitions of fractional derivatives.

Author Contributions

Investigation, M.L.; Supervision, M.L.; Writing–original draft, A.N.D.; Writing—review & editing, M.L. and E.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chierici, A.; Giovacchini, V.; Manservisi, S. Analysis and Computations of Optimal Control Problems for Boussinesq Equations. Fluids 2022, 7, 203. [Google Scholar] [CrossRef]
  2. Gunzburger, M.D. Perspectives in Flow Control and Optimization; Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 2002. [Google Scholar] [CrossRef]
  3. Magin, R.L. Fractional Calculus in Bioengineering; Begell House Redding: Redding, CT, USA, 2006. [Google Scholar]
  4. Mainardi, F. Fractional Calculus and Waves in Linear Viscoelasticity; Imperial College Press: London, UK, 2010. [Google Scholar]
  5. Podlubny, I. Fractional Differential Equations, 1st ed.; Academic Press: New York, NY, USA, 1999. [Google Scholar]
  6. Alavi, S.A.; Haghighi, A.; Yari, A.; Soltanian, F. A Numerical Method For Solving Fractional Optimal Control Problems Using The Operational Matrix Of Mott Polynomials. Comput. Methods Differ. Equ. 2022, 10, 755–773. [Google Scholar]
  7. Lotfi, A.; Yousefi, S.A. A numerical technique for solving a class of fractional variational problems. J. Comput. Appl. Math. 2013, 237, 633–643. [Google Scholar] [CrossRef] [Green Version]
  8. Sweilam, N.H.; Nagy, A.M.; Al-Ajami, T.M. Numerical solutions of fractional optimal control with Caputo-Katugampola derivative. Adv. Contin. Discret. Model. 2021, 2021, 425. [Google Scholar] [CrossRef]
  9. Ghanbari, G.; Razzaghi, M. Numerical solutions for fractional optimal control problems by using generalised fractional-order Chebyshev wavelets. Int. J. Syst. Sci. 2022, 53, 778–792. [Google Scholar] [CrossRef]
  10. Singh, H.; Pandey, R.K.; Kumar, D. A reliable numerical approach for nonlinear fractional optimal control problems. Int. J. Nonlinear Sci. Numer. Simul. 2021, 22, 495–507. [Google Scholar] [CrossRef]
  11. Soradi-Zeid, S. Solving a class of fractional optimal control problems via a new efficient and accurate method. Comput. Methods Differ. Equ. 2021, 9, 480–492. [Google Scholar]
  12. Taherpour, V.; Nazari, M.; Nemati, A. A new numerical Bernoulli polynomial method for solving fractional optimal control problems with vector components. Comput. Methods Differ. Equ. 2021, 9, 446–466. [Google Scholar]
  13. Ashpazzadeh, E.; Lakestani, M.; Fatholahzadeh, A. Spectral Methods Combined with Operational Matrices for Fractional Optimal Control Problems: A Review. Appl. Comput. Math. 2021, 20, 209–235. [Google Scholar]
  14. Baleanu, D.; Defterli, O.; Agrawal, O.M.P. A central difference numerical scheme for fractional optimal control problems. J. Vib. Control 2009, 15, 547–597. [Google Scholar] [CrossRef] [Green Version]
  15. Elnegar, G.A.; Kazemi, M.A. Pseudospectral Chebyshev optimal control of constrained nonlinear dynamical systems. Comput. Optim. Appl. 1998, 1, 195–217. [Google Scholar] [CrossRef]
  16. Khosravian-Arab, H.; Dehghan, M.; Eslahchi, M.R. Fractional Sturm-Liouville boundary value problems in unbounded domains: Theory and applications. J. Comput. 2015, 299, 526–560. [Google Scholar] [CrossRef]
  17. Lakestani, M.; Dehghan, M.; Irandoust-pakchin, S. The construction of operational matrix of fractional derivatives using B-spline functions. Commun. Nonlinear. Sci. Numer. Simulat. 2012, 17, 1149–1162. [Google Scholar] [CrossRef]
  18. Saadatmandi, A.; Dehghan, M. A new operational matrix for solving fractional-order differential equations. Comput. Math. Appl. 2010, 59, 1326–1336. [Google Scholar] [CrossRef] [Green Version]
  19. Tricaud, C.; Chen, Y.Q. An approximation method for numerically solving fractional order optimal control problems of general form. Comput. Math. Appl. 2010, 59, 1644–1655. [Google Scholar] [CrossRef] [Green Version]
  20. Wang, L.; Yuan, J.; Wu, C.; Wang, X. Practical algorithm for stochastic optimal control problem about microbial fermentation in batch culture. Optim. Lett. 2017, 13, 527–541. [Google Scholar] [CrossRef]
  21. Gautschi, W. The condition of polynomials in power form. Math. Comput. 1979, 33, 343–352. [Google Scholar] [CrossRef]
  22. Arablouye Moghaddam, M.; Edrisi-Tabriz, Y.; Lakestani, M. Solving fractional optimal control problems using Genocchi polynomials. Comput. Methods Differ. Equ. 2021, 9, 79–93. [Google Scholar]
  23. Behroozifar, M.; Habibi, N. A numerical approach for solving a class of fractional optimal control problems via operational matrix Bernoulli polynomials. J. Vib. Control 2018, 24, 2494–2511. [Google Scholar] [CrossRef]
  24. Heydari, M.H.; Hooshmandasl, M.R.; Maalek Ghaini, F.M.; Cattani, C. Wavelets method for solving fractional optimal control problems. Appl. Math. Comput. 2016, 286, 139–154. [Google Scholar] [CrossRef]
  25. Lotfi, A.; Dehghan, M.; Yousefi, S.A. A numerical technique for solving fractional optimal control problems. Comput. Math. Appl. 2011, 62, 1055–1067. [Google Scholar] [CrossRef] [Green Version]
  26. Lotfi, A.; Yousefi, S.A.; Dehghan, M. Numerical solution of a class of fractional optimal control problems via the Legendre orthonormal basis combined with the operational matrix and the Gauss quadrature rule. Comput. Appl. Math. 2013, 250, 143–160. [Google Scholar] [CrossRef]
  27. Lotfi, A.; Yousefi, S.A. Epsilon-Ritz Method for Solving a Class of Fractional Constrained Optimization Problems. J. Optim. Theory Appl. 2014, 163, 884–899. [Google Scholar] [CrossRef]
  28. Mashayekhi, S.; Razzaghi, M. An approximate method for solving fractional optimal control problems by hybrid functions. J. Vib. Control 2018, 24, 1621–1631. [Google Scholar] [CrossRef]
  29. Rabiei, K.; Parand, K. Collocation method to solve inequality-constrained optimal control problems of arbitrary order. Eng. Comput. 2020, 36, 115–125. [Google Scholar] [CrossRef]
  30. Rabiei, K.; Ordokhani, Y.; Babolian, E. Fractional-order Boubaker functions and their applications in solving delay fractional optimal control problems. J. Vib. Control 2017, 25, 3370–3383. [Google Scholar] [CrossRef]
  31. Sahu, P.K.; Saha Ray, S. Comparison on wavelets techniques for solving fractional optimal control problem. J. Vib. Control 2018, 24, 1185–1201. [Google Scholar] [CrossRef]
  32. Keshavarz, E.; Ordokhani, Y.; Razzaghi, M. A numerical solution for fractional optimal control problems via Bernoulli polynomials. J. Vib. Control 2016, 22, 2889–2903. [Google Scholar] [CrossRef]
  33. Yousefi, S.A.; Lotfi, A.; Dehghan, M. The use of a Legendre multiwavelet collocation method for solving the fractional optimal control problems. J. Vib. Control 2011, 13, 1–7. [Google Scholar] [CrossRef]
  34. Kilbas, A.A.; Srivastava, H.M.; Trujillo, J.J. Theory and Applications of Fractional Differential Equations, 1st ed.; North-Holland Mathematics Studies; Elsevier Science B.V.: Amsterdam, The Netherlands, 2006; Volume 204. [Google Scholar]
  35. Mallat, S. A Wavelet Tour of Signal Processing: The Sparse Way, 3rd ed.; Academic Press: Cambridge, MA, USA, 2009. [Google Scholar]
  36. Han, B. Framelets and Wavelets, Applied and Numerical Harmonic: Algorithms, Analysis, and Applications, 1st ed.; Birkhäuser: Basel, Switzerland, 2017. [Google Scholar]
  37. Ashpazzadeh, E.; Lakestani, M.; Yildirim, A. Biorthogonal multiwavelets on the interval for solving multidimensional fractional optimal control problems with inequality constraint. Optim. Control Appl. Methods 2020, 41, 1477–1494. [Google Scholar] [CrossRef]
  38. Lancaster, P.; Tismenetsky, M. The Theory of Matrices, 2nd ed.; Academic Press: New York, NY, USA, 1985. [Google Scholar]
  39. Ashpazzadeh, E.; Lakestani, M.; Razzaghi, M. Nonlinear constrained optimal control problems and cardinal Hermite interpolant multiscaling functions. Asian J. Control. 2018, 20, 1–10. [Google Scholar] [CrossRef]
  40. Avrile, M. Nonlinear Programming. Analysis and Methods; Dover Publications: Mineola, NY, USA, 1976. [Google Scholar]
  41. Nelder, J.A.; Mead, R.A. A simplex method for function minimization. Comput. J. 1965, 7, 308–313. [Google Scholar] [CrossRef]
  42. Ashpazzadeh, E.; Lakestani, M. Biorthogonal cubic Hermite spline multiwavelets on the interval for solving the fractional optimal control problems. Comput. Methods Differ. Equ. 2016, 4, 99–115. [Google Scholar]
  43. Alipour, M.; Rostamy, D.; Baleanu, D. Solving multi-dimensional fractional optimal control problems with inequality constraint by Bernstein polynomials operational matrices. J. Vib. Control 2013, 19, 2523–2540. [Google Scholar] [CrossRef]
Figure 1. Plots of the state and control variables obtained for α = 0.8 , 0.9 , . 099 , 1 and the exact solution for α = 1 in Example 1.
Figure 1. Plots of the state and control variables obtained for α = 0.8 , 0.9 , . 099 , 1 and the exact solution for α = 1 in Example 1.
Mathematics 10 03779 g001
Figure 2. Approximate state and control variables for Example 2.
Figure 2. Approximate state and control variables for Example 2.
Mathematics 10 03779 g002
Figure 3. Approximate state and control variables for Example 3.
Figure 3. Approximate state and control variables for Example 3.
Mathematics 10 03779 g003
Table 1. Absolute errors of x ( t ) in comparison to the results from [25,32,42].
Table 1. Absolute errors of x ( t ) in comparison to the results from [25,32,42].
tLegendre Basis [25]Bernoulli Basis [32]Multiwavelet Method [42]PresentMethod
M = 5 M = 5 J = 8 J = 4J = 5
0 6.25 × 10 6 6.25 × 10 6 0.0 0.00.0
0.1 1.34 × 10 5 2.39 × 10 6 1.26 × 10 6 6.81 × 10 7 3.98 × 10 7
0.2 2.12 × 10 5 1.21 × 10 6 1.03 × 10 6 1.01 × 10 6 1.82 × 10 7
0.3 3.24 × 10 5 1.72 × 10 6 8.35 × 10 7 9.50 × 10 7 1.52 × 10 7
0.4 4.73 × 10 5 6.82 × 10 7 6.68 × 10 7 4.08 × 10 7 2.70 × 10 7
0.5 6.20 × 10 5 1.93 × 10 6 5.23 × 10 7 1.90 × 10 8 7.12 × 10 9
0.6 7.49 × 10 5 3.11 × 10 7 3.99 × 10 7 2.41 × 10 7 1.78 × 10 7
0.7 8.88 × 10 5 1.90 × 10 6 2.90 × 10 7 3.72 × 10 7 7.27 × 10 8
0.8 1.07 × 10 5 9.17 × 10 7 1.94 × 10 7 2.53 × 10 7 3.90 × 10 8
0.9 1.31 × 10 5 2.49 × 10 6 1.09 × 10 7 7.90 × 10 8 4.63 × 10 8
Table 2. Estimated values of J for Example 1.
Table 2. Estimated values of J for Example 1.
Method J
Method [42]
J = 70.192909
Method [27]
M = 80.192909
Present method
J = 20.19290931206
J = 30.19290929658
J = 40.19290929819
J = 50.19290929807
Exact solution0.19290929809
Table 3. The computational results for Example 2.
Table 3. The computational results for Example 2.
Methods J
Epsilon–Ritz Method [27]
k = 5 , ϵ = 0.001 , 0.000053424
k = 8 , ϵ = 0.0001 , 8.0027 × 10 6
Biorthogonal multiwavelets [37]
J = 4 9.49 × 10 7
J = 5 6.30 × 10 8
J = 6 4.15 × 10 9
Present method
J = 1 2.60 × 10 5
J = 2 3.35 × 10 6
J = 3 3.37 × 10 7
J = 4 2.99 × 10 8
J = 5 2.43 × 10 9
J = 6 1.86 × 10 10
Table 4. Computational results for Example 3.
Table 4. Computational results for Example 3.
Methods J
Bernstein polynomials [43]
M 2 = 3 0.30685
Hybrid of block-pulse and Bernoulli polynomials [28]
M = 3 , N = 1 0.30683
Fractional order of Chebyshev polynomials [29] 0.30685380
M = 3 , N = 1
Biorthogonal multiwavelets [37]
J = 5 0.30683
J = 6 0.30682
Present Method
J = 3 0.30683
J = 4 0.30682
Exact 0.30682
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Noori Dalawi, A.; Lakestani, M.; Ashpazzadeh, E. An Efficient Algorithm for the Multi-Scale Solution of Nonlinear Fractional Optimal Control Problems. Mathematics 2022, 10, 3779. https://doi.org/10.3390/math10203779

AMA Style

Noori Dalawi A, Lakestani M, Ashpazzadeh E. An Efficient Algorithm for the Multi-Scale Solution of Nonlinear Fractional Optimal Control Problems. Mathematics. 2022; 10(20):3779. https://doi.org/10.3390/math10203779

Chicago/Turabian Style

Noori Dalawi, Araz, Mehrdad Lakestani, and Elmira Ashpazzadeh. 2022. "An Efficient Algorithm for the Multi-Scale Solution of Nonlinear Fractional Optimal Control Problems" Mathematics 10, no. 20: 3779. https://doi.org/10.3390/math10203779

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop