Next Article in Journal
Robust and Sparse Portfolio: Optimization Models and Algorithms
Next Article in Special Issue
Event-Triggered Relearning Modeling Method for Stochastic System with Non-Stationary Variable Operating Conditions
Previous Article in Journal
A Result of Krasner in Categorial Form
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Closed-Loop Continuous-Time Subspace Identification with Prior Information

College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
*
Author to whom correspondence should be addressed.
Mathematics 2023, 11(24), 4924; https://doi.org/10.3390/math11244924
Submission received: 30 October 2023 / Revised: 9 December 2023 / Accepted: 10 December 2023 / Published: 11 December 2023

Abstract

:
This paper presents a closed-loop continuous-time subspace identification method using prior information. Based on a rational inner function, a generalized orthonormal basis can be constructed, and the transformed noises have ergodicity features. The continuous-time stochastic system is converted into a discrete-time stochastic system by using generalized orthogonal basis functions. As is known to all, incorporating prior information into identification strategies can increase the precision of the identified model. To enhance the precision of the identification method, prior information is integrated through the use of constrained least squares, and principal component analysis is adopted to achieve the reliable estimate of the system. Moreover, the identification of open-loop models is the primary intent of the continuous-time system identification approaches. For closed-loop systems, the open-loop subspace identification methods may produce biased results. Principal component analysis, which reliably estimates closed-loop systems, provides a solution to this problem. The restricted least-squares method with an equality constraint is used to incorporate prior information into the impulse response following the principal component analysis. The input–output algebraic equation yielded an optimal multi-step-ahead predictor, and the equality constraints describe the prior information. The effectiveness of the proposed method is provided by numerical simulations.

1. Introduction

In recent decades, subspace identification methods have garnered significant attention in the identification process [1,2,3]. The majority of identification approaches work with discrete-time, open-loop systems. Actually, the majority of systems are continuous in nature and run in closed-loop using a feedback controller. Moreover, many open-loop identification approaches could produce biased results for closed-loop system identification. Hence, investigating a novel identification approach for closed-loop continuous-time systems is significant.
To acquire the continuous-time systems, estimating discrete-time models and converting them into continuous-time systems are conventional methods. There are certain drawbacks regarding the system conversion. These drawbacks specifically include the complicated computation of the matrix logarithm and the difficult selection of the sampling time. Numerous identification approaches have been presented to address the aforementioned problems in order to acquire reliable models. Linear filtering, which includes Laguerre filters, generalized PMFs (GPMFs), and Poisson Moment Functionals (PMFs), is the first category [4,5,6]. In [7], a generalized singular-value decomposition (SVD) was used to compensate for the noise coloration for estimating the continuous-time system. Using the GPMF and nuclear norm minimization, Ref. [8] evaluated continuous-time models. In order to address two types of identification problems, Ref. [9] presented continuous-time system identification methods that made use of Laguerre filters and Laguerre projection. Based on fractional Laguerre generating functions, Ref. [10] provided the subspace identification approach for fractional-commensurate-order systems. The second category consists of modulating function methods, which were used in [11] to address the continuous-time state-space model-identification problem using generalized orthogonal basis functions. A transformation theory using generalized orthonormal basis functions for stochastic systems was established by [12]. The integral approaches fall into the third category. Ref. [13] used random distribution theory to illustrate time derivatives and to deduce the input–output algebra relationship in the time-domain. The subspace identification approaches were implemented in the aforementioned references with the open-loop assumption. For the future inputs that are correlated with the noise, these approaches have the drawback of giving biased estimates when the systems to be represented run in closed-loop. Ref. [14] presented a closed-loop subspace identification method based on subsequent SVD and orthogonal projection. Ref. [15] concentrated on the parity space rather than the observable subspace to produce a consistent estimation of the closed-loop systems. Several closed-loop subspace identification approaches during the past ten years were compiled by [16]. The closed-loop continuous-time subspace identification approaches are still thought of as parameterized black-box models, while the majority of the aforementioned closed-loop identification approaches concentrate on discrete-time systems [17,18,19]. Therefore, it is still difficult to incorporate prior information into closed-loop continuous-time identification algorithms.
In general, the model’s quality is determined by the quality of the input–output data. To guarantee the precision and consistency of the estimated models, the subspace identification approaches also require the confirmation of a specific excitation. However, in many circumstances, the input–output data might not provide enough information for the inadequate excitation or noise component. Obviously, these factors may influence the precision of the estimated models. To improve the quality of the identified model, the prior information can be incorporated into the models throughout the identification process. The prior information was integrated into the state space model realization algorithm by [20], which estimated the model parameters using Kung’s singular-value decomposition realization [21]. Ref. [22] investigated the subspace identification approach using constrained least squares while taking into account prior information. The subspace identification method was enhanced as a multi-step forward predictor by resolving an optimization problem with equality constraints. Ref. [23] developed a new recursive-subspace-identification method that takes into account prior information, based on constrained recursive least squares. The prior information was taken into consideration by [24] as a linear equality and inequality constraints on the impulse response, which was resolved using active-set-optimization approaches. When comparing the precision of the identified model, subspace identification with prior information proved to be more accurate than classical subspace algorithms. Ref. [25] introduced the closed-loop subspace identification method, which took advantage of prior knowledge by eliminating the correlation between the future input and past innovation. By utilizing prior information, Ref. [26] developed a new closed-loop subspace-identification method based on principal component analysis (PCA). For batch operations exposed to repetitive disturbances, Ref. [27] developed a prior-knowledge-based subspace identification approach that offered unbiased parameter estimation and enhanced robustness to white measurement noises. Very few studies have focused on closed-loop continuous-time subspace system identification, despite the fact that including prior information in the subspace identification algorithm can improve the quality of the identified model.
In this paper, we propose to use generalized orthonormal basis functions to achieve closed-loop continuous-time subspace identification with prior information. The main contributions can be summarized as follows:
(1) The continuous-time stochastic system is converted into a discrete-time stochastic system by using generalized orthogonal basis functions.
(2) For closed-loop systems, the open-loop subspace identification methods may produce biased results. The principal component analysis, which reliably estimates closed-loop systems, provides a solution to this problem.
(3) The proposed approach converts the prior information into an equality constraint, and a weighting mechanism is used to solve the constrained least-squares issues. With increased computational performance, the proposed method can provide unbiased process models.
The remainder of this paper is organized as follows: The preliminaries are presented in Section 2. In Section 3, the system transformation is provided. Section 4 presents the main closed-loop subspace identification algorithm. The numerical simulations used to assess the proposed approach are shown in Section 5. Section 6 offers conclusions.

2. Preliminaries

Let L 2 ( , ) denote the space of square integrable functions over ( , ) , and the inner product is obtained.
u , v = v ( t ) u ( t ) d t ,
where superscript denotes the conjugate transpose.
Let L 2 ( j R ) denote the space of square integrable functions of frequency j ω j R , and the inner product is given.
f , g = 1 2 π g ( ω ) f ( ω ) d ω .
A continuous-time multiplication operator Λ h : L 2 ( j R ) L 2 ( j R ) is defined as
( Λ h f ) ( j ω ) = h ( j ω ) f ( j ω ) ,
where h L 2 ( j R ) . Inner function ϕ ( s ) denotes a continuous-time, single-input, single-output rational transfer function.
The Hardy space H is the space of matrix-valued bounded analytic functions in the right half plane. For a continuous-time inner function ϕ ( s ) in H , the multiplication operator Λ ϕ : L 2 ( j R ) L 2 ( j R ) is unitary. Let ϕ ( s ) H be a non-constant inner function. Consider the orthogonal complement of the invariant subspace Λ ϕ H 2 in H 2 , that is S = H 2 Λ ϕ H 2 ; the Hardy space H 2 is the space of analytical functions on the right half plane.
H 2 = m = 0 Λ ϕ m S , L 2 ( j R ) = m = Λ ϕ m S ,
where ⨁ denotes the direct sum.
A function f H 2 can be represented as follows.
f = m = 0 Λ ϕ m f m , f = m = Λ ϕ m f m , f m S .
where m-power denotes the product of m elements.
Let { v 1 , , v n ϕ } be an orthonormal basis for S and
v 1 , , v n ϕ , Λ ϕ v 1 , , Λ ϕ v n ϕ , , Λ ϕ m v 1 , , Λ ϕ m v n ϕ ,
be an orthonormal basis for H 2 . Based on the the inverse Fourier transform, the set is identified with an orthonormal basis for L 2 ( 0 , ) . This set is called a generalized orthonormal basis. A generalized orthonormal basis can be constructed by any finite-dimensional Blashke product.
Proposition 1
([28]). Consider an inner function ϕ and the subspace S = H 2 Λ ϕ H 2 . If ϕ ( s ) = D ϕ + C ϕ ( s I A ϕ ) 1 B ϕ is the balanced realization of an inner function for a continuous-time system such that D ϕ = I , A ϕ + A ϕ T + B ϕ T B ϕ = 0 , then
v ( s ) = [ v 1 ( s ) , , v n u n ϕ ( s ) ] , = ( I n C ϕ ) ( s I ( I n A ϕ ) ) 1
is an orthonormal basis for S n u , wheremeans the Kronecker product.

3. System Transformation

The generalized orthonormal basis can be constructed by the rational inner function. In addition, the continuous-time stochastic system is converted into a discrete-time stochastic system by using generalized orthogonal basis functions.
Consider a continuous-time system with process and observation noises:
d x = A x d t + B 1 d w + B 2 u d t , x ( 0 ) = x 0 d η = C x d t + D 1 d w + D 2 u d t ,
where A R n × n , B 1 R n × n w , B 2 R n × n u , C R n y × n , D 1 R n y × n w , D 2 R n y × n u , w is a Wiener process, and u is a deterministic signal.
Define
u ˜ k = 0 Λ ϕ k v ( t ) T u ( t ) d t , w ˜ k = 0 Λ ϕ k v ( t ) T d w ( t ) , y ˜ k = 0 Λ ϕ k v ( t ) T d η ( t ) .
Notice that w ˜ k and y ˜ k are stochastic processes.
Theorem 1.
Consider a stochastic system (7), and define the deterministic sequence u ˜ k and the stochastic processes w ˜ k , y ˜ k by Equation (8). Then, they satisfy the following discrete-time stochastic system:
ξ ( k + 1 ) = A ˜ ξ ( k ) + B ˜ 1 w ˜ k + B ˜ 2 u ˜ k , ξ ( 0 ) = x 0 , y k = C ˜ ξ ( k ) + D ˜ 1 w ˜ k + D ˜ 2 u ˜ k ,
where
A ˜ = ϕ ( A ) , B ˜ 1 = X 1 , B ˜ 2 = X 2 , C ˜ = Y , D ˜ 1 = h 111 ( A ϕ T ) h 11 n u ( A ϕ T ) h 1 n y 1 ( A ϕ T ) h 1 n y n u ( A ϕ T ) , D ˜ 2 = h 211 ( A ϕ T ) h 21 n u ( A ϕ T ) h 2 n y 1 ( A ϕ T ) h 2 n y n u ( A ϕ T ) ,
h 1 i j ( s ) is the ( i , j ) -th element of the transfer function h 1 ( s ) = D 1 + C ( s I A ) 1 B 1 ; h 2 i j ( s ) is the ( i , j ) -th element of the transfer function h 2 ( s ) = D 2 + C ( s I A ) 1 B 2 ; X 1 , X 2 , and Y are the unique solutions to the following Sylvester equations:
AX 1 + X 1 ( I n u A ϕ ) T + B 1 ( I n u B ϕ ) T = 0 , AX 2 + X 2 ( ( I n u A ϕ ) T + B 2 ( I n u B ϕ ) T = 0 , ( I n u A ϕ ) T Y + YA + ( I n u C ϕ ) T C = 0 .
Proof. 
Assume that n u = n y = 1 . If u S , from Proposition 1, u = C ϕ ( s I A ) 1 η for some η . In terms of C ϕ T C ϕ = ( s I A ϕ ) ( s I + A ϕ T ) , we have
Λ ϕ u = [ D ϕ T B ϕ T ( s I + A ϕ T ) 1 C ϕ T ] · C ϕ ( s I A ϕ ) 1 η = D ϕ T C ϕ ( s I A ϕ ) 1 η B ϕ T ( s I + A ϕ T ) 1 η + B ϕ T ( s I A ϕ ) 1 η = B ϕ T ( s I + A ϕ T ) 1 η .
In view of Equation (10), it can be found that
B u = 0 e A τ B ( F 1 Λ ϕ u ) ( τ ) d τ , = 0 e A τ BB ϕ T e A ϕ T τ d τ η = X η .
C ξ is the orthogonal projection of C ( s I A ) 1 onto S. The orthonormal basis for S is used for the following equation.
C ξ = C ϕ ( s I A ϕ ) 1 0 e A ϕ T τ C ϕ T C e A τ d τ η , = C ϕ ( s I A ϕ ) 1 Y ξ .
Notice that D u is the orthogonal projection of Λ h u onto S. Therefore,
1 2 π ( j ω I A ϕ T ) 1 C ϕ T h ( j ω ) · C ϕ ( j ω I A ϕ ) 1 d ω η = 1 2 π j h ( s ) ( s I + A ϕ T ) 1 C ϕ T C ϕ ( s I A ϕ ) 1 d s η , = 1 2 π j h ( s ) [ ( s I + A ϕ T ) 1 ( s I A ϕ ) 1 ] d s η , = h ( A ϕ T ) η = h ( A ϕ T ) η .
Note that the matrices B and D are defined, mutatis mutandis, as B ˜ 1 , B ˜ 2 , D ˜ 1 , and D ˜ 2 . □
Similar to any other identification method, when the available data are not informative enough due to a low signal-to-noise ratio or insufficient input excitations, the performance of the proposed approach will deteriorate. However, the proposed approach incorporates the prior information and can, thus, diminish the deterioration of model quality.

4. Closed-Loop Subspace Identification

In this section, the restricted-least-squares method with an equality constraint is used to incorporate the prior information into the impulse response following the principal component analysis. The method closed-loop subspace identification with prior information using generalized orthonormal basis functions (CLSPI-GOBF) is proposed.

4.1. Derivation of Input–Output Algebraic Equation

In terms of the stochastic system (7), the following data can be constructed as
u ˜ k , i = 0 Λ ϕ k v ( t ) T u ( t + t i ) d t , w ˜ k , i = 0 Λ ϕ k v ( t ) T d w ( t + t i ) , y ˜ k , i = 0 Λ ϕ k v ( t ) T d η ( t + t i ) ,
where 0 t 0 < t 1 < < t i < is a sequence of time instances such that t i + 1 t i t min for some t min > 0 .
Let x i = x ( t i ) . For fixed integers p , q and N, define
X N = [ x 0 x 1 x N 1 ] , X q , N = [ x q x q + 1 x q + N 1 ] , U p , q , N = u ˜ p , 0 u ˜ p , 1 u ˜ p , N 1 u ˜ p + 1 , 0 u ˜ p + 1 , 1 u ˜ p + 1 , N 1 u ˜ p + q 1 , 0 u ˜ p + q 1 , 1 u ˜ p + q 1 , N 1 ,
W p , q , N = w ˜ p , 0 w ˜ p , 1 w ˜ p , N 1 w ˜ p + 1 , 0 w ˜ p + 1 , 1 w ˜ p + 1 , N 1 w ˜ p + q 1 , 0 w ˜ p + q 1 , 1 w ˜ p + q 1 , N 1 ,
Y p , q , N = y ˜ p , 0 y ˜ p , 1 y ˜ p , N 1 y ˜ p + 1 , 0 y ˜ p + 1 , 1 y ˜ p + 1 , N 1 y ˜ p + q 1 , 0 y ˜ p + q 1 , 1 y ˜ p + q 1 , N 1 .
Let
Γ q = C ˜ C ˜ A ˜ C ˜ A ˜ q 1 , H 1 , q = D ˜ 1 0 0 C ˜ B ˜ 1 D ˜ 1 0 C ˜ A ˜ q 2 B ˜ 1 C ˜ A ˜ q 3 B ˜ 1 D ˜ 1 , H 2 , q = D ˜ 2 0 0 C ˜ B ˜ 2 D ˜ 2 0 C ˜ A ˜ q 2 B ˜ 2 C ˜ A ˜ q 3 B ˜ 2 D ˜ 2 .
From Theorem 1, the above matrices satisfy the input–output algebraic equation:
Y p , q , N = Γ q X q , N + H 1 , q W p , q , N + H 2 , q U p , q , N .

4.2. Consistent Estimation via Principal Component Analysis

Multiplying both sides by ( Γ q ) T , Equation (17) can be converted to
( Γ q ) T I H 2 , q Y p , q , N U p , q , N = ( Γ q ) T ( H 1 , q W p , q , N ) .
Define Z q = Y p , q , N U p , q , N . Equation (18) becomes
( Γ q ) T I H 2 , q Z q = ( Γ q ) T ( H 1 , q W p , q , N ) ,
The instrumental variable Z h = U 0 , p , N Y 0 , p , N is introduced to eliminate the estimate bias [16]. It gives
lim N 1 N H 1 , q W p , q , N Z h T = 0 ,
where Z h = U 0 , p , N Y 0 , p , N consisting of the input–output data are the instrumental variables.
We have
lim N 1 N ( Γ q ) T I H 2 , q Z q Z h T = 0 ;
thus, Equation (21) implies that ( Γ q ) T I H 2 , q is in the left null space of lim N 1 N Z q Z h T .
The PCA decomposition is performed on
1 N Z q Z h T = P T T + P ˜ T ˜ T ,
where P , P ˜ are the loading matrices and are mutually orthogonal. T , T ˜ are the score matrices, and the number of principal components is selected as lim N T ˜ = 0 .
It can be found that
( Γ q ) T I H 2 , q P = 0 .
Equation (23) can be reformulated as
Γ q H 2 , q T Γ q T P = 0 .
Since Equation (24) indicates that Γ q H 2 , q T Γ q shares the same column space as P ˜ , we have
Γ q H 2 , q T Γ q = P ˜ M .
where M is an arbitrary non-singular matrix.
Matrix P ˜ can be partitioned as
Γ q H 2 , q T Γ q = P ˜ y P ˜ u M .
We have
Γ q = P ˜ y M ,
H 2 , q T Γ q = P ˜ u M
According to Equation (27), we select a specific M .
Γ q = P ˜ y .
Substituting Equation (27) into Equation (28) gives
P ˜ y T H 2 , q = P ˜ u T
Define
P ˜ y T = Ξ = Ξ 1 Ξ 2 Ξ i ,
and
P ˜ u T = Υ = Υ 1 Υ 2 Υ i ,
where Ξ i is the i-th block column of Ξ and Υ i is the i-th block column of Υ .
Equation (30) can be described as
Ξ H 2 , q = Υ ,
that is
Ξ 1 Ξ 2 Ξ i D ˜ 2 0 0 C ˜ B ˜ 2 D ˜ 2 0 C ˜ A ˜ q 2 B ˜ 2 C ˜ A ˜ q 3 B ˜ 2 D ˜ 2 = Υ 1 Υ 2 Υ i .
Let
H 2 , q 1 = D ˜ 2 C ˜ B ˜ 2 C ˜ A ˜ q 2 B ˜ 2 ;
we obtain
Ξ 1 Ξ 2 Ξ i 1 Ξ i Ξ 2 Ξ 3 Ξ i 0 Ξ i 0 0 0 H 2 , q 1 = Υ 1 Υ 2 Υ i .

4.3. Constrained-Least-Squares Approach

To enforce the structure of H 2 , q , the following relationship can be required.
vec ( ABC ) = ( C T A ) vec ( B ) ,
where vec stands for the operation of forming a long vector from a matrix by stacking its columns one under the other.
Equation (34) can be described as
vec ( Υ ) y = I T Ξ Z vec ( H 2 , q 1 ) θ .
Equation (38) can be solved in the least-squares sense with added equality constraints representing the prior knowledge. This leads to a new problem:
min θ y Z θ 2 2 ,
which is subject to the following equality constraints:
A eq θ = b eq ,
where A eq R c × ( q n y n ϕ ( p n y n ϕ + p n u n ϕ ) + q n y n ϕ n u n ϕ ) , b eq R c × 1 , and c is the number of constraints.

4.3.1. Known Steady-State Gain

Assume that it takes k sampling times for the system to settle and that q impulse response parameters, g 0 , g 1 , , g q 1 , are estimated. The constraints can be described as
i = 0 k 1 g i = K s s , g k = g k + 1 = = g q 1 = 0 n y n ϕ × n u n ϕ ,
where K s s R n y n ϕ × n u n ϕ is the DC gain matrix. It can be described as
K s s = K 11 K 1 n u n ϕ K n y n ϕ 1 K n y n ϕ n u n ϕ ,
and K i j is the DC gain from the j-th input to the i-th output.
In view of Equation (37), applying this vec operation for both sides in each constraint in (41), we have
Υ × vec g 0 vec g 1 vec g k 1 vec g k vec g k + 1 vec g q 1 θ g = vec K s s 0 n y n ϕ n u n ϕ × 1 0 n y n ϕ n u n ϕ × 1
where
Υ = I l m × l m I l m × l m I l m × l m 0 l m × l m 0 l m × l m 0 l m × l m 0 l m × l m 0 l m × l m 0 l m × l m I l m × l m 0 l m × l m 0 l m × l m 0 l m × l m 0 l m × l m 0 l m × l m 0 l m × l m I l m × l m 0 l m × l m 0 l m × l m 0 l m × l m 0 l m × l m 0 l m × l m 0 l m × l m I l m × l m ,
Equation (43) can be expressed as
1 1 × k I l m × l m 0 l m × ( q k ) l m 0 ( q k ) l m × k l m I ( q k ) l m × ( q k ) l m θ g = vec ( K s s ) 0 ( q k ) l m × 1 ,
where the symbol l = n y n ϕ , m = n u n ϕ , 1 p × q is a matrix of ones of size p × q and 0 p × q is a matrix of zeros of size p × q . In view of θ , Equation (45) can be described as
A eq θ = b eq ,
where
A eq = 0 ( q k + 1 ) l m × q l ( p l + p m ) 1 1 × k I l m × l m 0 l m × ( q k ) l m 0 ( q k ) l m × k l m I ( q k ) l m × ( q k ) l m , b eq = vec ( K s s ) 0 ( q k ) l m × 1 .

4.3.2. Zero Transfer Functions

The outputs of some multiple-input multiple-output systems are unaffected by the inputs. Accordingly, some transfer functions are zero. However, by identifying such systems based on noisy data, the zero transfer functions cannot be established. The transfer functions might be pre-specified during the identification phase to address the aforementioned issue.
If the j-th input and the i-th output have a zero transfer function and all the impulse response coefficients at this channel are zeros,
g 0 i j = g 1 i j = = g q 1 i j = 0 ,
where the q constraints are formed. The zero transfer function can be written as
( 0 1 × q l ( p l + p m ) 0 1 × k l m + l ( j 1 ) + i 1 1 0 0 ) θ = 0 .
Therefore, A eq and b eq can be described as
A eq = 0 q × q l ( p l + p m ) 0 1 × l ( j 1 ) + i 1 1 0 0 0 1 × l m + l ( j 1 ) + i 1 1 0 0 0 1 × ( q 1 ) l m + l ( j 1 ) + i 1 1 0 0 R q × ( q l ( p l + p m ) + q l m ) , b eq = 0 q × 1 .
Noted that each zero transfer function needs q constraints.
The impulse response parameters θ ^ g can be estimated, and the following Hankel matrix T is formed.
T = g ^ 1 g ^ 2 g ^ q / 2 g ^ 2 g ^ 3 g ^ q / 2 + 1 g ^ q / 2 g ^ q / 2 + 1 g ^ q 1 .
The matrix T can be factorized using Kung’s realization algorithm as
T = USV T .
The observability matrix Γ and controllability matrix Δ are obtained as
Γ = U ( : , 1 : n ) S 1 / 2 , Δ = S 1 / 2 V ( : , 1 : n ) T .
The system matrices are given using Γ and Δ as
A ^ = Γ ̲ Γ ¯ , Γ ̲ = Γ ( 1 : l ( q 1 ) , : ) , Γ ¯ = Γ ( l + 1 ; q l , : ) . B ^ = Δ ( : , 1 : m ) , C ^ = Γ ( 1 : l , : ) , D ^ = g ^ 0 .
Remark 1.
The proposed approach’s performance will decrease, just like any other identification method, if the input–output data are insufficiently informative because of a low signal-to-noise ratio or inadequate input excitations. The generalized orthonormal basis functions are constructed and effected by the rational inner function. To solve this problem, prior information is integrated through the use of constrained least squares.
Remark 2.
It should be noted that a large number of traditional subspace identification approaches are inapplicable to closed-loop data. This issue stems from an identification procedure step that projects onto the future horizon and necessitates that the input from the future horizon be uncorrelated with the noise from the past. The proposed approach avoids this projection. Consequently, the cases of closed-loop data can be valuably applied to the proposed approach.

4.4. Summary of Subspace System Identification Algorithm

The proposed CLSPI-GOBF method is summarized in Table 1.

5. Numerical Simulation

The effectiveness of the proposed CLSPI-GOBF method was evaluated by the following examples.

5.1. Example 1: Known Steady-State Gain

Consider a second-order system with a first-order controller [29]. For the transfer functions of the process, the controller is
G ( s ) = b 1 s + b 2 s 2 + a 2 s + a 1 , C ( s ) = 10 s + 15 s ,
and the first-order inner function is used:
ϕ ( s ) = s p s + p .
The reference signal r ( t ) was chosen as pseudo-random binary sequence signals; d ( t ) was set to zero; v ( t ) is a white noise. The signal-to-noise ratio was equal to 10 dB. The sampling period was chosen to be 0.01 s.
We set a 2 = 0.5 , a 1 = 1 , b 1 = b 2 = 1 , and the number of each of the future and past block rows p = q = 10 . The experiments were conducted by 100 Monte Carlo experiments. The output response for Example 1 is depicted in Figure 1. The closed-loop subspace identification using generalized orthonormal basis functions (CLS-GOBF) and bias-eliminated least-squares method (BELSM) in [30] are compared in Figure 1. It indicates that the line of the step response from CLSPI-GOBF is closer to the step response of the true system.
The Bode diagram of the CLSPI-GOBF, CLS-GOBF, and BELSM is shown in Figure 2. The CLSPI-GOBF appeared to have a higher identification effectiveness than the other approaches, as both identified curves were able to converge to the true ones. This suggests a higher identification performance for the proposed CLSPI-GOBF approach.
For clarity, the estimated values for the CLSPI-GOBF, CLS-GOBF, and BELSM are described in Table 2.
The mean values of the CLSPI-GOBF approach were more accurate than those obtained using the other methods, as indicated by the results displayed in Table 2. The corresponding values of the CLSPI-GOBF were smaller than the other methods’ values in terms of variance estimations, indicating that the CLSPI-GOBF fluctuations were more mild. The results showed that the CLSPI-GOBF, the proposed method, performed better in the identification process.

5.2. Example 2: Zero Transfer Functions

Consider the following continuous-time system [29]:
G ( s ) = G 11 ( s ) G 12 ( s ) G 21 ( s ) G ( s ) 22 = 2 ( s + 2 ) 0 0 2 ( s + 2 ) ,
with the following feedback controller:
u ( t ) = 1 0 0 1 y ( t ) + r ( t ) .
The first-order inner function is used:
ϕ ( s ) = s p s + p .
which has two zero transfer functions G 12 and G 21 , while G 11 and G 22 have unity gains. The system was excited using the zero-mean white Gaussian process with unit variance. One hundred Monte Carlo simulations were performed.
The Hankel matrices had N = 81 columns, and the horizons for the three methods were all set to p = q = 10 . We set the sampling time to 0.01 s. The CLSPI-GOBF was compared with the CLS-GOBF and BELSM in order to verify the identification algorithm’s superiority. The average step responses from each of the three methods with white noise are displayed in Figure 3. The step response from the CLSPI-GOBF is shown in Figure 3 as a line of small circles, which is more consistent with the step response of the true system. Figure 4 describes the Bode diagram of the CLSPI-GOBF, CLS-GOBF, and BELSM. It can clearly be seen that the identified curves of the CLSPI-GOBF were closer than the other identified methods. Therefore, it had a better identification performance.
For clarity, the mean and variance of the pole estimations are depicted in Table 3.
Table 3 describes that the estimated values by the CLSPI-GOBF were superior to those generated by the other methods. Comparing the CLSPI-GOBF to the other methods, the former yielded more-accurate and -consistent results.

6. Conclusions

A closed-loop continuous-time subspace identification with prior information was proposed. The transformation of the continuous-time stochastic system into a discrete-time stochastic system was the foundation of the method. Then, the continuous-time system model was obtained by inversely transforming the deterministic portion. Based on the principal component analysis method, the consistent estimate of the closed-loop systems can be obtained. Prior information was introduced in terms of equality constraints based on the constrained least squares. Kung’s realization approach can be used to extract the system matrices and increase the accuracy of the impulse response parameters with the prior information. The simulation results showed that the proposed method increased the accuracy of the identified model. It is important to extend the proposed method to inaccurate or incomplete prior information, which will be the future work.

Author Contributions

Conceptualization, M.Y. and W.W.; methodology, Y.W.; software, W.W.; validation, W.W. and Y.W.; writing—original draft preparation, W.W.; writing—review and editing, Y.W.; funding acquisition, M.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the National Natural Science Foundation of China (NSFC) (No. 62003082), the Natural Science Foundation of Hebei Province (No. F2021501018), and the Science and Technology Project of Hebei Education Department (No. ZD2022148).

Data Availability Statement

No new data were created nor analyzed in this study. Data sharing is not applicable to this article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Huang, C. A combined invariant-subspace and subspace identification method for continuous-time state-space models using slowly sampled multi-sine-wave data. Automatica 2022, 140, 110261. [Google Scholar] [CrossRef]
  2. Kheradmandi, M.; Mhaskar, P. Data Driven Economic Model Predictive Control. Mathematics 2018, 6, 51. [Google Scholar] [CrossRef]
  3. Liu, T.; Hou, J.; Qin, S.J.; Wang, W. Subspace model identification under load disturbance with unknown transient and periodic dynamics. J. Process Control 2020, 85, 100–111. [Google Scholar] [CrossRef]
  4. Yu, M.; Liu, J.C.; Guo, G.; Zhang, W.L. Recursive subspace identification of continuous-time systems using generalized Poisson moment functionals. Circuits Syst. Signal Process. 2022, 41, 1848–1868. [Google Scholar] [CrossRef]
  5. Guo, J.; Jia, R.; Su, R.; Zhao, Y. Identification of fir systems with binary-valued observations against data tampering attacks. IEEE Trans. Syst. Man, Cybern. Syst. 2023, 53, 5861–5873. [Google Scholar] [CrossRef]
  6. Liu, L.; Liu, J.C.; Wang, H.H.; Tan, S.B.; Yu, M.; Xu, P. A multivariate monitoring method based on kernel principal component analysis and dual control chart. J. Process Control 2023, 127, 102994. [Google Scholar] [CrossRef]
  7. Bastogne, T.; Garnier, H.; Sibille, P. A PMF-based subspace method for continuous-time model identification. Application to a multivariable winding process. Int. J. Control 2001, 74, 118–132. [Google Scholar] [CrossRef]
  8. Varanasi, S.K.; Jampana, P. Nuclear norm subspace identification of continuous time state-space models with missing outputs. Control Eng. Pract. 2020, 95, 104239. [Google Scholar] [CrossRef]
  9. Bergamasco, M.; Lovera, M. Continuous-time predictor-based subspace identification using Laguerre filters. IET Control Theory Appl. 2011, 5, 856–867. [Google Scholar] [CrossRef]
  10. Hu, Y.S.; Fan, Y.; Wei, Y.H.; Wang, Y. Subspace-based continuous-time identification of fractional order systems from non-uniformly sampled data. Int. J. Syst. Sci. 2015, 47, 122–134. [Google Scholar] [CrossRef]
  11. Ohta, Y. Realization of input–output maps using generalized orthonormal basis functions. Syst. Control Lett. 2005, 54, 521–528. [Google Scholar] [CrossRef]
  12. Ohta, Y. Stochastic system transformation using generalized orthonormal basis functions with applications to continuous-time system identification. Automatica 2011, 47, 1001–1006. [Google Scholar] [CrossRef]
  13. Ohsumi, A.; Kameyama, K.; Yamaguchi, K.I. Subspace identification for continuous-time stochastic systems via distribution-based approach. Automatica 2002, 38, 63–78. [Google Scholar] [CrossRef]
  14. Huang, B.; Ding, S.X.; Qin, S.J. Closed-loop subspace identification: An orthogonal projection approach. J. Process Control 2005, 15, 53–66. [Google Scholar] [CrossRef]
  15. Wang, J.; Qin, S.J. Closed-loop subspace identification using the parity space. Automatica 2006, 42, 315–320. [Google Scholar] [CrossRef]
  16. Veen, G.V.D.; Wingerden, J.W.V.; Bergamasco, M.; Lovera, M.; Verhaegen, M. Closed-loop subspace identification methods: An overview. IET Control Theory Apply 2013, 7, 1339–1358. [Google Scholar] [CrossRef]
  17. Li, K.; Luo, H.; Jiang, Y.C.; Tang, D.J.; Yang, H.Y. Subspace identification for closed-loop systems with unknown deterministic disturbances. IEEE-CAA J. Autom. Sin. 2023, 10, 2248–2257. [Google Scholar] [CrossRef]
  18. Uematsu, R.; Masuda, S.; Kano, M. Closed-loop identification of plant and disturbance models based on data-driven generalized minimum variance regulatory control. J. Process Control 2022, 115, 197–208. [Google Scholar] [CrossRef]
  19. Breschi, V.; Chiuso, A.; Formentin, S. Data-driven predictive control in a stochastic setting: A unified framework. Automatica 2023, 152, 110961. [Google Scholar] [CrossRef]
  20. Trnka, P.; Havlena, V. Subspace like identification incorporating prior information. Automatica 2009, 45, 1086–1091. [Google Scholar] [CrossRef]
  21. Kung, S.Y. A new identification and model reduction algorithm via singular value decompositions. In Proceedings of the 12th Asilomar Conference on Circuits, Systems and Computers, Pacific Grove, CA, USA, 6–8 November 1978; pp. 705–714. [Google Scholar]
  22. Alenany, A.; Shang, H.; Soliman, M.; Ziedan, I. Improved subspace identification with prior information using constrained least squares. IET Control Theory Appl. 2011, 5, 1568–1576. [Google Scholar] [CrossRef]
  23. Alenany, A.; Shang, H. Recursive subspace identification with prior information using the constrained least squares approach. Comput. Chem. Eng. 2013, 54, 174–180. [Google Scholar] [CrossRef]
  24. Markovsky, I.; Mercère, G. Subspace identification with constraints on the impulse response. Int. J. Control 2017, 90, 1728–1735. [Google Scholar] [CrossRef]
  25. Wang, Y.Q.; Zhang, L.; Zhao, Y.L. Improved closed-loop subspace identification with prior information. Int. J. Syst. Sci. 2018, 49, 1821–1835. [Google Scholar] [CrossRef]
  26. Zhang, L.; Zhou, D.H.; Zhong, M.Y.; Wang, Y.Q. Improved closed-loop subspace identification based on principal component analysis and prior information. J. Process Control 2019, 80, 235–246. [Google Scholar] [CrossRef]
  27. Hou, J.; Chen, F.W.; Li, P.H.; Zhu, Z.Q. Prior-knowledge-based subspace identification for batch processes. J. Process Control 2019, 82, 22–30. [Google Scholar] [CrossRef]
  28. Heuberger, P.S.C.; Van den Hof, P.M.J.; Bosgra, O.H. A generalized orthogonal basis for linear dynamical systems. IEEE Trans. Autom. Control 1995, 40, 451–465. [Google Scholar] [CrossRef]
  29. Garnier, H.; Wang, L.P. Identification of Continuous-Time Models from Sampled Data; Springer: London, UK, 2008. [Google Scholar]
  30. Garnier, H.; Gilson, M.; Zheng, W.X. A bias-eliminated least-squares method for continuous-time model identification of closed-loop system. Int. J. Control 2000, 73, 38–48. [Google Scholar] [CrossRef]
Figure 1. Comparison of step responses for simulation Example 1.
Figure 1. Comparison of step responses for simulation Example 1.
Mathematics 11 04924 g001
Figure 2. Comparison of Bode diagram for Example 1.
Figure 2. Comparison of Bode diagram for Example 1.
Mathematics 11 04924 g002
Figure 3. Comparison of step responses for Example 2.
Figure 3. Comparison of step responses for Example 2.
Mathematics 11 04924 g003
Figure 4. Comparison of Bode diagram for Example 2.
Figure 4. Comparison of Bode diagram for Example 2.
Mathematics 11 04924 g004
Table 1. Summary of the CLSPI-GOBF method.
Table 1. Summary of the CLSPI-GOBF method.
step 1:
(1) Construct the data matrices Y p , q , N , U p , q , N , Y 0 , p , N , U 0 , p , N . Form Z , y in Equation (38).
(2) Transform the prior information into A eq and b eq . Utilizing Equation (40) as a
constraint, the least-squares optimization problem is solved in Equation (39).
step 2:
(3) Estimate the impulse response parameters θ ^ g by Equation (51).
(4) Factorize T using Kung’s realization algorithm in Equation (52).
step 3:
(5) Estimate the observability matrix Γ and controllability matrix Δ using Equation (53).
(6) Extract the system matrices by Equation (54).
Table 2. The values of parameter estimation.
Table 2. The values of parameter estimation.
ParametersTrueCLSPI-GOBFCLS-GOBFBELSM
MeanVarianceMeanVarianceMeanVariance
a 1 10.99570.00040.95780.00520.93470.0082
a 2 0.50.49140.00050.49050.00410.45710.0021
b 1 10.96850.00070.94580.00090.91200.0062
b 2 10.97410.00050.96470.00100.92490.0073
Table 3. The values of pole estimations for Example 2.
Table 3. The values of pole estimations for Example 2.
ApproachMean of p 1 Variance of p 1 Mean of p 2 Variance of p 2
CLSPI-GOBF−1.97590.0025−1.96540.0086
CLS-GOBF−1.95240.0457−1.92040.0527
BELSM−1.91400.1547−1.85800.8426
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yu, M.; Wang, W.; Wang, Y. Closed-Loop Continuous-Time Subspace Identification with Prior Information. Mathematics 2023, 11, 4924. https://doi.org/10.3390/math11244924

AMA Style

Yu M, Wang W, Wang Y. Closed-Loop Continuous-Time Subspace Identification with Prior Information. Mathematics. 2023; 11(24):4924. https://doi.org/10.3390/math11244924

Chicago/Turabian Style

Yu, Miao, Wanli Wang, and Youyi Wang. 2023. "Closed-Loop Continuous-Time Subspace Identification with Prior Information" Mathematics 11, no. 24: 4924. https://doi.org/10.3390/math11244924

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop