Controllability of Stochastic Integro-Differential Systems with Time Delay in Control Input ()
1. Introduction
Dynamical systems involving input/output delays arise naturally in many engineering fields such as process control and communication systems. Time delays may occur for various reasons and are often the main causes for substantial performance deterioration and the instability of the system. Further, satisfactory modelling of systems with time-varying control delays is also important for the synthesis of effective control systems since they show significantly different characteristics from that of fixed time delays [1]-[3]. In practical application, time varying input delays in a flexible spacecraft due to the physical structure and energy consumption of the actuators [4]. It is essential that system models must take into account of these time delays in order to predict the true dynamics of the systems. Moreover, majority of processes in the industrial practice have stochastic characteristics and the systems have to be modelled in the form of stochastic differential equations [5]-[7]. Thus, it is of theoretical and practical significance to address the controllability problems for such stochastic systems with delays in control input [8] [9].
Controllability is one of the most important aspects of industrial process operability, because it can be used to assess the attainable operation of a given process and improve its dynamic performance. It refers to the ability of a controller to arbitrarily alter the functionality of the dynamical system. Controllability of linear and nonlinear systems is a well established subject with extensive literature [10] [11]. Much attention is to establish controllability conditions for linear and nonlinear systems involving delays in control [12]-[18]. Further, one can see the survey article by Klamka [19] for recent developments in this topic.
The results on controllability of linear and nonlinear stochastic systems have been subject of intense research over the past few years [20]-[23]. In recent years, we have witnessed increasing interests in nonlinear stochastic systems involving delays in state/control (see [24] [25] and reference therein). Klamka [26]-[29] investigated the controllability of linear stochastic systems with single time-variable delay in the control. More recently, the controllability of nonlinear stochastic systems with delay in control has recently been considered by Shen and Sun [30] based upon a fixed point approach. The above references reflect the great importance of such lines of research and we study the problem of controllability for semilinear stochastic integro-differential systems involving single variable control delay as can be seen in [31]-[33].
The contents of this paper are as follows: In Section 2, we formulate the problem and present some preliminaries. In Section 3, we investigate the controllability of linear stochastic systems with time delay in control input. Section 4 is entirely devoted to establish the sufficient controllability conditions for semilinear stochastic integro-differential systems via one of the fixed point methods, namely, the contraction mapping principle. In Section 5, we present an example which illustrates the main results in this paper.
Notations. The notation used in this paper is fairly standard. Throughout the paper,
is a complete probability space equipped with the filtration
generated by
-dimensional Wiener process
be an defined on the probability space;
denotes the Hilbert space of all
-measurable square-integrable random variables with values in
;
denotes the Hilbert space of all square-integrable and
-measurable processes with values in
;
, the set of admissible controls;
denote the space of all linear transformations from
to
;
and
denotes resolvent and identity matrices respectively;
denotes the mathematical expectation operator of stochastic process with respect to the given probability measure
.
2. System Description and Preliminaries
Consider the linear stochastic integro-differential system with a time-varying delay in control of the form
(2.1)
where
is the instantaneous state of the system,
and
are respectively
and
continuous matrix functions whose elements are bounded measurable functions on
. The kernel
is an
continuous matrix function for
and
. Further,
is a vector input to the stochastic dynamical system satisfying
for
. Further, the function
defined by
is continuously differentiable and strictly increasing, and
is a time variable point delay.
These situations may appear, for instance, when controlling a system by applying a force which takes into account not only the present state of the system but also the history of the solutions. In particular, this type of equations arise in population models where the integral term here specifies how much weight to attach to the population at varies past times, in order to arrive at their present effect on the resources availability.
Here, the control function
regulates the system state by fusing the values of
at time moment
, where
is a time varying delay as well at the current time
, which assumes that the current state of the systems depends not only on the current value of
but also on its value after certain lag
.
Moreover, since for
dynamical system (2.1) is infact without delay, then we generally assume that the final time
.
For a given initial condition (2.1) and any admissible control
, there exists a unique solution
of the linear system (2.1) which can be represented in the following integral form
(2.2)
where
is the resolvent matrix which is the unique solution of the initial value problem
It is important to note that the resolvent solution
of (2.1) plays the same role as the fundamental matrix solution when
, that is
i)
is invertible.
ii)
for all
.
However these properties are not true in general when
(see [33]).
Let us introduce the time lead functions
, such that
Taking
and using the time lead function
in (2.2), we have
Thus, for
, (2.2) can be written as
or equivalently
Now, for a fixed given final time
, taking into account the form of the above integral solution, let us introduce the following operators and the reachable set.
We define the linear and bounded control operator
as follows:
and its adjoint bounded linear operator
as
where the star (
) denotes the adjoint matrix.
From the above notation it follows that the set of all states reachable from initial state
in time
, using admissible controls has the form
where
is the solution of the system (2.1).
The linear controllability operator
associated with the control operator
is defined by
and the deterministic controllability matrix is defined by
is
Definition 2.1 The stochastic system (2.1) is said to be relatively exact controllable on
if
that is, if all the points in
can be exactly reached at time
from any arbitrary initial point
at time
.
Definition 2.2 The stochastic system (2.1) is said to be relatively approximate controllable on
if
that is, if all the points in
can be approximately reached at time
from any arbitrary initial point
at time
.
3. Linear Stochastic Systems
Before we prove the main result, we recall some important results which is necessary to establish the criterion.
Consider the corresponding deterministic system of the following form
(3.1)
where
is the admissible control.
For the deterministic system (3.1) let us denote by
the set of all states reachable from the initial state
in time
using admissible controls.
Definition 3.1 The deterministic system (3.1) is said to be relatively controllable on
if
.
Lemma 3.2 The following conditions are equivalent:
i) Deterministic system (3.1) is relatively controllable on
.
ii) The deterministic controllability matrix
is nonsingular.
The following lemma shows that relative controllability of the associated deterministic linear system (3.1) is equivalent to relative exact controllability and relative approximate controllability of the linear stochastic system (2.1).
Lemma 3.3 The following conditions are equivalent:
i) Deterministic system (3.1) is relatively controllable on
.
ii) Stochastic system (2.1) is relatively exact controllable on
.
iii) Stochastic system (2.1) is relatively approximate controllable on
.
Note that from [34], we see that if the linear stochastic system (2.1) is relatively exact controllable, then the operator
is strictly positive definite and thus, the inverse linear operator
is bounded. Using the fact that the operator
is bounded we shall construct the control
that steers the system from the initial state
to a desired final state
at time
.
Lemma 3.4 Assume that the stochastic system (2.1) is relatively exact controllable on
. Then, for arbitrary target
and
, the control
transfers the system
from
to
at time
.
Moreover, among all the admissible controls
transferring the initial state
to the final state
at time
, the control
minimizes the integral performance index
Proof. Since the stochastic dynamical system (2.1) is relatively exact controllable on
, the controllability operator
is invertible and its inverse
is a linear and bounded operator, that is
. Substituting the control
into the solution formula of the differential state equation and substituting
, one can easily verify that the control (3.1) steers the linear system from
to
. The second part of the proof is similar to that of Theorem 2 of Klamka (2007).
4. Semilinear Stochastic Systems
Taking into account of the above notations and results, we shall derive sufficient controllability conditions for the semilinear stochastic integrodifferential systems with variable delay in control system of the form
(4.1)
where
,
and
are defined as before.
Then the solution of the system (4.1) can be expressed in the following form
Now using the time lead function, we have
(4.2)
and the above equation for
can be expressed as
Now let us define the control function associated with the system (4.1) as follows:
(4.3)
where
Inserting (4.3) in (4.2), it is easy to verify that the control
transfers the
to the desired vector
at time
.
We will consider Eq. (4.1) under the following assumptions:
(H1) The function
is Lipschitz continuous, that is, for
and
there exists a constant
such that
(H2) The function
is continuous and satisfies the usual linear growth condition, that is, there exists a constant
such that for all
and all
Let
denotes the Banach space of all square integrable and
-adapted processes
endowed with the norm
Define the nonlinear operator
from
to
by
(4.4)
From Lemma 3.4, it is shown that if the operator
defined in (4.4) has a fixed point, then the system (4.1) has a solution
defined in (4.2) with respect to
, and
, which implies that the system (4.1) is relatively controllable. Thus, the problem of controllability of nonlinear system (4.1) can be reduced to the existence of a unique fixed point of the operator
.
Now, for our convenience, let us introduce the following notations:
Note that if the linear system (2.1) is relatively exact controllable, then for some
[34],
and so
Theorem 4.1 Assume that the conditions (H1) - (H2) hold and suppose that the linear stochastic system (2.1) is relatively exact controllable. Further, if the inequality
(4.5)
is satisfied, then the semilinear stochastic system (4.1) is relatively exact controllable.
Proof. In order to prove the relative controllability of the system (4.1), it is enough to show that the operator
has a fixed point in
. To do this, we can employ the contraction mapping principle. To apply the principle, first we show that
maps
into itself.
Now, by Lemma 3.4, we have
By the condition (H2), there exists some constant
, depending on
and
, such that
Moreover, from the above estimate we obtain
Hence we derive that
maps
into itself.
Now, we claim that
is a contraction on
. For
,
It results that
Therefore we conclude from (4.5) that
is a contraction mapping on
. Then the mapping
has a unique fixed point
with
, which is the solution of the equation (4.2). Thus the system is relatively exact controllable on
. □
Remark 4.2 Obviously hypothesis (4.5) is fulfilled if
is sufficiently small.
Remark 4.3 In the case when
in (4.1), the results coincides with Theorem 3.1 of [31].
5. Numerical Example
To illustrate the applicability of the above results, we consider the following nonlinear stochastic integrodifferential system which is described by
(5.1)
for
. Here we have
It can been easily seen that
satisfies
and
. Moreover,
and consider the time lead function as follows,
Moreover, for
, we have
Further, the deterministic controllability matrix,
is nonsingular. Moreover, it is easy to show that for all
,
and hence
is globally Lipschitz with respect to
. Further, one can see that the inequality (4.5) holds and all other conditions stated in Theorem 4.1 are satisfied. Hence, the system (5.1) is relatively exact controllable on
, that is, the system (5.1) can be steered from
to
.
6. Conclusion
In this paper, we investigated the relative controllability problem of semi linear Stochastic integro differential systems with a variable delay in control. Under suitable conditions. It is shown that the semi linear Stochastic system may be steered up to the reachable set of its corresponding linear system in finite terminal time where the results are obtained by using the fixed point techniques.