^{1}

^{*}

^{2}

^{*}

This article presents the Parametric Iteration Method (PIM) for finding optimal control and its corresponding trajectory of linear systems. Without any discretization or transformation, PIM provides a sequence of functions which converges to the exact solution of problem. Our emphasis will be on an auxiliary parameter which directly affects on the rate of convergence. Comparison of PIM and the Variational Iteration Method (VIM) is given to show the preference of PIM over VIM. Numerical results are given for several test examples to demonstrate the applicability and efficiency of the method.

Consider linear system described by

where are the state and control vector, respectively. are constant matrix and is the initial state. The Optimal Control Problem (OCP) is to find a control law which minimizes the quadratic cost functional

where are symmetric positive semi-definite matrices and is symmetric positive definite matrix.

In general the problem can be transformed to the Riccati differential equation [

According to the classic optimal control theory, as pointed out in [

and the optimal control law for OCP can be written as where is known as the costate variable.

Analytic solutions can rarely be found for such TPBV problem and authors often solve it approximately for example Yousefi, Dehghan and Tatari [

PIM is an approximation method for solving linear and nonlinear problems and at beginning it was proposed for solving nonlinear fractional differential equations [

where A is a nonlinear operator, t denotes the time, and is an unknown variable. To explain the basic idea of PIM, we first consider Equation (4) as below:

where L denotes a linear differential operator with respect to u, N is a nonlinear operator with respect to u and is the source term. We then construct a family of iterative formulas as:

where and denote the so-called auxiliary parameter and auxiliary function respectively. Now by use of which is a weighted integral operator, we have:

Accordingly, the successive approximations, will be readily obtained by choosing the zeroth component satisfying the general property

One logical guess for can be stablished by solving its corresponding linear homogeneous equation. Another choice is according to the initial condition. Otherwise it can be freely chosen with possible unknown constants. Note that choosing can affect on the form of the solutions.

The auxiliary parameter h is an accelerating factor which can be identified optimally by the technique proposed in this paper. We show that a suitable value of h, directly improves the rate of convergence. The auxiliary function prepare us to have various basis functions to change the solution terms to a desired form. Relation (6) shows that the sequence constructed by PIM is dependent on h and, and this directly ables us to identify and control the domain and rate of convergence and this is the main preference of PIM over VIM.

It should be emphasized that though we have the great freedom to choose the linear operator L, the auxiliary parameter h, the auxiliary function, and the initial approximation, which is fundamental to the validity and flexibility of PIM, we can also assume that all of them are properly chosen so that solution of (6) exists, as will be shown in this paper later.

Finally, the exact solution may be obtained by using

In order to solving the OCP described by (1) and (2), the PIM constructs the following sequences to directly approximate the solutions of the TPBV problem (3),

Starting with and as initial approximations, and calculate from above iteration formulas. Convergence of these sequences to the optimal solution of the problems (1) and (2) is guaranteed by the following theorem. A similar theorem for nonlinear chaotic Genesio system can be found in [

Convergence theorem: if sequence (9) constructed by PIM converges to, then is the optimal trajectory of system (1), and if is the limit of (10), then the optimal control function is

Proof: Analytically, as mentioned in [4,5], by having the answers of the system (3), i.e. and, we can establish the optimal control law of OCP (1) - (2) and it’s corresponding optimal trajectory. Hence if we show that the limits of the iteration formulas (9) and (10) are the answers of the system (3), then the proof is complete. To this end, suppose that

Also consider that and be uniformly convergent. This hypothesis is in order to guarantee convergence of sequence of derivatives to derivative of the limit i.e.

Now

and since, we have:

Now by substituting (11) and (12) we have:

Also and satisfy in conditions of system (3), because:

This shows and are the answers of system (3), and this completes the proof.

Remark 1. Unfortunately the second condition of system (3) i.e., is not an initial condition, so the initial approximation for iteration formula (10) is not available. To overcome this difficulty we use a technique likes shooting method, such that first we let where s is a constant and calculate using (10), next we apply the condition and solve this equation due to s as an unknown to find out s. Finally we return to iteration formula (10) with as an initial approximation.

Remark 2. Finding an optimal h: h is a parameter in this method which has effect on the rate of convergence. If this method is coinciding on He’s variational iteration method. But we show by several examples that a suitable value of h, directly improves the rate of convergence. An optimal value of the convergence accelerating parameter h can be determined by the residual error

One can easily minimize (13) by imposing the requirement.

In this section, we solve several examples by the PIM to show the efficiency and usefulness of the method indicating on the influence of parameter h on decreasing the iterations and increasing the convergence rate and accuracy of approximations. Whenever the form of approximations has no importance, we take. As pointed out in section 3, we solve OCPs by solving the corresponding TPBV problems (3).

Example 1. Consider the following optimal control system [

The PIM constructs the following sequences to approximate the solutions:

The exact solutions are:

Example 2. Consider the following system:

According to [4,5],. In

Example 3. Consider a second-order system as follows:

According to Equations (9) and (10), the iteration formulas are:

The exact solutions are:

Figures 4 and 5 show the exact and approximate solutions. This problem was solved by VIM in [

There are various methods for solving linear OCPs, but in practice, the preferred method is that which be executable by computers and the PIM is one of them, because, moreover it’s simple structure, it has an accelerator parameter h which directly increases the convergence rate and decreases the number of iterations and this ability will be interesting for using in the softwars. One idea to estimate optimal h mentioned in the paper. In general finding optimal auxiliary parameter h and auxiliary function, are open problems. This easy to use method can be used for nonlinear systems too.