An expanded optimal control policy for a coupled tanks system with random disturbance

In this paper, an expanded optimal control policy is proposed to study the coupled tanks system, where the random disturbance is added into the system. Since the dynamics of the coupled tanks system can be formulated as a nonlinear system, determination of the optimal water level in the tanks is useful for the operation decision. On this point of view, the coupled tanks system dynamics is usually linearized to give the steady state operating height. In our approach, a model-based optimal control problem, which is adding with adjusted parameters, is considered to obtain the true operating height of the real coupled tanks system. During the computation procedure, the differences between the real plant and the model used are measured repeatedly, where the optimal solution of the model used is updated. On this basis, system optimization and parameter estimation are integrated. At the end of the iteration, the iterative solution approximates to the correct optimal solution of the original optimal control problem, in spite of model-reality differences. In conclusion, the efficiency of the approach proposed is shown.


Introduction
A coupled tanks system, which consists of a joint of two tanks together through pipes in order to reserve water at the operating height level, is an important study in the control engineering and process industries [1].The applications of the coupled tanks system have been widely used in the real-world process, for example, petrochemical, waste-water treatment, and purification [2] [3].Essentially, the coupled tanks modeling provides a configurable process control experiment to engineers and researchers such that a wide array of modeling and control-related laboratory works on liquid control can be performed in advance [1].
Theoretically, the dynamics of the coupled tanks system is formulated into a system of differential equations.The inflow and the outflow of the coupled tanks system are monitored in a simulation way in which the balance between the change rate of the water height level and the water flow in and out can be measured precisely.In addition to this, the water flow rate shall be controlled such that the equilibrium of the steady state along the operating height level is established.In literature, there are many studies on this steady state of the water level that are carried out.See for more detail in [4] [5] [6].
In practice, the experimental works on the coupled tanks system, which cover the inflow and the outflow, are affected by some disturbances, such as inaccuracy of apparatus, man-made error and unfamiliar skill, and would give the inappropriate results [7].Due to these reasons, the steady-state of the operating height level in the coupled tanks system is not easy to be addressed [8].Therefore, approximating the operating height level in the coupled tanks system as accurately as possible attracts the interest of engineers and researchers.Therefore, in this paper, an expanded optimal control policy, which takes into account different structures and parameters [9] [10] [11], is proposed for determining the steady-state of the operating height level of a couple tanks system with random disturbance.In our approach, the adjusted parameters are added to the model used.Accordingly, the expanded optimal control model is further defined [12] [13] [14].Especially, the optimal control policy, which is known as the expanded optimal control policy, is designed for solving the expanded optimal control model iteratively.On this basis, an illustrative example of the coupled tanks system, which is disturbed by the random noise, is presented.As a result, the optimal operating height level of the coupled tanks system is determined.
Hence, the efficiency of the approach proposed is highly recommended.
The structure of the paper is organized as follows.In Section 2, the problem on the coupled tanks system is described, where the related mathematical model is formulated.In Section 3, the expanded optimal control model, which is added the adjusted parameters into the model used, is introduced.From the iterative calculation, the expanded optimal control policy, which determines the optimal operating height level in the coupled tanks system, is obtained.In Section 4, the illustrative example of the coupled tanks system is discussed.The result shows the application of the approach proposed.Finally, some concluding remarks are made.

Problem Statement
Consider that two tanks are joined to be the coupled tanks system [3] 1 shows the system plant that is determined by relating the flow i Q into the tanks to the flow c Q leaving the valve at the tank bottom.
The flow balance equation for Tank 1 is given by where 1 A is the cross-sectional area of Tank 1, b Q is the flow rate of water from Tank 1 to Tank 2 through Valve B. While, for Tank 2, the flow balance equation is given by where 2 A is the cross-sectional area of Tank 2, c Q is the flow rate of water out of Tank 2 through Valve C. The system plant comes from the two flow balances and the nonlinear equations for flows through the valves.
With the assumption that the valves are ideal orifice, the flows through the valves will be related to the water levels in the tanks by the following expressions: ( ) where b a and c a are, respectively, the cross sectional areas of the orifice at Valves B and C, and db C and dc C are the discharge coefficients of Valves B and C, respectively.These coefficients take into account all fluid characteristics, losses and irregularities in the system to make the two sides of (1) and (2) balance.The gravitational constant is given by g = 9.80 m/s 2 .In addition to this, the two flow balances for ideal valves, which are given by ( 1) and ( 2), are rewritten by Figure 1.A coupled tanks system.
( ) Here, ( 4) and ( 5) describe the coupled tanks system dynamics in the nonlinear manner with ideal equations for the valves.In practice, the cross sectional area is given by the dimensions of the valve and the flow channel, which could be more complicated.

Denote
( ) as the heights of water level in the tanks, In presence of the random disturbances, the system plant dynamics in ( 4) and ( 5) is rewritten as where ω ω ω = is the Gaussian random variable with zero mean and covariance Q ω .Hence, this problem of controlling the water level in Tank 2 can be formulated as an optimal control problem, which is referred to as Problem (P), given below [11] [12]: Problem (P): Find the optimal control input u, which is the flow rate, to minimize the cost function subject to the system dynamics ( 7) and ( 8) with the output measurement where 2 s x and s u are the steady states of the value, r is the positive weight coefficient, 0 t is the initial time and 1 t is the fixed terminal time.
Notice that the structure of Problem (P) is complex and nonlinear.Solving Problem (P) would be computational demanding.However, the optimal solution of Problem (P) could be obtained through solving its simplified model, which is referred to as Problem (M), given by where and s u are the steady states of the value, whereas, ( ) α α α = is the adjustable parameter.Refer to this simplified model, it is highlighted that the aim of adding the adjustable parameter into the model used in Problem (M) is to measure the differences between the system plant and the linear model used repeatedly.By virtue of this, the optimal solution of the model used could be updated in order to approximate the correct optimal solution of Problem (P), in spite of model-reality differences [9]- [14].

System Optimization with Parameter Estimation
Now, refer to the cost function in (9) or (10), setting the weighting coefficient matrices Q and R, and the state transition matrix A and the control coefficient matrix B, respectively, to be Let ( ) represents the system dynamics function of the coupled tanks system, that is, ( ) ( ) ( ) Let us define an expanded optimal control problem, which is referred to as Problem (E), given by r ∈ ℜ are introduced to improve the convexity and to facilitate the conver- gence of the resulting iterative algorithm.It is important to note that the algorithm is designed in such a way that the constraints ( ) ( ) ( ) ( ) are satisfied due on the termination of iterations, assuming convergence is achieved.The state constraint ( ) z t and the control constraint ( ) v t are used for the computation of the parameter estimation and the matching scheme, while the corresponding state constraint ( ) x t and control constraint ( ) u t are reserved for optimizing the linear model-based optimal control prob- lem.Hence, system optimization and parameter estimation are mutually interactive.

Necessary Conditions
Define the Hamiltonian function by where ( ) p t ∈ ℜ is the Lagrange multiplier.Then, the augmented cost function for the cost function in (15) becomes   ( ) ( ) with ( ) ( ) and ( ) 0 t θ = .

Modified Optimal Control Problem
From the necessary conditions ( 18)-( 22), a modified optimal control problem, which is referred to as Problem (MM), is defined by

Optimal Control Law
The optimal control law for Problem (MM), which is known as the expanded optimal control policy, is a feedback control [9]- [14].This control law is stated in the following theorem.Theorem 1 (Expanded optimal control policy): Assume that the expanded optimal control policy exists.Then, this optimal control law is the feedback control law for Problem (MM), given by where with the boundary conditions ( ) Proof: From the necessary condition (18), the optimal control is written by Applying the sweep method [15] [16], ( ) ( ) ( ) ( ) into (33), after some algebraic manipulations, the feedback control law (28) is Step 1: Compute the parameter ( ) . This is called the parameter estimation step.
Step 2: Compute the multipliers ( ) Step 3: Using ( ) ( ) ( ) ( ) , , , and ( ) i z t , solve Problem (MM) de- fined in (27) by using the result that is presented in Theorem 1.This is called the system optimization step.
1) Solve (32) forward to obtain ( ) i s t and solve (29) to obtain 2) Use (28) to obtain the new control ( ) 3) Use (38) to obtain the new state ( ) Step 4: Test the convergence and update the optimal solution of Problem (P).
In order to provide a mechanism for regulating convergence, a simple relaxation method is employed: within a given tolerance, stop; else set 1 i i = + , and repeat the procedure staring from Step 1.

Remarks:
a) The nominal solution can be the optimal solution that is obtained from the standard linear quadratic regulator (LQR) optimal control problem.
b) The off-line computation for solving (30) and ( 31) is done at Step 0 before the iteration begins with assuming ( ) ( ) and ( ) 0 c) The numerical scheme for solving the ordinary differential equations of ( ) S t and ( ) s t can be used.
d) The relaxation method given in (40) establishes a matching scheme for the updating of the iterative solution.

Result and Discussion
For the numerical illustration, the physical parameters of the coupled tanks system are shown in Table 1 [4].The steady states of the value are set at Follow from this, the algorithm proposed is applied to obtain the optimal operating height level in the coupled tanks system.For doing this task, the algorithm proposed is implemented in the MATLAB 2016 R1 environment in Window 8.1 Pro with the processor 2.10 GHz and the 64-bit operating system.Refer to Table 1, the system parameters used are calculated and given as follow: 0.019442 0.019442 0.019442 0.024302 The simulation result is shown in Table 2.The final cost gives a smaller value than the original cost, which saves about 0.039 percent of the original cost spent.In addition to this, the water in Tank 2 is controlled at the steady-state value     Figure 5 shows the stationary condition of the optimality.It verifies that the iterative algorithm proposed is efficient and the final solution is the optimal solution.As a result, the iterative algorithm proposed is applicable to making the decision on the operating height of the coupled tanks system.

Concluding Remarks
The use of the expanded optimal control policy in determining the operating height level in the coupled tanks system was discussed in this paper.The special feature of this expanded optimal control policy is that the model used, which is a linear model, has a different structure compared to the original problem, which is a nonlinear model.By adding the adjusted parameters into the model used, the differences between the model used and the original model could be measured iteratively.As a result, the flow rate of the coupled tanks system is controlled and the operating height level is achieved, in spite of model-reality differences.In conclusion, the efficiency of the expanded optimal control policy is highly presented.Nonetheless, the optimal operating height level obtained by the algorithm proposed is the expected solution of the coupled tanks system, where the system is disturbed by the random noises.Apparently, this expected solution approximates to the steady-state value.In fact, an optimal solution of the coupled tanks system with random disturbance could be further improved by using the filtering techniques.Therefore, it is suggested to determine the optimal filtering solution of the coupled tanks system with the random disturbance in future research.

)
Advances in Pure Mathematics h) Separable variables:

4 )
Use (34)  to obtain the new costate ( ) i p t .5) Use (39) to obtain the new output ( ) i y t .

Figure 2
Figure 2 shows the trajectory of control input for the coupled tanks.The control input reduces its value dramatically from 3.33 units and then increases gradually after 0.2 seconds.It takes 0.6 seconds to converge to the steady state value 3.322 s u = .This behavior of the control input indicates that the flow rate, which is pumped into Tank 1 for the first 0.2 second, is moved into Tank 2 and reaches at the steady state after 0.8 seconds.
in Figure3and Figure4.It can be seen that the original state trajectory is disturbed by the random disturbances.Nonetheless, the expected state trajectory, which is measured from the origin, is increased obviously in such a way that controlling the steady-state value of the water level in the second tank is made.
The system states are the water level H 1 in Tank 1 and the water level H 2 in Tank 2. The control input is the pump flow rate i Q and the variable to be controlled is the second state, which is the water level H 2 , with disturbances that are caused by variations in the rate of flow out of the system by Valve B or by changes in Valve C. Hence, a mathematical model shall be built for each of the tank water levels.Figure [6][5][6].S. L. Kek et al.DOI: 10.4236/apm.2019.94014319 Advances in Pure Mathematics

Table 1 .
Physical parameters of coupled tanks system.