Modified Algorithm for Solving Linear Integro-Differential Equations of the Second Kind

M. Al-Towaiq, Ahmed Kasasbeh

Department of Mathematics and Statistics, Jordan University of Science and Technology, Al Ramtha, Irbid, Jordan.

DOI: 10.4236/ajcm.2017.72014                

Abstract

In this paper, a modified algorithm is proposed for solving linear integro-differential equations of the second kind. The main idea is based on applying Romberg extrapolation algorithm (REA), on Trapezoidal rule. In accordance with the computational perspective, the comparison has shown that Adomian decomposition approach is more effective to be utilized. The numerical results show that the modified algorithm has been successfully applied to the linear integro-differential equations and the comparisons with some existing methods appeared in the literature reveal that the modified algorithm is more accurate and convenient.

Keywords

Algorithm, Integro-Differential Equations, Trapezoidal Rule, Romberg Extrapolation

1. Introduction

Mathematical modelling of real-life problems usually results in functional equations, such as differential, integral, and integro-differential equations. Many mathematical formulations of physical phenomena reduced to integro-differen- tial equations, like fluid dynamics, biological models and chemical kinetics [1] [2] [3] .

The numerical solution of integro-differential equation is a part of numerical analysis, which has been changed by the ongoing revolution in numerical methods. With the development of technology, useful methods are evolving for full utilization of the inherent powers of high speed and large memory computing machine. Many significant methods were discovered to approximate the solution of linear integro-differential equations, such as the Improved Bessel collocation method [4] , the Legendre wavelets method [5] , the finite element method [6] , the Tau method [7] , Euler polynomials [8] , Sherman-Morrison formula [9] , the Adomian’s decomposition method [10] [11] , the Cas wavelet [12] , the homotopy perturbation method [13] , the Variational iteration method [14] [15] [16] , the comined Laplace transform and the Adomian decomposition methods [17] , the Sinc method [18] [19] , the Galerkin method [20] , Romberg extrapolation [21] , the Chebyshev polynomial approach [22] [23] , Lagrange Interpolation [24] , and many mathematicians still search to get strong methods and powerful techniques to solve problems in integro-differential equations.

Without loss of generality, the linear Fredholmintegro differential equation of the second kind was considered.

$u^{\prime }\left(x\right)=f\left(x\right)+{\displaystyle {\int }_a^{b}k\left(x,t\right)u\left(t\right)\text{d}t},u\left(a\right)=\alpha ,$ (1)

where, α is a real constant.

Some authors studied the numerical solution of the nonlinear integro-differ- ential equations by the Adomian decomposition method and compared it with the variational iteration method [14] [15] [16] . Therefore, results show that the variation iteration method (VIM) has been successfully employed to obtain the approximate analytical solutions of the nonlinear integro-differential equations. Others solve it through a comparison of the Adomian decomposition method and the wavelet-Galerkin method [20] . From the computational view point, the comparison shows that the Adomian decomposition method is more efficient and easy to use.

Saadati et al. [1] , presented numerical method to approximate the integro- differential equations (Volterra, Fredholm) using the Trapezoidal rule. This method based on transforming the first derivative integro-differential equations to a system of algebraic equations.

In [22] [23] , the Chebyshev polynomial was used to approximate the solution of integral equations, system of higher-order linear Fredholm-Volterra integro-differential equations, and integro-differential equations. The main idea of their techniques based on transforming these equations to a system of algebraic equations. They showed that the method has some major advantages: Chebyshev coefficients of the solution are found very easily and this process is very fast. An interesting feature of the method obtained analytical solution in many cases. Many studies have indicated the variational iteration method to solve the linear and nonlinear integro differential equations (Volterra, Fredholm) [3] [14] [15] [16] [17] . They applied the variational iteration method to approximate the solutions of the integro-differential equations. The results show that this method is very effective with low computation time. Also, some authors concluded that the method can be used to find exact solution for some cases.

M. T. Rashed [24] computed the solution of the integro-differential equation numerically by using the Lagrange interpolation. It is being concluded that the method is the very rapid convergence, and successfully treated Volterra type and Fredholm type without any difficulties. In this paper, the solutions of the linear integro-differential equations of different types are studied, analyzed and implemented using a modified algorithm based on the Romberg extrapolation techniques.

Jaradat et al. [25] presented an applicability of the Homotopy method to solve Fredholm integro-differential equation. They test the validity and the applicability of this method, and show that the Homotopy techniques are very powerful to approximate the linear Fredholm integro-differential equations.

Mostafa Nadir and Azedine Rahmoune [26] , presented a numerical method to approximate the solution of the linear Volterra integral equations of the second kind, based on Simpson’s rule.

The paper is organized as follows: In Section 2, the proposed technique for solving the linear integro-differential equations is introduced. Some numerical experiments are presented in Section 3. The paper is concluded in Section 4.

2. The Modified Algorithm

In this section, the chosen algorithm is introduced for the solution of Fredholm integro-differential equation of the second kind. First, the Trapezoidal rule is applied to approximate the integral and the finite difference to approximate the derivative in (1), and then Romberg extrapolation is applied to increase the accuracy of the solution.

The numerical setting and the approximation of the integral for the Volterra Equation (1) will result in the coefficient matrix of the linear system of equations being a lower triangular one, which is exactly due to the variable upper limit x of the integration in (1), because in this equation the kernel $k\left(x,t\right)\equiv 0$ for $t>x$ as the integrand can be considered identically zero above it is upper limit of integration x. So, for the discrete case $k\left(x_i,t_j\right)=k_{ij}=0$ for $j>i$ is used. Then the system of linear equations with such a natural triangular coefficient matrix can be solved easily.

To use Trapezoidal rule the interval of integration $\left(a,x\right)$ has been partitioned into n equally spaced subintervals of width

$h=\frac{x_n-a}{n},n\ge 1,$ (2)

where $x_n$ is the end point chosen for x; set t₀ = a should be set and

$t_j=a+jh=t_0+jh,j=1,2,3,\cdots ,n.$ (3)

Then the approximation of the integral in the integro-differential Equation (1) is given by,

${\displaystyle {\int }_a^{x}k\left(x,t\right)u\left(t\right)\text{d}t}\cong h[\frac{1}{2}k\left(x,t_0\right)u\left(t_0\right)+k\left(x,t_1\right)u\left(t_1\right)+\cdots +k\left(x,t_{n-1}\right)u\left(t_{n-1}\right)$ $+\frac{1}{2}k\left(x,t_n\right)u\left(t_n\right)],$ (4)

where,

$h=\frac{t_j-a}{j}=\frac{x-a}{n},t_j\le x,j\ge 1,x=x_n=t_n.$ (5)

Replace n by $2^n=m$ , then (4) becomes,

${\displaystyle {\int }_a^{x}k\left(x,t\right)u\left(t\right)\text{d}t}\cong h[\frac{1}{2}k\left(x,t_0\right)u\left(t_0\right)+k\left(x,t_1\right)u\left(t_1\right)+\cdots +k\left(x,t_{m-1}\right)u\left(t_{m-1}\right)$ $+\frac{1}{2}k\left(x,t_m\right)u{t}_m],$ (6)

which is called R(n, 0). Then Romberge algorithm (REA) R_k,j can be applied,

where,

$R_{k,j}=R_{k,j-1}+\frac{R_{k,j-1}-R_{k-1,j-1}}{4^j-1},i,j\ge 1$ (7)

Now, substitute Equation (6) in (1), thus obtain,

$u^{\prime }\left(x\right)=f\left(x\right)+h[\frac{1}{2}k\left(x,t_0\right)u\left(t_0\right)+k\left(x,t_1\right)u\left(t_1\right)+\cdots +k\left(x,t_{m-1}\right)u\left(t_{m-1}\right)$ $+\frac{1}{2}k\left(x,t_m\right)u\left(t_m\right)],$ (8)

If n values of ${u^{\prime }}_i=u^{\prime }\left(x_i\right)=u^{\prime }\left(t_i\right)$ are considered and,

$k\left(x,t_j\right)u\left(t_j\right)=k\left(x_i,t_j\right)u\left(t_j\right),i=1,2,3,\cdots ,n,$

then Equation (8) becomes,

$u^{\prime }\left(x_i\right)=f\left(x_i\right)+h\left[\frac{k\left(x_i,t_0\right)u\left(t_0\right)}{2}+\frac{k\left(x_i,t_m\right)u\left(t_m\right)}{2}+k\left(x_i,t_1\right)u\left(t_1\right)+\cdots +k\left(x_i,t_{m-1}\right)u\left(t_{m-1}\right)\right]$ (9)

For simplicity Equation (9) becomes,

${u^{\prime }}_i=f_i+h\left[\frac{k_{i0}{u}_0}{2}+\frac{k_{i,m}{u}_m}{2}+k_{i1}{u}_1+\cdots +k_{i,m-1}{u}_{m-1}\right].$ (10)

The finite difference formula is applied,

$u^{\prime }\left(x\right)\cong \frac{3u\left(x\right)-4u\left(x-h\right)+u\left(x-2h\right)}{2h}$

to approximate ${u^{\prime }}_i\left(x\right)$ in Equation (10) to get the following equation

$\frac{3u_m-4u_{m-1}+u_{m-2}}{2h}=f_i+h\left[\frac{k_{i0}{u}_0}{2}+\frac{k_{i,m}{u}_m}{2}+k_{i1u1}+\cdots +k_{i,m-1}{u}_{m-1}\right].$ (11)

In matrix notation, Equation (11) transform into the following system of linear equations:

$KU=F,$

where,

$\begin{array}{l}K=[(-)h^2{k}_{11}\left(1-2h^2{k}_{12}\right)\left(-2h^2{k}_{13}\right)\cdots -h^2{k}_{1_m}\\ -\left(2h^2{k}_{21}+1\right)-2h^2{k}_{22}\left(1-2h^2{k}_{23}\right)\left(1-2h^2{k}_{23}\right)\left(1-2h^2{k}_{23}\right)\cdots -h^2{k}_{{12}_m}\\ -2h^2{k}_{31}-\left(2h^2{k}_{32}+1\right)-h^2{k}_{33}\\ ⋮\\ -2h^2{k}_{m-1,1}-2h^2{k}_{m-1,2}\cdots -2h^2{k}_{m-1,m-1}\left(1-2h^2{k}_{m-1,m}\right)\\ -2h^2{k}_{m,1}-2h^2{k}_{m,2}\cdots -\left(2h^2{k}_{m,m-1}+4\right)-\left(2h^2{k}_{m,m}-3\right)]\end{array}$ (13)

$U={\left(u_1,u_2,\cdots ,u_{m-1},u_m\right)}^t$ (14)

And,

$F={[2h{f}_1+\left(h^2{k}_{10}+1\right)u_0,2h{f}_2+\left(h^2{k}_{20}\right)u_0,\cdots ,2h{f}_{m-1}+h^2{k}_{m-1,0}\left(u_0\right),2h{f}_m}^{}$ $+h^2{k}_{m-1,0}\left(u_0\right)]t.$ (15)

This system can be solved for the unknowns u_i’s, $i=\text{1},\text{2},\cdots ,m$ easily.

3. Numerical Experiments

In this paper, illustrative examples of integro-differential equation are given to demonstrate the accuracy and efficiency of the proposed technique and compare it with some other existing methods.

Example 3.1 [10] . Consider the following Linear Fredholm integro-differential equation of the first derivative:

$u^{\prime }\left(x\right)=1-\frac{1}{3}x+{\displaystyle {\int }_0^{1}xtu\left(t\right)},u\left(0\right)=0,$ (16)

In Equation (16),

$f\left(x\right)=1-\frac{1}{3}x,k\left(x,t\right)=xt.$

The exact solution of Equation (3.1) is:

$u\left(x\right)=x.$ (17)

The modified algorithm of Romberg extrapolation is applied for solving this example. Following equation is used:

$h=h_5=\frac{1}{16},$ then $k=5,$ with $x_0=0,$ and $x_{16}=1,$ with mesh points,

$x_i=i{h}_5,i=1,2,\cdots ,16.$ (18)

Apply Equation (10) and Equation (11) to compute the approximate solution,

$u_i,i=1,2,\cdots ,16.$

Table 1 shows the absolute errors of the numerical results of R_5,2. It is shown that the proposed algorithm is accurate and efficient. Based on the recursive relations of Romberg extrapolation the accuracy increased with less computation time.

In [10] , Vahidi reported the computed absolute error for Example (3.1), with n = 10 for different methods such as the CAS wavelet method, the differential transform method (DTM), and the Adomian decomposition method (ESA). For comparison purposes, norm 2 for the absolute error vector of all the points on [0, 1] is computed. The computed norms for all the above mentioned methods and technique (REA) are shown in Table 2. The table shows that algorithm is more accurate and convenient than other methods. But, if technique is compared with the VIM method, the VIM gives better accuracy.

However, the technique has the advantage, on the time R_k,1 is computed, the accuracy will increase with less computation as the recursive relation of Romberg increases.

Example 3.2 [1] . In this example, the technique for solving the following Linear Volterra integro-differential equation of the first derivative is applied:

Table 1. Approximate solution and absolute errors of Example (3.1), using R_5,2.

Table 2. Absolute error.

$u^{\prime }\left(x\right)=1+\sin x+{\displaystyle {\int }_0^{x}u\left(t\right)},u\left(0\right)=-1,$ (19)

In Equation (19), $f\left(x\right)=1+\sin x,k\left(x,t\right)=1.$ The exact solution of Equation (3.3) is

$u\left(x\right)=\frac{1}{4}{\text{e}}^x-\frac{3}{4}{\text{e}}^{-x}-\frac{1}{2}\cos x.$ (20)

The modified algorithm of Romberg extrapolation is applied for solving this example.

The study use $h_5=\frac{1}{16},$ then, $k=5$ , with $x_0=0,$ and $x_{16}=1,$ with mesh

points,

$x_i=i{h}_5,i=1,2,\cdots ,16.$

Apply Equation (11) to compute the approximate solution $u_i,i=1,2,\cdots ,16.$

Table 3 shows the absolute errors of the numerical results of R_5,2. It is shown that the proposed algorithm is accurate and efficient. Based on the recursive relations of Romberg extrapolation the accuracy increased with less computation

time.

In [10] , Vahidi reported the computed absolute error for Example 3.2, with n = 10 for the different methods mentioned in example 3.1. The computed norms for all the methods are shown in Table 4. The table shows that the technique is more accurate than the CAS wavelet and the differential transform method (DTM) and has the same accuracy as the Adomian decomposition method (ESA).

4. Conclusion

A modified technique by using Romberg extrapolation on the Trapezoidal rule was introduced to find an approximate solution of the linear integro-differential equation. Some numerical examples appearing in the literature are presented for introducing the main idea behind the approach and for comparisons purposes. The numerical results show that the technique has been successfully applied to the linear integro-differential equations with first derivative. Comparisons with the methods provided in [10] revealed that the technique is more accurate and

Table 3. Approximate solution and absolute errors of Example (3.2) using R_5,2.

Table 4. Absolute error.

convenient than the other methods. When the technique is compared with the VIM, the VIM normally gives a better accuracy than the method selected. However, the technique has one advantage: the accuracy can be increased with less computation as the recursive relations of Romberg increases.

Acknowledgements

The authors are very thankful to all the associated personnel in any reference that contributed in/for the purpose of this research. Further, this research holds no conflict of interest and is not funded through any source.

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Saadati, R., Raftari, B., Abibi, H., Vaezpour, S.M. and Shakeri, S. (2008) A Comparison between the Variational Iteration Method and Trapezoidal Rule for Solving Linear Integro-Differential Equations. World Applied Sciences Journal, 4, 321-325.
[2]	Jerri, A.J. (1999) Introduction to Integral Equations with Applications. John Wiley & Sons, New York.
[3]	Alawneh, A., Al-Khaled, K. and Al-Towaiq, M. (2010) Reliable Algorithms for Solving Integro-Differential Equations with Applications. International Journal of Computer Mathematics, 87, 1538-1554. https://doi.org/10.1080/00207160802385818
[4]	Yuzbas, S. (2016) Improved Bessel Collocation Method for Linear Volterraintegro-Differential Equations with Piecewise Intervals and Application of a Volterra Population Model. Applied Mathematical Modelling, 40, 5349-5363. https://doi.org/10.1016/j.apm.2015.12.029
[5]	Razzaghi, M. and Yousefi, S. (2005) Legendre Wavelets Method for the Nonlinear Volterra-Fredholm Integral Equations. Mathematics and Computers in Simulation, 70, 1-8. https://doi.org/10.1016/j.matcom.2005.02.035
[6]	Sharma, N. and Sharma, K. (2015) Finite Element Method for a Nonlinear Parabolicintegro-Differential Equation in Higher Spatial Dimensions. Applied Mathematical Modelling, 39, 7338-7350. https://doi.org/10.1016/j.apm.2015.02.037
[7]	Pour-Mahmoud, J., Rahimi-Ardabili, M.Y. and Shahmorad, S. (2005) Numerical Solution of the System of Fredholm Integro-Differential Equations by the Tau Method. Applied Mathematics and Computation, 168, 465-478. https://doi.org/10.1016/j.amc.2004.09.026
[8]	Mirzaee, F. and Bimesl, S. (2015) Numerical Solutions of Systems of High-Order Fredholmintegro-Differential Equations Using Euler Polynomials. Applied Mathematical Modelling, 39, 6767-6779. https://doi.org/10.1016/j.apm.2015.02.022
[9]	Egidi, N. and Maponi, P. (2010) The Use of Sherman-Morrison Formula in the Solution of Fredholmintegral Equation of Second Kind. Mathematics and Computers in Simulation, 81, 693-704. https://doi.org/10.1016/j.matcom.2010.03.006
[10]	Vahidi, A.R., Babolian, E., Cordshooli, G.A. and Azimzadeh, Z. (2009) Numerical Solution of Fredholm Integro-Differential Equation by Adomian’s Decomposition Method. International Journal of Mathematical Analysis, 36, 1769-1773.
[11]	El-Sayed, S.M. and Abdel-Aziz, M.R. (2003) A Comparison of Adomian’s Decomposition Method and Wavelet-Galerkin Method for Solving Integro-Differential Equations. Applied Mathematics and Computation, 136, 151-159. https://doi.org/10.1016/S0096-3003(02)00024-3
[12]	Danfu, H. and Xufeng, S. (2007) Numerical Solution of Integro-Differential Equations by Using CAS Wavelet Operational Matrix of Integration. Applied Mathematics and Computation, 194, 460-466. https://doi.org/10.1016/j.amc.2007.04.048
[13]	Yusufoglu, E. (2009) Improved Homotopy Perturbation Method for Solving Fredholm Type Integro-Differential Equations. Chaos Solitons Fractals, 41, 28-37. https://doi.org/10.1016/j.chaos.2007.11.005
[14]	Wang, S.Q. and He, J.H. (2007) Variational Iteration Method for Solving Integro-Differential Equations. Physics Letters A, 367, 188-191. https://doi.org/10.1016/j.physleta.2007.02.049
[15]	Abbasbandy, S. and Shivanian, E. (2009) Application of Variational Iteration Method for nth-Order Integro-Differential Equations. Zeitschrift für Naturforschung A, 64, 439-444. https://doi.org/10.1515/zna-2009-7-805
[16]	Sweilam, N.H. (2007) Fourth Order Integro-Differential Equations Using Variational Iteration Method. Computers & Mathematics with Applications, 54, 1086-1091. https://doi.org/10.1016/j.camwa.2006.12.055
[17]	Wazwaz, A.M. (2010) The Combined Laplace Transform-Adomian Decomposition Method for Handling Nonlinear Volterra Integro-Differential Equations. Applied Mathematics and Computation, 216, 1304-1309. https://doi.org/10.1016/j.amc.2010.02.023
[18]	Rashidinia, J. and Zarebnia, M. (2007) The Numerical Solution of Integro-Differential Equation by Means of the Sinc Method. Applied Mathematics and Computation, 188, 1124-1130. https://doi.org/10.1016/j.amc.2006.10.063
[19]	Kajani, M.T., Ghasemi, M. and Babolian, E. (2006) Numerical Solution of Linear Integro-Differential Equation by Using Sine-Cosine Wavelets. Applied Mathematics and Computation, 180, 569-574. https://doi.org/10.1016/j.amc.2005.12.044
[20]	Maleknejad, K. and Kajani, M.T. (2004) Solving Linear Integro-Differential Equation System by Galerkin Methods with Hybrid Functions. Applied Mathematics and Computation, 159, 603-612. https://doi.org/10.1016/j.amc.2003.10.046
[21]	Mestrovic, M. and Ocvirk, E. (2007) An Application of Romberg Extrapolation on Quadrature Method for Solving Linear Volterra Integral Equations of the Second Kind. Applied Mathematics and Computation, 194, 389-393. https://doi.org/10.1016/j.amc.2007.04.043
[22]	Dascioglu, A. (2006) A Chebyshev Polynomial Approach for Linear Fredholm-Volterra Integro-Differential Equations in the Most General Form. Applied Mathematics and Computation, 181, 103-112. https://doi.org/10.1016/j.amc.2006.01.018
[23]	Dascioglu, A. and Sezer, M. (2005) Chebyshev Polynomial Solutions of Systems of Higher-Order Linear Fredholm-Volterra Integro-Differential Equations. Journal of the Franklin Institute, 342, 688-701. https://doi.org/10.1016/j.jfranklin.2005.04.001
[24]	Rashed, M.T. (2004) Lagrange Interpolation to Compute the Numerical Solutions of Differential, Integral and Integro-Differential Equations. Applied Mathematics and Computation, 151, 869-878. https://doi.org/10.1016/S0096-3003(03)00543-5
[25]	Jaradat, H., Alsayyed, O. and Al-Shara, S. (2008) Numerical Solution of Linear Integro-Differential Equations. Journal of Mathematics and Statistics, 4, 250-254. https://doi.org/10.3844/jmssp.2008.250.254
[26]	Mostafa, N. and Azedine, R. (2007) Modified Method for Solving Linear Volterra Integral Equations of the Second Kind Using Simpson’s Rule. International Journal: Mathematical Manuscripts, 1, 141-146.