Chaotic Behavior of a Class of Neural Network with Discrete Delays

In this paper, the effect of neuronal gain in discrete delayed neural network model is investigated. It is observed that such neural networks become highly chaotic due to the presence of high neuronal gain. On the basis of the largest Lyapunov exponent and largest eigenvalue of Jacobian matrix, chaos analysis has been done. Finally, some numerical simulations are presented to justify our results.


Introduction
Neuronal gain plays an important role for processing information in the brain [1].At the single neuron level, gain modulation can arise if the two inputs are subject to a direct multiplicative interaction.Alternatively, these inputs can be summed in a linear manner by the neuron and gain modulation can arise, instead, from a nonlinear input-output relationship [2].It was first observed in neurons of the parietal cortex of the macaque monkey that combine retinal and gaze signals in a multiplicative manner [3,4].Gain modulation has also been seen in other cortical areas [5][6][7].Higgs et al. [8] measured the effects of current noise on firing frequency-current f-I relationships in pyramidal neurons.In most pyramidal neurons, noise had a multiplicative effect on the steady-state f-I relationship, increasing gain.Aihara et al. [9] first introduced chaotic neural network models in order to simulate the chaotic behavior of biological neurons.Chaotic neural networks have been successfully applied in combinational optimization, parallel recognition, secure communication, and other areas [10,11].Actually, such spatial networks as special complex networks can exhibit some complex dynamics including chaos [12,13].Therefore the investigation of dynamics of chaotic neural networks is of practical importance and many interesting results have been obtained via different approaches in recent years [14,15].
In practice, due to the finite speeds of the switching and signals time delays exist in various delayed neural networks.Many research works have been done to inves-tigate such dynamics of delayed neural network models considering neuron gain (the maximum slope of the sigmoidal activation function) as unity.Marcus and Westervelt [16] first introduced a single delay in Hopfield model and showed that symmetrically connected continuous time network oscillates as the delay crosses a critical value.Liu et al. [17] obtained sufficient conditions ensuring existence and global exponential stability of periodic solution for the BAM neural network with time varying delays.Sun et al. [18] studied global robust exponential stability of the periodic solution of interval-delayed neural networks.Majee [19] obtained sufficient conditions for asymptotic stability about the origin of the following gain modulated a class of n-neuron nonlinear delayed system: In this paper, the model ( 1) is again considered where gain parameter  is taken as greater than unity.The main motivation of this paper is to understand the role of neuronal gain in shaping the dynamics of a class of delayed n-neuron system.It also helps to detect chaotification of delayed system by easily varifiable conditions.It is shown that for a fixed small value of time delay the gradual increment of gain parameter may give rise to periodic solution then to chaos through period doubling.This chaotic dynamics are analyzed by means of largest Lyapunov exponent and largest eigenvalue of Jacobian matrix of the system.Sufficient conditions are verified by several numerical simulations.

Chaos Analysis
Main ingredients of chaos are sensitive dependence and transitivity.We will insist that the invariant set X be bounded, so that the sensitivity is not simply due to escape to infinity.Finally, it is also necessary to require that X be closed to ensure that chaos is a topological invariant.
Definition 1. Chaos [20]: A flow  is chaotic on a com- pact invariant set X , if  is transitive and exhibits sen- sitive dependence on X .
The concept of "sensitive dependence" requires that nearby orbits eventually separates; however, the rate of separation is not specified.Indeed, there appears to be a dichotomy between systems for which nearby orbits separate exponentially for truly chaotic system.Therefore we have This concept is familiar from our study of the linearization of equilibria: when the Jacobian matrix of the vector field at equilibrium has a positive eigenvalue, then the linearized system has trajectories that grow exponentially.
Therefore the sensitivity is always measured by the largest Lyapunov exponent at the initial conditions.Hence, when the Jacobian matrix is a parameter matrix, the Lyapunov exponents are equal to the eigenvalues of the jacobian matrix.If the largest Lyapunov exponent is positive, then the system is sensitive to the initial conditions.Science chaos is defined only for compact invariant sets, this bound is quite natural.Moreover, if jacobian is uniformly bounded on the orbit, it is easy to see that the growth of any vector is at most exponential.
The vector-matrix form of system (1) is where, , , , , , diag , , , , , , , , is discrete delay parameter and  is neuronal gain parameter which is a multiplicative factor not a function.
is continuous and differentiable nonlinear function.
satisfies system (1), it is obvious that all solutions of system ( 1) is closed and bounded for   0, t   .Therefore, it is easy to conclude that the invariant set X , is compact for Using ( 2) and ( 4) we have the Jacobian J of system (1) as follows: where, system (1) satisfies the initial conditions i i Therefore the eigenvalues of J is similar to the values for Lyapunov exponent of system (1).
If 1) the activation function satisfies 1 H and 2

Numerical Example
In this section we consider a system of three-neuron delayed network model:

Conclusion
In this paper, it is shown that the gradual increment of maximum slope    of the sigmoidal activation function for a system of a class of neural network (1) cause periodic oscillation, then to chaos through period-doubling.Numerical simulations are presented here to justify the obtained results.Moreover, largest Lyapunov exponent can be evaluated to verify that the system is sensitive to initial conditions.

It is shown in Figure 1 ( 1 
a) that without neuronal gain system (5) is oscillatory, but in presence neuronal gain > , this system exhibits aperiodic behaviors (see Figures 1(b)-(e)) and ultimately becomes chaotic (as shown in Figures 1(f) and (i)).In Figure 2 bifurcation diagram depicts that system (5) become chaotic through periodic oscillation and then period-doubling as gain parameter  varies.Chaotic behaviors are verified by different numerical simulation methodologies, which are shown in Figure 3.