Detecting the Stable , Observable and Controllable States of the Human Brain Dynamics

A new technique is proposed in this paper for real-time monitoring of brain neural activity based on the balloon model. A continuous-discrete extended Kalman filter is used to estimate the nonlinear model states. The stability, controllability and observability of the proposed model are described based on the simulation and measured clinical data analysis. By introducing the controllable and observable states of the hemodynamic signal we have developed a numerical technique to validate and compare the impact of brain signal parameters affecting on BOLD signal variation. This model increases significantly the signal-to-noise-ratio (SNR) and the speed of brain signal processing. A linear-quadratic regulator (LQR) also has been introduced for optimal control of the model.


Introduction
In the brain, real-time monitoring of hemodynamic states and preserving their stability provides a significant mechanism for fast and reliable brain monitoring especially in early detection of seizure and epilepsy or in brainmachine interaction studies.In order to measure the neural activity of the brain the electroencephalography (EEG) and magnetoencephalography (MEG) could be applied for electrophysiological aspects and the functional magnetic resonance imaging (fMRI) and functional near infrared spectroscopy (fNIRS) [1] for metabolic aspects.When the blood oxygenation changes in the brain, it shows that we have a neural activity.So, this is a way to track the neural activity by detecting the hemodynamic changes in the brain.Blood oxygen level-dependent (BOLD) signal shows the brain activity and fMRI and fNIRS use this signal to show this activity.Many experimental observations have provided evidence of the deviation of BOLD from linearity [2][3][4][5][6][7].With these observations of nonlinearity of the BOLD response, several researchers have attempted to handle nonlinear characterization for these underlying brain processes.In [3], the linear model of heomodynamic response presented in [4] is extended to cover nonlinear responses using a Volterra series expansion.
At the same time the first compelling model for heomodynamic signal transduction in fMRI was presented in [5], namely the Balloon Model.Several works have recently used this physiological model in the analysis of fMRI data, in the context of parameter estimation.The work presented in [6] uses the Buxton-Fritson model, where the Buxton's balloon model [7] is added with a damped oscillator to model the blood flow [8].They used a local linearization transfer function in the Kalman filter methodology, allowing physiological noise in addition to the measurement noise.
The work presented in [8] investigates the above physiological model plus the integrated version of the balloon model [9].They use a maximum likelihood approach for the model based on the optimization of the parameter estimation, however only the measurement noise is dealt with the system modeling.Models of the underlying hemodynamic and physiologic processes which give rise to the BOLD response have recently been incorporated into a more complete nonlinear system.Hemodynamic responses to neuronal activity are observed experimentally in fMRI data via the BOLD signal, which provides a noninvasive measure of neuronal activity.
Despite the widespread use of functional neuroimaging techniques [6,7,11,12], the physiological changes in the brain that accompanying neural activation are still poorly understood [2][3][4][5][6][7].Due to the nonlinear and/or unspecified effects of different parameters on BOLD signal variation, there is no specific criterion to validate and observe the impact of each parameter.
The highly dependency and correlation of neurons processing, metabolic and vascular responses are conceptually well known in time and state space [13], but still the details on the translation between an ensemble of neurons firing and the ensuing increase in focal cerebral blood flow is a controversial issue.The most popular model to describe the neural activity according to the data from fMRI, is balloon model, which relates BOLD signal to the blood flow.This model is a nonlinear hemodynamic model and the measurements usually have a noisy behavior.Furthermore, the electromagnetic field produced by neurons is very weak and noisy, so the SNR is very low.No quantified technique has been proposed yet in order to validate and compare the effect of hemodynamic parameters.
We have introduced an efficient hemodynamic state stimulation technique at [14] using fNIRS Data with the Extended Kalman Filter and Bifurcation Analysis of Balloon Model.Here we have used a modified and integrated version of the balloon model [7], using state space system realization to be easily applied in any control system.We prefer to use this particular version of the balloon model since it has many degrees of freedom comparing to the other models [7,8] and can therefore produce a more desired behavior.An extended Kalman filter is applied as a reasonable model to estimate the nonlinear model states and output of the balloon model to extract data from the signal and increase the SNR.By introducing the controllable and observable states of the hemodynamic signal we have also developed a numerical technique to validate and compare the impact of brain signal parameters affecting on BOLD signal variation.
As a consequence, in this paper the proposed model is introduced in Section 2. Section 3 presents the simulation and experimental results following by analysis and discussions on the stability, controllability and observability of the proposed system.A linear-quadratic regulator (LQR) also has been introduced at the end.

The Extended Balloon Model
We have introduced an extended balloon model as depicted in (1) here 0  is the mean transit time through the compartment,   (0 -30 s) indicated the viscoelastic time constant (inflation) and   (0 -30 s) is the viscoelastic time constant (deflation).
Equation (1) thereby introduces a fundamental nonlinearity, sufficient to generate all transients of the BOLD response.The variation of the normalized [HbR] concentration (q), can be defined as: The core of the model is the physical necessity to largely increase CBF,   in f t to achieve a small increase in oxygen delivery.An increase in cerebral blood flow is very closely linked to the underlying neuronal activity [9].Due to the significant noise induced by measurements we have applied a stochastic hemodynamic system model to describe it.A continuous-discrete extended Kalman filter is used as a reasonable model to estimate the nonlinear states of the balloon model.The Balloon model [7] is an input-state-output nonlinear hemodynamic model with two state variables volume (v) and deoxy-hemoglobin content (q).The input to the system is blood flow (f in ) and the output is the BOLD signal (y).The BOLD signal is partitioned into an extra and intravascular component, weighted by their respective volumes.These signal components depend on the deoxy-hemoglobin content and render the signal a nonlinear function of v and q.By extending the model to cover the dynamic coupling of synaptic activity and flow a complete model, relating experimentally induced changes in neuronal activity to BOLD signal, obtains.Here we have considered four different states include: v cerebral blood volume (CBV), q deoxyhaemoglobin content, s flow inducing signal, f, CBF.These equations are acquired from the magnetic properties of hemoglobin which is diamagnetic for oxyhemoglobin and paramagnetic for deoxy-hemoglobin.Using the electromagnetic equations around a cylinder and variation with oxygen saturation, the balloon model can be obtained.The neural activity signal u is the input of the model.The mathematical expression of hemodynamic balloon model is as follows:

The Extended Kalman Filter
Extended Kalman filter is a nonlinear version of Kalman filter using for nonlinear dynamic systems, applied to estimate the states of balloon model.The nonlinear stochastic dynamical system is described by following state space equation: This model includes perturbation and measurement noise, because of weak signal of fMRI.In this state space equation,   We can measure a new parameter  , m t which is CMRO2 normalized to baseline too: The prediction is established as:     In this model is baseline oxygen extraction fraction, is baseline blood volume, is weight for deoxy Hb change and is the weight for blood volume. is the autoregulatory time constant, and ɛ is the neuronal efficacy.Now, we can describe the state space equations as a nonlinear dynamic system.The state of the system is a vector: The Jacobian matrix and H x   are defined as follow: The input signal u in the balloon model is the neural activity and it is created by a square stimulus signal   a t .The relation between the neural activity and the stimulus signal can be stated by:    

Simulation and Measurement Setup
The balloon model is implemented in Simulink and a reasonable neural activity input is produced.Then the output is plotted as a BOLD signal.A white noise is added to this signal in order to mimic a noisy BOLD signal.Using proposed extended Kalman filter, the output due to the noisy signal follows the measurements (Figure 2).
The proposed system is verified using measured clinical data also plotted in Figure 3.The extended Kalman filter is used to estimate the BOLD signal.Figure 4 shows the simulated, measured, and the estimated BOLD signals.The effect of s  is very important especially on the time of reaching to steady state.For higher s  the system will reach to steady state later and, so if our purpose is to reach to steady state condition, we should have a small s  .As it is supposed when the initialized variance ( 0 ) increases that is the initial conditions are unknown and it causes that the contribution of measurements in the update equation increases which results the faster convergence.For higher 0 especially when the system starts, Kalman gain is more than the case of the lower 0 .The convergence is slower when 0     is low which means we trust to the initial values.Due to the relationship between R and Kalman gain, when the level of the noise at the measured value increases (R increases) the gain will decrease and the contribution of measurement in the update equation will decrease.Therefore slower convergence is a direct result of the higher noise level at the output.

Bifurcation Analysis
Bifurcation analysis investigates the stability of the system under change of parameters.Thus, it is important to first investigate nonlinear stability of the system and then use MatCont for Bifurcation analysis.For bifurcation analysis first the equilibrium point should be calculated as follow: As we see the important parameters for the equilibrium point are 0 , E  , f  ,  and we have investi- gated their effects in the bifurcation analysis.Now, we put this equilibrium point in the Jacobian matrix and then find the eigenvalues of that matrix to investigate the nonlinear stability of balloon model for different parameters.
The eigenvalues of the Jacobian matrix in this case are: As we see all of the eigen-values are negative and this system for every choice of parameters is always stable.This is very interesting achievement regarding to the stability characteristics of the proposed system to describe the hemodynamic parameters.These eigenvalues depend on  , s  , 0  , f  ,  and independent of 0 E .For the bifurcation analysis, in this paper MatCont is used to analyze stability of the system with change of different effective parameters of the system.Figure 4 compares the simulated and estimated BOLD signals with the measurement data.

Stability
Bifurcation analysis shows that the nonlinear stability of balloon model is always guarantied.Here the stability is also represented based on the linearization of the balloon model.This is a simpler model of stability when all of the eigenvalues of the system ( 1 2 3 4 , , ,     ) are negative.
In this situation, the system is linearizable and it is possible to linearize the state space equation and then use the definition of stability, observability, and controllability in the linear case.The linear model is in the form of: where: x u is the equilibrium point.and The eigenvalues of A are: ; All of these eigenvalues are negative and equal to the ca  The linear and nonlinear controllability and has been investigated at this section.For linear controllability and observability based on the controllability matrix C CACA CA ,     e their determinant to in we can determin vestigate if the system is controllable and observable or not.The determinant of each matrix is as followed: f s For nonlinear controllability and observability, the no nlinear balloon model is directly investigated.For nonlinear controllability we have: , . where:   The observability and controllability of linear and no R Controller Design sign an LQR con-nlinear systems depend on all previously introduced parameters, so they have been calculated in equilibrium point for all of these parameters.The calculation results show that for these values the system is controllable and observable.

The LQ
As the system is controllable we can de   troller.So, a full state feedback u kx with a proper gain vector k can effectively control the system in a neighborhood of the equilibrium point.We consider the output   0 2 1 y V a v a q   to be matched with the experimental results.The input, output and the states of the system are shown in igures 6 and 7, when the LQR controller is applied.

Conclusions
F real-time monitoring of brain neural A new model for activity is proposed in this paper based on the balloon model.The stability, controllability and observability of the proposed model are described based on the simulation and measured clinical data analysis.By introducing the controllable and observable states of the hemody-namic signal we have developed a numerical technique to validate and compare the impact of brain signal parameters affecting on BOLD signal variation.This model increases significantly the SNR and the speed of brain signal processing.Up to our knowledge this is the first work on evaluation of these control parameters and introducing their practical impacts on clinical application.Surprisingly we realized that the system is always stable independent from any variation in blood flow and HbR/HbO variation.The observability and controllability characteristics are introduced as significant factors to be considered as an evaluation tool to verify the preference of different h dynamic factors.The preferred factors then can be considered based on their specified priority for further diagnosis and monitoring in clinical applications.This model can also be efficiently applied in any monitoring and control platform include brain and for study of hem namic and brain imaging modalities such as pulse-oximetry and fNIRS.

Figure 1 .
The balloon model relates BOLD signal to the blood flow.The balloon model is expanded by a difference in normalized venous out-flow The cerebral blood flow (CBF) is also considered identical to in   f t in most works[9][10][11][12][13]15].Conservation of mass then defines the change in the normalized blood volume v in the venous balloon as follow:

Figure 1 .
Figure 1.Overview diagram of the applied brain hemodynamic model.

0 
is the mean transit time of the venous compartment, α is the stiffness component of the balloon model, s  is the signal decay time constant, f an inhibitory feedback signal and k is a gain factor.u  is a time constant.So, first the neural activity will be produced from and then use neural activity as an input to the balloon model.

Figure 2 .
Figure 2. Dynamics of the hemodynamic model: (a) The BOLD signal and its estimation; (b) The estimation error of BOLD signal.

Figure 3 .
Figure 3. (a) Real experimental measurement of output data and its estimation; (b) The Experimental error.

3. 4 .
Controllability and Observability observability se of nonlinear stability analysis when u = 0. So, the system is stable.The Bode diagram and the Root-Locus of the open-loop and closed-loop systems are shown in Figure 5.

Figure 6 Figure 7 .
Figure 6.Input (a) and outp he LQR Controller.ut (b) signals of t