Modeling Seasonal Fractionally Integrated Autoregressive Moving Average-Generalized Autoregressive Conditional Heteroscedasticity Model with Seasonal Level Shift Intervention ()
1. Introduction
The phenomenon of long memory or long range dependence in time series processes has been of interest in time series research. A popular way to analyze a long memory time series is to use seasonal autoregressive fractionally integrated moving average (SARFIMA) processes introduced by [1] and [2]. The works of [1] and [2] assume that the conditional variance of the time series is constant over time. However, non constant variance in non-linear time series is a challenging modelling exercise, considered among other things by [3]. In particular, the stylized fact that the volatility of financial time series is non constant has been long recognized in literature, see for example [4] [5] and [6].
The methodology for modelling time series with long memory behavior has been extended to long memory time series with time varying conditional variance, see for instance, [7] who developed the ARFIMA model with generalized autoregressive conditional heteroskedasticity (GARCH) type innovations, and [8] examine the daily average PM10 concentration using a seasonal ARFIMA model with GARCH errors. Tong [9] analyzed the nonlinear time series using GARCH models and [10] used GARCH models for testing market efficiency. These models do not capture level shifts both in mean and variance, in this paper we introduce a new class of SARFIMA-GARCH models with seasonal level shift intervention in mean and volatility. This approach allows us to model mean and volatility seasonal level shifts in an SARFIMA-GARCH model which is often observed in financial or economics time series.
This article introduces detection of a mean and volatility level shifts innovation in an ARFIMA-GARCH model. The works of [11] first applied ARFIMA-GARCH models to price indices then [7] derived conditions for asymptotic normality of the approximate (Gaussian) maximum likelihood (ML) estimator in the ARFIMA-GARCH model. This paper also extends parameter estimation for an SARFIMA-GARCH model to case with seasonal level shift which we will denote Seasonal Level Shift SARFIMA (SLS-ARFIMA) and Seasonal Level Shift GARCH (SLS-GARCH) using quasi-maximum likelihood estimation.
The first concern of this paper is how one would formally address modeling mean and volatility seasonal level shifts in an SARFIMA-GARCH. The second concern is derivation of test statistics that are useful to examine presence of seasonal level shifts in mean and volatility for an SARFIMA-GARCH model. The layout of the paper is organised as follows. Section 2 reviews some theoretical results of SARFIMA-GARCH and intervention. In Section 3, we introduce the class of SLS-ARFIMA-SLS-GARCH models. Section 4 deals with parameter estimation in SLS-ARFIMA and SLS-GARCH models. Section 5 is dedicated to the proposed procedure of level shift detection in SARFIMA-GARCH models. The last section concludes with the main findings and limitations. Common acronyms used in this paper are given in Table 1.
Table 1. Common acronyms used in this paper.
2. SARFIMA-GARCH Models
This section presents review of the ARFIMA models, SARFIMA models, GARCH models and the SARFIMA-GARCH models. The variance of GARCH model and intervention in ARFIMA models is also presented.
2.1. ARFIMA Process
Time series analysis has turned attention to the studies with long memory or long-range dependence characteristics. The
process, first introduced by [1] and [2], present this property when the differencing parameter d is in the interval (0, 0.5). This feature is reflected by the hyperbolic decay of its autocorrelation function or by the unboundedness of its spectral density function, while in the ARMA model, dependency between observations decays at a geometric rate.
Montanari et al. [12] introduced a special form of the generalized ARFIMA model considered by [13]. This formulation is able to reproduce short-and long memory periodicity in the autocorrelation function of the process. Using the [14] notation, the general form of the ARFIMA model is defined as follows:
Let
be a stochastic process, then
is a zero mean
process given by the expression
(1)
where
is a white noise process with zero mean and variance
, B is the backward-shift operator, that is,
and
is the non seasonal difference,
and
are the non-seasonal polynomials of degrees p and q, respectively, defined by:
(2)
where
, and
are constants and
.
The difference operator
is defined by means of the binomial expansion:
(3)
where;
and
is the well known gamma function.
The ARFIMA model is said to be stationary when
. The model becomes nonstationary when
and stationary but non invertible when
. The ARFIMA model represents a short memory if
and a unit root process is shown when
. Furthermore, the model has a positive dependence among distance observations or the so called long memory process if
; and it also has an anti-persistent property or has an intermediate memory if
.
2.2.
Process
The seasonal autoregressive fractionally integrated moving average process, denoted hereafter by
, is an extension of the long range dependence in the mean
process, proposed by [1] and [2]. The
process describes time series with long memory or long range dependence or persistent periodical behavior at finite number of spectrum frequencies.
A special form of the generalized ARFIMA model was considered by [13]. This formulation is able to reproduce short and long memory periodicity in the autocorrelation function of the process. Using the [14] notation, the general form of the SARFIMA model is defined below:
Let
be a stochastic process, then
is a zero mean
process given by the expression
(4)
where
is the seasonal period, B is the backward-shift operator, that is,
,
is the seasonal difference operator,
and
are the polynomials of degrees P and Q, respectively, defined by:
(5)
where
and
are constants and
.
The seasonal difference operator
, with seasonality
, for all
, is defined by means of the binomial expansion;
(6)
where;
(7)
A compact form of Equation (1) and Equation (4) is given by:
(8)
In Equation (8), the operator
is defined by
(9)
where
is the memory vector parameter, d and D are the fractionally parameters at non seasonal and seasonal frequencies, respectively. The fractional filters are:
(10)
where;
(11)
Suppose in Equation (8),
and
have no common zeros. Let also
and
, the process
has spectral density function is given by;
(12)
where
.
Note that according to [15]:
1) The processs
is stationary if
,
and
, for
.
2) The stationary process
has a long memory property if
,
and
, for
.
3) The stationary process
has an intermediate property if
,
and
, for
.
For convenience, we introduce the notation
,
and
.
Theorem 2.1. Let
be the
process given by expression:
(13)
with zero mean,
as the seasonal period. Then the process
has autocovariance function of order h,
, given by
(14)
where
1) The process
is an
with autocovariance function of order h,
, given by
(15)
2) The process
is an
with autocovariance function of order
,
, given by
(16)
For proof of Theorem (2.1) see [15] Theorem 2.1.
Theorem 2.2. Let
be a causal and invertible
process given by the expression:
(17)
with zero mean,
as the seasonal period. Suppose
and
have no common zeros. For
,
, then the process
has autocovariance function of order h,
, given by
(18)
where
1) the process
is an
with autocovariance function given by
.
2) the process
is an
with autocovariance function given by
.
For proof of Theorem (2.2) see [15] Theorem 2.2.
2.3. The GARCH(m, r) Model
The
model can be obtained from Equation (1) by letting
and the conditional variance,
where
is the
field generated by the past information
. Let also
and
(19)
where
is normal distributed with mean 0 and variance 1. [4] introduced the
model which defines the conditional variance equation as follows;
(20)
where
,
, r and m are positive integer. Note that the GARCH model defined by (20) can be replaced by other conditional heteroscedastic models.
2.4. The General SARFIMA-GARCH Model
Let the
model be the discrete time series model of
given by the following equation.
(21)
2.5. Variance of Variance in the Standard GARCH(m, r) Model
By rearranging the conditional variance Equation (20) for a GARCH(1,1) we obtain:
(22)
where
and
. [16] have shown that the variance of variance is given by:
(23)
where
denotes the conditional kurtosis of
, which we assume to be finite constant. If the distribution of
is standard normal, then
.
[16] further rearranged the terms in Equation (22), the conditional variance equation becomes:
(24)
where
determines the speed at which the conditional variance reverts to its long run mean
, that is,
and its corresponding variance becomes:
(25)
2.6. Intervention in ARIMA Models
Traditional time series analysis has considered four types of interventions, see for instance, [17] [18] [19] and [20]. The four types of interventions are:
1) Additive Outlier (AO): represents an isolated spike.
2) Level Shift (LS): represents a step function.
3) Transitory or Temporary Change (TC): represents a spike that takes a few periods to disappear.
4) Innovative Outlier (IO): represents effects that depend on the ARIMA model for the observed series.
According to [21], the effect of an AO, a LS, or a TC on an observed series is independent of the ARIMA model whereas the effect of an IO on an observed series consist of an initial shock that propagates in the subsequent observations with the weights of the ARIMA model.
Let
be a time series that can be described with the
model:
(26)
and let
be the contaminated series containing k outliers represented by:
(27)
where
is the initial impact of the outlier at time
;
is an indicator variable such that it is 1 for
and 0 otherwise; and
determines the dynamics of the intervention occurring at time
according to the following schemes:
1) AO:
.
2) LS:
.
3) TC:
.
4) IO:
.
[21] came up with a new intervention type, Seasonal Level Shift (SLS), that can describe a perturbation mostly related to the seasonal component. Seasonal level shifts are the interventions that affect only certain quarters or months of a year. The SLS is a special kind of level shift that occurs in
at some point
in time and reoccur regularly every year at same season say s and its effect carries up to subsequent seasons. The basic model with SLS suggested by [21] is given by
(28)
However
causes an impact on trend which can only be removed by defining dynamic weights as
(29)
The dynamic impact was normalized as suggested by [22]:
(30)
Thus model (28) becomes
(31)
Equation (31) is the observed series indicating series that the occurrence of SLS affects the time series for several seasons at same quarters or month with magnitude of outlier
. The outlier is introduced in the model by generating a variable:
(32)
However in this research, for a SLS intervention at period
, we shall stick to the simple specification model (28).
3. SARFIMA-GARCH Models with Level Shift
This section presents a natural extension of the SARFIMA-GARCH models to a case with level shift. We start with a standard shift in the mean, then a level shift in seasonality. We will also consider level shift in the volatility with its corresponding shift in seasonality.
3.1. The SARFIMA Model with Level Shift
The
model is written as
(33)
where
is the time series at time t,
is the unconditional mean of the process. We assume the noise process
to be Gaussian, with expectation zero and variance
.
To allow for a mean level shift, after time
of the data, we write the sum of an unobserved SARFIMA process and the term for the mean level shift which we will denote as
(34)
(35)
where
denotes the observed contaminated series;
follows the SARFIMA process;
is an indicator variable taking values 1 for
, and 0 otherwise. The parameter
indicates the size of the mean level shift at time
;
determines the dynamics of the intervention occurring at time
. The mean level shift is an abrupt but permanent shift by
in the series caused by an intervention.
The extension of (34) to k level shifts is straightforward. We define
as the
shift in level, compared to the previous level, where
. When we allow k level changes at pre-specified time
, we can extend Equation (34) and Equation (35) to
(36)
(37)
The component
allows the intercept of the SARFIMA model to fluctuate over time between
and
.
3.2. The SARFIMA Model with Seasonal Level Shift
Seasonal Level Shift in SARFIMA models denoted as SLS-SARFIMA type intervention display seasonal features in its pattern. Many economic series display breaks and anomalies within the previous restrictions. To illustrate the argument, the SLS is presented in Figure 1.
This paper covers the methodologically and computationally less complex approach by extending intervention detection procedures to cover shifts in the seasonal component in fractionally integrated SARFIMA models. The Seasonal Level Shift (SLS) intervention has an effect on the trend given by the step function of Figure 2(a), and an effect on the seasonal component shown in Figure 2(b).
A Seasonal Level Shift intervention at period
would affect the series
and is represented by model (38):
Figure 2. Seasonal level shift effect: (a) effects of a SLS on the trend cycle component. (b) effects of a SLS on the seasonal component.
(38)
Assuming the observed series contains k seasonal level shifts at time
for
, their combined effect can be expressed in general form as:
(39)
The component
allows the intercept of the SARFIMA model to fluctuate over time between
and
.
3.3. The GARCH(m, r) Model with Level Shift
As indicated earlier, [4] introduced the GARCH(m, r) model which defines the conditional variance equation as follows;
(40)
To allow for a volatility level shift, denoted
, after time
of the data, we write
as the sum of an unobserved GARCH process and the term of the volatility level shift which we will denote as LS-GARCH(m, r).
(41)
(42)
where
is an indicator variable taking values 1 for
, and 0 otherwise. The parameter
indicates the size of the volatility level shift at time
.
The extension of Equation (41) and Equation (42) to k volatility level shifts is straightforward. We define
as the
shift in volatility level, compared to the previous level, where
. When we allow k volatility level changes at pre-specified time
, we can extend (41) and (42) to
(43)
(44)
The component
governs the level shift movement of GARCH model intercept, that is baseline volatility, over time between
and
.
3.4. The GARCH(r, m) Model with Seasonal Level Shift
Seasonal Level Shift in volatility denoted as SLS-GARCH type intervention display seasonal features in its pattern. The Seasonal Level Shift (SLS) intervention has an effect on the trend given by the step function and an effect on the seasonal component.
A Seasonal Level Shift intervention in GARCH model at period
would affect the series
and is represented by model (45) and (46):
(45)
(46)
Assuming the observed series contains k seasonal level shifts at time
for
, their combined effect can be expressed in general form as:
(47)
(48)
The component
allows the intercept of the GARCH model to fluctuate over time between
and
.
3.5. The General SARFIMA-GARCH Model with Level Shift
Extension of
the
process to the case with standard level shift is given by the following equation which we will denote as LS-SARFIMA-LS-GARCH
(49)
Similarly, extension of
the
process to the case with seasonal level shift is given by the following equation which we will denote as SLS-SARFIMA-SLS-GARCH
(50)
4. Estimation of SLS-SARFIMA-SLS-GARCH Model Parameters
4.1. Estimation of SLS-SARFIMA Model Parameters
The first step of estimation consists in estimating the
assuming that the conditional variance is constant over time. By rearranging Equation (38) for one mean seasonal level shift we have:
(51)
Therefore the null hypothesis of unconditional mean constancy becomes:
. Let
be the approximate likelihood estimator (MLE)
of
that maximizes the conditional log-likelihood:
(52)
The partial derivatives evaluated under
are given by:
(53)
·
·
·
·
·
·
·
·
·
Under
, the LM-type statistics is asymptotically distributed as
with one degree of freedom:
(54)
4.2. Estimation of SLS-GARCH Parameters
Once the SLS-SARFIMA model is estimated and the residuals
are obtained, we test the alternative of SLS-GARCH specification with one volatility level shift against the null hypothesis of GARCH model. Let us rearrange model (41) with one volatility level shift:
(55)
Therefore the null hypothesis of the unconditional variance constancy becomes:
. Let
be the vector of the SLS-GARCH model parameters and the quasi-likelihood function is given by:
(56)
The partial derivatives evaluated under
are given by:
(57)
·
·
·
·
Under the null hypothesis, the “hats” indicates the maximum likelihood estimator and
denotes the conditional variance estimated at time t. Under
, the LM-type statistics is asymptotically distributed as
with one degree of freedom:
(58)
5. Level Shift Detection and Estimation in SARFIMA-GARCH
In this section we discuss how the iterative detective procedure described in [23] and [24] can be extended to allow for both detection and estimation of SLS in SARFIMA-GARCH intervention to be denoted SLS-SARFIMA and SLS-GARCH.
5.1. Detection and Estimation in SLS-SARFIMA
Let
be the vector of parameters in model (59)
(59)
and let us suppose, for the moment, that it is known. Further, suppose that the observed series is subject to the influence of a perturbation at time
such that:
(60)
where we assume that model (59) is stationary. Model (60) can be rewritten as a linear regression model presented in model (61) and model (62)
(61)
where
is an
. Writing model (61) in matrix form:
(62)
where
;
and
.
According to [21], model (62) is a regression model with autocorrelation residuals and therefore the problem of estimating
can be solved by Generalized Least Squares (GLS).
Let
with
a
matrix which depends on
and which is assumed to be positive definite, and let
be the Cholesky decomposition of
with
lower triangular. Pre-multiplying Equation (62) by
, and setting
,
and
, we obtain the Ordinary Least Square (OLS) model
(63)
where
. The OLS estimator of
and its variance are obtained from Equation (63) as
(64)
As argued in [24], to move from the GLS model in (62) to the OLS model in (63), there is no need to evaluate the matrix
, since the application of the Kalman filter on the observed series
yields the vector of standardized residuals
. Similarly, the application of the same filter on vector
provides the vector
from which Equation (64) can be computed.
To test the null hypothesis that the observation at time
is not an intervention, one can use the standardized statistic.
(65)
which, for known
, follows a standard normal distribution. By setting appropriate starting conditions (see, for example, ( [24] [25], or [26] ), the previous scheme extends in a straightforward manner to non-stationary series, for which
follows model (59).
5.2. Mean Level Shift Detection in SARFIMA-GARCH
The mean level shift detection test was previously derived by [27] for ARIMA models and extended by [20] for the fractionally integrated
models assuming conditional variance is constant over time. [28] extended the level shift detection test of the mean for a realization of time series
satisfying LS-SARFIMA-LS-GARCH model. For our purpose a natural extension of the seasonal level shift detection test of the mean for a realization of time series
satisfying SLS-SARFIMA and SLS-GARCH model was derived. In order to derive the test statistic, let us rewrite model (38), with only one mean seasonal level shift:
(66)
The hypothesis to be tested is
(67)
which is based on
a realization of time series
satisfying SARFIMA-GARCH model with mean seasonal level shift.
Model (66) can be rewritten as
This implies transforming the series by differencing of
. Thus if
,
. The intervention parameter
can be estimated using various methods like the maximum likelihood estimation and least square estimation. The least square estimate of
if the mean intervention is at time
is given by
(68)
Extension of [27] test statistics can be written as:
(69)
where
is the estimated intervention or impact at time
and
is an estimate of the variance of
.
The distribution of the statistics is based on the fact that it is originally Normally distributed and then transformed to the Gamma distribution both of which belong to the Domain of Attraction of the Gumbel distribution with normalizing constants:
1) Normal Distribution:
(70)
2) Gamma Distribution:
(71)
The maximum domain of attraction of the Gumbel is shown to some extent in [29] and in greater detail in [30].
Let the test statistics be given by
(72)
Then under
, the statistics
satisfies
(73)
where D signifies convergence in distribution. Here,
is location parameter and
is scale parameter. The location parameter is also the mode of the distribution. Inverse of the
in Equation (73), is given by:
(74)
Thus a test of hypothesis can be conducted by comparing the test statistic
in Equation (72) with an appropriate critical value. The largest
statistic is considered an intervention at the
significance if the
value exceeds the critical value.
5.3. Volatility Seasonal Level Shift Detection in SARFIMA-GARCH Model
The second step is a natural extension of mean seasonal level shift detection in SARFIMA-GARCH model to volatility seasonal level shift detection in SARFMA-GARCH model. After estimating the SLS-SARFIMA model and the residuals
are obtained, we test, the alternative hypothesis of SLS-GARCH volatility level shift against the null hypothesis of GARCH model. Let us rewrite model (47) with one volatility seasonal level shift:
(75)
The hypothesis tested is
(76)
which is based on
a realization of time series
from a GARCH model with seasonal level shift.
The derivation is based on the statistics
(77)
where
is the estimated intervention or impact at time
and
is an estimate of the variance of
.
Model (75) can be rewritten as
(78)
Thus if
,
. The intervention parameter
can be estimated using various methods like the maximum likelihood estimation and least square estimation. The least square estimate of
if the volatility intervention is at time
is
(79)
The distribution of the statistics is based on the fact that it is originally Normally distributed and then transformed to the Gamma distribution both of which belong to the Domain of Attraction of the Gumbel distribution with normalizing constants:
1) Normal Distribution:
(80)
2) Gamma Distribution:
(81)
The maximum domain of attraction of the Gumbel is shown to some extent in [29] and in greater detail in [30].
Let
be a time series satisfying the volatility seasonal level shift model
(82)
For any realization
of this time series, let the test statistics be given by:
(83)
Then under
, the statistics
satisfies
(84)
where D signifies convergence in distribution. Thus a test of hypothesis can be conducted by comparing the test statistic
Equation (83) with an appropriate critical value. The largest
statistic is considered as volatility intervention at the
level of significance if the test statistic
value exceeds the critical value.
5.4. Mean and Volatility Level Shift Detection in SARFIMA-GARCH
Summary of the detection procedure is presented below:
1) Plot the data to get a picture of the type of series and possible seasonal level shift in the data.
2) Assume that the underlying SARFIMA-GARCH series
contains no level shift and use maximum likelihood procedure to estimate its parameters.
3) The first test is performed to check the mean seasonal level shift which can be conducted as follows:
a) State the hypothesis being tested, which is
(85)
b) Compute the residuals, the impact
and the test statistics like the popular [27] ’s likelihood ratio test statistics given by
Then compute the statistics:
c) Determine the critical values to use in the test.
d) Determine whether observations are seasonal level shifts and remove each from the series by subtracting the value of the impact
then apply the SARFIMA-GARCH modeling procedure to obtain the adequate model.
4) The second test is performed to check the volatility level shift which can be conducted as follows:
a) State the hypothesis being tested, which is
(86)
b) Compute the residuals, the impact
and the test statistics like the popular [27] ’s likelihood ratio test statistics given by
(87)
Then compute the statistics:
c) Determine the critical values to use in the test.
d) Determine whether observations are level shifts and remove each from the series by subtracting the value of the impact
then apply the SARFIMA-GARCH modeling procedure to obtain the adequate model.
6. Conclusions
This paper focused on the theoretical derivation of the class of seasonal fractionally integrated autoregressive moving average-conditional heteroskedastisticty (SARFIMA-GARCH) models, with level shift type intervention. The following derivations were established:
1) A natural extension of the seasonal level shift detection test of the mean for a time series satisfies SLS-SARFIMA.
2) A natural extension of the seasonal level shift detection test of the volatility for a time series satisfies SLS-GARCH.
3) Test statistics that are useful to examine if seasonal level shift in an SARFIMA-GARCH model was established.
4) Estimation of SLS-SARFIMA and SLS-GARCH parameters was derived using quasi maximum likelihood estimation.
To appreciate the procedure, we derived a simulation study consisting of simulation of critical values for mean and volatility seasonal level shift, simulating different sizes of mean and volatility seasonal level shift impact, performing detection test and conducting the power of the mean level shift detection procedure which are considered in a separate paper by the same authors.