White Noise Analysis: A Measure of Time Series Model Adequacy

The purpose of this study is to apply white noise process in measuring model adequacy targeted at confirming the assumption of independence. This ensures that no autocorrelation exists in any time series under consideration, and that the autoregressive integrated moving average (ARIMA) model entertained is able to capture the linear structure in such series. The study explored the share price series of Union bank of Nigeria, Unity bank, and Wema bank obtained from Nigerian Stock Exchange from January 3, 2006 to November 24, 2016 comprising 2690 observations. ARIMA models were used to model the linear dependence in the data while autocorrelation function (ACF), partial autocorrelation function (PACF), and Ljung-Box test were applied in checking the adequacy of the selected models. The findings revealed that ARIMA(1,1,0) model adequately captured the linear dependence in the return series of both Union and Unity banks while ARIMA(2,1,0) model was sufficient for that of Wema bank. Also, evidence from ACF, PACF and Ljung-Box test revealed that the residual series of the fitted models were white noise, thus satisfying the conditions for stationarity.


Introduction
The fundamental building block of time series is stationarity and basically, the idea behind stationarity is that the probability laws that govern the behaviour of the process do not change overtime. This is to ensure that the time series process is in a state of statistical equilibrium and would in turn enhance a statistical setting for describing and making inferences about the structure of data that somehow fluctuate in a random manner [1] [2] [3]. According to [3], a process is said to be strictly stationary if the whole probability structure must depend only on time differences. A less restrictive requirement, called weak stationarity of order k, is that the moments up to some order k depends only on time lags and that the second order stationarity plus an assumption of normality are sufficient to produce strict stationarity (see also, [4] [5]). For simplicity, a time series is said to be stationary, if it has a mean, variance and autocovariance function that are constant over time (see [6]). Moreover, one most important and fundamental example of a stationary process is the white noise process which is defined as a sequence of independent (uncorrelated) and identically distributed random variables with zero mean and constant variance [2] [3] [5]. Thus, the white noise process is particularly important and constitutes an essential bedrock in time series model building.
In this study, our aim is to apply white noise process in measuring model adequacy targeted at confirming independence assumption, which ensures that no autocorrelation exists in the time series considered and that the ARMA model entertained is able to capture the linear structure in the dataset.
The motivation stems from the fact that the problem of statistical modeling is to achieve parsimony (i.e. the principle of model selection with the possibility of having the smallest number of parameters that completely express the linear dependence structure, providing better prediction, and generalization of new observations) conditional on the restriction of model adequacy.
Testing for model adequacy or diagnostic checking as defined by [7] incorporates all relevant information and when calibrated to the data no important significant departures from statistical assumptions made can be found. Actually, model adequacy involves residual analysis and overfitting. In time series modeling, a good model parameter estimates must be reasonably close to the true values, should have the dependence structure of the data adequately captured, and should also produce residuals that are approximately uncorrelated [2] [6] [8]. These residuals are obtained by taking the difference between an observed value of a time series and a predicted value from fitting a candidate model to the data. They are useful in checking whether a model has adequately captured the information in the data. According to [6], model adequacy is related primarily to the assumption that residuals are independent. Moreover, if the residuals of a given model are correlated, the model must be refined because it does not completely capture the statistical relationship amongst the time series [2]. Furthermore, a model is said to be adequate if the residuals are statistically independent implying that the residual series is uncorrelated. Therefore, in testing for model adequacy, which is mainly to check for independence of the residual series, an autocorrelation function (ACF), Partial autocorrelation function (ACF) and Ljung-Box test on the residuals are considered.
Another adequacy checking tool is overfitting, which has to do with adding another coefficient to a fitted model so as to see if the resulting model is better.
The following are identified as the implications of fitting and overfitting: and moving average (MA) parts of the model simultaneously.
3) Extend the model in directions suggested by the analysis of the residuals.
However, one setback of overfitting is the tendency of the violation of the principle of parsimony [2] [6].
In addition, the remaining part of this work is organized as follows; Section 2 takes care of the methodology, followed by the results and then the discussion in Section 3, while the conclusion of the overall results is handled in Section 4.

Return Series
The return series, t R , can be obtained given that t P is the price of a unit share at time, t, while 1 t P − is the share price at time, t − 1.

Autoregressive Integrated Moving Average (ARIMA) Model
In [3] the extension of ARMA model to deal with homogenous non-stationary time series in which t X , itself is non-stationary but its th d difference is a sta- where ( ) B ϕ is the nonstationary autoregressive operator such that d of the roots of ( ) 0 B ϕ = are unity and the remainder lie outside the unit circle.

Stationarity
The foundation of time series analysis is stationarity. Consider a finite set of re- where , 1, 2, , j r j k = are any real numbers.
A process is said to be: for any integers 1 , t k and 1 t k + .

2) second-order stationary in distribution if
, , for any integers 1 2 1 , , , t t k t k + and 2 t k + .
3) the th n -order stationary in distribution if for any ( ) and k integers. A process is said to be strictly stationary if (3.6) is true for any n, that is, Stationary in the wide sense or covariance stationary is also referred to as second-order stationary process.

White Noise Process
A process { } t a is called a white noise process if it is a sequence of uncorrelated random variables from a fixed distribution with constant mean, WN stands for white noise [5]. By definition, a white noise process { } t a is stationary with autocovariance function, The autocorrelation function is given as: while the partial autocorrelation function is Thus, the implication of a white noise specification is that the ACF and PACF are identically equal to zero.

Autocovariance and Autocorrelation Functions
According to [5], covariance between t R and t k R + denoted by ( ) which is a function of the time difference, k, is called the autocovariance function { } k γ of the stochastic process. As a function of k, k γ is called the autocovariance function in the time series analysis since it represents the covariance between t R and t k R + from the same process. It is defined as Similarly, the correlation between t R and t k R + denoted by ( ) which is a function of the time difference, k, is called the autocorrelation function { } k ρ of the stochastic process. As function of k, k ρ is called the autocorrelation function in time series analysis since it represents the correlation between t R and t k R + from the same process. It is defined as The corresponding sample estimate is given by

Partial Autocorrelation Function (PACF)
The conditional correlation between t R and t k R + after their mutual linear dependency on the intervening variables ( ) has been removed, given by ( ) , is usually referred to as the partial autocorrelation in time series analysis ( [5]).
Partial autocorrelation can be derived from the regression model, where the dependent variable, t k R + , from a zero-mean stationary process is regressed on k-lagged variables 1 2 , , and t R , that is where ki ϕ denotes the th i regression parameter and t k α + is an error term with mean zero and uncorrelated with t k j R + − , for 1, 2, , j k = . Multiplying t k j R + − on both sides of the above regression equation and taking the expectation, we get Hence,

Diagnostic Checking of Linear Time Series Models
Diagnostic checking is applied with an objective of uncovering a possible lackof-fit of the tentative model and possibly unraveling the cause of such a case. If no lack-of-fit is indicated, the model is ready for use. In other words, if any inadequacy is found, the iterative cycle of identification, estimation and diagnostic checking is repeated until a suitable and appropriate representation is obtained.
Once the parameters of the tentative models have been estimated, we check whether or not the residuals obtained from the estimated equation are approximately white noise. This is done by examining the ACF and PACF of the resi- The Portmanteau lack-of-fit test uses the residual sample ACFs as a unit to check the joint null hypothesis test, which requires that several autocorrelations of t a are zero. [17] proposed the Portmanteau statistics given as: where T is the number of observations. A test statistic for the null hypothesis, where T is the number of observations.

Dataset
Data collection was based on secondary source from the records of Nigerian          2) Estimation of parameters From Table 1, ARIMA(1,1,0) model is selected based on the grounds of significance of the parameters and minimum AIC.

Interpretation of Time Plot
3) Diagnostic checking of the model From Figure 9 and Figure 10, all the lags coefficients of ACF and PACF are within the significance bands, that is, they are zero implying that the residual series of ARIMA(1,1,0) model appears to be a white noise series, that is, the series is independent and identically distributed with mean zero and constant variance.
Evidence from Ljung-Box Q-statistics in Table 2 shows that ARIMA(1,1,0) model is adequate at 5% level of significance given the Q-statistic at Lags 1, 4, 8 and 24. That is, the hypothesis of no autocorrelation is not rejected. Thus, confirming the independence of residual series.
2) Estimation of parameters From Table 3, ARIMA(1,1,0) model is selected based on the grounds of significance of the parameters and minimum AIC.
3) Diagnostic checking of the model From Figure 13 and Figure 14, all the lags coefficients of ACF and PACF are within the significance bands except lag 9, that is, they are zero implying that the DOI: 10.4236/am.2019.1011069 998 Applied Mathematics residual series of ARIMA(1,1,0) model appears to be a white noise series, that is, the series is independent and identically distributed with mean zero and constant variance.
Evidence from Ljung-Box Q-statistics in Table 4 shows that ARIMA(1,1,0) model is adequate at 5% level of significance given the Q-statistic at Lags 1,4,8 and 24. That is, the hypothesis of no autocorrelation is not rejected. Hence, confirming the independence of the residual series.
2) Estimation of parameters From Table 5, ARIMA(2,1,0) model is selected based on the grounds of significance of the parameters and minimum AIC.
3) Diagnostic checking of the model From Figure 17 and Figure 18, all the lags coefficients of ACF and PACF are within the significance bands, that is, they are zero implying that the residual series of ARIMA(2,1,0) model appears to be a white noise series, that is, the series is independent and identically distributed with mean zero and constant variance.
Evidence from Ljung-Box Q-statistics in Table 6 shows that ARIMA(2,1,0) model is adequate at 5% level of significance given the Q-statistic at Lags 1,4,8 and 24. That is, the hypothesis of no autocorrelation is not rejected. Thus, confirming the independence of the residual series.                So far, the residuals series of the selected models for the three banks considered have been analyzed and found to follow a noise process and it thus suffice the aim of our study. The study further agrees with the works of [7]- [17] that model adequacy could be measured by white noise processes through ACF, PACF and Ljung-Box test but differs in that it considers the returns series of Nigerian banks.

Conclusion
In summary, our study showed that model adequacy could be measured by white noise process through ACF, PACF, and Ljung-Box test. The role of white noise process in checking the model adequacy was properly appraised and confirmed that modeling a white noise process satisfies all the conditions for stationarity (independence). However, the failure to apply overfitting approach of model adequacy is one weakness of this study and it is recommended that further study should be extended to cover overfitting.