Open Journal of Statistics

Volume 2, Issue 5 (December 2012)

ISSN Print: 2161-718X   ISSN Online: 2161-7198

Google-based Impact Factor: 0.53  Citations  

Estimators of Linear Regression Model and Prediction under Some Assumptions Violation

HTML  XML Download Download as PDF (Size: 583KB)  PP. 534-546  
DOI: 10.4236/ojs.2012.25069    7,534 Downloads   13,571 Views  Citations

ABSTRACT

The development of many estimators of parameters of linear regression model is traceable to non-validity of the assumptions under which the model is formulated, especially when applied to real life situation. This notwithstanding, regression analysis may aim at prediction. Consequently, this paper examines the performances of the Ordinary Least Square (OLS) estimator, Cochrane-Orcutt (COR) estimator, Maximum Likelihood (ML) estimator and the estimators based on Principal Component (PC) analysis in prediction of linear regression model under the joint violations of the assumption of non-stochastic regressors, independent regressors and error terms. With correlated stochastic normal variables as regressors and autocorrelated error terms, Monte-Carlo experiments were conducted and the study further identifies the best estimator that can be used for prediction purpose by adopting the goodness of fit statistics of the estimators. From the results, it is observed that the performances of COR at each level of correlation (multicollinearity) and that of ML, especially when the sample size is large, over the levels of autocorrelation have a convex-like pattern while that of OLS and PC are concave-like. Also, as the levels of multicollinearity increase, the estimators, except the PC estimators when multicollinearity is negative, rapidly perform better over the levels autocorrelation. The COR and ML estimators are generally best for prediction in the presence of multicollinearity and autocorrelated error terms. However, at low levels of autocorrelation, the OLS estimator is either best or competes consistently with the best estimator, while the PC estimator is either best or competes with the best when multicollinearity level is high(λ>0.8 or λ<-0.49).

Share and Cite:

K. Ayinde, E. Apata and O. Alaba, "Estimators of Linear Regression Model and Prediction under Some Assumptions Violation," Open Journal of Statistics, Vol. 2 No. 5, 2012, pp. 534-546. doi: 10.4236/ojs.2012.25069.

Cited by

[1] A SIMULATION STUDY TO DETERMINE THE BEST ESTIMATORS FOR SOLVING PROBLEMS OF AUTOCORRELATION IN LINEAR REGRESSION MODEL
Nigerian Journal of Scientific Research, 2022
[2] ESTIMATORS FOR HANDLING MULTICOLLINEARITY PROBLEMS IN LINEAR REGRESSION MODEL WITH NORMALLY AND UNIFORMLY DISTRIBUTED …
Nigerian Journal of Scientific Research, 2022
[3] Was treibt die Renditen von Hedgefonds? Eine empirische Untersuchung ausgewählter Hedgefonds Strategien
2021
[4] Was treibt die Renditen von Hedgefonds? Eine empirische Untersuchung ausgewählter Hedgefonds Strategien (What drives hedge fund returns? An empirical …
2021
[5] Predicting the extent of root and butt rot in stems of Norway spruce (Picea abies)
2020
[6] REGRESSION TECHNIQUES IN THE PRESENCE OF MULTICOLLINEARITY AND AUTOCORRELATION PHENOMENA: MONTE CARLO APPROACH
Anale. Seria Informatica, 2020
[7] MONTE CARLO APPROACH FOR COMPARATIVE ANALYSIS OF REGRESSION TECHNIQUES IN THE PRESENCE OF MULTICOLLINEARITY AND …
2020
[8] Parameter estimation methods in multiple linear regression analysis with intraclass correlation and heavy-tailed distributed data
2019
[9] The relationship between e-CRM and customer loyalty: a Kenyan Commercial Bank case study
2017
[10] Estimation of Linear Regression Model with Correlated Regressors in the Presence of Autocorrelation
International Journal of Statistics and Applications, 2016
[11] Comparative Appraisal of some Specification Error Test
2014
[12] On the Effect of Autocorrelation in Regression Model due to Specification Error
International Journal of Modern Mathematical Sciences, 2014
[13] Effect of Omitted Variable due to Misspecification Error in Regression Analysis
International Journal of Modern Mathematical Sciences, 2014
[14] On the Performance of RESET and Durbin Watson Tests in Detecting Specification Error
Copyright© 2014 by Modern Scientific Press Company, Florida, USA International Journal of Modern Mathematical Sciences,, 2014

Copyright © 2024 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.