Open Journal of Statistics

Volume 5, Issue 7 (December 2015)

ISSN Print: 2161-718X   ISSN Online: 2161-7198

Google-based Impact Factor: 0.53  Citations  

On the Covariance of Regression Coefficients

HTML  XML Download Download as PDF (Size: 431KB)  PP. 680-701  
DOI: 10.4236/ojs.2015.57069    6,281 Downloads   10,787 Views  Citations

ABSTRACT

In many applications, such as in multivariate meta-analysis or in the construction of multivariate models from summary statistics, the covariance of regression coefficients needs to be calculated without having access to individual patients’ data. In this work, we derive an alternative analytic expression for the covariance matrix of the regression coefficients in a multiple linear regression model. In contrast to the well-known expressions which make use of the cross-product matrix and hence require access to individual data, we express the covariance matrix of the regression coefficients directly in terms of covariance matrix of the explanatory variables. In particular, we show that the covariance matrix of the regression coefficients can be calculated using the matrix of the partial correlation coefficients of the explanatory variables, which in turn can be calculated easily from the correlation matrix of the explanatory variables. This is very important since the covariance matrix of the explanatory variables can be easily obtained or imputed using data from the literature, without requiring access to individual data. Two important applications of the method are discussed, namely the multivariate meta-analysis of regression coefficients and the so-called synthesis analysis, and the aim of which is to combine in a single predictive model, information from different variables. The estimator proposed in this work can increase the usefulness of these methods providing better results, as seen by application in a publicly available dataset. Source code is provided in the Appendix and in http://www.compgen.org/tools/regression.


Share and Cite:

Bagos, P. and Adam, M. (2015) On the Covariance of Regression Coefficients. Open Journal of Statistics, 5, 680-701. doi: 10.4236/ojs.2015.57069.

Cited by

[1] Reflection on modern methods: visualizing the effects of collinearity in distributed lag models
Gómez - International Journal of …, 2022
[2] Assessment of Sea Level and Morphological Changes along the Eastern Coast of Bangladesh
Journal of Marine Science …, 2022
[3] Unveil the unseen: Exploit information hidden in noise
Applied Intelligence, 2022
[4] IEA
International Journal of Epidemiology, 2020
[5] Hidden Transmitter Localization Accuracy Model Based on Multi-Position Range Measurement
2020
[6] Making biased but better predictions: The trade-offs strategists face when they learn and use heuristics
2019
[7] Software Application for Calculating Models Forecasting Innovative Development of Industries
Journal: Herald of Dagestan State Technical …, 2019
[8] Trade and Women Employment in China: An Insight into the Low Presence of Women Workforce in the 21st Century Corporate China
2018
[9] ПРОГРАММНОЕ ПРИЛОЖЕНИЕ ДЛЯ РАСЧЕТА МОДЕЛИ ПРОГНОЗИРОВАНИЯ ИННОВАЦИОННОГО РАЗВИТИЯ ОТРАСЛЕЙ
2018
[10] РАЗРАБОТКА АВТОМАТИЗИРОВАННОЙ СИСТЕМЫ МОДЕЛИРОВАНИЯ РАЗВИТИЯ СТРОИТЕЛЬСТВА
2018
[11] Estimating winter balance and its uncertainty from direct measurements of snow depth and density on alpine glaciers
Journal of Glaciology, 2018
[12] Tree mortality in Central Europe: Empirically-based modeling using long-term datasets
2016
[13] Fuzzy logic system for intermixed biogas and photovoltaics measurement and control
Mathematical Problems in Engineering, 2016

Copyright © 2024 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.