Open Journal of Statistics

Volume 13, Issue 3 (June 2023)

ISSN Print: 2161-718X   ISSN Online: 2161-7198

Google-based Impact Factor: 1.45  Citations  

Dealing with Multicollinearity in Factor Analysis: The Problem, Detections, and Solutions

HTML  XML Download Download as PDF (Size: 328KB)  PP. 404-424  
DOI: 10.4236/ojs.2023.133020    2,732 Downloads   16,042 Views  Citations

ABSTRACT

Multicollinearity in factor analysis has negative effects, including unreliable factor structure, inconsistent loadings, inflated standard errors, reduced discriminant validity, and difficulties in interpreting factors. It also leads to reduced stability, hindered factor replication, misinterpretation of factor importance, increased parameter estimation instability, reduced power to detect the true factor structure, compromised model fit indices, and biased factor loadings. Multicollinearity introduces uncertainty, complexity, and limited generalizability, hampering factor analysis. To address multicollinearity, researchers can examine the correlation matrix to identify variables with high correlation coefficients. The Variance Inflation Factor (VIF) measures the inflation of regression coefficients due to multicollinearity. Tolerance, the reciprocal of VIF, indicates the proportion of variance in a predictor variable not shared with others. Eigenvalues help assess multicollinearity, with values greater than 1 suggesting the retention of factors. Principal Component Analysis (PCA) reduces dimensionality and identifies highly correlated variables. Other diagnostic measures include the condition number and Cook’s distance. Researchers can center or standardize data, perform variable filtering, use PCA instead of factor analysis, employ factor scores, merge correlated variables, or apply clustering techniques for the solution of the multicollinearity problem. Further research is needed to explore different types of multicollinearity, assess method effectiveness, and investigate the relationship with other factor analysis issues.

Share and Cite:

Kyriazos, T. and Poga, M. (2023) Dealing with Multicollinearity in Factor Analysis: The Problem, Detections, and Solutions. Open Journal of Statistics, 13, 404-424. doi: 10.4236/ojs.2023.133020.

Cited by

[1] Well-being and multisensory urban parks at different ages: The role of interoception and audiovisual perception
Journal of …, 2024
[2] Remote work arrangement: An investigation on the influence of team's innovative performance in multinational NGOs in Jordan
… Journal of Data and …, 2024
[3] Evaluating Inspiring Factors and Obstacles in the Start-Up of Owned Agri-Preneurial Businesses: Underlying Evidence from South Africa
Administrative Sciences, 2024
[4] Green mining in China: Fintech's contribution to enhancing innovation performance aimed at sustainable and digital transformation in the mining sector
Resources Policy, 2024
[5] A Bayesian Regression Approach for Estimating Photosynthetically Active Radiation Using Satellite Data: Implications for Soybean Yield Prediction using the …
Earth Systems and Environment, 2024
[6] Psychometric evaluation and misophonic experience in a Portuguese-speaking sample
Behavioral …, 2024
[7] How and When Resilience can Boost Student Academic Performance: A Weekly Diary Study on the Roles of Self-Regulation Behaviors, Grit, and Social …
Journal of Happiness Studies, 2024
[8] Dental disease in companion rabbits under UK primary veterinary care: Frequency and risk factors
Veterinary …, 2024
[9] Augmented reality and customer engagement in the context of e-banking
Journal of Financial Services Marketing, 2024
[10] Deriving community vulnerability indices by analyzing multi-resolution space-borne data and demographic data for extreme weather events in global cities
Remote Sensing Applications: Society and …, 2024
[11] Development of Ridge Ensemble Standardized Drought Index (RESDI) for improving drought characterization and future assessment
Environmental …, 2024
[12] How to leverage the initiative of regional innovation subjects under the digital economy? A study on the mediating effect of innovation environment
Technology Analysis & Strategic …, 2024
[13] Development of a Cost Prediction Model for Design Changes: Case of Korean Apartment Housing Projects
Sustainability, 2024
[14] Workforce Diversity at Work: Exploring Ethnicity as Moderating in Age and Performance
Asian Journal of Management Analytics, 2024
[15] The effect of emotional intelligence, and fostering creativity on entrepreneurship business administration: mediating role of innovation and intrinsic motivation
2024
[16] Eliminating collinearity observed in chemical mass balance analysis using multi linear regression and synthetic receptor source profile dataset
Sādhanā, 2024
[17] A study on how to enhance the well-being of young professionals confronting internal overcompetition in China: Prospect of reducing the stress of Nei Juan
Health Economics and …, 2024
[18] Exploring antecedents of destination brand engagement of tourists: The roles of destination brand experience and destination brand authenticity.
Valley International Journal Digital …, 2024
[19] Leveraging Partner Country Factors in Deep Learning for Thailand's Forecasted Inflation Accuracy Enhancement
Engineering Journal, 2024
[20] AN INDICATOR BASED APPROACH TO QUANTIFY RIVER FLOOD RISK FOR THE MAAS RIVER IN LIMBURG
2024
[21] Impact of Artificial Intelligence on Knowledge Management: An investigation on the Public Sector in Saudi Arabia
American Academic & Scholarly Research Journal, 2024
[22] Influence of Information Symmetry Management on Loan Portfolio Quality for Savings and Credit Cooperative Societies in Tanzania
African Development …, 2024
[23] From Recession to Pandemic: Evolving Inequalities in OECD Countries through a Two-Decade Analysis of Socio-Economic Impacts
Comparative Sociology, 2024
[24] TOKSİK YÖNETİCİ DAVRANIŞLARI VE İŞYERİ ŞİDDETİNİN ÖRGÜTSEL SİNİZM İLE İLİŞKİSİNİN İNCELENMESİ: SAĞLIK ÇALIŞANLARI ÜZERİNE KESİTSEL BİR …
EKEV Akademi Dergisi, 2024
[25] Evaluation of International Shipping Alliance: A Case Study of Transport Capacity and Cost Efficiency Influence the Quality of Cooperation Inter-Country Using …
International Journal of Offshore …, 2024
[26] ZERO-INFLATED NEGATIVE BINOMIAL MODELING IN INFANT DEATH CASE DUE TO PNEUMONIA IN EAST JAVA PROVINCE
BAREKENG: Jurnal Ilmu …, 2023
[27] The Relationship Between Financial Behavior with its Determinants and Well-Being of College Students in Bandung
Return: Study of …, 2023
[28] Unlocking Insights from Nerve Excitability Testing: Revealing Factors Shaping Nerve Health in Arm and Leg Data
2023
[29] Physical Activity, Learning Experience, and Their Influence on Athletic and Sports Performance in the United States: The Mediating Role of Quality of Life
… de Psicología del Deporte (Journal of …, 2023
[30] Analysis of Competitive Intelligence in Retail Management in the Jordanian Market from the Consumer's Perspective
Journal of Intelligence …, 2023

Copyright © 2025 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.