
multicollinearity
Sign in to saveAlso known as collinearity
In statistics, multicollinearity or collinearity is a situation where the predictors in a regression model are linearly dependent.
~12 min read
Article
14 sectionsContents
- Perfect multicollinearity
- Resolution
- Numerical issues
- Solutions
- Effects on coefficient estimates
- Remedies
- Regularized estimators
- Improved experimental design
- Acceptance
- Misuse
- See also
- References
- Further reading
- External links
In statistics, multicollinearity or collinearity is a situation where the predictors in a regression model are linearly dependent.
Perfect multicollinearity refers to a situation where the predictive variables have an exact linear relationship. When there is perfect collinearity, the design matrix X has less than full rank, and therefore the moment matrix X^{\mathsf{T}}X cannot be inverted. In this situation, the parameter estimates of the regression are not well-defined, as the system of equations has infinitely many solutions.