The performance of latent root-M based regression.
Problem statement: In the presence of multicollinearity, the estimation of parameters in multiple linear regression models by means of Ordinary Least Squares (OLS) is known to suffer severe distortion. An alternative approach was to use the modified OLS which was based on the latent roots and latent...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English English |
| Published: |
Science Publications
2009
|
| Subjects: | |
| Online Access: | http://psasir.upm.edu.my/id/eprint/17262/ http://psasir.upm.edu.my/id/eprint/17262/1/The%20performance%20of%20latent%20root.pdf |
| _version_ | 1848843193037094912 |
|---|---|
| author | Midi, Habshah Lau, Ung Hua |
| author_facet | Midi, Habshah Lau, Ung Hua |
| author_sort | Midi, Habshah |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | Problem statement: In the presence of multicollinearity, the estimation of parameters in multiple linear regression models by means of Ordinary Least Squares (OLS) is known to suffer severe distortion. An alternative approach was to use the modified OLS which was based on the latent roots and latent vectors of the correlation matrix of the independent and dependent variables. This procedure is called the Latent Root Regression (LRR) which serves the purpose to improve the stability of the estimates for data plagued by multicollinearity. However, there was evidence that the LRR estimators were easily affected by a few atypical observations that we call outliers. It is now evident that the robust method alone cannot rectify the combined problems of multicollinearity and outliers.
Approach: In this study, we proposed a robust procedure for the estimation of the regression parameters in the presence of multicollinearity and outliers. We called this method Latent Root-M based Regression (LRMB) because here we employed the weight of the M-estimator in the weighted correlation matrix. Numerical examples and some simulation studies were presented to illustrate the performance of the newly proposed method.
Results: Results of the study showed that the LRMB method is more efficient than the existing methods.
Conclusion/Recommendations: In order to get a reliable estimate, we recommend using the LRMB when both multicollinearity and outliers are present in the data.
|
| first_indexed | 2025-11-15T08:11:08Z |
| format | Article |
| id | upm-17262 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English English |
| last_indexed | 2025-11-15T08:11:08Z |
| publishDate | 2009 |
| publisher | Science Publications |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-172622015-10-23T03:13:43Z http://psasir.upm.edu.my/id/eprint/17262/ The performance of latent root-M based regression. Midi, Habshah Lau, Ung Hua Problem statement: In the presence of multicollinearity, the estimation of parameters in multiple linear regression models by means of Ordinary Least Squares (OLS) is known to suffer severe distortion. An alternative approach was to use the modified OLS which was based on the latent roots and latent vectors of the correlation matrix of the independent and dependent variables. This procedure is called the Latent Root Regression (LRR) which serves the purpose to improve the stability of the estimates for data plagued by multicollinearity. However, there was evidence that the LRR estimators were easily affected by a few atypical observations that we call outliers. It is now evident that the robust method alone cannot rectify the combined problems of multicollinearity and outliers. Approach: In this study, we proposed a robust procedure for the estimation of the regression parameters in the presence of multicollinearity and outliers. We called this method Latent Root-M based Regression (LRMB) because here we employed the weight of the M-estimator in the weighted correlation matrix. Numerical examples and some simulation studies were presented to illustrate the performance of the newly proposed method. Results: Results of the study showed that the LRMB method is more efficient than the existing methods. Conclusion/Recommendations: In order to get a reliable estimate, we recommend using the LRMB when both multicollinearity and outliers are present in the data. Science Publications 2009 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/17262/1/The%20performance%20of%20latent%20root.pdf Midi, Habshah and Lau, Ung Hua (2009) The performance of latent root-M based regression. Journal of Mathematics and Statistics, 5 (1). pp. 1-9. ISSN 1549-3644 http://thescipub.com/abstract/10.3844/jmssp.2009.1.9 Multivariate analysis. Statistics and Probability. Regression analysis. 10.3844/jmssp.2009.1.9 English |
| spellingShingle | Multivariate analysis. Statistics and Probability. Regression analysis. Midi, Habshah Lau, Ung Hua The performance of latent root-M based regression. |
| title | The performance of latent root-M based regression. |
| title_full | The performance of latent root-M based regression. |
| title_fullStr | The performance of latent root-M based regression. |
| title_full_unstemmed | The performance of latent root-M based regression. |
| title_short | The performance of latent root-M based regression. |
| title_sort | performance of latent root-m based regression. |
| topic | Multivariate analysis. Statistics and Probability. Regression analysis. |
| url | http://psasir.upm.edu.my/id/eprint/17262/ http://psasir.upm.edu.my/id/eprint/17262/ http://psasir.upm.edu.my/id/eprint/17262/ http://psasir.upm.edu.my/id/eprint/17262/1/The%20performance%20of%20latent%20root.pdf |