Robust Weighted Least Squares Estimation of Regression Parameter in the Presence of Outliers and Heteroscedastic Errors
DOI:
https://doi.org/10.11113/jt.v71.3609Keywords:
Robust estimation, robust weighted least squares, robust least trimmed squares, heteroscedasticity, outliersAbstract
In a linear regression model, the ordinary least squares (OLS) method is considered the best method to estimate the regression parameters if the assumptions are met. However, if the data does not satisfy the underlying assumptions, the results will be misleading. The violation for the assumption of constant variance in the least squares regression is caused by the presence of outliers and heteroscedasticity in the data. This assumption of constant variance (homoscedasticity) is very important in linear regression in which the least squares estimators enjoy the property of minimum variance. Therefor e robust regression method is required to handle the problem of outlier in the data. However, this research will use the weighted least square techniques to estimate the parameter of regression coefficients when the assumption of error variance is violated in the data. Estimation of WLS is the same as carrying out the OLS in a transformed variables procedure. The WLS can easily be affected by outliers. To remedy this, We have suggested a strong technique for the estimation of regression parameters in the existence of heteroscedasticity and outliers. Here we apply the robust regression of M-estimation using iterative reweighted least squares (IRWLS) of Huber and Tukey Bisquare function and resistance regression estimator of least trimmed squares to estimating the model parameters of state-wide crime of united states in 1993. The outcomes from the study indicate the estimators obtained from the M-estimation techniques and the least trimmed method are more effective compared with those obtained from the OLS.
References
Midi, S. Rana, and A. Rahmatullah. 2009. The Performance of Robust Weighted Least Squares in the Presence of Outliers and Heteroscedasticity Errors. WSEAS Transaction on Mathematics. 351–360.
S. Chatterjee, and A. S. Hadi. 2006. Regression Analysis by Examples. 4th ed. Wiley, New York.
R. D. Cook, and S. Weisberg. Diagnostics for Heteroscedasticity in Regression. Biometrika. 70(983): 1–10.
Halbert White, A. 1980. Heteroskedastic Consistent Covariance Matrix Estimator and a Direct Test fFor Heteroskedasticity. Econometrica. 48: 817–838.
R. A. Maronna, R. D. Martin, and V. J. Yohai. 2006. Robust Statistics-Theory and Methods. Wiley, New York.
M. S. Rana, H. Midi, and A. H. M. R. Imon. 2008. A Robust Modification of the Goldfeld-Quandt Test for the Detection of Heteroscedasticity in the Presence of Outliers. Journal of mathematics and Statistics. 4(4): 277–283.
M. H. Kutner, C. J. Nachtsheim, and J. Neter. 2004. Applied Linear Regression Models. 4th ed., McGraw-Hill/ Irwin, New York.
H. Midi and B. A. Talib. 2008. The Performance of Robust Estimator in Linear Regression Model Having both Continous and Catigorical Variables with Heteroscedasticity Errors. Malaysia Journal of Mathematical Science. 2(1): 25–48
P. J. Rousseeuw, and A. Leroy. 1987. Robust Regression and Outlier Detection. Wiley, New York.
A. H. Midi and R. Imon. 2009. Deletion Residuals in the Detection of Heterogencity of Variance in Linear Regression. Journal of Applied Statistics. 36: 347–358.
R. Marona, R. Martin, V. J. Yohai. 2006. Robust Statistics Theory and Methods. John Wiley & Sons Ltd., England.
D. L. Donoho and P. J. Huber. 1983. The Notion of Breakdown Point. In: Bickel PJ Doksum KA, Hodges JL Jr (Editors), A Festschrift for Erich L. LehmannWadsworth, Belmont. 157–184.
A. Christmann. 1994. Least Median of Weighted Squares in Logistic Regression with Large Strata. Biometrika. 81: 413–417.
P. J. Rousseeuw, A. M. Leroy. 1987. Robust Regression and Outlier Detection. Wiley-Interscience, New York.
P. H. Huber. 1964. Robust Estimation of a Location Parameter. The Annals of Mathematical Statistics. 35:7–101.
Downloads
Published
Issue
Section
License
Copyright of articles that appear in Jurnal Teknologi belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions, or any other reproductions of similar nature.
