FRACTIONAL RESIDUAL PLOT FOR MODEL VALIDATION
DOI:
https://doi.org/10.11113/jt.v79.8421Keywords:
Model validation, error measurement, residual plotAbstract
A pairwise comparison is important to measure the goodness-of-fit of models. Error measurements are used for this purpose but it only limit to the value, thus a graph is used to help show the precision of the models. These two should show a tally result in order to defense the hypothesis correctly. In this study, a fractional residual plot is proposed to help showing the precision of forecasts. This plot improvises the scale of the graph by changing the scale into decimal ranging from -1 to 1. The closer the point to 0 will indicate that forecast is robust and value closer to -1 or 1 will indicate that the forecast is poor. Two error measurements which are mean absolute error (MAE) and mean absolute percentage error (MAPE) and residual plot are used to justify the results and make comparison with the proposed fractional residual plot. Three difference data are used for this purpose and the results have shown that the fractional residual plot could give as much information as the residual plot but in an easier and meaningful way. In conclusion, the error plot is important in visualize the accurateness of the forecast. Â
References
Legates, D. R. and G. J. McCabe. 1999. Evaluating the use of “goodnessâ€ofâ€fit†measures in hydrologic and hydroclimatic model validation. Water resources research. 35(1): 233-241.
Cumming, G., F. Fidler, and D. L. Vaux. 2007. Error bars in experimental biology. The Journal of cell biology. 177(1): 7-11.
Willmott, C.J. 1981. On the validation of models. Physical geography. 2(2): 184-194.
Hyndman, R.J. and A. B. Koehler. 2006. Another look at measures of forecast accuracy. International journal of forecasting. 22(4): 679-688.
Hyndman, R. J. 2006. Another look at forecast-accuracy metrics for intermittent demand. Foresight: The International Journal of Applied Forecasting. 4(4): 43-46.
Baddeley, A. et al. 2005. Residual analysis for spatial point processes (with discussion). Journal of the Royal Statistical Society: Series B (Statistical Methodology). 67(5): 617-666.
Cox, N. J. 2004. Speaking Stata: Graphing model diagnostics. Stata Journal. 4(4): 449-475.
Baharudin, Z. and N. Kamel. 2007. One Week Ahead Short Term Load Forecasting. European Conference on Power and Energy Systems (EuroPES 2007) IASTED. Palma de Mallorca, Spain. 29-31 August 2007. 1-6.
Gould, P. G., et al. 2008. Forecasting time series with multiple seasonal patterns. European Journal of Operational Research. 191(1): 207-222.
Soares, L. J. and M. C. Medeiros. 2008. Modeling and forecasting short-term electricity load: A comparison of methods with an application to Brazilian data. International Journal of Forecasting. 24(4): 630-644.
Zhang, G. P. 2003. Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing. 50(0): 159-175.
Downloads
Published
Issue
Section
License
Copyright of articles that appear in Jurnal Teknologi belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions, or any other reproductions of similar nature.
