Corporate Default Prediction with AdaBoost and Bagging Classifiers

Authors

  • Suresh Ramakrishnan Finance and Accounting Department, Faculty of Management, Universiti Teknologi Malaysia, 81310 UTM Johor Bahru, Johor, Malaysia
  • Maryam Mirzaei Finance and Accounting Department, Faculty of Management, Universiti Teknologi Malaysia, 81310 UTM Johor Bahru, Johor, Malaysia
  • Mahmoud Bekri Economic and Statistic Institute, Karlsruhe Institute of Technology, Germany

DOI:

https://doi.org/10.11113/jt.v73.4191

Keywords:

Default prediction, Adaboost, bagging, data mining

Abstract

This study aims to show a substitute technique to corporate default prediction. Data mining techniques have been extensively applied for this task, due to its ability to notice non-linear relationships and show a good performance in presence of noisy information, as it usually happens in corporate default prediction problems. In spite of several progressive methods that have widely been proposed, this area of research is not out dated and still needs further examination. In this paper, the performance of ensemble classifier systems is assessed in terms of their capability to appropriately classify default and non-default Malaysian firms listed in Bursa Malaysia. AdaBoost and Bagging are novel ensemble learning algorithms that construct the base classifiers in sequence using different versions of the training data set. In this paper, we compare the prediction accuracy of both techniques and single classifiers on a set of Malaysian firms, considering the usual predicting variables such as financial ratios. We show that our approach decreases the generalization error by about thirty percent with respect to the error produced with a single classifier. 

References

J. Abellán, J., & Masegosa, A. 2012. Bagging Schemes on the Presence of Noise in Classification. Expert Systems with Applications. 39(8): 6827–6837.

Allison, P. D. 2001. Logistic Regression Using the SAS System: Theory and Application. Cary, NC: SAS Publishing, BBU Press.

Altman, Edward I. 1968. Financial Ratios, Discriminant Analaysis and the Prediction of Corporate Bankruptcy. Journal of Finance. 23(4): 589–609.

Altman, Edward I. 1973. Predicting Railroad Bankruptcies in America. Bell Journal of Economics & Management Science. 4(1): 184.

Atiya, A. 2001. Bankruptcy Prediction for Credit Risk using Neural Networks: A Survey and New Results. IEEE Transactions on Neural Networks. 12: 929–935.

Beaver, William H. 1966. Financial Ratios as Predictors of Failure. Journal of Accounting Research. 4(3): 71–111.

Brown, G., Wyatt, J.L. Harris, R. Yao, X. 2005. Diversity Creation Methods: A Survey and Categorization, Information Fusion. 6 (1): 5–20.

Carter, C., & Catlett, J. 1987. Assessing Credit Card Applications Using Machine Learning. IEEE Expert. 2: 71–79.

Dimitras, A. I., Zanakis, S. H., & Zopounidis, C. 1996. A Survey of Business Failure with Anemphasis on Prediction Methods andindustrialapplication. European Journal of Operational Research. 90: 487–513.

Freund Y. and Schapire R. E. 1997. A Decision-theoretic Generalisation of On-Line Learning and an Application to Boosting. J. of Computer and System Science. 55(1): 119–139.

Frydman, H., Altman, E., & Kao, D. 1985. Introducing Recursive Partitioning for Financial Classification: The Case of Financial Distress. Journal of Finance. 269–291.

Gepp, Adrian, Kumar, Kuldeep, & Bhattacharya, Sukanto. 2010. Business Failure Prediction Using Decision Trees. Journal of Forecasting. 29(6): 536–555. doi: 10.1002/for.1153.

Gestel, T. V., Baesens, B., Dijcke, P. V., Suykens, J., Garcia, J., & Alderweireld, T. 2005. Linear and Nonlinear Credit Scoring by Combining Logistic Regression and Support Vector Machines. Journal of Credit Risk. 1(4): 31–60.

Härdle, Wolfgang, Moro, Rouslan, & Schäfer, Dorothea. 2005. Predicting Bankruptcy with Support Vector Machines. Statistical Tools in Finance & Insurance. 225–248.

Hertz, J., Krogh, A., & Palmer, R.G. 1991. The Theory of Neural Network Computation. Addison Welsey: Redwood, CA.

Hosmer, D. W., & Lemeshow, S. 2000. Applied Logistic Regression. New York: Wiley.

Jackendoff, N. 1962. A Study of Published Industry Financial and Operating Ratios. Philadelphia: Temple University, Bureau of Economic and Business Research.

Libby, Robert. 1975. Accounting Ratios and the Prediction of Failure: Some Behavioral Evidence. Journal of Accounting Research. 13(1): 150–161.

Lin, F., and McClean, S. 2001. A Data Mining Approach to the Prediction of Corporate Failure-Knowledge-Based Systems. 14(3–4): 189–195.

Lin, Y., 2002. Improvement on Behavioural Scores by Dual-model Scoring System. International Journal of Information Technology and Decision Making. 1: 153–165.

Martin, D. 1977. Early Warnings of Bank Failure: A Logit Regression Approach. Journal of Banking and Finance. 1: 249–276.

Messier, JR. W., & Hansen, J. 1988. Inducing Rules for Expert System Development: An Example Using Default and Bankruptcy Data. Management Science. 34: 1403–1415.

Morris, Richard. 1997. Early Warning Indicators of Corporate Failure: A Critical Review of Previous Research and Further Mpirical Evidence. Ashgate.

Myers, J. H., & Forgy, E. W. 1963. The Development of Numerical Credit Evaluation Systems. Journal of the American Statistical Association. 58(303): 799–806.

Ohlson, James A. 1980. Financial Ratios and the Probabilistic Prediction of Bankruptcy. Journal of Accounting Research. 18(1).

Pompe, P., & Feelders, A. 1997. Using Machine Learning, Neural Networks, and Statistics to Predict Corporate Bankruptcy. Microcomputers in Civil Engineering. 12: 267–276.

Polikar, R. 2006. Ensemble Based Systems in Decision Making. IEEE Circuits and Systems Magazine. 6(3): 21–45.

Quinlan, J. R. 1986. Induction of Decision Trees, Machine Learning. 1: 81–106.

Ravi Kumar, P., & Ravi, V. 2007. Bankruptcy Prediction in Banks and Firms Via Statistical and Intelligent Techniques-A Review. European Journal of Operational Research. 180(1): 1–28.

Rokach, L. 2010. Ensemble Methods in Supervised Learning. Data Mining and Knowledge Discovery Handbook. 959–979.

Shin, K. S., and Lee, Y. J. 2002. A Genetic Algorithm Application in Bankruptcy Prediction Modeling. Expert Systems with Applications. 9: 503–512.

Shin, K. S., lee, T. S., & Kim, H. J. 2005. An Application of Support Vector Machines in Bankruptcy Prediction Model. Expert system Application. 28(1): 127–135.

Shumway, Tyler. 2001. Forecasting Bankruptcy More Accurately: A Simple Hazard Model. Journal of Business. 74(1): 101–124.

Smith, C. W., & Stulz, R. M. 1985. The Determinants of Firms’ Hedging Policies. Journal of Financial and Quantitative Analysis. 20(4): 391–405.

Smith, R., & Winakor, A. 1935. Changes in Financial Structure of Unsuccessful Industrial Corporations. Bureau of Business Research. Bulletin Urbna University of Illinois Press. 51.

West, D., Dellana, S., Qian, J. 2005. Neural Network Ensemble Strategies for Financial Decision Applications. Computers and Operations Research. 32: 2543–2559.

Zhu, H., Beling, P.A., Overstreet, G. 2001. A Study in the Combination of Twoconsumer Credit Scores. Journal of the Operational Research Society. 52: 974–980.

Zmijewski, M. E. 1984. Methodological Issues Related to the Estimation of Financial Distress Prediction Models. Journal of Accounting Research. 22: 59–86.

Downloads

Published

2015-03-09

How to Cite

Corporate Default Prediction with AdaBoost and Bagging Classifiers. (2015). Jurnal Teknologi (Sciences & Engineering), 73(2). https://doi.org/10.11113/jt.v73.4191