COMPREHENSIBLE CREDIT-SCORING KNOWLEDGE VISUALIZATION USING DECISION TABLES AND DIAGRAMS

Christophe Mues, Johan Huysmans, Jan Vanthienen, Bart Baesens

Abstract

One of the key decision activities in financial institutions is to assess the credit-worthiness of an applicant for a loan, and thereupon decide whether or not to grant the loan. Many classification methods have been suggested in the credit-scoring literature to distinguish good payers from bad payers. Especially neural networks have received a lot of attention. However, a major drawback is their lack of transparency. While they can achieve a high predictive accuracy rate, the reasoning behind how they reach their decisions is not readily available, which hinders their acceptance by practitioners. Therefore, we have, in earlier work, proposed a two-step process to open the neural network black box which involves: (1) extracting rules from the network; (2) visualizing this rule set using an intuitive graphical representation. In this paper, we will focus on the second step and further investigate the use of two types of representations: decision tables and diagrams. The former are a well-known representation originally used as a programming technique. The latter are a generalization of decision trees taking on the form of a rooted, acyclic digraph instead of a tree, and have mainly been studied and applied by the hardware design community. We will compare both representations in terms of their ability to compactly represent the decision knowledge extracted from two real-life credit-scoring data sets.

References

  1. AT&T Laboratories (2003). Graphviz, graph-drawing tool. http://www.research.att.com/sw/tools/graphviz/.
  2. Baesens, B., Mues, C., Setiono, R., De Backer, M., and Vanthienen, J. (2003a). Building intelligent credit scoring systems using decision tables. In Proceedings of the Fifth International Conference on Enterprise Information Systems (ICEIS'2003), pages 19- 25, Angers, France.
  3. Baesens, B., Setiono, R., Mues, C., and Vanthienen, J. (2003b). Using neural network rule extraction and decision tables for credit-risk evaluation. Management Science, 49(3):312-329.
  4. Baesens, B., Van Gestel, T., Viaene, S., Stepanova, M., Suykens, J., and Vanthienen, J. (2003c). Benchmarking state of the art classi cation algorithms for credit scoring. Journal of the Operational Research Society, 54(6):627-635.
  5. Bryant, R. (1986). Graph-based algorithms for boolean function manipulation. IEEE Transactions on Computers, C-35(8):677-691.
  6. David, R., Edelman, D., and Gammerman, A. (1992). Machine learning algorithms for credit-card applications. IMA Journal of Mathematics Applied In Business and Industry, 4:43-51.
  7. Gansner, E. R., Koutso os, E., North, S. C., and Vo, K. P. (1993). A technique for drawing directed graphs. IEEE Transactions on Software Engineering, 19(3):214-230.
  8. Henley, W. and Hand, D. (1997). Construction of a knearest neighbour credit-scoring system. IMA Journal of Mathematics Applied In Business and Industry, 8:305-321.
  9. Horiyama, T. and Ibaraki, T. (2002). Ordered binary decision diagrams as knowledge-bases. Arti cial Intelligence, 136(2):189-213.
  10. Kam, T., Villa, T., Brayton, R. K., and SangiovanniVincentelli, A. L. (1998). Multi-valued decision diagrams: Theory and applications. International Journal on Multiple-Valued Logic, 4(1-2):9-62.
  11. Kohavi, R. (1996). Wrappers for Performance Enhancement and Oblivious Decision Graphs. PhD thesis, Department of Computer Science, Stanford University.
  12. Long, D. (2003). OBDD package. 2.cs.cmu.edu/┬╗modelcheck/bdd.html.
  13. Miller, D. and Drechsler, R. (1998). Implementing a multivalued decision diagram package. In Proceedings of the International Symposium on Multiple-Valued Logic, pages 52-57, Fukuoka, Japan.
  14. Prologa (2003). Decision table modelling tool. http://www.econ.kuleuven.ac.be/prologa/.
  15. Santos-Gomez, L. and Darnel, M. (1992). Empirical evaluation of decision tables for constructing and comprehending expert system rules. Knowledge Acquisition, 4:427-444.
  16. Steenackers, A. and Goovaerts, M. (1989). A credit scoring model for personal loans. Insurance: Mathematics and Economics, 8:31-34.
  17. Thomas, L. (2000). A survey of credit and behavioural scoring: forecasting nancial risk of lending to customers. International Journal of Forecasting, 16:149-172.
  18. Vanthienen, J. and Dries, E. (1994). Illustration of a decision table tool for specifying and implementing knowledge based systems. International Journal on Arti cial Intelligence Tools, 3(2):267-288.
  19. Vanthienen, J., Mues, C., and Aerts, A. (1998). An illustration of veri cation and validation in the modelling phase of kbs development. Data and Knowledge Engineering, 27:337-352.
  20. Wets, G. (1998). Decision Tables in Knowledge-Based Systems: Adding Knowledge Discovery and Fuzzy Concepts to the Decision Table Formalism. PhD thesis, Department of Applied Economic Sciences, Catholic University of Leuven, Belgium.
Download


Paper Citation


in Harvard Style

Mues C., Huysmans J., Vanthienen J. and Baesens B. (2004). COMPREHENSIBLE CREDIT-SCORING KNOWLEDGE VISUALIZATION USING DECISION TABLES AND DIAGRAMS . In Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 972-8865-00-7, pages 226-232. DOI: 10.5220/0002598602260232


in Bibtex Style

@conference{iceis04,
author={Christophe Mues and Johan Huysmans and Jan Vanthienen and Bart Baesens},
title={COMPREHENSIBLE CREDIT-SCORING KNOWLEDGE VISUALIZATION USING DECISION TABLES AND DIAGRAMS},
booktitle={Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2004},
pages={226-232},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002598602260232},
isbn={972-8865-00-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - COMPREHENSIBLE CREDIT-SCORING KNOWLEDGE VISUALIZATION USING DECISION TABLES AND DIAGRAMS
SN - 972-8865-00-7
AU - Mues C.
AU - Huysmans J.
AU - Vanthienen J.
AU - Baesens B.
PY - 2004
SP - 226
EP - 232
DO - 10.5220/0002598602260232