Skip to main content

Application of Machine Learning to a Credit Rating Classification Model: Techniques for Improving the Explainability of Machine Learning

April 21, 2023
Ryuichiro Hashimoto*1
Kakeru Miura*2
Yasunori Yoshizaki*3

Abstract

Machine learning (ML) has been used increasingly in a wide range of operations at financial institutions. In the field of credit risk management, many financial institutions are starting to apply ML to credit scoring models and default models. In this paper we apply ML to a credit rating classification model. First, we estimate classification models based on both ML and ordinal logistic regression using the same dataset to see how model structure affects the prediction accuracy of models. In addition, we measure variable importance and decompose model predictions using so-called eXplainable AI (XAI) techniques that have been widely used in recent years. The results of our analysis are twofold. First, ML captures more accurately than ordinal logit regression the nonlinear relationships between financial indicators and credit ratings, leading to a significant improvement in prediction accuracy. Second, SHAP (Shapley Additive exPlanations) and PDP (Partial Dependence Plot) show that several financial indicators such as total revenue, total assets turnover, and ICR have a significant impact on firms' credit quality. Nonlinear relationships between financial indicators and credit rating are also observed: a decrease in ICR below about 2 lowers firms' credit quality sharply. Our analysis suggests that using XAI while understanding its underlying assumptions improves the low explainability of ML.

JEL classifications
C49, C55, G32

Keywords
Credit risk management, Machine learning, Explainability, eXplainable AI (XAI)

The authors would like to thank the staff of the Bank of Japan for their valuable comments. The views expressed in this paper are those of the authors and do not necessarily reflect the official view of the Bank of Japan or of the Financial System and Bank Examination Department.

  1. *1Financial System and Bank Examination Department, Bank of Japan
    E-mail : ryuuichirou.hashimoto@boj.or.jp
  2. *2Financial System and Bank Examination Department, Bank of Japan
    E-mail : kakeru.miura@boj.or.jp
  3. *3Financial System and Bank Examination Department, Bank of Japan
    E-mail : yasunori.yoshizaki@boj.or.jp

Notice

Papers in the Bank of Japan Working Paper Series are circulated to stimulate discussion and comment. Views expressed are those of the authors and do not necessarily reflect those of the Bank.
If you have any comments or questions on a paper in the Working Paper Series, please contact the authors.
When making a copy or reproduction of the content for commercial purposes, please contact the Public Relations Department (post.prd8@boj.or.jp) at the Bank in advance to request permission. When making a copy or reproduction, the Bank of Japan Working Paper Series should explicitly be credited as the source.