A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees

•A new hybrid algorithm (logit leaf model) is proposed for customer churn prediction.•It is designed to perform well in terms of both accuracy and interpretability.•Its competitive performance is apparent from an extensive benchmarking experiment.•Its ability to deliver actionable insights is demons...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:European journal of operational research Ročník 269; číslo 2; s. 760 - 772
Hlavní autoři: De Caigny, Arno, Coussement, Kristof, De Bock, Koen W.
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier B.V 01.09.2018
Elsevier
Témata:
ISSN:0377-2217, 1872-6860
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:•A new hybrid algorithm (logit leaf model) is proposed for customer churn prediction.•It is designed to perform well in terms of both accuracy and interpretability.•Its competitive performance is apparent from an extensive benchmarking experiment.•Its ability to deliver actionable insights is demonstrated in a case study. Decision trees and logistic regression are two very popular algorithms in customer churn prediction with strong predictive performance and good comprehensibility. Despite these strengths, decision trees tend to have problems to handle linear relations between variables and logistic regression has difficulties with interaction effects between variables. Therefore a new hybrid algorithm, the logit leaf model (LLM), is proposed to better classify data. The idea behind the LLM is that different models constructed on segments of the data rather than on the entire dataset lead to better predictive performance while maintaining the comprehensibility from the models constructed in the leaves. The LLM consists of two stages: a segmentation phase and a prediction phase. In the first stage customer segments are identified using decision rules and in the second stage a model is created for every leaf of this tree. This new hybrid approach is benchmarked against decision trees, logistic regression, random forests and logistic model trees with regards to the predictive performance and comprehensibility. The area under the receiver operating characteristics curve (AUC) and top decile lift (TDL) are used to measure the predictive performance for which LLM scores significantly better than its building blocks logistic regression and decision trees and performs at least as well as more advanced ensemble methods random forests and logistic model trees. Comprehensibility is addressed by a case study for which we observe some key benefits using the LLM compared to using decision trees or logistic regression.
ISSN:0377-2217
1872-6860
DOI:10.1016/j.ejor.2018.02.009