Learning customized and optimized lists of rules with mathematical programming

We introduce a mathematical programming approach to building rule lists, which are a type of interpretable, nonlinear, and logical machine learning classifier involving IF-THEN rules. Unlike traditional decision tree algorithms like CART and C5.0, this method does not use greedy splitting and prunin...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Mathematical programming computation Jg. 10; H. 4; S. 659 - 702
Hauptverfasser: Rudin, Cynthia, Ertekin, Şeyda
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Berlin/Heidelberg Springer Berlin Heidelberg 01.12.2018
Springer Nature B.V
Schlagworte:
Accuracy
Decision trees
Digital Object Identifier
Full Length Paper
Machine learning
Mathematical analysis
Mathematical models
Mathematical programming
Mathematics
Mathematics and Statistics
Mathematics of Computing
Operations Research/Decision Theory
Optimization
Pruning
Sparsity
Theory of Computation
68T05 Learning and adaptive systems
Learning and adaptive systems
Sparsity
90C11 Mixed integer programming
Mixed-integer programming
62-04 Explicit machine computation and programs (not the theory of computation or programming)
Decision lists
Interpretable modeling
Decision trees
Artificial intelligence
Associative classification 68T05—Computer Science
ISSN:1867-2949, 1867-2957
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:We introduce a mathematical programming approach to building rule lists, which are a type of interpretable, nonlinear, and logical machine learning classifier involving IF-THEN rules. Unlike traditional decision tree algorithms like CART and C5.0, this method does not use greedy splitting and pruning. Instead, it aims to fully optimize a combination of accuracy and sparsity, obeying user-defined constraints. This method is useful for producing non-black-box predictive models, and has the benefit of a clear user-defined tradeoff between training accuracy and sparsity. The flexible framework of mathematical programming allows users to create customized models with a provable guarantee of optimality. The software reviewed as part of this submission was given the DOI (Digital Object Identifier) https://doi.org/10.5281/zenodo.1344142 .
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1867-2949
1867-2957
DOI:10.1007/s12532-018-0143-8