Stacking Based LightGBM-CatBoost-RandomForest Algorithm and Its Application in Big Data Modeling

Recent years, the application of big data model prediction in various fields has been increasing, but the improvement of model accuracy has always been a major problem. Integrating multiple base classifiers by using an ensemble algorithm is an efficient way to improve model accuracy. In this paper,...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2022 4th International Conference on Data-driven Optimization of Complex Systems (DOCS) S. 1 - 6
Hauptverfasser: Wang, Zhihong, Ren, Hongru, Lu, Renquan, Huang, Lirong
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 28.10.2022
Schlagworte:
Big Data
Big Data Model
Classification algorithms
Data models
Ensemble learning
LightGBM-CatBoost-RandomForest
Prediction algorithms
Predictive models
Stacking
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Recent years, the application of big data model prediction in various fields has been increasing, but the improvement of model accuracy has always been a major problem. Integrating multiple base classifiers by using an ensemble algorithm is an efficient way to improve model accuracy. In this paper, LightGBM, CatBoost and RandomForest are used as base classifiers, and the Stacking method in ensemble learning is used to build a combined model of LightGBM-CatBoost-Random-Forest. A comparative experiment is carried out with the SVM-KNN combination model based on the soft voting method in the existing literature. The results show that the Stacking-based on LightGBM-CatBoost-RandomForest combined model has good performance in the four model evaluation indicators of accuracy, precision, recall and F1 score.
DOI:10.1109/DOCS55193.2022.9967714