Stacking Based LightGBM-CatBoost-RandomForest Algorithm and Its Application in Big Data Modeling

Recent years, the application of big data model prediction in various fields has been increasing, but the improvement of model accuracy has always been a major problem. Integrating multiple base classifiers by using an ensemble algorithm is an efficient way to improve model accuracy. In this paper,...

Full description

Saved in:

Bibliographic Details
Published in:	2022 4th International Conference on Data-driven Optimization of Complex Systems (DOCS) pp. 1 - 6
Main Authors:	Wang, Zhihong, Ren, Hongru, Lu, Renquan, Huang, Lirong
Format:	Conference Proceeding
Language:	English
Published:	IEEE 28.10.2022
Subjects:	Big Data Big Data Model Classification algorithms Data models Ensemble learning LightGBM-CatBoost-RandomForest Prediction algorithms Predictive models Stacking
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	Recent years, the application of big data model prediction in various fields has been increasing, but the improvement of model accuracy has always been a major problem. Integrating multiple base classifiers by using an ensemble algorithm is an efficient way to improve model accuracy. In this paper, LightGBM, CatBoost and RandomForest are used as base classifiers, and the Stacking method in ensemble learning is used to build a combined model of LightGBM-CatBoost-Random-Forest. A comparative experiment is carried out with the SVM-KNN combination model based on the soft voting method in the existing literature. The results show that the Stacking-based on LightGBM-CatBoost-RandomForest combined model has good performance in the four model evaluation indicators of accuracy, precision, recall and F1 score.
DOI:	10.1109/DOCS55193.2022.9967714