Dynamic iterative imputation algorithm based on rough fuzzy C-Means clustering

Missing data is a very common phenomenon in daily life. To mitigate its adverse impact on data analysis, this paper proposes a dynamic iterative imputation algorithm based on the rough fuzzy C-means algorithm. The algorithm incorporates dynamic approximations to partition and iterate the cluster ass...

Full description

Saved in:
Bibliographic Details
Published in:Journal of physics. Conference series Vol. 2791; no. 1; pp. 12080 - 12090
Main Authors: Gong, Zheng, Yan, Chun, Liu, Wei
Format: Journal Article
Language:English
Published: Bristol IOP Publishing 01.07.2024
Subjects:
Algorithms
Clustering
Clusters
Data analysis
Datasets
Impact analysis
Machine learning
Missing data
ISSN:1742-6588, 1742-6596
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Missing data is a very common phenomenon in daily life. To mitigate its adverse impact on data analysis, this paper proposes a dynamic iterative imputation algorithm based on the rough fuzzy C-means algorithm. The algorithm incorporates dynamic approximations to partition and iterate the cluster assignment of missing sample points, utilizing information from complete sample points within the same cluster for iterative imputation. The imputation results are evaluated by using MAE and RMSE metrics, and the optimal number of iterations and imputation values are determined by minimizing these metrics. To verify the effectiveness of the proposed algorithm, 6 UCI public datasets are selected for imputation tests, and the change curves of metric value with iterations are generated under different missing proportions in each dataset. The optimal imputation result is obtained based on the lowest point of the curve. Subsequently, the performance of the proposed algorithm is compared with three cluster-based and five machine learning-based imputation algorithms. The results demonstrate the significant superiority of the proposed algorithm over the other methods, achieving a more approximate imputation of missing values in the dataset.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1742-6588
1742-6596
DOI:10.1088/1742-6596/2791/1/012080