Dynamic iterative imputation algorithm based on rough fuzzy C-Means clustering

Missing data is a very common phenomenon in daily life. To mitigate its adverse impact on data analysis, this paper proposes a dynamic iterative imputation algorithm based on the rough fuzzy C-means algorithm. The algorithm incorporates dynamic approximations to partition and iterate the cluster ass...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Journal of physics. Conference series Ročník 2791; číslo 1; s. 12080 - 12090
Hlavní autoři: Gong, Zheng, Yan, Chun, Liu, Wei
Médium: Journal Article
Jazyk:angličtina
Vydáno: Bristol IOP Publishing 01.07.2024
Témata:
Algorithms
Clustering
Clusters
Data analysis
Datasets
Impact analysis
Machine learning
Missing data
ISSN:1742-6588, 1742-6596
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Missing data is a very common phenomenon in daily life. To mitigate its adverse impact on data analysis, this paper proposes a dynamic iterative imputation algorithm based on the rough fuzzy C-means algorithm. The algorithm incorporates dynamic approximations to partition and iterate the cluster assignment of missing sample points, utilizing information from complete sample points within the same cluster for iterative imputation. The imputation results are evaluated by using MAE and RMSE metrics, and the optimal number of iterations and imputation values are determined by minimizing these metrics. To verify the effectiveness of the proposed algorithm, 6 UCI public datasets are selected for imputation tests, and the change curves of metric value with iterations are generated under different missing proportions in each dataset. The optimal imputation result is obtained based on the lowest point of the curve. Subsequently, the performance of the proposed algorithm is compared with three cluster-based and five machine learning-based imputation algorithms. The results demonstrate the significant superiority of the proposed algorithm over the other methods, achieving a more approximate imputation of missing values in the dataset.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1742-6588
1742-6596
DOI:10.1088/1742-6596/2791/1/012080