DBCURE-MR: An efficient density-based clustering algorithm for large data using MapReduce

Clustering is a useful data mining technique which groups data points such that the points within a single group have similar characteristics, while the points in different groups are dissimilar. Density-based clustering algorithms such as DBSCAN and OPTICS are one kind of widely used clustering alg...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Information systems (Oxford) Jg. 42; S. 15 - 35
Hauptverfasser: Kim, Younghoon, Shim, Kyuseok, Kim, Min-Soeng, Sup Lee, June
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Elsevier Ltd 01.06.2014
Schlagworte:
Clustering algorithm
Density-based clustering
MapReduce
Parallel algorithm
Parallel algorithm
Clustering algorithm
Density-based clustering
MapReduce
ISSN:0306-4379, 1873-6076
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Clustering is a useful data mining technique which groups data points such that the points within a single group have similar characteristics, while the points in different groups are dissimilar. Density-based clustering algorithms such as DBSCAN and OPTICS are one kind of widely used clustering algorithms. As there is an increasing trend of applications to deal with vast amounts of data, clustering such big data is a challenging problem. Recently, parallelizing clustering algorithms on a large cluster of commodity machines using the MapReduce framework have received a lot of attention. In this paper, we first propose the new density-based clustering algorithm, called DBCURE, which is robust to find clusters with varying densities and suitable for parallelizing the algorithm with MapReduce. We next develop DBCURE-MR, which is a parallelized DBCURE using MapReduce. While traditional density-based algorithms find each cluster one by one, our DBCURE-MR finds several clusters together in parallel. We prove that both DBCURE and DBCURE-MR find the clusters correctly based on the definition of density-based clusters. Our experimental results with various data sets confirm that DBCURE-MR finds clusters efficiently without being sensitive to the clusters with varying densities and scales up well with the MapReduce framework. •A density-based clustering algorithm DBCURE can find clusters with varying densities.•DBCURE is a generalization of DBSCAN using ellipsoidal neighborhoods.•We propose a parallel version of DBCURE, called DBCURE-MR, using MapReduce.•DBCURE-MR finds clusters correctly based on the definition of density-based clusters.•Experimental results show the efficiency and scalability of the proposed algorithms.
ISSN:0306-4379
1873-6076
DOI:10.1016/j.is.2013.11.002