An efficient vertical-Apriori Mapreduce algorithm for frequent item-set mining

Algorithms such as OPUS and Apriori-based Mapreduce for enhancing the efficiency of mining frequent item-set for pattern recognition application from transactional dataset have been proposed in the literature. Most of these algorithms are, however, evaluated offline on relatively small data size. Wh...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA) S. 108 - 112
Hauptverfasser: Dawei Sun, Lee, Vincent Cs, Burstein, Frada, Haghighi, Pari Delir
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.06.2015
Schlagworte:
Apriori
attribute identifier
Big data
Dairy products
Data mining
Distributed databases
Frequent item-set mining
Generators
Itemsets
Mapreduce
Sugar
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Algorithms such as OPUS and Apriori-based Mapreduce for enhancing the efficiency of mining frequent item-set for pattern recognition application from transactional dataset have been proposed in the literature. Most of these algorithms are, however, evaluated offline on relatively small data size. When confronting with larger data size, which is inevitable for todays organisation, most if not all algorithms performed not as efficient as required to meet the real time big data driven decision making needs. We therefore attempt to solve these efficiency problems by proposing a VAMR (Vertical-Apriori Map-reduce) algorithm. VAMR is based on data attribute identifier which is exploited as capability metric for mining frequency item-set from large dataset in a single node (for example in a single site enterprise) that has no distributed and parallel computing system environment. Our evaluations using synthetic datasets and data from public repository suggest that VAMR algorithm can offer superior efficiency in mining frequent item-sets from large transaction dataset.
DOI:10.1109/ICIEA.2015.7334093