Ensemble classifier design by parallel distributed implementation of genetic fuzzy rule selection for large data sets

Evolutionary algorithms have been actively applied to knowledge discovery, data mining and machine learning under the name of genetics-based machine learning (GBML). The main advantage of using evolutionary algorithms in those application areas is their flexibility: Various knowledge extraction crit...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:IEEE Congress on Evolutionary Computation s. 1 - 8
Hlavní autoři: Nojima, Yusuke, Mihara, Shingo, Ishibuchi, Hisao
Médium: Konferenční příspěvek
Jazyk:angličtina
japonština
Vydáno: IEEE 01.07.2010
Témata:
Accuracy
Classification algorithms
Data mining
Evolutionary computation
Genetics
Training
Training data
ISBN:1424469090, 9781424469093
ISSN:1089-778X
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Evolutionary algorithms have been actively applied to knowledge discovery, data mining and machine learning under the name of genetics-based machine learning (GBML). The main advantage of using evolutionary algorithms in those application areas is their flexibility: Various knowledge extraction criteria such as accuracy and complexity can be easily utilized as fitness functions. On the other hand, the main disadvantage is their large computation load. It is not easy to apply evolutionary algorithms to large data sets. The scalability improvement to large data sets is one of the main research issues in GBML. In our former studies, we proposed an idea of parallel distributed implementation of GBML and examined its effectiveness for genetic fuzzy rule selection. The point of our idea was to realize a quadratic speed-up by dividing not only a population but also training data. Training data subsets were periodically rotated over sub-populations in order to prevent each sub-population from over-fitting to a specific training data subset. In this paper, we propose the use of parallel distributed implementation for the design of ensemble classifiers. An ensemble classifier is designed by combining base classifiers, each of which is obtained from each sub-population. Through computational experiments on parallel distributed genetic fuzzy rule selection, we examine the generalization ability of designed ensemble classifiers under various settings with respect to the size of training data subsets and their rotation frequency.
ISBN:1424469090
9781424469093
ISSN:1089-778X
DOI:10.1109/CEC.2010.5586393