Constant Approximation Algorithm for Minimizing Concave Impurity

Partitioning algorithms play a key role in many scientific and engineering disciplines. A partitioning algorithm divides a set into a number of disjoint subsets or partitions. Often, the quality of the resulted partitions is measured by the amount of impurity in each partition, the smaller impurity...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings of the ... IEEE International Conference on Acoustics, Speech and Signal Processing (1998) pp. 3635 - 3639
Main Authors: Nguyen, Thuan, Le, Hoang, Nguyen, Thinh
Format: Conference Proceeding
Language:English
Published: IEEE 06.06.2021
Subjects:
approximation
Approximation algorithms
Conferences
Entropy
Impurities
impurity
Partition
Partitioning algorithms
Signal processing
Signal processing algorithms
ISSN:2379-190X
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Partitioning algorithms play a key role in many scientific and engineering disciplines. A partitioning algorithm divides a set into a number of disjoint subsets or partitions. Often, the quality of the resulted partitions is measured by the amount of impurity in each partition, the smaller impurity the higher quality of the partitions. Let M be the number of N-dimensional elements in a set and K be the number of desired partitions, then an exhaustive search over all the possible partitions to find a minimum partition has the complexity of O(K M ) which quickly becomes impractical for many applications with modest values of K and M. Thus, many approximate algorithms with polynomial time complexity have been proposed, but few provide the bounded guarantee. In this paper, we propose a linear time algorithm with bounded guarantee based on the maximum likelihood principle. Furthermore, the guarantee bound of the proposed algorithm is better than the state-of-the-art method in [1] for many impurity functions, and at the same time, for K ≥ N, the computational complexity is reduced from O(M 3 ) to O(M).
ISSN:2379-190X
DOI:10.1109/ICASSP39728.2021.9415005