Structured learning for unsupervised feature selection with high-order matrix factorization

•Propose an efficient convergent algorithm for high-order matrix factorization.•Construct a unified framework for feature selection and data fusion.•Present one globally structured learning regularizer via sparse representation.•Establish a new method for optimization problem with orthogonality cons...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Expert systems with applications Jg. 140; S. 112878
Hauptverfasser: Wang, Shiping, Chen, Jiawei, Guo, Wenzhong, Liu, Genggeng
Format: Journal Article
Sprache:Englisch
Veröffentlicht: New York Elsevier Ltd 01.02.2020
Elsevier BV
Schlagworte:
Algorithms
Canonical forms
Clustering
Convergence
Data fusion
Feature selection
Graph Laplacian
High-order matrix factorization
Iterative algorithms
Local learning
Machine learning
Performance enhancement
Product acceptance
Production planning
Graph Laplacian
Data fusion
Feature selection
Local learning
High-order matrix factorization
Machine learning
ISSN:0957-4174, 1873-6793
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:•Propose an efficient convergent algorithm for high-order matrix factorization.•Construct a unified framework for feature selection and data fusion.•Present one globally structured learning regularizer via sparse representation.•Establish a new method for optimization problem with orthogonality constraints. Feature selection aims at searching the most discriminative and relevant features from high-dimensional data to improve the performance of certain learning tasks. Whereas, irrelevant or redundant features may increase the over-fitting risk of consequent learning algorithms. Structured learning of feature selection is to embed intrinsic structures of data, such as geometric structures and manifold structures, resulting in the improvement of learning performance. In this paper, three types of structured regularizers are embedded into the feature selection framework and an iterative algorithm with proved convergence for feature selection problem is proposed. First, serving as crucial representation pipelines of local structures, three types of local learning regularizers, including graph Laplacian, neighborhood preservation and sparsity regularizer, are defined. Second, the local and global structures are integrated into one joint framework for the feature selection problem. Third, the framework is formulated as the canonical form of high-order matrix factorizations and then an efficient convergent iterative algorithm is proposed for the problem. Besides, the proposed framework is further extended to multi-view feature selection and fusion problems from an algorithmic view. Finally, the proposed algorithm is tested on eight publicly available datasets and compared to several state-of-the-art feature selection methods. Experimental results demonstrate the superiority of the proposed method against the compared algorithms in terms of clustering performance.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0957-4174
1873-6793
DOI:10.1016/j.eswa.2019.112878