Generalized Matrix Local Low Rank Representation by Random Projection and Submatrix Propagation

Matrix low rank approximation is an effective method to reduce or eliminate the statistical redundancy of its components. Compared with the traditional global low rank methods such as singular value decomposition (SVD), local low rank approximation methods are more advantageous to uncover interpreta...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings / International Conference on Knowledge Discovery and Data Mining Vol. 2023; p. 390
Main Authors: Dang, Pengtao, Zhu, Haiqi, Guo, Tingbo, Wan, Changlin, Zhao, Tong, Salama, Paul, Wang, Yijie, Cao, Sha, Zhang, Chi
Format: Journal Article
Language:English
Published: United States 01.08.2023
Subjects:
Representation learning
Randomized matrix approximation
Computing methodologies→Machine learning algorithms
Random projection
Sub-matrix detection
Local low rank matrix
ISSN:2154-817X
Online Access:Get more information
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Matrix low rank approximation is an effective method to reduce or eliminate the statistical redundancy of its components. Compared with the traditional global low rank methods such as singular value decomposition (SVD), local low rank approximation methods are more advantageous to uncover interpretable data structures when clear duality exists between the rows and columns of the matrix. Local low rank approximation is equivalent to low rank submatrix detection. Unfortunately, existing local low rank approximation methods can detect only submatrices of specific mean structure, which may miss a substantial amount of true and interesting patterns. In this work, we develop a novel matrix computational framework called RPSP (Random Probing based submatrix Propagation) that provides an effective solution for the general matrix local low rank representation problem. RPSP detects local low rank patterns that grow from small submatrices of low rank property, which are determined by a random projection approach. RPSP is supported by theories of random projection. Experiments on synthetic data demonstrate that RPSP outperforms all state-of-the-art methods, with the capacity to robustly and correctly identify the low rank matrices when the pattern has a similar mean as the background, background noise is heteroscedastic and multiple patterns present in the data. On real-world datasets, RPSP also demonstrates its effectiveness in identifying interpretable local low rank matrices.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:2154-817X
DOI:10.1145/3580305.3599361