A Distributed Block Chebyshev-Davidson Algorithm for Parallel Spectral Clustering

We develop a distributed Block Chebyshev-Davidson algorithm to solve large-scale leading eigenvalue problems for spectral analysis in spectral clustering. First, the efficiency of the Chebyshev-Davidson algorithm relies on the prior knowledge of the eigenvalue spectrum, which could be expensive to e...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Journal of scientific computing Ročník 98; číslo 3; s. 69
Hlavní autori: Pang, Qiyuan, Yang, Haizhao
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: New York Springer US 01.03.2024
Springer Nature B.V
Predmet:
Algorithms
Chebyshev approximation
Clustering
Communication
Computational Mathematics and Numerical Analysis
Costs
Data science
Eigenvalues
Eigenvectors
Mathematical and Computational Engineering
Mathematical and Computational Physics
Mathematics
Mathematics and Statistics
Sparsity
Spectrum analysis
Theoretical
Parallel computing
Sparse symmetric matrices
Spectral clustering
Spectral analysis
ISSN:0885-7474, 1573-7691
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:We develop a distributed Block Chebyshev-Davidson algorithm to solve large-scale leading eigenvalue problems for spectral analysis in spectral clustering. First, the efficiency of the Chebyshev-Davidson algorithm relies on the prior knowledge of the eigenvalue spectrum, which could be expensive to estimate. This issue can be lessened by the analytic spectrum estimation of the Laplacian or normalized Laplacian matrices in spectral clustering, making the proposed algorithm very efficient for spectral clustering. Second, to make the proposed algorithm capable of analyzing big data, a distributed and parallel version has been developed with attractive scalability. The speedup by parallel computing is approximately equivalent to p , where p denotes the number of processes. Numerical results will be provided to demonstrate its efficiency in spectral clustering and scalability advantage over existing eigensolvers used for spectral clustering in parallel computing environments.
Bibliografia:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0885-7474
1573-7691
DOI:10.1007/s10915-024-02455-y