Parallel Algorithms for Constrained Tensor Factorization via Alternating Direction Method of Multipliers

Tensor factorization has proven useful in a wide range of applications, from sensor array processing to communications, speech and audio signal processing, and machine learning. With few recent exceptions, all tensor factorization algorithms were originally developed for centralized, in-memory compu...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on signal processing Vol. 63; no. 20; pp. 5450 - 5463
Main Authors: Liavas, Athanasios P., Sidiropoulos, Nicholas D.
Format: Journal Article
Language:English
Published: New York IEEE 15.10.2015
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Algorithms
Analytical models
Computer architecture
Matrices
Optimization
PARAFAC model
parallel algorithms
Signal processing algorithms
Sparse matrices
Tensile stress
Tensor decomposition
ISSN:1053-587X, 1941-0476
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Tensor factorization has proven useful in a wide range of applications, from sensor array processing to communications, speech and audio signal processing, and machine learning. With few recent exceptions, all tensor factorization algorithms were originally developed for centralized, in-memory computation on a single machine; and the few that break away from this mold do not easily incorporate practically important constraints, such as non-negativity. A new constrained tensor factorization framework is proposed in this paper, building upon the Alternating Direction Method of Multipliers (ADMoM). It is shown that this simplifies computations, bypassing the need to solve constrained optimization problems in each iteration; and it naturally leads to distributed algorithms suitable for parallel implementation. This opens the door for many emerging big data-enabled applications. The methodology is exemplified using non-negativity as a baseline constraint, but the proposed framework can incorporate many other types of constraints. Numerical experiments are encouraging, indicating that ADMoM-based non-negative tensor factorization (NTF) has high potential as an alternative to state-of-the-art approaches.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1053-587X
1941-0476
DOI:10.1109/TSP.2015.2454476