An Efficient Solution to Structured Optimization Problems using Recursive Matrices

We present a linear algebra framework for structured matrices and general optimization problems. The matrices and matrix operations are defined recursively to efficiently capture complex structures and enable advanced compiler optimization. In addition to common dense and sparse matrix types, we def...

Full description

Saved in:
Bibliographic Details
Published in:Computer graphics forum Vol. 38; no. 8; pp. 33 - 39
Main Authors: Rückert, D., Stamminger, M.
Format: Journal Article
Language:English
Published: Oxford Blackwell Publishing Ltd 01.11.2019
Subjects:
Algorithms
CCS Concepts
Computer vision
Computing methodologies → Symbolic and algebraic algorithms
Linear algebra
Linear algebra algorithms
Mathematical analysis
Matrix methods
Optimization
Optimization algorithms
Sparse matrices
Structured matrices
ISSN:0167-7055, 1467-8659
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present a linear algebra framework for structured matrices and general optimization problems. The matrices and matrix operations are defined recursively to efficiently capture complex structures and enable advanced compiler optimization. In addition to common dense and sparse matrix types, we define mixed matrices, which allow every element to be of a different type. Using mixed matrices, the low‐ and high‐level structure of complex optimization problems can be encoded in a single type. This type is then analyzed at compile time by a recursive linear solver that picks the optimal algorithm for the given problem. For common computer vision problems, our system yields a speedup of 3–5 compared to other optimization frameworks. The BLAS performance is benchmarked against the MKL library. We achieve a significant speedup in block‐SPMV and block‐SPMM. This work is implemented and released open‐source as a header‐only extension to the C+ + math library Eigen.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0167-7055
1467-8659
DOI:10.1111/cgf.13758