Beyond EM: A faster Bayesian linear regression algorithm without matrix inversions
•We propose a novel matrix inversion free algorithm for solving the Bayesian linear regression problem with Gaussian priors.•Compared with the conventional gradient based and EM algorithms, our proposed one runs significantly faster while achieving the similar precision performance.•An iterative met...
Saved in:
| Published in: | Neurocomputing (Amsterdam) Vol. 378; pp. 435 - 440 |
|---|---|
| Main Author: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
Elsevier B.V
22.02.2020
|
| Subjects: | |
| ISSN: | 0925-2312, 1872-8286 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | •We propose a novel matrix inversion free algorithm for solving the Bayesian linear regression problem with Gaussian priors.•Compared with the conventional gradient based and EM algorithms, our proposed one runs significantly faster while achieving the similar precision performance.•An iterative method from a perspective of latent matrices is proposed for optimal search without breaking the symmetric positive definite manifold constraint.
The Bayesian linear regression is a useful tool for many scientific communities. This paper presents a novel algorithm for solving the Bayesian linear regression problem with Gaussian priors, which shares the same spirit as the gradient based methods. In addition, the standard scheme for this task, the Expectation Maximization (EM) algorithm, involves matrix inversions but our proposed algorithm is free of. Numerical experiments demonstrate that the proposed algorithm performs as well as the gradient based and EM algorithms in term of precision, but runs significantly faster than the gradient based and EM algorithms. Due to its matrix-inversion-free nature, the algorithm of this paper is a viable alternative to the competing methods available in the literature. |
|---|---|
| ISSN: | 0925-2312 1872-8286 |
| DOI: | 10.1016/j.neucom.2019.10.061 |