Unified frameworks for high order Newton-Schulz and Richardson iterations: a computationally efficient toolkit for convergence rate improvement

Gespeichert in:
Bibliographische Detailangaben
Titel: Unified frameworks for high order Newton-Schulz and Richardson iterations: a computationally efficient toolkit for convergence rate improvement
Autoren: Stotsky, Alexander
Quelle: Journal of Applied Mathematics and Computing. 60(1-2):605-623
Schlagwörter: Richardson iteration · Neumann series · High order Newton-Schulz algorithm · Least squares estimation · Harmonic regressor · Strictly Diagonally Dominant Matrix · Symmetric positive definite matrix · Ill-conditioned matrix · Polynomial preconditioning · Matrix power series factorization · Computationally efficient matrix inversion algorithm · Simultaneous calculations
Beschreibung: Convergence rate and robustness improvement together with reduction of computational complexity are required for solving the system of linear equations in many applications such as system identification, signal and image processing, network analysis, machine learning and many others. Two unified frameworks (1) for convergence rate improvement of high order Newton-Schulz matrix inversion algorithms and (2) for combination of Richardson and iterative matrix inversion algorithms with improved convergence rate for estimation of the parameter vector are proposed. Recursive and computationally efficient version of new algorithms is developed for implementation on parallel computational units. In addition to unified description of the algorithms the frameworks include explicit transient models of estimation errors and convergence analysis. Simulation results confirm significant performance improvement of proposed algorithms in comparison with existing methods.
Dateibeschreibung: electronic
Zugangs-URL: https://research.chalmers.se/publication/516462
https://research.chalmers.se/publication/520750
https://link.springer.com/article/10.1007/s12190-018-01229-8
Datenbank: SwePub
Beschreibung
Abstract:Convergence rate and robustness improvement together with reduction of computational complexity are required for solving the system of linear equations in many applications such as system identification, signal and image processing, network analysis, machine learning and many others. Two unified frameworks (1) for convergence rate improvement of high order Newton-Schulz matrix inversion algorithms and (2) for combination of Richardson and iterative matrix inversion algorithms with improved convergence rate for estimation of the parameter vector are proposed. Recursive and computationally efficient version of new algorithms is developed for implementation on parallel computational units. In addition to unified description of the algorithms the frameworks include explicit transient models of estimation errors and convergence analysis. Simulation results confirm significant performance improvement of proposed algorithms in comparison with existing methods.
ISSN:15985865
DOI:10.1007/s12190-018-01229-8