Two hybrid conjugate gradient based algorithms on Riemannian manifolds with adaptive restart strategy for nonconvex optimization problems

In this paper, we propose two hybrid conjugate gradient algorithms for solving nonconvex optimization problems on Riemannian manifolds. The conjugate parameter of the first method extends a hybrid formula [Comput. Oper. Res. 159 (2023) 106341] from Euclidean to Riemannian spaces. The conjugate param...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Journal of computational and applied mathematics Ročník 461; s. 116452
Hlavní autoři: Jiang, Meixuan, Wang, Yun, Shao, Hu, Wu, Ting, Sun, Weiwei
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier B.V 01.06.2025
Témata:
Adaptive restart strategy
Global convergence
Hybrid conjugate gradient method
Riemannian optimization
Global convergence
Hybrid conjugate gradient method
Riemannian optimization
Adaptive restart strategy
ISSN:0377-0427
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:In this paper, we propose two hybrid conjugate gradient algorithms for solving nonconvex optimization problems on Riemannian manifolds. The conjugate parameter of the first method extends a hybrid formula [Comput. Oper. Res. 159 (2023) 106341] from Euclidean to Riemannian spaces. The conjugate parameter of the second method integrates the Fletcher–Reeves conjugate parameter with another flexible conjugate parameter. An adaptive restart strategy is then incorporated into their respective search directions to enhance their theoretical properties and computational efficiency. As a result, both methods independently generate sufficient descent directions regardless of any stepsize strategy on Riemannian manifolds. Under typical assumptions and using the Riemannian weak Wolfe conditions to generate stepsize, the global convergence results of these two families are demonstrated. Numerical comparisons with existing methods using different Riemannian optimization scenarios verify the effectiveness of our proposed methods.
ISSN:0377-0427
DOI:10.1016/j.cam.2024.116452