A fast continuous time approach for non-smooth convex optimization using Tikhonov regularization technique

In this paper we would like to address the classical optimization problem of minimizing a proper, convex and lower semicontinuous function via the second order in time dynamics, combining viscous and Hessian-driven damping with a Tikhonov regularization term. In our analysis we heavily exploit the M...

Full description

Saved in:
Bibliographic Details
Published in:Computational optimization and applications Vol. 87; no. 2; pp. 531 - 569
Main Author: Karapetyants, Mikhail A.
Format: Journal Article
Language:English
Published: New York Springer US 01.03.2024
Springer Nature B.V
Subjects:
Convergence
Convex analysis
Convex and Discrete Geometry
Convexity
Damping
Management Science
Mathematics
Mathematics and Statistics
Operations Research
Operations Research/Decision Theory
Optimization
Regularization
Statistics
Strong convergence
65K05
Nonsmooth convex optimization
Moreau envelope
Proximal operator
Hessian-driven damping
Tikhonov regularization
37N40
90C25
Damped inertial dynamics
65K10
46N10
49M99
ISSN:0926-6003, 1573-2894
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper we would like to address the classical optimization problem of minimizing a proper, convex and lower semicontinuous function via the second order in time dynamics, combining viscous and Hessian-driven damping with a Tikhonov regularization term. In our analysis we heavily exploit the Moreau envelope of the objective function and its properties as well as Tikhonov regularization properties, which we extend to a nonsmooth case. We introduce the setting, which at the same time guarantees the fast convergence of the function (and Moreau envelope) values and strong convergence of the trajectories of the system to a minimal norm solution—the element of the minimal norm of all the minimizers of the objective. Moreover, we deduce the precise rates of convergence of the values for the particular choice of parameters. Various numerical examples are also included as an illustration of the theoretical results.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:0926-6003
1573-2894
DOI:10.1007/s10589-023-00536-6