Iterative Reweighted Minimization for Generalized Norm/Quasi-Norm Difference Regularized Unconstrained Nonlinear Programming

In this paper, we study the minimization of l p-q (0 <; p ≤ 1, q ≥ 1, p=6q), the general difference of l p and l q norms/quasi-norms, as a nonconvex metric for solving unconstrained nonlinear programming. We first establish an exact (stable) sparse recovery condition for the l p-q constrained pro...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access Vol. 7; pp. 153102 - 153122
Main Authors: Cen, Yi, Zhang, Linna, Wang, Ke, Cen, Yigang
Format: Journal Article
Language:English
Published: Piscataway IEEE 2019
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
<italic xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">lₚ –<italic xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">q -minimization
<italic xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">lₚ –<italic xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">q -null space property
Algorithms
Approximation algorithms
Convergence
Difference of convex/nonconvex functions algorithm
Iterative algorithms
Iterative methods
iterative reweighted <italic xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">lₜ minimization
Measurement
Methods
Minimization
Nonlinear programming
Norms
Optimization
Recovery
Sensors
ISSN:2169-3536, 2169-3536
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we study the minimization of l p-q (0 <; p ≤ 1, q ≥ 1, p=6q), the general difference of l p and l q norms/quasi-norms, as a nonconvex metric for solving unconstrained nonlinear programming. We first establish an exact (stable) sparse recovery condition for the l p-q constrained problem under an extended restricted p-isometry property and then propose an iterative algorithm for the l p-q regularized unconstrained minimization based on the t-variant of the iterative reweighted minimization method (t ≥ 1) and ε-approximation. We theoretically prove that the proposed algorithm converges to a stationary point satisfying the first-order optimality condition. In particular, we provide a convergence rate analysis of the method and show that the local convergence is superlinear under a certain condition. Our extensive experimental results demonstrate that if the sensing matrix satisfies the restricted p-isometry property, the proposed iterative reweighted minimization method for the l p-q unconstrained problem generally outperforms the existing methods (especially for those methods based on the difference of norms). For the ill-conditioned sensing matrix, a variant of our method via the difference of convex functions algorithm (DCA) shows better performance on the frequency of success for signal sparse recovery. Likewise, our methods are illustrated to be valid and generally outperform the existing methods for real images.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2019.2948426