Iterative shrinkage-thresholding algorithm with inertia and dry friction for convolutional dictionary learning

The iterative shrinkage-thresholding algorithm (ISTA) is often used to address the convolutional dictionary learning problem. However, the ISTA algorithm is easy to fall into the local minimum, and some atoms in the convolution dictionary change little when updated. Therefore, in this paper, we prop...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Digital signal processing Ročník 140; s. 104139
Hlavní autoři: Li, Pengyu, Zhang, Yali, Li, Ze, Wang, Jinjia
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier Inc 01.08.2023
Témata:
Convolutional dictionary learning
Dry friction
Finite convergence
Inertia algorithm
Iterative shrinkage-thresholding algorithm
Finite convergence
Iterative shrinkage-thresholding algorithm
Convolutional dictionary learning
Inertia algorithm
Dry friction
ISSN:1051-2004, 1095-4333
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:The iterative shrinkage-thresholding algorithm (ISTA) is often used to address the convolutional dictionary learning problem. However, the ISTA algorithm is easy to fall into the local minimum, and some atoms in the convolution dictionary change little when updated. Therefore, in this paper, we propose an improved ISTA algorithm, iterative shrinkage-thresholding algorithm with inertia and dry friction (ISTA-IDF). An inertia is introduced to avoid falling into the local minimum but generating an oscillatory behavior since the values of the objective function is not monotonic decreasing, which can be alleviated by dry friction. From the perspective of dynamics, ISTA can be seen as an iteration algorithm deduced by a forward-backward Euler discretization of a first-order dynamic system, and ISTA-IDF can be regarded as the forward-backward Euler discretization of a second-order heavy-ball system with dry friction (HBDF). So using the dynamics theory, we establish the linear and finite convergence property of ISTA-IDF. The experimental results on image reconstruction and denoising tasks demonstrate the superior performance of the proposed ISTA-IDF compared with ISTA and FISTA. •This paper proposes an improved ISTA algorithm with the inertia and dry friction damping terms for the CDL problem.•The linear and finite convergence property of ISTA-IDF is established.•We conducted experiments on image reconstruction and denoising to demonstrate the effectiveness of ISTA-IDF.
ISSN:1051-2004
1095-4333
DOI:10.1016/j.dsp.2023.104139