Kernel‐risk‐sensitive conjugate gradient algorithm with Student's‐t distribution based random fourier features

Kernel‐risk‐sensitive loss (KRSL) achieves an efficient performance surface, which has been applied in the kernel adaptive filters (KAFs) successfully. However, the KRSL based KAFs use the stochastic gradient descent (SGD) method in the optimization, which usually suffer from inadequate accuracy wit...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Electronics letters Ročník 59; číslo 9
Hlavní autoři: Tang, Shenjie, Li, Xifeng, Bi, Dongjie, Tang, Yu, Xie, Xuan, Li, Zhenggui, Xie, Yongle
Médium: Journal Article
Jazyk:angličtina
Vydáno: Stevenage John Wiley & Sons, Inc 01.05.2023
Témata:
Accuracy
Adaptive filters
adaptive signal processing
Algorithms
Conjugate gradient method
Convexity
Dictionaries
Fourier transforms
Methods
Normal distribution
Optimization
Risk
ISSN:0013-5194, 1350-911X
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Kernel‐risk‐sensitive loss (KRSL) achieves an efficient performance surface, which has been applied in the kernel adaptive filters (KAFs) successfully. However, the KRSL based KAFs use the stochastic gradient descent (SGD) method in the optimization, which usually suffer from inadequate accuracy with the slow convergence speed. In this letter, the conjugate gradient method is adopted in the optimization of KRSL function, and the problem of non‐convexity in KRSL is addressed by twice half‐quadratic (HQ) methods. For sparsification, a novel Student's‐t distribution based random Fourier feature (St‐RFF) method for performance improvement of the conventional RFF method. Thus, a novel Student's‐t distribution based random Fourier features kernel‐risk‐sensitive conjugate gradient (St‐RFFKRSCG) algorithm is proposed. Simulations on Mackey‐Glass time series prediction under non‐Gaussian noises confirm the superiorities in terms of accuracy performance, robustness, and computational cost. The kernel‐risk‐sensitive loss function is first transformed into a global convex quadratic form using twice half‐quadratic (HQ) methods. Then, the CG method can be adopted, effectively. A novel Student's‐t distribution‐based random Fourier feature (St‐RFF) method is developed to enhance the efficiency of conventional RFF method. Applying St‐RFF and the CG method, we propose a novel St‐RFF based kernel‐ risk‐sensitive conjugate gradient (St‐RFFKRSCG) algorithm, which achieves comparable filtering accuracy against non‐Gaussian noises with a low computational complexity.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0013-5194
1350-911X
DOI:10.1049/ell2.12809