Robust support vector machine classifier with truncated loss function by gradient algorithm

The support vector machine (SVM) is an increasingly important tool in machine learning. Despite its popularity, the SVM classifier can be adversely affected under the presence of noise in the training dataset. The SVM can be fit in the regularization framework of Loss ＋ Penalty. The loss function pl...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computers & industrial engineering Jg. 172; S. 108630
Hauptverfasser: Zhu, Wenxin, Song, Yunyan, Xiao, Yingyuan
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Elsevier Ltd 01.10.2022
Schlagworte:
Accelerated proximal gradient algorithm
AUC
Friedman test
Huberized truncated pinball loss
Nemenyi post hoc test
Support vector machine
Friedman test
Nemenyi post hoc test
Support vector machine
Accelerated proximal gradient algorithm
Huberized truncated pinball loss
AUC
ISSN:0360-8352, 1879-0550
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The support vector machine (SVM) is an increasingly important tool in machine learning. Despite its popularity, the SVM classifier can be adversely affected under the presence of noise in the training dataset. The SVM can be fit in the regularization framework of Loss ＋ Penalty. The loss function plays an essential role which is used to keep the fidelity of the resulting model to the data. Most SVMs use convex losses, however, they often suffer from the negative impact of points far away from their own classes. This paper proposes a new nonconvex differentiable loss, namely huberied truncated pinball loss, which can be able to reduce the effects of noise in the training sample. The SVM classifier with the huberied truncated pinball loss (HTPSVM) is proposed. The HTPSVM combines the elastic net penalty and the nonconvex huberied truncated pinball loss. It inherits the benefits of both ℓ1 and ℓ2 norm regularizers. The HTPSVM involves nonconvex minimization, the accelerated proximal gradient (APG) algorithm was used to solve the corresponding optimization. To evaluate the performance of classifiers, classification accuracy and area under ROC curve (AUC) were employed as the accuracy indicators. The numerical results show that our new classifier is effective. Friedman and Nemenyi post hoc tests of the experimental results indicate that the proposed HTPSVM is shown to be more robust to noise than HSVM, PSVM and HHSVM. •We propose a novel robust and smooth loss function.•Accelerated proximal gradient algorithm is applied to solve the proposed method.•Classification accuracy and AUC are employed to evaluate the performance of classifiers.•Statistical evaluation of the experimental results shows the effectiveness of the proposed method.
ISSN:0360-8352
1879-0550
DOI:10.1016/j.cie.2022.108630