A hybrid anomaly detection method for high dimensional data

Anomaly detection of high-dimensional data is a challenge because the sparsity of the data distribution caused by high dimensionality hardly provides rich information distinguishing anomalous instances from normal instances. To address this, this article proposes an anomaly detection method combinin...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:PeerJ. Computer science Ročník 9; s. e1199
Hlavní autoři: Zhang, Xin, Wei, Pingping, Wang, Qingling
Médium: Journal Article
Jazyk:angličtina
Vydáno: United States PeerJ, Inc 12.01.2023
PeerJ Inc
Témata:
Algorithms and Analysis of Algorithms
Anomalies
Anomaly detection
Autoencoder
Classification
Data compression
Data Mining and Machine Learning
Data Science
Feature extraction
High-dimensional data
Least squares
Support vector machine
Support vector machines
High-dimensional data
Support vector machine
Autoencoder
Anomaly detection
ISSN:2376-5992, 2376-5992
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Anomaly detection of high-dimensional data is a challenge because the sparsity of the data distribution caused by high dimensionality hardly provides rich information distinguishing anomalous instances from normal instances. To address this, this article proposes an anomaly detection method combining an autoencoder and a sparse weighted least squares-support vector machine. First, the autoencoder is used to extract those low-dimensional features of high-dimensional data, thus reducing the dimension and the complexity of the searching space. Then, in the low-dimensional feature space obtained by the autoencoder, the sparse weighted least squares-support vector machine separates anomalous and normal features. Finally, the learned class labels to be used to distinguish normal instances and abnormal instances are outputed, thus achieving anomaly detection of high-dimensional data. The experiment results on real high-dimensional datasets show that the proposed method wins over competing methods in terms of anomaly detection ability. For high-dimensional data, using deep methods can reconstruct the layered feature space, which is beneficial for gaining those advanced anomaly detection results.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:2376-5992
2376-5992
DOI:10.7717/peerj-cs.1199