Covert fault detection with imbalanced data using an improved autoencoder for optical networks

Covert faults are characterized by the performance parameters falling within the normal range, without any observable abnormalities. These types of faults pose a significant risk as they present no apparent warning signs of potential danger. Therefore, it is crucial to establish an efficient covert...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Journal of optical communications and networking Ročník 15; číslo 11; s. 913 - 924
Hlavní autoři: Zhang, Chunyu, Zhang, Min, Liu, Songlin, Liu, Zhuo, Wang, Danshi
Médium: Journal Article
Jazyk:angličtina
Vydáno: Piscataway Optica Publishing Group 01.11.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Témata:
Abnormalities
Adaptive optics
Data analysis
Data models
Decoding
Error detection
Fault detection
Faults
Machine learning
Monitoring
Optical communication
Optical fiber networks
Principal components analysis
Reconstruction
Training
ISSN:1943-0620, 1943-0639
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Covert faults are characterized by the performance parameters falling within the normal range, without any observable abnormalities. These types of faults pose a significant risk as they present no apparent warning signs of potential danger. Therefore, it is crucial to establish an efficient covert fault detection method to ensure the reliable and stable operation of optical networks. Data-driven technology, which reveals the internal relations and data patterns between the historical data by mining and analyzing the historical data, offers a new perspective for covert fault detection. However, equipment failures are extremely rare in real optical network systems, and the data imbalance of covert fault samples poses a challenge for standard machine learning classifiers in learning precise decision boundaries. To address this challenge, we propose a fault detection scheme based on an improved autoencoder for covert fault detection under data imbalance. The designed covert fault detection model exclusively utilizes normal samples during training and remains unaffected by data imbalance. Specifically, the model is specifically designed according to a number of encoder and decoder components to learn the normal sample data patterns in the latent space and detect covert faults based on the reconstruction errors in that space. To validate the proposed scheme, we conducted experiments using actual backbone data. According to the results, the detection accuracy and F1 score of the designed model on the test set were 0.9811 and 0.9527, and the false negative and false positive rates were 0.0026 and 0.0227, respectively. Furthermore, the visualization of the latent space reconstruction error principle for detecting covert faults was implemented using the principal component analysis dimension reduction and scatter plots.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1943-0620
1943-0639
DOI:10.1364/JOCN.502937