AutoML with Parallel Genetic Algorithm for Fast Hyperparameters Optimization in Efficient IoT Time Series Prediction

With the development of artificial intelligence and the improvement of hardware computing power, deep learning models have become widely used in the Internet of Things (IoT) field, especially for analyzing spatiotemporal data collected by wireless sensors. Recurrent Neural Networks (RNN) such as Lon...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on industrial informatics Jg. 19; H. 9; S. 1 - 10
Hauptverfasser: Wu, Di, Guan, Qinghua, Fan, Zhe, Deng, Hanhui, Wu, Tao
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Piscataway IEEE 01.09.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:
Artificial intelligence
Automation
AutoML
Computational modeling
Datasets
Deep learning
Electronics packaging
Genetic algorithms
Internet of Things
Machine learning
Operators
Optimization
Parallel Genetic Algorithm
Recurrent neural networks
Sensors
Spatiotemporal data
Subgroups
Time series
Time series analysis
Training
ISSN:1551-3203, 1941-0050
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:With the development of artificial intelligence and the improvement of hardware computing power, deep learning models have become widely used in the Internet of Things (IoT) field, especially for analyzing spatiotemporal data collected by wireless sensors. Recurrent Neural Networks (RNN) such as Long Short-Term Memory (LSTM) network are generally used for these time series data. Hyperparameter settings of model training are regarded as essential factors for the performance of deep learning models. Manually optimizing hyperparameters not only cost more resources but also be more likely to set hyperparameters that follow stereotypes, resulting in unreasonable hyperparameter settings and poor model performance. As one of the most important fields in Automated Machine Learning (AutoML) research, automated hyper-parameter optimization (HPO) mainly includes grid search, hyperparameter search based on genetic algorithm, etc. Whereas these methods have their own drawbacks. In this paper, an automated hyper-parameter optimization method based on parallel genetic algorithm (PGA) is proposed. According to the process of PGA, this paper divided hyperparameter optimization into several stages, including population initialization, fitness function, tournament selection, crossover operators, mutation operators, subgroup exchange, and end of evolution. Then the proposed hyperparameter optimization method is implemented in LSTM models and tested on two different time series datasets collected by real-world IoT sensors. By comparing our proposed method with other mainstream HPO methods in different datasets, it is proved that our HPO method based on PGA shows better performance on both time costs and prediction results.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1551-3203
1941-0050
DOI:10.1109/TII.2022.3231419