The Improvement of Dropout Strategy Based on Two Evolutionary Algorithms

Dropout strategy is a simple and common regularization method in the construction of deep network that it can control the status of units in the Dropout layers according to the constant probability values in the training processes to prevent the training from overfitting. However, the probability va...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:2018 IEEE International Conference on Robotics and Biomimetics (ROBIO) s. 814 - 819
Hlavní autori: Chen, Tianhao, Jia, Wenchuan, Sun, Yi
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: IEEE 01.12.2018
Predmet:
AI-Based Methods
Big Data in Robotics and Automation
Computer Vision for Other Robotic Applications
Dropout strategy
Encoding
Evolutionary computation
Genetic algorithms
Mathematical model
Sociology
Statistics
Training
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Dropout strategy is a simple and common regularization method in the construction of deep network that it can control the status of units in the Dropout layers according to the constant probability values in the training processes to prevent the training from overfitting. However, the probability values of the Dropout strategy are single and decided by users, which means that we need more training iterations to receive better results and avoid less fitting problem. In this paper, two evolutionary algorithms, genetic algorithm and differential evolution algorithm are used to optimize the set probability values of network units to improve dropout strategy and they are proved to be able to increase the accuracy of the original method to about 5%.
DOI:10.1109/ROBIO.2018.8665324