The Improvement of Dropout Strategy Based on Two Evolutionary Algorithms

Dropout strategy is a simple and common regularization method in the construction of deep network that it can control the status of units in the Dropout layers according to the constant probability values in the training processes to prevent the training from overfitting. However, the probability va...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2018 IEEE International Conference on Robotics and Biomimetics (ROBIO) s. 814 - 819
Hlavní autoři: Chen, Tianhao, Jia, Wenchuan, Sun, Yi
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.12.2018
Témata:
AI-Based Methods
Big Data in Robotics and Automation
Computer Vision for Other Robotic Applications
Dropout strategy
Encoding
Evolutionary computation
Genetic algorithms
Mathematical model
Sociology
Statistics
Training
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Dropout strategy is a simple and common regularization method in the construction of deep network that it can control the status of units in the Dropout layers according to the constant probability values in the training processes to prevent the training from overfitting. However, the probability values of the Dropout strategy are single and decided by users, which means that we need more training iterations to receive better results and avoid less fitting problem. In this paper, two evolutionary algorithms, genetic algorithm and differential evolution algorithm are used to optimize the set probability values of network units to improve dropout strategy and they are proved to be able to increase the accuracy of the original method to about 5%.
DOI:10.1109/ROBIO.2018.8665324