The Improvement of Dropout Strategy Based on Two Evolutionary Algorithms

Dropout strategy is a simple and common regularization method in the construction of deep network that it can control the status of units in the Dropout layers according to the constant probability values in the training processes to prevent the training from overfitting. However, the probability va...

Full description

Saved in:
Bibliographic Details
Published in:2018 IEEE International Conference on Robotics and Biomimetics (ROBIO) pp. 814 - 819
Main Authors: Chen, Tianhao, Jia, Wenchuan, Sun, Yi
Format: Conference Proceeding
Language:English
Published: IEEE 01.12.2018
Subjects:
AI-Based Methods
Big Data in Robotics and Automation
Computer Vision for Other Robotic Applications
Dropout strategy
Encoding
Evolutionary computation
Genetic algorithms
Mathematical model
Sociology
Statistics
Training
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Dropout strategy is a simple and common regularization method in the construction of deep network that it can control the status of units in the Dropout layers according to the constant probability values in the training processes to prevent the training from overfitting. However, the probability values of the Dropout strategy are single and decided by users, which means that we need more training iterations to receive better results and avoid less fitting problem. In this paper, two evolutionary algorithms, genetic algorithm and differential evolution algorithm are used to optimize the set probability values of network units to improve dropout strategy and they are proved to be able to increase the accuracy of the original method to about 5%.
DOI:10.1109/ROBIO.2018.8665324