The dropout learning algorithm

Dropout is a recently introduced algorithm for training neural networks by randomly dropping units during training to prevent their co-adaptation. A mathematical analysis of some of the static and dynamic properties of dropout is provided using Bernoulli gating variables, general enough to accommoda...

Celý popis

Uložené v:

Podrobná bibliografia
Vydané v:	Artificial intelligence Ročník 210; s. 78 - 122
Hlavní autori:	Baldi, Pierre, Sadowski, Peter
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Oxford Elsevier B.V 01.05.2014 Elsevier
Predmet:	Applied sciences Approximation Artificial intelligence Backpropagation Computer science; control theory; systems Connectionism. Neural networks Detection, estimation, filtering, equalization, prediction Dropouts Ensemble Exact sciences and technology Functions (mathematics) Geometric mean Information, signal and communications theory Learning and adaptive systems Logistics Machine learning Mathematical analysis Networks Neural networks Regularization Signal and communications theory Signal, noise Sparse representations Stochastic gradient descent Stochastic neurons Stochasticity Telecommunications and information theory Training Variance minimization Backpropagation Neural networks Geometric mean Variance minimization Machine learning Ensemble Sparse representations Stochastic gradient descent Regularization Stochastic neurons Ergodic theory On line Self consistency Dynamic properties Modeling Adaptive method Varying speed Variance Gradient descent Backpropagation algorithm Sparse representation Transfer function Learning algorithm Logistic function Static properties Minimization Neural network Independent variable Linearity Artificial intelligence Logistics sparse representations backpropagation neural networks regularization variance minimization stochastic neurons ensemble machine learning stochastic gradient descent geometric mean
ISSN:	0004-3702, 1872-7921
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!

Buďte prvý, kto okomentuje tento záznam!