Exploration and generalization in deep learning with SwitchPath activations

This work provides a comprehensive theoretical and empirical analysis of SwitchPath, a stochastic activation function that improves learning dynamics by probabilistically toggling between a neuron standard activation and its negation. We develop theoretical foundations and demonstrate its impact in...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	Machine learning Jg. 114; H. 9; S. 200
Hauptverfasser:	Di Cecco, Antonio, Papini, Andrea, Metta, Carlo, Fantozzi, Marco, Galfrè, Silvia Giulia, Morandin, Francesco, Parton, Maurizio
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	Dordrecht Springer Nature B.V 01.09.2025
Schlagworte:	Adaptability Algorithms Back propagation Decision making Decision trees Deep learning Empirical analysis Generative networks Gradient flow Machine learning Neural network algorithms Neural networks Neurons Regularization
ISSN:	0885-6125, 1573-0565, 1573-0565
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!