Exploration and generalization in deep learning with SwitchPath activations

This work provides a comprehensive theoretical and empirical analysis of SwitchPath, a stochastic activation function that improves learning dynamics by probabilistically toggling between a neuron standard activation and its negation. We develop theoretical foundations and demonstrate its impact in...

Full description

Bibliographic Details

Published in:	Machine learning Vol. 114; no. 9; p. 200
Main Authors:	Di Cecco, Antonio, Papini, Andrea, Metta, Carlo, Fantozzi, Marco, Galfrè, Silvia Giulia, Morandin, Francesco, Parton, Maurizio
Format:	Journal Article
Language:	English
Published:	Dordrecht Springer Nature B.V 01.09.2025
Subjects:	Adaptability Algorithms Back propagation Decision making Decision trees Deep learning Empirical analysis Generative networks Gradient flow Machine learning Neural network algorithms Neural networks Neurons Regularization
ISSN:	0885-6125, 1573-0565, 1573-0565
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!