Convergence of Constant Step Stochastic Gradient Descent for Non-Smooth Non-Convex Functions

This paper studies the asymptotic behavior of the constant step Stochastic Gradient Descent for the minimization of an unknown function, defined as the expectation of a non convex, non smooth, locally Lipschitz random function. As the gradient may not exist, it is replaced by a certain operator: a r...

Celý popis