Reachability of gradient descent

math.OC arXiv:2509.12165
View PDF arXiv JSON

Abstract

We show that gradient descent can converge to any local minimum of a smooth semi-algebraic function. This holds if the step sizes are nonsummable and sufficiently small. The same results hold for the subgradient method on locally Lipschitz semi-algebraic functions if the step size is constant.

PDF Viewer