Finite Newton-Schulz iterations can be beneficial for nonsmooth nonconvex optimization, contrary to existing theory which treats finite depth as an approximation error

We show that finite Newton-Schulz can instead be beneficial for nonsmooth nonconvex optimization.

http://arxiv.org/abs/2608.26288v1