The exact number of hidden layers required to represent continuous piecewise linear functions remains open, with the answer potentially being a constant (possibly even 2) or higher

It remains completely open if the right answer is a constant number of hidden layers (possibly even 2!) or not.

http://arxiv.org/abs/2608.25221v1