Successive Capacity Growth (SCG) achieves 20.3% improvement in prediction loss over fixed small baseline with 56 times greater parameter efficiency on multi-object dynamics tasks

On a 60-dimensional multi-object dynamics task, SCG naturally triggers depth expansion, improving prediction loss by 20.3% over the fixed small baseline with 56 times greater parameter efficiency than scaling to the fixed large model

http://arxiv.org/abs/2608.27367v1