infrastructurefactneutralLower and middle Transformer layers build semantic representations while upper layers increasingly specialize them for prediction, creating a natural division of laborComputation and Language02 Aug 2026http://arxiv.org/abs/2607.28263v1