interpretabilityfactneutralHand-coded one-layer MLPs can memorize facts with scaling behavior (roughly linear with parameter count) similar to trained models, though with a lower prefactorAI Alignment Forum29 Jul 2026https://www.alignmentforum.org/posts/KWtchKwwnJkd4bwCi/challenge-hand-coding-weights-for-efficient-sequence-1