Training base models to be general agentic reasoners is becoming as opaque as at-scale pretraining was a few years ago

There is a shift happening where the ability to train a base model to be a general agentic reasoner is becoming opaque like at-scale pretraining practices from a few years ago.

https://www.interconnects.ai/p/teaching-everyone-to-fish-for-tokens