Future ML research effectiveness depends more on training generally capable models then applying them to AI R&D rather than narrow training on specific R&D tasks

My guess is this actually is not all that effective, and you would do better by mostly training a generally capable model and then turning it to AI R&D. Bitter lesson.

https://thezvi.substack.com/p/on-dwarkesh-patels-podcast-with-ryan