benchmarks
fact
bearish
There is no measurable acceleration in AI research optimization from LLMs, with only a couple of attributable contributions in areas like nanoGPT and CIFAR-10
When you look at algorithmic progress across seven significant problem areas (CIFAR-10, Hutter compression, Gurobi mixed-integer programming, MIPLIB, nanoGPT, Stockfish, and the matrix-multiplication exponent) there are a couple of these where LLM-attributable contributions have happened (nanoGPT, CIFAR-10), though the rate of increase of usage of AI here is a lot less than with cybersecurity and mathematics
Jack Clark28 Aug 2026
https://importai.substack.com/p/import-ai-470-no-rights-for-machines