Advanced skills like finding software vulnerabilities require carrying long causal chains of 20+ inference steps and do not live in total parameter count once a knowledge-holding threshold is reached

He notes that advanced skills (e.g., finding software vulnerabilities) are not retrieval/memorization problems. They require carrying long causal chains (20+ inference steps) without losing the thread. This ability does not live in total parameter count once a certain knowledge-holding threshold is reached.

https://www.latent.space/p/ainews-death-of-params-zai-ceo-jie