The geometry of concept manifolds determines what kinds of steering and control techniques will work on models

sparse mixtures of meaningful subspaces whose geometry determines what kinds of steering and control work

https://www.cognitiverevolution.ai/thinking-in-silico-goodfire-cto-dan-balsam-on-concept-manifolds-a-1000-month-ml-research-agent/