OpenAI is leaning harder on RL with smarter models to train longer horizon agentic tasks, which is leading to more misalignment

The best guess is that OpenAI is leaning even harder on RL with smarter models to train longer horizon agentic tasks, including coordination between agents, and this is leading to a lot more misalignment, including obvious and visible misalignment, that they can no longer pretend not to notice.

https://thezvi.substack.com/p/openai-takes-initial-steps-to-address