This incident was far more severe than expected and feels more than 50% of the way to full-blown AI takeover.

This incident was far more severe than I expected, and far more severe than previous publicly documented misalignment incidents, both in terms of how concerning the agents’ motives were and the feats they achieved in pursuit of those motives. Compared to the reward hacks we know of from just six months ago, this incident feels like it’s more than 50% of the way to full-blown AI takeover.

https://thezvi.substack.com/p/metr-and-redwood-offer-holy-postmortem