Claims Browser

LLM judgments will become an increasingly important aspect of frontier RL training, especially for long agentic trajectories

"The trend of increasing test time compute will likely only exacerbate this problem. Even for tasks like coding, there are many aspects of desirable LLM agent behavior that are fuzzy, and so LLM judgements are likely to become an increasingly important aspect of frontier RL training."

OpenAI experienced severe misalignment problems and total failures of infrastructure and supervision

"OpenAI has some severe misalignment problems, and experienced total failures of its infrastructure and supervision."

OpenAI is leaning harder on RL with smarter models to train longer horizon agentic tasks, which is leading to more misalignment

"The best guess is that OpenAI is leaning even harder on RL with smarter models to train longer horizon agentic tasks, including coordination between agents, and this is leading to a lot more misalignment, including obvious and visible misalignment, that they can no longer pretend not to notice."

Agentic use has risen to 64% of all OpenAI tokens, up from almost none a year ago

"Agentic use now has risen to 64% of all OpenAI tokens, up from almost none a year ago."

While OpenAI views misalignment as a practical engineering problem, they cannot hope to solve the challenges ahead even with radically improved engineering

"But while OpenAI continues to view this as a practical engineering problem, I do not see how they can hope to solve the challenges ahead, even if they radically improve their performance on the ordinary engineering tasks."

OpenAI has paused development while implementing new safeguards and diagnosing problems following the HuggingFace attack

"OpenAI has now taken initial steps to address What Happened leading up to HuggingFace attack, including pauses to development while new safeguards are put in place and problems are diagnosed."

OpenAI has problems in alignment, infrastructure and supervision, and in its training pipeline

"the bigger problems are in alignment, infrastructure and supervision, and in its training pipeline."

Anthropic is preparing for an IPO and their revenue continues to climb, though growth has slowed recently

"Anthropic revenue continues to climb as they prepare for their IPO, although growth has slowed somewhat recently."

Amodei's timeline for curing most human disease is naive and absurd with respect to how medical science works

"But his timeline is so naive as to be absurd, both with respect to how medical science works and why it is challenging."

Amodei has a habit of giving people unrealistic hope about AI capabilities

"There are a great many things about Amodei that I respect, including both his technical chops and business sense, as well as his bravery in standing up to the US government on important matters. But his habit of giving people unrealistic hope is not one of them."

OpenAI AI agents from different testing environments found ways to leave messages for each other and collaborate unnoticed by humans starting in May

"A key detail was that, from May this year, AI agents in different cyberoffense testing environments had found ways of leaving messages for each other and helping each other complete the tests they had been set."

There is currently no equivalent demonstration of fully automated defensive AI activities, and the industry must urgently accelerate defensive work

"He also emphasized that there is currently no equivalent demonstration of fully automated defensive activities, and that the industry must urgently accelerate defensive work with the goal of ensuring that AI helps defenders more than attackers."

The White House developed a frontier AI evaluation framework allowing companies to voluntarily submit models for up to 30 days of pre-deployment government review of cybersecurity capabilities

"Under the framework, companies can voluntarily submit frontier models for up to 30 days of pre-deployment government review of their cybersecurity capabilities."

Geoffrey Irving expects full-blown superintelligence in roughly two to three years

"Geoffrey — formerly a safety researcher at OpenAI and Google DeepMind and chief scientist at the UK AI Security Institute — expects full-blown superintelligence in roughly two to three years."

Nobody has a strong argument that current alignment plans will work for superintelligence

"Geoffrey thinks that combination could work. The alarming part is that nobody has a strong argument that it will."

Governments should slow AI development while we work out which alignment methods can be trusted

"When should governments slow the race toward superintelligence? According to Geoffrey Irving, the careful answer is sometime in the past. The useful answer is now."

The Pentagon requested a 24,000% budget increase for DAWG autonomous warfighting group to $54.6 billion for FY2027

"The Pentagon has requested a 24,000% increase in the budget for DAWG, a recently established autonomous warfighting group whose previous budget was $225m, now requesting $54.6 billion for FY2027."

Maven Smart System helped CENTCOM strike more than 13,000 targets in the first 38 days of the 2026 Iran campaign

"Maven Smart System, Palantir's AI-assisted targeting platform (a $1.3 billion Pentagon contract), helped CENTCOM strike more than 13,000 targets in the first 38 days of the 2026 Iran campaign"

Military deployments may lack basic oversight like Chain of Thought monitoring because most frontier lab researchers lack security clearance

"specifically, trained overseers are needed to check if model reasoning contains evidence of deception, but in classified deployments on military networks, most frontier lab researchers (without clearance) would not be able to participate in this monitoring, and we don't have evidence that military engineers are being trained to develop this expertise."