Claims Browser

ZID (Z-resolved Integrated Diagnostic) provides three linked outputs: an index for ranking departure magnitude, a permutation p-value for testing distributional equality, and a signed dispersion readout for diagnosis

"ZID reports three linked outputs: an index for ranking departure magnitude, a permutation $p$-value for testing distributional equality, and a signed dispersion readout for diagnosis"

ZID detects departures that FID misses, including cases where FID is flat or reversed in severity sweeps

"In controlled experiments, ZID detects a broad range of departures, and its score tracks increasing severity along the corresponding sweeps, including cases in which FID is flat or reversed"

ZID correctly identifies high-guidance diversity collapse in DiT-XL/2 and SiT-XL/2 models as under-dispersion

"On DiT-XL/2 and SiT-XL/2 guidance sweeps, ZID detects departure from real data, and its signed readout labels the high-guidance diversity collapse as under-dispersion"

AI has caused major acceleration in cybersecurity vulnerability discovery, with the rate of vulnerabilities reported dramatically accelerating in 2026 compared to 2025

"The rate of vulnerabilities reported across many projects has dramatically accelerated in 2026 compared with 2025, both for specific projects (cURL, OpenSSL, Firefox, and Microsoft) and for aggregate vulnerability databases (the US NVD, and OSV)"

AI has contributed minor acceleration to mathematics research, with arXiv submissions doubling in some areas in less than 12 months, though the value is difficult to quantify

"AI is clearly contributing to more work being done (arXiv submissions have doubled in some areas in less than 12 months) but quantifying the value of those contributions is difficult"

There is no measurable acceleration in AI research optimization from LLMs, with only a couple of attributable contributions in areas like nanoGPT and CIFAR-10

"When you look at algorithmic progress across seven significant problem areas (CIFAR-10, Hutter compression, Gurobi mixed-integer programming, MIPLIB, nanoGPT, Stockfish, and the matrix-multiplication exponent) there are a couple of these where LLM-attributable contributions have happened (nanoGPT, CIFAR-10), though the rate of increase of usage of AI here is a lot less than with cybersecurity and mathematics"

Acceleration in AI capabilities happens through phase changes for specific skills, as evidently occurred with day-to-day coding in 2025 and cyber in 2026

"My suspicion is that acceleration happens when models go through some kind of ineffable phase change for a given skill, as has evidently happened with day-to-day coding (2025), and cyber (2026)"

At 30B scale, SPADE reaches a suite average of 58.3, showing +8.1 improvement over base model and +5.3 over strongest fixed-environment baseline

"at 30B-A3B, SPADE reaches a suite average of 58.3: +8.1 over base and +5.3 over the strongest fixed-environment baseline"

Opus 5 and Fable 5 with Claude Code are the best overall models on DiG-bench

"Opus 5 and Fable 5 with Claude Code are the best overall models, followed by GPT-5.5"

Only Opus 5 and Fable 5 were able to beat any tasks in Tier 7 of DiG-bench

"Only Opus 5 and Fable 5 were able to beat any tasks (0.2) in (Tier 7)."

GLM-5.3 achieved frontier-level performance on agentic coding benchmarks with only ~750B parameters, one-third the size of Kimi K3

"This puts the model more or less at the frontier of agentic coding benchmarks, with only ~750B parameters – a third of Kimi K3!"

AI detectors are essentially a cat-and-mouse game where detection patterns must continuously adapt as LLMs evolve to avoid detection

"AI checkers are essentially a cat-and-mouse game. AI checkers may learn to detect a certain pattern that is indicative of AI-generated content. Then, the next LLM may incidentally or deliberately not exhibit that pattern and avoid detection. The AI checker then has to be updated to detect said LLM, and so forth."

Most existing math benchmarks evaluate only final answers, providing limited diagnostic value for identifying process-level failures

"However, most existing math benchmarks evaluate only final answers. This outcome-oriented evaluation provides limited diagnostic value for identifying process-level failures or rigorous logic, failing to guide the transformation of LLMs into robust agents."

Models with similar end-to-end accuracy can exhibit markedly different agentic capability profiles

"Experiments reveal that models with similar end-to-end accuracy can exhibit markedly different agentic capability profiles."

Process-level evaluation is crucial for interpreting the true potential of LLMs and guiding development of next-generation mathematical agents

"This demonstrates that process-level evaluation is crucial for interpreting the true potential of LLMs and guiding the development of next-generation mathematical agents."

AI detection tools like Pangram exhibit complete confidence even when making incorrect judgments on AI-generated content

Frontier evaluation has become harder than ever, with agentic evaluation methods being particularly complex

Evaluation methods have evolved through distinct eras from simple prompting to complex agentic sandboxes

Meta AI's Spark model family has shown visual improvements across versions 1.0, 1.1, and 1.2 as demonstrated by the pelican benchmark