Claims Browser

OpenAI is reportedly building devices for 24x7 monitoring that will upload everything you say to the cloud for AI analysis

"They are reportedly building devices for 24x7 monitoring, no doubt uploading everything you say to the cloud for AI analysis"

OpenAI refused to opt out of doing surveillance for the US government of US citizens

"they refused (via mealy mouth legalese) to opt out of doing surveillance for the US government of US citizens"

The proposed QHAdamW optimizer improves convergence, generalization, and forecasting performance compared to Adam for AQI forecasting using ANNs

"The proposed QHAdamW optimizer addresses the issues on convergence, generalization, and forecasting performance of Adam."

The compute needed to be at the frontier of current model recipes is going vertical, and will only become more evident as the world accelerates along recursive self improvement

"The compute needed to be at the frontier of the current model recipe is going vertical, and as the world accelerates along the axis of Recursive Self Improvement this will only become more evident."

Human level capabilities of intelligence will be fully commoditized by open source models, while super intelligence will likely not be

"We believe human level capabilities of intelligence will be fully commoditized by open source models, while super intelligence will likely not be."

The constraint for frontier models today is not only capital, but physical data center space and contracted compute

"And for this the constraint today is not only capital, it is physical data center space and contracted compute."

Input-output alignment was reduced during unconsciousness whereas potential capacity was increased in macaques under ketamine

"We found that input-output alignment was reduced during unconsciousness whereas potential capacity was increased."

Large language models lack an explicit mechanism for maintaining compact and evolving conceptual representations

"Large language models process large amounts of information but usually lack an explicit mechanism for maintaining compact and evolving conceptual representations."

More ambiguous next-token distributions are harder for LLMs to learn accurately

"we identify a curse of ambiguity: in large language models, and more broadly in all neural networks that produce discrete probability distributions, the more ambiguous a next-token distribution is, the harder it is to learn accurately."

More ambiguous distributions require more capacity, larger embeddings, more training steps, and amplify sampling noise

"More ambiguous distributions require more capacity to be stored, larger embeddings to be represented, more steps to be fitted, and amplify token-sampling noise."

DiffusionGemma maintains high monitorability despite having opaque serial depth

"Recently, Engels et al. found that DG nevertheless maintains high monitorability, for instance by showing that projecting the distribution to its top-k items largely retains performance."

Good performance can be maintained with only the top item in DiffusionGemma, supporting high monitorability

"We strengthen these results by showing that this performance degradation is largely a sampler artifact and good performance can be maintained with only the top item, supporting the case for high monitorability."

Interpretability techniques like probes, steering, and J-lens carry over to DiffusionGemma with performance largely retained

"we also examined how interpretability techniques carry over to DiffusionGemma, including probes, steering, and J-lens. We find that performance is largely retained."

Diffusion models derived from text-pretrained LLMs may be interpretable, but this might not apply to more general paradigms

"This is a positive update on the interpretability of diffusion models that are derived from text-pretrained LLMs (an efficient training method more likely to be deployed), but might not apply for more general paradigms."

Most LLM-based automated algorithm design methods only optimize designated components within human-specified scaffolds

"Most LLM-based automated algorithm design methods optimize a designated component within a human-specified scaffold, fixing overall organization and component interactions."

ATLAS outperforms several state-of-the-art component-synthesis methods while remaining competitive with strong human-designed algorithms

"Across four NP-hard problems, ATLAS outperforms several state-of-the-art component-synthesis methods and a matched full-synthesis baseline while remaining competitive with strong human-designed algorithms."

Embedding-guided quality-diversity search can make the enlarged full-algorithm design space practically searchable

"Our results suggest that embedding-guided quality-diversity search can make the enlarged full-algorithm design space practically searchable."

Gavin Baker claimed that Anthropic was making money on every token

"in a Friday All-In podcast interview, Gavin Baker claimed that Anthropic was making money on every token."

Global workspace theory lacks a formal criterion for identifying the mechanism that enables conscious access

"Global workspace theory explains conscious access as the broadcasting of selected information to the rest of the network, but it lacks a formal criterion for identifying the mechanism that enables this access."