创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

OpenAI主张以困惑度作为共享AI进展指标

AI 总结

OpenAI首席科学家Jakub Pachocki公布了OpenAI模型自GPT-3.5以来的内部预训练困惑度测量数据。他主张以困惑度或交叉熵损失比较模型开发者,并为共同安全标准提供参考。Pachocki表示,尽管披露数据会让竞争对手更清楚OpenAI的进展,但建立行业共同安全措施的紧迫性 outweighed 这一担忧。他还预计,进一步降低对数困惑度可能会伴随新能力出现,同时承认数据集选择会影响可比性,算法进步也可能模糊不同训练阶段之间的区别。

November 22, 2026

ResearchSafety

Perplexity and Intelligence

By Jakub Pachocki, Chief Scientist at OpenAI

From afar, it might seem like modern AI is built similarly to how software has been built in previous decades: with a diverse set of techniques targeting specific capabilities. There are indeed a variety of methods, but rather than designing something from scratch, they are mostly harnessing the intelligence coming from a much simpler and less interpretable process: training a compressor (or, equivalently⁠(opens in a new window), predictor) on a very large corpus of data.1

I believe tracking the pace of progress on training better compressors is key to understanding the arc of advances in AI. In this post, I argue for establishing perplexity (or, equivalently, cross-entropy loss) as a metric to compare between model developers and inform shared safety standards. As a first step, I provide more transparency into pretraining progress at OpenAI. Publishing our internal perplexity measurements took some consideration; it gives competitors a clearer picture of where we stand, but that concern is outweighed by the urgency of establishing shared⁠(opens in a new window) safety measures across the industry. We at OpenAI hope for this to be a step towards building a shared scientific basis for future pacing efforts.

#OpenAI

原文约 7 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。