Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Anthropic, OpenAI sought control over what external evaluators publish

AI summary

Reuters reported that Anthropic and OpenAI have pushed for substantial control over what outside evaluators of their models can publish, citing two people familiar with the talks; both labs worry the findings could reveal trade secrets. Anthropic told Reuters the account did not fit all of its reviewer work, saying previously engaged evaluators choose their own methods, findings and publications, while newer firms accept a company right to review and sign off reports as they learn how its models work. OpenAI said it does not want to approve whole reports, usually removing confidential details and letting reviewers note when large cuts were made. Ideas under discussion reportedly included lab staff monitoring review teams and barring evaluators from working at two labs at once; OpenAI has already cut some details from a METR and Redwood Research report, and the two groups said nothing key to their findings was removed.

In-depth insight

Independent publication is the basis for trusting external safety evaluations, so lab influence over what gets released could make it harder for the public and regulators to judge model risks.

AnthropicOpenAIMETR

Original · 2 min readRead the original
Group chat

No comments yet. Start the conversation.