Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

METR questions Anthropic’s low misalignment-risk assessment

AI summary

METR published an external review of the “Misalignment in high-stakes settings” section in Anthropic’s August 2026 Risk Report. METR’s best assessment was that catastrophic misalignment risk was low for the models covered, primarily because their capabilities were limited rather than because safeguards or alignment training were sufficient. METR said the report was far from adequate for confidently ruling out misalignment, criticized its covert-capability benchmarks as poor proxies for evading internal monitoring, and recommended publishing four redacted categories of information.

In-depth insight

METR’s critique directly challenges the evidentiary basis for Anthropic’s low-risk assessment and raises questions about whether its alignment assessments and internal monitoring can detect harmful behavior.

Scope and access: this review was written based solely on Anthropic’s internal Risk Report from August 2026 and is relatively lightweight. The authors of this review were engaged prior to the “An update on independent evaluators” announcement and did not have the level of access to information described in that post. We expect future engagements to be governed by different terms.

Redaction summary statement: Anthropic had the right to veto publication of this review and to redact any part of it. No redactions were made to our review and we did not change any of our conclusions during the publication review process. METR made minor changes to our review in response to feedback from Anthropic, but these changes were limited to minor wording and clarification, as well as improving the methodology of an experiment we ran.

Executive summary

METR conducted an external review of the “Misalignment in high-stakes settings” section of Anthropic’s Risk Report: August 2026. Anthropic’s report concludes that, as of July 15, 2026, “the risk of catastrophic harm caused by misalignment of [their] models is low.”

#METR#Anthropic

Original · 27 min readRead the original
Group chat

No comments yet. Start the conversation.