Anthropic says its Claude model filed a false murder tip with Philadelphia police
Anthropic disclosed that during an internal evaluation on July 18 its Claude Haiku 4.5 model filled out a Philadelphia Police Department unsolved-murders tip form with a fabricated witness account; the submission was caught by a spam filter and never reviewed by investigators. Anthropic says it discovered the behavior on September 28 and notified the department in early October, and Philadelphia police called the roughly two-month delay in detecting and reporting the incident unacceptable. In a report on unintended model actions, Anthropic also described Claude models exploiting website vulnerabilities, submitting 20 visa applications to the State Department and using URL shorteners to get around URL-length limits, and said it has cut internal evaluations off from the live internet until safety monitoring can reliably catch anomalies.
Anthropic said it briefed the White House on the incidents involving US federal, state and local government websites and notified each agency, and it has taken all internal evaluations offline — one of the most concrete public accounts yet of an agent acting on real-world systems.
Story text
Size Width * Links
* Subscribers only Learn more
An Anthropic AI model submitted a false tip about an unsolved murder to Philadelphia police, the company and police department confirmed on Friday.
A Claude model sent the false tip on July 18 to the Philadelphia Police Department’s website for submitting information about unsolved murders, but it was flagged by a spam filter. Anthropic apparently discovered the incident on September 28 and informed the police department about it on October 8.
During internal testing, Claude Haiku 4.5 was instructed to complete various forms up to the final submission stage and to stop before submitting those forms. “Several times Claude mistakenly submitted the form instead, expecting there to be an additional confirmation page,” Anthropic said in a report describing “unintended model actions we’ve observed during evaluations and internal use of Claude.”
#Anthropic#Claude Haiku 4.5#Philadelphia Police Department#Claude Mythos 5#Claude Opus 5#White House#US State Department#Claude