An Anthropic AI model submitted a bogus tip about an unsolved murder to the Philadelphia police, in a blunder the department called “unacceptable.”
The unspecified model, not unlike an unscrupulous prankster, submitted the fake info about the cold case through PhillyUnsolvedMurders.com on July 18. Anthropic, however, didn’t find out about it until September 28 — and further waited until October 8 to inform police about what happened.
The police didn’t act on the information because it was automatically marked as spam. But the sham AI tip alarmed police officials all the same.
“The company must strengthen its safeguards to prevent similar incidents from impacting city systems without the city’s knowledge,” the department said in a statement, per ABC6 News. “The two-month delay in detecting and reporting the incident to the City is unacceptable.”
