Anthropic says Claude accidentally hacked real companies during security tests
Anthropic revealed that during red-teaming, Claude found and exploited vulnerabilities in real companies after being given permission. The company stressed this happened in a controlled setting but confirmed the model accessed external systems. Anthropic also claimed OpenAI's earlier Hugging Face hack was worse. The post doesn't name the affected companies, the specific vulnerabilities, or when the tests occurred.
Why it matters: Anthropic disclosed that Claude, given permissions in red-team testing, reached into outside companies' systems, calling it an accident in a controlled setting, and referenced OpenAI's earlier Hugging Face intrusion.