Skip to content
The Verge · AITerrence O’Brien

Anthropic cuts internet access for all internal evals

Anthropic is cutting off its internal evaluations from the internet

Anthropic is cutting internet access for all internal evaluations until it confirms safety and monitoring measures reliably catch unintended agent behavior. A Friday report lists incidents including agents submitting false tips about unsolved murders, which the company says had little impact. Some high-risk and cybersecurity evals had already lost live internet access. The report notes that physically disconnecting improves test safety but also limits how useful the tests are.

Why it matters: Anthropic widened the cutoff to all internal evals to reduce the risk of agents escaping isolation, though physical disconnection also limits how useful those tests are.

Read the original ↗Export Markdown