Paul Christiano: AI capable of toppling a government may be only 12 months away
On the Dwarkesh Patel podcast, Paul Christiano said there is roughly a 1 in 3 chance of superintelligence within a year if progress keeps its current pace without slowing. He argues labs should pause algorithmic advances in pretraining and RL until they can protect model weights and research secrets and judge whether a system is sufficiently controlled. He stressed these are his personal views, not OpenAI board positions, and warned that stolen models or algorithms could make it hard for labs to stop the race even after spotting loss-of-control risk.
Why it matters: Christiano ties his call to pause algorithmic progress to the risk of model theft, arguing weak security would leave labs unable to slow down once they see loss of control.