AI training pipeline is going fully synthetic, from reward signal to environment
[AINews] 10% worse, 100x cheaper, 10000x faster: Why Simulation is taking over
Latent Space traces how every component of the ML pipeline has flipped from human-made to model-made since 2022. The reward signal went synthetic first with InstructGPT's reward model, then Phi's textbook-quality synthetic pretraining data, followed by Alpaca-style distillation where a frontier model acts as teacher. Meta's self-rewarding models automated curriculum design in 2024, and Karpathy's autoresearch loop ran 700 overnight experiments in 2026, cutting GPT-2 training time from 2.02 to 1.80 hours. The latest step is Z.ai's GLM-5.3 synthesizing entire RL environments. The author frames this as '10% worse, but 100x cheaper and 10,000x faster human simulation.'
Why it matters: Latent Space traced how AI training pipelines since 2022 have shifted reward signals, training data and the teacher role from human to model generation, with papers and products backing each step.