[AINews] The Inference Inflection
Latent Space argues inference demand has hit an inflection point, citing its Apr 28-29, 2026 AINews roundup. Jensen Huang is quoted saying per-task compute rose about 10,000x in two years, with usage up about 100x. The key watchpoints are CPU sandboxes, agent harnesses, and split inference workloads.
Why it matters: Jensen Huang's GTC numbers show per-task compute up roughly 10,000x in two years and total usage up about 100x, and Latent Space ties that inference demand to real workloads like CPU sandboxes and agent scheduling.