Skip to content

Opinions

What key people are thinking: founder interviews, researcher debates and investor calls.

283 picksRelated topicsTrendsIndustry

Latest picks

101–120 of 283

May 17Sunday

Dwarkesh Patel podcast

Notes on Pretraining Parallelisms and Failed Training Runs

Dwarkesh documents pretraining failure modes and parallelism tradeoffs: expert choice and token dropping can break causality in MoE routing, FP16 collectives can bias repeated additions after values exceed 1024, pretraining FLOPs are given as 6ND, B300 HBM is listed as 288GB, and FSDP communication can reach params × 3 with reduce-scatter.

Why it matters: The author breaks down two ways pretraining runs go off the rails, and why expert choice in MoE routing makes a token's destination depend on later routing decisions, so training sees information inference never gets.

AI HOT (Curated Pool)

RLVR May Perform Disproportionately Poorly in Science

Dwarkesh argues that RLVR has a short-feedback weakness in scientific theory validation; the post says validation loops can span decades or centuries, and does not disclose experimental results or benchmark numbers.

Why it matters: Dwarkesh Patel argues reinforcement learning from verifiable rewards may fail at scientific discovery, since theories can take decades or centuries to confirm.

AI HOT (Curated Pool)

Eric Jang shares lessons from building AlphaGo from scratch

Eric Jang spent several months implementing AlphaGo from scratch and says that in 2026, training a strong Go AI requires only a few thousand dollars in rented compute rather than DeepMind-scale resources.

Why it matters: Eric Jang published a full tutorial and code for building AlphaGo from scratch, plus a concrete cost estimate: renting compute in 2026 to train a competitive Go AI runs only a few thousand dollars.

May 16Saturday

AI HOT (Curated Pool)

Anthropic Founder’s Playbook warns AI can raise startup failure rates

Anthropic published Founder’s Playbook, arguing that AI tools such as Claude Code reduce prototyping cost but increase startup failure risk across the Idea, MVP, Launch, and Scale stages through false validation, confirmation bias, agentic technical debt, and founder decision bottlenecks.

Why it matters: Anthropic's Founder's Playbook argues that AI tools like Claude Code raise startup failure rates, and breaks down how risk grows at the idea, prototype, launch and scale stages.

AI HOT (Curated Pool)

Nvidia CEO Says Skilled Trades Have Better Prospects Than CS Graduates

Jensen Huang told Carnegie Mellon’s 2026 CS graduates that skilled trades have better prospects; Randstad says trade demand is growing three times faster than white-collar roles, with robotics technician jobs up 107%.

Why it matters: At Carnegie Mellon's computer science commencement, Jensen Huang said trades beat computer graduates, alongside data showing trade demand growing three times faster than white-collar and robotics technician roles up 107%.

Bloomberg Technology

US Is Starting to See Heavy Job Losses in Roles Exposed to AI

Several US occupations expected to be exposed to AI recorded heavy job losses for a second year in 2025, led by customer service representatives and some secretary and salesperson roles; the RSS snippet does not disclose job-loss counts or the attribution method.

Why it matters: Bloomberg data shows US roles exposed to AI have shed jobs for two straight years, with customer service, secretarial and sales positions hit hardest, so the contraction is no longer a one-off swing.

AI HOT (Curated Pool)

Yann LeCun interview: LLM limits, AI's future, and a new startup path

Yann LeCun discussed LLM limitations on the Unsupervised Learning podcast, covering his 2027 forecast, AMI’s bet on world models, his reasons for leaving Meta, and major disagreements with Geoffrey Hinton and Yoshua Bengio over Turing Award-era views.

Why it matters: Yann LeCun said on a podcast that the large language model path has a ceiling, and explained why he is betting on world models after leaving Meta, giving a direct account of the split from a key figure.

AI HOT (Curated Pool)

Eric Jang: Building AlphaGo from Scratch

Eric Jang uses AlphaGo to break down an intelligence system; the post only discloses three mechanisms: search, learning from experience, and self-play.

Why it matters: Eric Jang walks through rebuilding AlphaGo from scratch with modern tools, showing how Monte Carlo tree search, experience learning and self-play fit together.

May 15Friday

The Verge · AI

AI research papers are getting better, and it’s a big problem for scientists

The Verge describes Peter Degen investigating unusual citations to a 2017 paper: it rose from a few dozen citations over several years to being cited every few days, while the RSS snippet does not disclose the full sample size or review findings.

Why it matters: A researcher traced a 2017 paper's sudden citation spike to AI-written papers that pull references at random from training data.

Bloomberg Technology

Enterprise 40% of Revenue Streams, Says OpenAI CRO

OpenAI CRO Denise Dresser said enterprise business makes up 40% of total revenue and is expected to reach 50% by year-end; the Bloomberg snippet does not disclose OpenAI’s total revenue size.

Why it matters: OpenAI CRO Denise Dresser told Bloomberg that enterprise is 40% of revenue and should reach 50% by year end, giving a concrete number to the shift toward business customers.

AI HOT (Curated Pool)

The First Derivative of Inference: Growth Logic in the AI Wave

Tom Tunguz says the AI inference market will reach $250 billion within seven years; Datadog’s LLM observability data volume nearly doubled in the latest quarter, and about 20% of its AI customers contribute roughly 80% of ARR.

Why it matters: Tom Tunguz floated the idea of a first derivative of inference: companies like Datadog that sell no compute but earn more as customer AI usage grows, with LLM monitoring data nearly doubling in a quarter.

AI HOT (Curated Pool)

API prompt precaching speeds up first-token generation

Claude API prewarms prompt cache with the system prompt, skips output, then hits cache on the real request.

Why it matters: The Claude API can write a system prompt into the cache on its own before the real request arrives and skip output, so later requests hit the cache and cut first-token latency on long prompts.

r/LocalLLaMA

I tracked EU GPU prices across 15 stores for 50+ days: RTX 5090 is the only card not dropping

Reddit user egudegi tracked EU GPU prices across 15 stores for more than 50 days with a 6-hour scrape cadence and about 126,000 readings; RTX 5090 average pricing rose from €3,392 to €3,487, a 3.0% increase.

Why it matters: A Reddit user scripted GPU price tracking across 15 EU stores for over 50 days, and among roughly 126,000 data points the RTX 5090 rose from 3,392 to 3,487 euros while every other model fell.

Bloomberg Technology

AI Buildout Drives 76% Power Bill Jump on Largest US Grid

Power prices on the largest US electric grid rose 76% in the first quarter, and the RSS snippet attributes the increase to data-center demand; the post does not disclose the grid operator’s name or a specific capacity shortfall.

Why it matters: A grid operator's report ties a 76% jump in wholesale power prices to data center demand, giving anyone tracking AI compute costs a price signal from the electricity side.

r/LocalLLaMA

The RTX 5000 PRO 48GB arrived and is better than expected

A Reddit user built a $5,600 RTX 5000 PRO 48GB PC and ran Qwen3.6-27B-FP8 with full-precision cache; they report up to 80 tok/s in TG, about 50–60 tok/s on very large prompts, 4,400 tok/s in prompt processing, and 200k tokens fitting in BF16 KV cache.

Why it matters: A builder with no prior experience spent $5,600 on a single RTX 5000 PRO 48GB machine, hitting 80 tok/s on a 27B model with 200k context at full precision.

May 14Thursday

AI HOT (Curated Pool)

Moonshot AI founder Yang Zhilin releases a 40-minute video

Yang Zhilin explains Kimi K2 training in a 40-minute video, saying the model cost $4.6 million and beat GPT-5.5 and other competitors on coding tasks.

Why it matters: Yang Zhilin's 40-minute video puts Kimi K2's $4.6M training cost on the record and claims it beats GPT-5.5 on coding tasks.

AI HOT (Curated Pool)

Cost Analysis of AI Email

Top AI models process email at about $22 to $130 per month, with a $26 median; smaller models cut costs by 10 to 20 times, while local GPU execution can bring marginal cost close to zero.

Why it matters: A cost breakdown puts AI email handling at $22 to $130 per month in inference, and lays out smaller models and local GPUs as the ways down.

r/LocalLLaMA

2x RTX 3090 setup for local Qwen 3.6 27B inference

A Reddit user ran Qwen 3.6 27B on a dual RTX 3090 Ubuntu setup, reporting 48GB VRAM, a 262k context window, no NVLink, about 4000 pp/s prompt processing, and 113 tk/s generation.

Why it matters: A Reddit user runs Qwen 3.6 27B on two RTX 3090s in Ubuntu, holding 260K context in 48GB of VRAM at 113 tokens per second.

May 13Wednesday

AI HOT (Curated Pool)

90% of People Are Wasting Tokens

Andrej Karpathy says 90% of AI coding bills is wasted on unnecessary context, including repeated full-repository sends, expensive models for simple tasks, and missing prompt caching.

Why it matters: Karpathy names three ways tokens get wasted, re-sending codebases, using expensive models for simple work, and agents repeating content, and gives concrete fixes.

May 12Tuesday

r/LocalLLaMA

Local LLM Autocomplete and Agentic Coding on a Single 16GB GPU + 64GB RAM

Reddit user grumd runs Qwen2.5-Coder-7B Q6 for autocomplete and Qwen3.6-35B-A3B Q8 for agentic coding on one RTX 5080 with RAM offloading; the post reports about 145k context, 56GB RAM used with other apps open, and Qwen3.6-35B-A3B speed of tg128 at 35.29 tokens/s.

Why it matters: One user runs both a code-completion model and an agentic coding model on a single 16GB GPU with 64GB RAM, and lists the models, quantization and context lengths.