Skip to content

All news

14 today

May 20Wednesday

r/LocalLLaMA

Cursor and Claude Code Are Not Getting Dumber; Agent Loops Are Suffocating Context

A Reddit user says an API-log audit showed Cursor and Claude Code recursively grep about 40 files in 10k-plus-line repositories, sometimes load 2k-line files for 5-line edits, and spend roughly 30k tokens on tool definitions and logs before generating code.

Why it matters: A Reddit user found in API logs that Cursor and Claude Code agents grep roughly 40 files before writing code, with tool definitions and logs eating about 30,000 tokens of context.

May 19Tuesday

AI HOT (Curated Pool)

Former executive says Microsoft’s AI strategy faltered, with Copilot paid usage below 3%

Former Microsoft executive Matt Veloso said Microsoft generated about $30 billion from its AI partnership between 2023 and 2025, while related costs reached $100 billion; he also said actual usage among paid Copilot users is below 3%.

Why it matters: A former Microsoft director puts numbers on the OpenAI deal and says paid Copilot usage sits under 3%.

AI HOT (Curated Pool)

I really want to praise HTML!

The author used Claude Code to generate a single-file HTML project plan page in 2 minutes, with a dark theme, timeline, and collapsible tables; the comparable Notion template previously took 30-40 minutes.

Why it matters: A precise prompt gets Claude Code to build a single-file HTML project plan in two minutes, against 30 to 40 minutes of the same template in Notion.

Latent Space

[AINews] How to Land a Job at a Frontier Lab (on Pretraining)

Latent Space says Vlad Feinberg’s pretraining job-prep notes reduce frontier-lab readiness to kernel-level performance work: derive Chinchilla laws, compare dense and MoE architectures, code the solution in JAX, then write a Pallas kernel that beats jax.lax.ragged_dot for F > D by fusing up/down projections.

Why it matters: A job-hunting note from Vlad Feinberg lays out what pretraining work at a frontier lab actually tests: low-level performance tuning, deriving Chinchilla scaling laws, and comparing dense models with MoE architectures.

AI Chat-Group Daily (群聊日报)

May 18, 2026 Chat Group Daily

The chat group daily says AI21 Labs cut 60% of staff and stopped selling model access, and cites a University of Waterloo paper where GPT-5.4 accuracy dropped from 100% to 23% after false peer-consensus injection; the snippet also mentions Meta layoff talk at 10%, but does not disclose source details or confirmation conditions.

Why it matters: AI21 Labs cut 60% of staff and stopped selling its models on their own, as token prices fell 100x in two years and six independent model firms were absorbed.

r/LocalLLaMA

Tried Every Hermes Agent Alternative So You Don't Have To: 2026 Roundup

A Reddit user compared 11 Hermes Agent alternatives across open-source and managed options; OpenClaw is listed with 347k GitHub stars, 24+ integrations, and 9 CVEs in four days, while TrustClaw uses OAuth-only sandboxed execution and Perplexity Computer requires a $200/month Max tier.

Why it matters: Citing deployment friction and self-hosting security concerns, the authors tested 11 Hermes Agent alternatives, open source and hosted, for a side-by-side comparison.

May 18Monday

Latent Space

The Autonomous Drone Tech Stack and Economics of Drones — Yaroslav Azhnyuk

Latent Space interviewed The Fourth Law founder Yaroslav Azhnyuk for a two-hour episode covering FPV drones, five levels of autonomy, eight dimensions of the autonomous battlefield, and China’s manufacturing advantage; the transcript claims Ukraine produced 4 million FPV drones last year and discusses a hypothetical Chinese capacity of 4 billion.

Why it matters: The Fourth Law founder Yaroslav Azhnyuk explains on a podcast how FPV drones became a battlefield staple, and lays out autonomy levels and cost structure.

May 17Sunday

AI HOT (Curated Pool)

Microsoft AI CEO predicts AI will automate all white-collar jobs within 18 months

Mustafa Suleyman predicts AI will reach human-level performance within 18 months and automate most professional tasks, including accounting, law, marketing, and project management.

Why it matters: Microsoft AI chief Mustafa Suleyman puts a timeline on AI reaching human level and automating white-collar work, a useful marker of how tech leaders read the pace of substitution.

Financial Times · Technology

Chinese AI Groups Pull Ahead of US Rivals in Video Generation Race

FT says Chinese AI groups have moved ahead of US rivals in video generation; the RSS snippet names ByteDance and Kuaishou and says they outshine western competitors in advertising and entertainment quality, but the post does not disclose benchmark metrics or model details.

Why it matters: ByteDance and Kuaishou are said to lead US rivals in video generation, with better results in ads and entertainment, though the report gives no models, benchmarks or sample sizes.

Synced · WeChat

What Are World Models? Their History and the $10 Billion Bet

Jiqizhixin translated a MoE Capital blog tracing two world-model lineages. The article says more than $10 billion entered the category over 18 months, and cites DreamDojo as using 44,711 hours of first-person video pretraining to reach r=0.995 correlation with real-world robot policy outcomes.

Why it matters: Maps two routes to world models, one from AI planning research, one from game and film 3D generation, with over $10B invested in 18 months.

Synced · WeChat

Peter Steinberger Says His Monthly Token Bill Hit $1.3M, Covered by OpenAI

Peter Steinberger used 603 billion tokens across 7.6 million requests in 30 days, with the bill exceeding $1.3 million; he said disabling fast mode cut the price by 70%, and OpenAI does not charge him for the tokens.

Why it matters: Peter Steinberger posted a 30-day bill of 7.6 million requests and 603 billion tokens, noted that turning off fast mode cut costs by 70%, and said OpenAI covered the over $1.3 million spend.

AI HOT (Curated Pool)

Anthropic CEO discusses AI’s dual impact: high growth and high unemployment

Dario Amodei said AI may drive 5%-10% GDP growth while increasing unemployment and inequality, and near-free software costs would challenge the assumptions behind traditional software business models.

Why it matters: Amodei lays out a scenario where AI lifts GDP growth to 5–10% while raising unemployment and inequality, and says software costs near zero break the old licensing model.

AI HOT (Curated Pool)

Anthropic CEO predicts near-free software and major job shifts

Dario Amodei said in a Wall Street Journal YouTube interview that software costs will fall sharply toward near-free, and the traditional assumption that software needs millions of users to spread costs will no longer hold.

Why it matters: Amodei argues software costs fall to near free, which kills the logic of spreading cost across a million users, and says many jobs may disappear.

TechCrunch · AI

The Haves and Have-Nots of the AI Gold Rush

Deedy Das estimated that about 10,000 founders and employees at companies including OpenAI, Anthropic, and Nvidia have accumulated more than $20 million in wealth, while many software engineers face layoffs, sub-$500,000 career ceilings, and anxiety that their core skills are losing labor-market value.

Why it matters: Menlo Ventures partner Deedy Das estimates about 10,000 founders and employees at OpenAI, Anthropic and Nvidia built over $20 million in equity, while other software engineers face layoffs and eroding skills.

Dwarkesh Patel podcast

The mistake of conflating intelligence and power

Dwarkesh Patel argues that intelligence and power are being conflated: current AI systems improve through economically valuable tasks such as coding, while real-world power depends more on authority, trust, and large-scale cooperation than isolated strategic reasoning.

Why it matters: Dwarkesh Patel untangles the common confusion between intelligence and power, using Stalin to show that defining intelligence as goal achievement across domains gives counterintuitive results.

Dwarkesh Patel podcast

Notes on Pretraining Parallelisms and Failed Training Runs

Dwarkesh documents pretraining failure modes and parallelism tradeoffs: expert choice and token dropping can break causality in MoE routing, FP16 collectives can bias repeated additions after values exceed 1024, pretraining FLOPs are given as 6ND, B300 HBM is listed as 288GB, and FSDP communication can reach params × 3 with reduce-scatter.

Why it matters: The author breaks down two ways pretraining runs go off the rails, and why expert choice in MoE routing makes a token's destination depend on later routing decisions, so training sees information inference never gets.

AI HOT (Curated Pool)

RLVR May Perform Disproportionately Poorly in Science

Dwarkesh argues that RLVR has a short-feedback weakness in scientific theory validation; the post says validation loops can span decades or centuries, and does not disclose experimental results or benchmark numbers.

Why it matters: Dwarkesh Patel argues reinforcement learning from verifiable rewards may fail at scientific discovery, since theories can take decades or centuries to confirm.

AI HOT (Curated Pool)

Eric Jang shares lessons from building AlphaGo from scratch

Eric Jang spent several months implementing AlphaGo from scratch and says that in 2026, training a strong Go AI requires only a few thousand dollars in rented compute rather than DeepMind-scale resources.

Why it matters: Eric Jang published a full tutorial and code for building AlphaGo from scratch, plus a concrete cost estimate: renting compute in 2026 to train a competitive Go AI runs only a few thousand dollars.

May 16Saturday

AI HOT (Curated Pool)

Anthropic Founder’s Playbook warns AI can raise startup failure rates

Anthropic published Founder’s Playbook, arguing that AI tools such as Claude Code reduce prototyping cost but increase startup failure risk across the Idea, MVP, Launch, and Scale stages through false validation, confirmation bias, agentic technical debt, and founder decision bottlenecks.

Why it matters: Anthropic's Founder's Playbook argues that AI tools like Claude Code raise startup failure rates, and breaks down how risk grows at the idea, prototype, launch and scale stages.

AI HOT (Curated Pool)

Nvidia CEO Says Skilled Trades Have Better Prospects Than CS Graduates

Jensen Huang told Carnegie Mellon’s 2026 CS graduates that skilled trades have better prospects; Randstad says trade demand is growing three times faster than white-collar roles, with robotics technician jobs up 107%.

Why it matters: At Carnegie Mellon's computer science commencement, Jensen Huang said trades beat computer graduates, alongside data showing trade demand growing three times faster than white-collar and robotics technician roles up 107%.

Bloomberg Technology

US Is Starting to See Heavy Job Losses in Roles Exposed to AI

Several US occupations expected to be exposed to AI recorded heavy job losses for a second year in 2025, led by customer service representatives and some secretary and salesperson roles; the RSS snippet does not disclose job-loss counts or the attribution method.

Why it matters: Bloomberg data shows US roles exposed to AI have shed jobs for two straight years, with customer service, secretarial and sales positions hit hardest, so the contraction is no longer a one-off swing.

AI HOT (Curated Pool)

Yann LeCun interview: LLM limits, AI's future, and a new startup path

Yann LeCun discussed LLM limitations on the Unsupervised Learning podcast, covering his 2027 forecast, AMI’s bet on world models, his reasons for leaving Meta, and major disagreements with Geoffrey Hinton and Yoshua Bengio over Turing Award-era views.

Why it matters: Yann LeCun said on a podcast that the large language model path has a ceiling, and explained why he is betting on world models after leaving Meta, giving a direct account of the split from a key figure.

AI HOT (Curated Pool)

Eric Jang: Building AlphaGo from Scratch

Eric Jang uses AlphaGo to break down an intelligence system; the post only discloses three mechanisms: search, learning from experience, and self-play.

Why it matters: Eric Jang walks through rebuilding AlphaGo from scratch with modern tools, showing how Monte Carlo tree search, experience learning and self-play fit together.

May 15Friday

The Verge · AI

AI research papers are getting better, and it’s a big problem for scientists

The Verge describes Peter Degen investigating unusual citations to a 2017 paper: it rose from a few dozen citations over several years to being cited every few days, while the RSS snippet does not disclose the full sample size or review findings.

Why it matters: A researcher traced a 2017 paper's sudden citation spike to AI-written papers that pull references at random from training data.

Bloomberg Technology

Enterprise 40% of Revenue Streams, Says OpenAI CRO

OpenAI CRO Denise Dresser said enterprise business makes up 40% of total revenue and is expected to reach 50% by year-end; the Bloomberg snippet does not disclose OpenAI’s total revenue size.

Why it matters: OpenAI CRO Denise Dresser told Bloomberg that enterprise is 40% of revenue and should reach 50% by year end, giving a concrete number to the shift toward business customers.

AI HOT (Curated Pool)

The First Derivative of Inference: Growth Logic in the AI Wave

Tom Tunguz says the AI inference market will reach $250 billion within seven years; Datadog’s LLM observability data volume nearly doubled in the latest quarter, and about 20% of its AI customers contribute roughly 80% of ARR.

Why it matters: Tom Tunguz floated the idea of a first derivative of inference: companies like Datadog that sell no compute but earn more as customer AI usage grows, with LLM monitoring data nearly doubling in a quarter.

AI HOT (Curated Pool)

API prompt precaching speeds up first-token generation

Claude API prewarms prompt cache with the system prompt, skips output, then hits cache on the real request.

Why it matters: The Claude API can write a system prompt into the cache on its own before the real request arrives and skip output, so later requests hit the cache and cut first-token latency on long prompts.

r/LocalLLaMA

I tracked EU GPU prices across 15 stores for 50+ days: RTX 5090 is the only card not dropping

Reddit user egudegi tracked EU GPU prices across 15 stores for more than 50 days with a 6-hour scrape cadence and about 126,000 readings; RTX 5090 average pricing rose from €3,392 to €3,487, a 3.0% increase.

Why it matters: A Reddit user scripted GPU price tracking across 15 EU stores for over 50 days, and among roughly 126,000 data points the RTX 5090 rose from 3,392 to 3,487 euros while every other model fell.

Bloomberg Technology

AI Buildout Drives 76% Power Bill Jump on Largest US Grid

Power prices on the largest US electric grid rose 76% in the first quarter, and the RSS snippet attributes the increase to data-center demand; the post does not disclose the grid operator’s name or a specific capacity shortfall.

Why it matters: A grid operator's report ties a 76% jump in wholesale power prices to data center demand, giving anyone tracking AI compute costs a price signal from the electricity side.

r/LocalLLaMA

The RTX 5000 PRO 48GB arrived and is better than expected

A Reddit user built a $5,600 RTX 5000 PRO 48GB PC and ran Qwen3.6-27B-FP8 with full-precision cache; they report up to 80 tok/s in TG, about 50–60 tok/s on very large prompts, 4,400 tok/s in prompt processing, and 200k tokens fitting in BF16 KV cache.

Why it matters: A builder with no prior experience spent $5,600 on a single RTX 5000 PRO 48GB machine, hitting 80 tok/s on a 27B model with 200k context at full precision.

May 14Thursday

AI HOT (Curated Pool)

Moonshot AI founder Yang Zhilin releases a 40-minute video

Yang Zhilin explains Kimi K2 training in a 40-minute video, saying the model cost $4.6 million and beat GPT-5.5 and other competitors on coding tasks.

Why it matters: Yang Zhilin's 40-minute video puts Kimi K2's $4.6M training cost on the record and claims it beats GPT-5.5 on coding tasks.

AI HOT (Curated Pool)

Cost Analysis of AI Email

Top AI models process email at about $22 to $130 per month, with a $26 median; smaller models cut costs by 10 to 20 times, while local GPU execution can bring marginal cost close to zero.

Why it matters: A cost breakdown puts AI email handling at $22 to $130 per month in inference, and lays out smaller models and local GPUs as the ways down.

r/LocalLLaMA

2x RTX 3090 setup for local Qwen 3.6 27B inference

A Reddit user ran Qwen 3.6 27B on a dual RTX 3090 Ubuntu setup, reporting 48GB VRAM, a 262k context window, no NVLink, about 4000 pp/s prompt processing, and 113 tk/s generation.

Why it matters: A Reddit user runs Qwen 3.6 27B on two RTX 3090s in Ubuntu, holding 260K context in 48GB of VRAM at 113 tokens per second.

May 13Wednesday

AI HOT (Curated Pool)

90% of People Are Wasting Tokens

Andrej Karpathy says 90% of AI coding bills is wasted on unnecessary context, including repeated full-repository sends, expensive models for simple tasks, and missing prompt caching.

Why it matters: Karpathy names three ways tokens get wasted, re-sending codebases, using expensive models for simple work, and agents repeating content, and gives concrete fixes.

May 12Tuesday

r/LocalLLaMA

Local LLM Autocomplete and Agentic Coding on a Single 16GB GPU + 64GB RAM

Reddit user grumd runs Qwen2.5-Coder-7B Q6 for autocomplete and Qwen3.6-35B-A3B Q8 for agentic coding on one RTX 5080 with RAM offloading; the post reports about 145k context, 56GB RAM used with other apps open, and Qwen3.6-35B-A3B speed of tg128 at 35.29 tokens/s.

Why it matters: One user runs both a code-completion model and an agentic coding model on a single 16GB GPU with 64GB RAM, and lists the models, quantization and context lengths.

QbitAI · WeChat

Markdown Is Fading? Karpathy Also Backs HTML

Anthropic engineer Thariq argued for using HTML instead of Markdown and gave 5 reasons; the post says HTML generation takes about 2 to 4 times longer than Markdown.

Why it matters: Anthropic engineer Thariq listed five reasons to have models output HTML instead of Markdown, Karpathy reposted in agreement, and the discussion centered on Markdown syntax ambiguity and inconsistent parser implementations causing generation errors.

Computing Life · Yage

How AI Caused and Fixed My Insomnia

The author used AI to build a HealthKit export app in about 5 minutes and run multivariate regression, finding that the last post-dinner AI usage time correlated negatively with sleep duration; after avoiding AI at night, average sleep increased by 1 hour and 40 minutes.

Why it matters: An engineer built an app to export Apple Watch health data and ran a regression: later last AI use after dinner tracked with shorter sleep that night.

Computing Life · Yage

How AI Caused and Fixed My Insomnia

The author used AI to build a HealthKit export tool and run multivariate regression, found that post-dinner AI use correlated negatively with sleep duration, and added 1 hour 40 minutes of average nightly sleep after avoiding AI for several weeks.

Why it matters: The author exported Apple Watch health data and ran a multiple regression, finding that time spent using AI after dinner tracked most strongly with sleep quality, while caffeine and alcohol showed no clear effect.

r/LocalLLaMA

Computer Build Using Intel Optane Persistent Memory Runs a 1T-Parameter Model at Over 4 Tokens/s

Reddit user APFrisco ran the 1T-parameter Kimi K2.5 Q2_K_XL quant locally at about 4 tokens/s using 768GB Intel Optane PMem, 192GB DDR4 ECC DRAM, and a 12GB RTX 3060 with llama.cpp hybrid GPU/CPU inference.

Why it matters: A Reddit build pairs 768GB of Intel Optane persistent memory with an RTX 3060 to run a 1-trillion-parameter model locally at over 4 tokens/sec, showing llama.cpp hybrid inference on cheap hardware.

AI HOT (Curated Pool)

Using LLMs in Script Shebang Lines

Simon Willison demonstrates using an LLM command in a script shebang line, with fragments generating SVG, the -T option calling llm_time, and a YAML template defining Python tools to compute 2344×5252+134 and return 12,310,822.

Why it matters: Simon Willison shows how putting the llm command in a shebang line turns a plain text file into an executable script, treating natural language as an interpreter for command-line automation.