Skip to content

NVIDIA chips and ecosystem: new GPUs, CUDA, robotics platforms and the market for AI compute.

Latest picks

281–300 of 362

May 19Tuesday

r/LocalLLaMA

llama.cpp MTP support landed: Qwen3.6 27B reaches 2.44× on Strix Halo

llama.cpp merged MTP speculative decoding in PR #22673; Qwen3.6 27B Q8_0 rose from 7.4 to 18.1 tok/s on Strix Halo, while a dual RTX 3090 Q8_0 setup rose from 25.7 to 55.9 tok/s.

Why it matters: After llama.cpp merged MTP speculative decoding, Qwen3.6 27B measured 7.4 tok/s to 18.1 tok/s on Strix Halo, giving local inference a concrete speedup reference.

AI HOT (Curated Pool)

NVIDIA fine-tunes Cosmos Predict 2.5 with LoRA/DoRA for robot video generation

NVIDIA published a Hugging Face post on fine-tuning Cosmos Predict 2.5 with LoRA and DoRA to generate robot first-person videos from text prompts; the post does not disclose dataset size, training cost, or evaluation results.

Why it matters: NVIDIA's technical blog shows lightweight LoRA and DoRA fine-tuning of Cosmos Predict 2.5 to generate first-person robot footage like arm grasps from text prompts, a cheap path to training video for embodied AI.

May 17Sunday

QbitAI · WeChat

A Robot Dog Challenges Nvidia's Compute Lead

Weilan Technology unveiled BabyAlpha A3, a consumer quadruped robot using a six-chip heterogeneous cluster that runs a 7B-parameter model on-device at 280 TPS; the article says it has 66MP vision, 2.232 million point-cloud samples per second, and a planned Q3 launch.

Why it matters: Azurion runs a 7B model locally on a consumer robot dog using a six-chip heterogeneous cluster, claiming 280 TPS and giving on-device compute a concrete sample.

Synced · WeChat

What Are World Models? Their History and the $10 Billion Bet

Jiqizhixin translated a MoE Capital blog tracing two world-model lineages. The article says more than $10 billion entered the category over 18 months, and cites DreamDojo as using 44,711 hours of first-person video pretraining to reach r=0.995 correlation with real-world robot policy outcomes.

Why it matters: Maps two routes to world models, one from AI planning research, one from game and film 3D generation, with over $10B invested in 18 months.

r/LocalLLaMA

Same Models Tested Across Strix Halo, RTX 3090, and RTX 5070

C_Coffie published 55 local inference benchmark runs across Strix Halo, RTX 3090, RTX 5070, five backends, and 0.35B to 35B-A3B models; RTX 5070 beats RTX 3090 on models fitting 12GiB, while RTX 3090 leads in the 14–31B band that exceeds 12GiB but fits 24GiB.

Why it matters: A user ran 55 local inference tests across three GPUs and five backends, and reports an RTX 5070 decoding faster than an RTX 3090 within 12GB of VRAM.

Dwarkesh Patel podcast

Notes on Pretraining Parallelisms and Failed Training Runs

Dwarkesh documents pretraining failure modes and parallelism tradeoffs: expert choice and token dropping can break causality in MoE routing, FP16 collectives can bias repeated additions after values exceed 1024, pretraining FLOPs are given as 6ND, B300 HBM is listed as 288GB, and FSDP communication can reach params × 3 with reduce-scatter.

Why it matters: The author breaks down two ways pretraining runs go off the rails, and why expert choice in MoE routing makes a token's destination depend on later routing decisions, so training sees information inference never gets.

May 16Saturday

Hacker News front page

SANA-WM, a 2.6B open-source world model for 1-minute 720p video

SANA-WM’s title says the project is a 2.6B open-source world model for 1-minute 720p video; the RSS body only lists the project URL, Hacker News comments URL, 9 points, and 8 comments, and the post does not disclose training data, license terms, inference cost, evaluation setup, or benchmark results.

Why it matters: NVIDIA open-sources SANA-WM, a 2.6B world model that turns one image plus a camera trajectory into a minute of 720p video, with a two-stage pipeline for long-video quality and motion consistency.

AI HOT (Curated Pool)

Nvidia CEO Says Skilled Trades Have Better Prospects Than CS Graduates

Jensen Huang told Carnegie Mellon’s 2026 CS graduates that skilled trades have better prospects; Randstad says trade demand is growing three times faster than white-collar roles, with robotics technician jobs up 107%.

Why it matters: At Carnegie Mellon's computer science commencement, Jensen Huang said trades beat computer graduates, alongside data showing trade demand growing three times faster than white-collar and robotics technician roles up 107%.

Bloomberg Technology

Cerebras CEO Is Worth $3.2 Billion After Year’s Largest IPO

Cerebras Systems rose about 68% on Nasdaq after the year’s largest IPO, giving the company a market value of roughly $67 billion; the headline says its CEO is worth $3.2 billion after the listing.

Why it matters: Cerebras listed on Nasdaq and closed its first day up about 68%, giving a concrete public-market price for an AI compute company.

May 15Friday

r/LocalLLaMA

Fully Offline Suitcase Robot Built Around Jetson Orin NX SUPER 16GB

CreativelyBankrupt built Sparky as a fully offline suitcase robot on Jetson Orin NX SUPER 16GB, running Gemma 4 E4B Q4_K_M via llama.cpp with q8_0 KV cache, about 200 ms cached TTFT, 14-15 tok/s sustained output, 12K context, 30+ sensors, and no WiFi, Bluetooth, or cellular interface.

Why it matters: A solo developer runs Gemma 4 E4B fully offline on a Jetson Orin NX SUPER 16GB mounted on a suitcase, with about 200ms cached TTFT and 14 to 15 tokens per second.

r/LocalLLaMA

I tracked EU GPU prices across 15 stores for 50+ days: RTX 5090 is the only card not dropping

Reddit user egudegi tracked EU GPU prices across 15 stores for more than 50 days with a 6-hour scrape cadence and about 126,000 readings; RTX 5090 average pricing rose from €3,392 to €3,487, a 3.0% increase.

Why it matters: A Reddit user scripted GPU price tracking across 15 EU stores for over 50 days, and among roughly 126,000 data points the RTX 5090 rose from 3,392 to 3,487 euros while every other model fell.

r/LocalLLaMA

The RTX 5000 PRO 48GB arrived and is better than expected

A Reddit user built a $5,600 RTX 5000 PRO 48GB PC and ran Qwen3.6-27B-FP8 with full-precision cache; they report up to 80 tok/s in TG, about 50–60 tok/s on very large prompts, 4,400 tok/s in prompt processing, and 200k tokens fitting in BF16 KV cache.

Why it matters: A builder with no prior experience spent $5,600 on a single RTX 5000 PRO 48GB machine, hitting 80 tok/s on a 27B model with 200k context at full precision.

May 14Thursday

r/LocalLLaMA

2x RTX 3090 setup for local Qwen 3.6 27B inference

A Reddit user ran Qwen 3.6 27B on a dual RTX 3090 Ubuntu setup, reporting 48GB VRAM, a 262k context window, no NVLink, about 4000 pp/s prompt processing, and 113 tk/s generation.

Why it matters: A Reddit user runs Qwen 3.6 27B on two RTX 3090s in Ubuntu, holding 260K context in 48GB of VRAM at 113 tokens per second.

Bloomberg Technology

Anthropic Eyeing Over $900 Billion Valuation

Bloomberg says Anthropic is seeking at least $30 billion in new financing at a valuation above $900 billion; the post does not disclose investors, deal terms, or a timeline.

Why it matters: Anthropic is reported to be seeking at least $30 billion in new funding at a valuation above $900 billion, a scale that benchmarks against what top labs now need.

May 13Wednesday

New York Times Chinese

Jensen Huang Gets Last-Minute Invitation to Join Trump’s China Trip

Trump called Jensen Huang on Tuesday morning to invite him to join the China trip; the White House’s Monday list of 16 CEOs did not include him, while Nvidia is still seeking approval to sell AI chips to China.

Why it matters: Nvidia spent a year lobbying both Washington and Beijing on AI chip export licenses, and its CEO now joins the White House group.

New York Times Chinese

China Seeks AI Technology Self-Reliance, Weakening Washington’s Leverage Over Beijing

DeepSeek optimized its latest model for inference on Huawei chips for the first time, while two semiconductor sources said training still relies on Nvidia chips; Huawei says it plans to release a training chip this year, but matching current Nvidia performance will take another year.

Why it matters: DeepSeek's new model runs inference on Huawei chips while training still depends on Nvidia, and Huawei's training chips are a year behind, which shows where China's AI hardware decoupling stands and where it stalls.

May 11Monday

QbitAI · WeChat

OpenAI backs Cerebras as the Nvidia challenger targets a $35B IPO valuation

Cerebras raised its IPO price range to $150-$160 per share, targeting about a $35 billion valuation at the top end, after OpenAI signed a 750-megawatt AI compute purchase agreement with deliveries through 2028.

Why it matters: After signing a 750 MW compute purchase deal with OpenAI, Cerebras raised its IPO price range to $150–160 per share, about $35 billion at the top end, with deliveries running into 2028.

May 10Sunday

r/LocalLLaMA

NVIDIA AI Releases Star Elastic: One Checkpoint Contains 30B, 23B, and 12B Reasoning Models

NVIDIA AI released Star Elastic, a single checkpoint that can zero-shot slice 30B, 23B, and 12B reasoning models in BF16, FP8, and NVFP4; when the 23B submodel handles thinking and the 30B model handles final answers, reported accuracy rises 16% and latency drops 1.9× on AIME-2025, GPQA, LiveCodeBench v5, and MMLU-Pro.

Why it matters: NVIDIA's Star Elastic slices 30B, 23B and 12B reasoning models from one checkpoint with no extra training, the 23B thinking and the 30B answering.

May 9Saturday

TechCrunch · AI

Nvidia has already committed $40B to equity AI deals this year

Nvidia has committed more than $40 billion to equity investments in AI companies in 2026, including a $30 billion investment in OpenAI, seven multi-billion-dollar public-company deals, and around two dozen private startup rounds, according to CNBC and FactSet data cited by TechCrunch.

Why it matters: Nvidia has committed over $40 billion to AI equity deals this year, with $30 billion going to OpenAI alone.

Xinzhiyuan · WeChat

NVIDIA, AMD, and Intel Back RadixArk’s $100M Seed Round

RadixArk announced a $100 million seed round on May 5 at a $400 million post-money valuation, led by Accel and co-led by Spark Capital, with participation from NVentures, AMD, MediaTek, Databricks, and other investors tied to AI infrastructure.

Why it matters: RadixArk closed a $100 million seed at a $400 million post-money valuation, with Nvidia, AMD and Intel all on the cap table.