Skip to content

NVIDIA chips and ecosystem: new GPUs, CUDA, robotics platforms and the market for AI compute.

Latest picks

321–340 of 362

Apr 29Wednesday

r/LocalLLaMA

Qwen3.6 27B on Dual RTX 5060 Ti 16GB with vLLM: ~60 tok/s, 204k Context Working

A user ran Qwen3.6 27B with vLLM on dual RTX 5060 Ti 16GB cards, reaching ~62–66 tok/s at 8K. The setup used 32GB VRAM, TP=2, fp8 KV cache, MTP 3 tokens, and a 204800 context window. The tight part is memory: after a 168k prefill, each GPU used ~15.65GiB with max_num_seqs=1.

Why it matters: A user ran Qwen3.6 27B on two RTX 5060 Ti 16GB cards with vLLM and measured 62–66 tok/s at 8K context, with the exact tensor-parallel, fp8 KV cache and MTP settings listed.

NVIDIA Blog

NVIDIA Launches Nemotron 3 Nano Omni for Vision, Audio, and Language Agents

NVIDIA launched Nemotron 3 Nano Omni, claiming up to 9x higher throughput at the same interactivity. It uses a 30B-A3B hybrid MoE with Conv3D, EVS, and 256K context, taking text, images, audio, video, documents, charts, and GUIs as input. Open weights, datasets, and training methods arrive April 28, 2026 on Hugging Face, OpenRouter, build.nvidia.com, and 25+ platforms.

Why it matters: NVIDIA open-sourced Nemotron 3 Nano Omni, one model handling image, text, audio and video with 3B active parameters and 256K context, giving teams building multimodal agents an open path.

Apr 27Monday

Bloomberg Technology

Sequoia and Nvidia Back Ex-DeepMind Researcher’s New AI Startup at $5.1 Billion Value

David Silver’s Ineffable Intelligence raised $1.1 billion at a $5.1 billion valuation. Backers include Sequoia and Nvidia; the post does not disclose product scope, model specs, or launch timing.

Why it matters: Former DeepMind researcher David Silver's new company raised $1.1 billion from Sequoia and Nvidia at a $5.1 billion valuation, showing how capital prices a top research team's pedigree.

Hacker News front page

Show HN: Utilyze — an open-source GPU monitoring tool claiming higher accuracy than nvtop

Systalyze open-sourced Utilyze to measure real GPU compute efficiency in production, with negligible overhead claimed. The post says nvidia-smi and nvtop only check whether any kernel runs during the sampling window; an H100 has 132 SMs and 17,424 cores. The key issue is real throughput headroom, not binary utilization dashboards.

Why it matters: Utilyze measures GPU load by effective compute efficiency instead of the binary busy flag in nvidia-smi and nvtop, so a single busy core on an H100 no longer reads as 100%.

Hacker News front page

AI can cost more than human workers now

Axios says some firms now spend more on AI than salaries; Nvidia's Bryan Catanzaro says compute costs exceed employee costs. Gartner forecasts 2026 IT spending at $6.31T, up 13.5%, driven by AI infrastructure, software, and cloud. Watch token costs: Uber's CTO has already exhausted the 2026 AI budget.

Why it matters: An Nvidia executive says the team's compute costs far exceed headcount, and Uber's CTO burned its entire 2026 AI budget on tokens, signs that AI bills now outrun payroll at specific companies.

QbitAI · WeChat

Stanford-led LLM-as-a-Verifier claims SOTA on Terminal-Bench 2.0

Stanford, Berkeley and Nvidia introduced LLM-as-a-Verifier, claiming SOTA on Terminal-Bench 2.0 and SWE-Bench Verified. It selects trajectories via score-token granularity, repeated checks and criteria decomposition; ForgeCode accuracy reached 86.4%.

Why it matters: Stanford, Berkeley and NVIDIA proposed LLM-as-a-Verifier, which has a model check another model's solution path step by step, and it topped both Terminal-Bench 2.0 and SWE-Bench Verified.

Apr 25Saturday

Latent Space

DeepSeek V4 Pro and Flash released, runnable on Huawei Ascend chips

DeepSeek released V4 Pro and V4 Flash, with 1.6T/49B active and 284B/13B active parameters. Both support 1M-token context, Base/Instruct variants, and an MIT license; the report claims 27% FLOPs and 10% KV cache versus V3.2 at 1M tokens. The key point is Huawei CANN compatibility, not just benchmarks, because it reduces CUDA dependence.

Why it matters: DeepSeek's V4 Pro and V4 Flash both take a 1M-token context, cut long-text compute to 27% of V3.2, and run on Huawei Ascend chips.

Computing Life · Share · Yage

TPU vs. CUDA: A Post-Cloud Next 2026 Assessment

Google announced TPU 8t/8i, TorchTPU, and an Anthropic deal at Cloud Next 2026; TPU 8i is slated for H2 2027 volume production. 8i has 288GB HBM, 8.6TB/s bandwidth, and 384MB SRAM; TorchTPU runs PyTorch on TPU, but the post says independent benchmarks are missing. The key crack is vLLM inference, while the author says TPU will not replace NVIDIA within 18-24 months.

Why it matters: At Cloud Next 2026 Google split its eighth-gen TPU into 8t for training and 8i for inference, and launched TorchTPU so PyTorch code runs directly without the old bridge layer.

Apr 22Wednesday

TechCrunch · AI

Exclusive: Google deepens Thinking Machines Lab ties with new multibillion-dollar deal

Thinking Machines Lab signed a multibillion-dollar deal with Google Cloud for AI infrastructure powered by Nvidia’s latest GB300 chips. The snippet discloses the deal size, cloud provider, and chip generation; the post does not disclose term length, compute volume, delivery timeline, or workload details. The real signal is GB300 entering a top lab’s procurement stack, not just launch-stage specs.

Why it matters: Mira Murati's Thinking Machines Lab signed a multi-billion-dollar, multi-year compute deal with Google Cloud using Nvidia GB300 chips for training and inference, adding one more data point on how top labs buy silicon.

QbitAI · WeChat

SenseAuto's Sage with 3B active params claims to beat GPT-5.4 and Opus 4.6 in cars

SenseAuto released Sage, an in-car multimodal edge model with 32B total params and 3B active params, and says it scored 94% on PinchBench, above Claude Opus 4.6 at 93.3% and GPT-5.4 at 90.5%. The post says Sage runs on Nvidia OrinX with about 0.5s TTFT, 0.03s TPOT, and 80 tok/s throughput; its SCOUT training method cuts GPU hours by about 60%, and ERL raises complex-task completion by 20%. The key point is not the headline race but whether a 3B-active model can sustain multi-step tool use on device.

Why it matters: SenseAuto's Sage is an on-car multimodal model with 32B total parameters that activates 3B per pass, scoring 94% on PinchBench ahead of Claude Opus 4.6 and GPT-5.4, with OrinX latency and throughput numbers.

Apr 21Tuesday

Bloomberg Technology

Google to Release New AI Chips, Challenging Nvidia | Bloomberg Tech 4/20/2026

Google plans to release new AI chips focused on inference, directly challenging Nvidia. The RSS snippet confirms the inference focus, but the post does not disclose launch timing, model names, performance, pricing, or customers. The real signal is rising competition on inference silicon supply, not the show's other rocket or IPO items.

Why it matters: Google is preparing a new AI chip built for inference, putting it in direct competition with Nvidia at the same stage of the stack.

Apr 19Sunday

r/LocalLLaMA

Unweight: how we compressed an LLM 22% without sacrificing quality

Cloudflare released Unweight, a lossless system that compresses LLM weights by 15% to 22% with bit-exact outputs preserved. The snippet says it targets memory-bandwidth bottlenecks on GPUs like NVIDIA H100 by compressing only the BF16 exponent byte; over 99% of weights in a typical layer use 16 exponent values, saving about 3 GB VRAM on an 8B model. The key detail is on-chip decompression plus four autotuned execution paths; the post does not disclose throughput results or model coverage in the excerpt.

Why it matters: Cloudflare's open-source Unweight compresses only the exponent bits of BF16 weights, decompresses to output identical to the original model, and saves about 3GB of VRAM on an 8B model.

QbitAI · WeChat

Amap unveiled ABot, its first full-stack embodied AI stack for AGI, and claimed 15 SOTA results

Amap unveiled embodied AI stack ABot and claimed SOTA on 15 metrics. The post says ABot-3DGS builds 10k-scale 3D scenes from centimeter-level map data, while ABot-PhysWorld uses a 14B DiT and 3M real manipulation videos. What matters is the interactive world model and VLA loop; the post does not disclose the 15 benchmarks, exact metrics, or the open-source timeline and scope.

Why it matters: Amap published its full-stack embodied intelligence system ABot, whose ABot-PhysWorld trains a 14B-parameter diffusion model on 3 million real robot-arm manipulation videos so robots simulate an action before executing it.

Apr 17Friday

Dwarkesh Patel

Jensen Huang Makes the Case for Selling Chips to China

Jensen Huang argues the US should keep selling AI chips to China, saying China is about 40% of the global tech industry and abandoning that market weakens the US stack and developer base. He says a DeepSeek model optimized for Huawei first would disadvantage the US, and that Nvidia wins on compute, programmability, and ecosystem. The key issue is ecosystem lock-in, not a single export ban alone.

Why it matters: Huang argues that leaving a market worth about 40% of the global tech industry hands the developer ecosystem to Huawei and other Chinese hardware.

Hacker News front page

The Beginning of Scarcity in AI

Nvidia Blackwell GPU rental prices rose from $2.75 to $4.08 per hour in two months, a 48% jump, signaling tighter AI compute supply. The post adds that CoreWeave raised prices 20% and extended minimum contracts from one to three years, while Anthropic limited its newest model to about 40 organizations. The real signal is procurement and capacity allocation, not model scores alone.

Why it matters: Blackwell GPU rental prices rose 48% in two months, CoreWeave raised rates 20% and pushed minimum terms to three years, and OpenAI has already cut projects for lack of compute.

Apr 16Thursday

Dwarkesh Patel

Jensen Huang Fires Back on China Chip Ban

Jensen Huang argues in the video against broad US chip bans on China and calls for more balanced rules so Nvidia can keep competing globally. The post only discloses his arguments and two analogies: he rejects comparing AI chips to enriched uranium and disputes the premise that China is a lost market anyway; it does not disclose specific policy terms, timing, or affected chip models. The key claim is structural: compute platforms are sticky, so conceding a market weakens a US firm's ecosystem position.

Why it matters: Jensen Huang pushed back on US chip export limits to China in a video and rejected the comparison of AI chips to enriched uranium, answering a common argument for the controls.

Dwarkesh Patel

Jensen Huang: Will Nvidia's moat persist?

Jensen Huang says Nvidia's moat is the hard-to-copy stack that turns electrons into tokens, plus supply-chain coordination, not chip design alone; the interview cites nearly $100B in disclosed purchase commitments, and a SemiAnalysis report estimating $250B. He grounds that in two mechanisms: explicit and implicit upstream commitments across foundry, HBM, and packaging, and a downstream ecosystem tying model builders, OEMs, and developers together; he also says agent growth will drive more usage of software tools.

Why it matters: Huang pins Nvidia's moat on the whole supply chain that turns electrons into tokens, work heavy in science and engineering that can't be commoditized soon.

Apr 14Tuesday

最佳拍档 (BestPartners)

Global GPU shortage worsens: H100 rental prices rose nearly 40% in five months

SemiAnalysis says Nvidia H100 one-year rental pricing rose from $1.70 to $2.35 per GPU-hour between Oct 2025 and Mar 2026, up nearly 40% in five months. The post attributes this to Anthropic-driven demand, multi-agent and media generation workloads, and memory cost spikes, with LPDDR5 and DDR5 contract prices up about 4x and 5x year over year; much new capacity is already prebooked. The key variable is the supply gap, not Blackwell refreshes alone.

Why it matters: SemiAnalysis reports H100 one-year rental prices rose from $1.70 to $2.35 per hour in five months, with spot clusters of 64 GPUs now hard to rent, putting compute tightness into concrete numbers.

Apr 11Saturday

QbitAI · WeChat

A Chinese embodied model reached global No.1 as a 100,000-hour human dataset for robots was released

Psibot says it released a 100,889-hour human-plus-robot manipulation dataset, and that Psi-R2 ranked first on AllenAI’s MolmoSpace benchmark. The post lists 95,472 hours of human data, 5,417 hours of robot data, 1,000 open-sourced hours, 294 scenes, 4,821 tasks, and 1,382 objects; Psi-W0 adds 30% failure samples, and Psi-R2 latency drops from 2.2s to under 100ms. The key point is the data loop and benchmark framing: the post claims nearly 10x higher success, but does not disclose task setup, full baselines, or statistics.

Why it matters: Psi-R2 tops AllenAI's MolmoSpace benchmark and ships a 100,889-hour manipulation dataset, 95,472 hours of it human, with 1,000 hours open sourced so far.

Apr 8Wednesday

MIT Technology Review · AI

Mustafa Suleyman: AI development won’t hit a wall anytime soon—here’s why

Mustafa Suleyman argues frontier AI training compute rose from about 10^14 to over 10^26 FLOPs since 2010, a 1 trillion-fold increase, so AI development is not near a wall. He cites a 7x Nvidia chip gain in six years, 3x more HBM3 bandwidth, and Epoch AI estimates that compute needed for fixed performance halves every eight months. The piece is commentary from Microsoft AI’s CEO, not an independent study; the post does not disclose a reproducible basis for the 200GW-by-2030 claim.

Why it matters: Suleyman lays out concrete compute and chip numbers to argue AI scaling will not stall in the near term.