Skip to content

NVIDIA chips and ecosystem: new GPUs, CUDA, robotics platforms and the market for AI compute.

Latest picks

201–220 of 363

Jun 24Wednesday

The Verge · AI

OpenAI reveals its first AI processor: Jalapeño

OpenAI unveiled Jalapeño, its first custom chip built with Broadcom for ChatGPT inference. The chip is in mass production and already deploying on OpenAI's own servers, aiming to cut reliance on Nvidia and control costs. It only handles inference for now; a training chip is still in development. The post does not disclose performance, power, or cost figures.

Why it matters: OpenAI's first in-house chip, Jalapeño, is built with Broadcom, already in production and handling ChatGPT inference only, a concrete test of replacing Nvidia.

Financial Times · Technology

SK Hynix bets on AI demand with a $29bn US listing

SK Hynix plans a $29bn US IPO, the largest overseas listing by a Korean company. The capital will mainly expand HBM memory production for AI chip customers like Nvidia. The post doesn't disclose the timeline or pricing yet. The direction is clear: the AI arms race keeps pushing capital upstream.

Why it matters: SK Hynix plans a $29 billion US listing to expand HBM output for AI chipmakers like Nvidia, the largest overseas listing by a Korean company.

Jun 23Tuesday

TechCrunch · AI

Groq confirms $650M raise and re-staffs after Nvidia's $20B not-acqui-hire deal

AI chip startup Groq confirmed a $650M funding round and is rebuilding its executive team after Nvidia spent roughly $20B to hire away most of Groq's staff without acquiring the company. CEO Jonathan Ross says Groq is now leaning into a neocloud model—running inference services on its own chips instead of just selling hardware. New hires include a chief product officer and a VP of engineering, both from outside the group that left for Nvidia. The post does not disclose the round's valuation or investors.

Why it matters: After Nvidia took most of its staff in a roughly $20B not-acqui-hire, Groq confirmed a $650M raise and a pivot to serving AI inference directly on its own chips.

TechCrunch · AI

SpaceX inks $150M/month compute deal with open source AI lab Reflection AI

SpaceX's Colossus 2 data center near Memphis landed its third major AI compute customer. Open source lab Reflection AI will pay $150 million per month starting July 1, 2026 through 2029 for immediate access to Nvidia GB300 chips. The deal follows earlier contracts with Anthropic ($1.25B/month) and Google ($920M/month). The post doesn't disclose what models Reflection AI plans to train or its funding sources.

Why it matters: SpaceX signed a third big compute deal at its Memphis Colossus 2 data center, with open source lab Reflection AI paying $150M a month for Nvidia GB300 chips through 2029.

Jun 17Wednesday

New York Times Chinese

AI chip boom redraws global tech map, with China conspicuously absent

Nvidia's AI boom is making SK Hynix, Samsung, and Micron extremely rich. The most advanced memory chips come only from these three—none from China. Huang wrote "Please produce more :)" on a Hynix wafer at Computex because supply can't keep up. Memory prices more than doubled this year. Samsung and SK Hynix made South Korea the first country outside the US with two trillion-dollar companies. US tariffs and tech restrictions locked China out of this boom more effectively than subsidies ever did. The supply chain now sits almost entirely in Taiwan and South Korea, two geopolitical flashpoints.

Why it matters: AI chip demand has made the three makers of the most advanced memory wafers a bottleneck, with prices more than doubling this year.

Jun 16Tuesday

Hacker News front page

SubQ 1.1 Small: Sparse attention cuts long-context compute by 64.5x at 1M tokens

Subquadratic released the model card for SubQ 1.1 Small. It replaces quadratic dense attention with Subquadratic Sparse Attention (SSA) that routes based on content relevance, scaling linearly with context length. At 1M tokens, SSA uses 64.5x less compute than dense attention and runs 56x faster than FlashAttention-2. The model scores near-perfect on needle-in-a-haystack from 1M to 12M tokens and 99.12% on RULER at 128K. General reasoning holds: GPQA Diamond 85.4%, LiveCodeBench pass@4 89.7%, AutomationBench Finance 13%. Training started from an open-weight frontier model, replaced attention with SSA, then ran staged context extension up to 2M and ~1T tokens of continued pretraining on books, documents, and repo-scale code. The post does not name the base model. SubQ 1.1 Small is deploying with select design partners; a broader lineup from 2M to 12M tokens is planned later this year.

Why it matters: Subquadratic published the SubQ 1.1 Small model card, replacing dense computation with sparse attention routed dynamically by content relevance, so long-context compute grows linearly with length instead of exploding quadratically.

Jun 10Wednesday

NVIDIA Blog

NVIDIA confidential computing will help Apple expand Private Cloud Compute

Apple is bringing NVIDIA's confidential computing into Private Cloud Compute, running AI inference inside encrypted GPU environments. The setup uses H100 GPUs and Hopper architecture with hardware-level trusted execution environments, so data stays encrypted during processing and even the cloud provider can't access it. Apple previously ran private cloud inference only on its own silicon; this deal signals a shift of some workloads to NVIDIA while keeping the same security isolation. The post doesn't give a launch date or scale numbers, but confirms deployment will start in Apple's own data centers.

Why it matters: Apple moved part of its Private Cloud Compute inference load from its own silicon to Nvidia H100s, keeping data encrypted through hardware-level trusted execution, so its compute base now spans general GPUs.

Jun 9Tuesday

AI HOT (Curated Pool)

Elon Musk Details SpaceX's AI1 Orbital AI Data Center Satellite Plan

Elon Musk detailed SpaceX’s AI1 orbital AI data center satellite plan, with 150 kW peak power per satellite, about 120 kW sustained compute power, and 6-8 ms round-trip latency at 600-800 km low Earth orbit.

Why it matters: Musk detailed SpaceX's AI1 orbital data center satellite, about 120 kW of sustained compute per unit, roughly one NVIDIA GB300 rack, with 6-8 ms laser link round-trip latency.

Jun 8Monday

AI HOT (Curated Pool)

The Vanishing Crash in Five-Model Economies: Control and Emergence

The experiment used five models from OpenAI, NVIDIA, OpenBMB, and a self-fine-tuned 500M-parameter model to drive market agents; three interventions failed to reproduce the price crash, and the crash was created only by overriding prices during settlement.

Why it matters: Five models ran trading agents, and none of three interventions produced a crash until prices were forcibly rewritten at settlement.

r/LocalLLaMA

DFlash Speculative Decoding and KV Cache Compression on RTX 5090 Show 3.26x Speedup

The author tested Qwen3.6-27B on an RTX 5090 with DFlash plus KV cache compression, reaching up to 3.26x speedup; q4_0/turbo4 delivered 3.18x speedup with only +0.02% PPL on WikiText-2.

Why it matters: A single RTX 5090 runs DFlash speculative decoding with KV cache compression on Qwen3.6-27B, hitting 3.26x speedup while q4_0 quantization adds only 0.02% perplexity.

r/LocalLLaMA

Weird to get near-linear scaling by adding another GPU?

A Reddit user benchmarked qwen3.6-27b-autoround-int4 on 1x3090 versus 2x3090. Narrative decode rose from 53 TPS to 94 TPS, and code decode rose from 62 TPS to 120 TPS, under no NVLink, 8x/8x PCIe, P2P automatically enabled, tensor parallelism set to 2, and different KV-cache settings.

Why it matters: A Reddit user ran int4 qwen3.6-27b on two 3090s over plain PCIe without NVLink and nearly doubled decode speed over one card, a concrete data point for adding a second local GPU.

AI HOT (Curated Pool)

Nvidia and SK Hynix Sign Multi-Year Pact to Develop Next-Generation AI Memory Chips

Nvidia and SK Hynix signed a multi-year pact to co-design future generations of memory chips for AI applications; the RSS snippet does not disclose product specifications, production timelines, or financial terms.

Why it matters: Nvidia and SK Hynix signed a multi-year deal to co-develop next-generation AI memory chips from the design stage, a direction worth reading given their roles in AI memory supply.

Jun 7Sunday

AI HOT (Curated Pool)

Five Labs, Five Minds: Building a Multi-Model Financial Drama Game with Small Models

Thousand Token Wood v2 uses four small models from different labs to drive agents in a financial simulation game, with vLLM 0.22.1’s CUDA toolkit dependency identified as the main serving friction, while a fine-tuned 0.5B Qwen reached 0% self-trading and 100% valid quotes.

Why it matters: Small models from four labs play market roles while the player lends, spreads real and fake tips, shorts and bribes, with model differences driving the game's feel.

Jun 6Saturday

r/LocalLLaMA

Big week for open AI, with 25+ notable open-weight drops across every modality

Victor M summarized 25+ open-weight model releases in one week, including NVIDIA Nemotron 3 Ultra, a 550B hybrid Mamba-MoE with 55B active parameters and a 1M-token context window.

Why it matters: More than 25 open-weight models shipped in a week across text, image and speech, with NVIDIA's Nemotron 3 Ultra at 550B parameters and a 1M token context.

r/LocalLLaMA

Running Qwen3.6-35B-A3B on a laptop RTX 4060 8GB

A Reddit user ran Qwen3.6-35B-A3B on an RTX 4060 8GB laptop and reported that --no-mmap raised generation from about 11 to 43 tok/s, while speculative decoding with a Qwen3.5-0.8B draft model improved throughput by 26%.

Why it matters: A Reddit user tested Qwen3.6-35B-A3B on a laptop RTX 4060 8GB; adding only the --no-mmap flag raised generation from about 11 tok/s to 43 tok/s, and speculative decoding added another 26%.

Jun 5Friday

AI HOT (Curated Pool)

Apple’s New Siri Is Marked Internally as Beta, Not Marketed as Finished

Apple marks the new Siri internally as Beta and may use a waitlist for access; some Siri queries will route through Google Cloud to a licensed Gemini version and run on Google’s NVIDIA Blackwell B200 cluster.

Why it matters: Apple labels the new Siri a Beta internally and may gate it behind an Apple Intelligence waitlist, which shows how Apple positions a product it hasn't shipped.

Jun 4Thursday

r/LocalLLaMA

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 on Hugging Face

NVIDIA released Nemotron-3-Ultra-550B-A55B-BF16 with 550B total parameters, 55B active parameters, a 1M-token context window, and minimum hardware listed as 8x H200, 16x H100, or 8x GB200/B200/GB300/B300.

Why it matters: NVIDIA's Nemotron-3-Ultra activates 55B of its 550B parameters per pass, carries a 1M token context, and needs at least 8 H200s to run.

QbitAI · WeChat

CVPR 2026: NVIDIA, Tesla, and Waymo hear Xpeng present physical AI

Xpeng presented its world-model stack at CVPR 2026, covering X-World, X-Foresight, and X-Cache; the article says X-Cache cuts about 70% of repeated computation, the second-generation VLA used over 4 trillion training tokens, and the in-car stack reduced inference latency to 80 ms.

Why it matters: XPeng's CVPR 2026 world-model stack cuts redundant compute by about 70% with X-Cache and trains its second-gen VLA on over 4 trillion tokens.

Jun 3Wednesday

NVIDIA Blog

NVIDIA Research Presents Grasping, Autonomous Driving and Agent Training Work at CVPR

NVIDIA Research presented three physical AI papers at CVPR: GraspGen-X was trained on 2 billion simulated grasps, LCDrive cuts reasoning tokens by about half versus text-based reasoning, and NitroGen trains embodied agents across more than 1,000 games and 40,000 hours of interaction.

Why it matters: NVIDIA published three CVPR papers, including LCDrive, which has a driving model output trajectories directly and cuts inference tokens by about half to lower latency.

AI HOT (Curated Pool)

NVIDIA launches NemoClaw platform for autonomous AI engineers in industrial software

NVIDIA released NemoClaw at COMPUTEX as an open blueprint for long-running AI agents, and more than a dozen industrial software vendors are using it to build autonomous AI engineers for CAE and EDA workflows that compress weeks-long simulation and design tasks into hours.

Why it matters: NVIDIA's NemoClaw open blueprint at COMPUTEX already has more than ten industrial software vendors building autonomous AI engineers on it, spanning CAE simulation and EDA chip design.