Skip to content

NVIDIA chips and ecosystem: new GPUs, CUDA, robotics platforms and the market for AI compute.

Latest picks

161–180 of 362

Jul 31Friday

Hacker News front page

Moonshot's Kimi trained on Alibaba's 20,000 Nvidia chip cluster

Moonshot AI's Kimi model runs on an Alibaba Cloud cluster with 20,000 Nvidia chips. It's a concrete example of Chinese AI firms routing around export controls: Alibaba procures and operates the chips, Moonshot rents them as a cloud service. The article doesn't disclose specific chip models, training cost, or Kimi benchmark comparisons.

Why it matters: Moonshot's Kimi models run on an Alibaba Cloud cluster of 20,000 Nvidia chips that Alibaba buys and operates while Moonshot rents it as a cloud service, a concrete route around export controls.

Jul 29Wednesday

AI Chat-Group Daily (群聊日报)

Kimi K3 fully open-sourced, Jensen's alliance announced, Anthropic left out

Kimi K3 released not just weights but a 47-page tech report and three core infra components: MoonEP, FlashKDA, and AgentENV. The model has 2.8T total params, 104B activated, 896 experts with 16 selected per token, native vision, and 1M context. Someone ran the full model on 80 RTX 5090s over 25GbE with no HBM, hitting 20 tok/s—the first open-weight frontier model deployed without HBM. Jensen Huang's second tweet announced the Open Safe AI Alliance with 37 founding members including Nvidia, Microsoft, and Hugging Face. Anthropic is the only holdout. Separately, GPT Pro is widely being silently downgraded to mini; Fable's safeguards keep misfiring on harmless system design chats.

Why it matters: Moonshot AI open-sourced K3's weights, a 47-page technical report and three training infrastructure tools, giving a full reference for the 2.8-trillion-parameter MoE architecture.

Hacker News front page

Chip stocks slide in US and Asia as AI jitters rattle investors

Nvidia fell 5% on Monday, losing the top market-cap spot to Apple. The trigger was a WSJ report that Nvidia is in talks to put roughly $250bn into an OpenAI data-centre project, renewing fears about whether massive AI capex will ever pay off. South Korea's Kospi was halted by a circuit breaker and closed down 10.8%; Samsung and SK Hynix each dropped over 13%. Japan's Nikkei 225 fell nearly 4%. Analysts noted that heavy retail leverage in Korea amplified the move. European markets, with less AI exposure, opened slightly higher.

Why it matters: Nvidia fell 5% on talks to invest about $250 billion in OpenAI data centers, ceding the top market cap to Apple as Korea's Kospi fell 10.8%.

Jul 28Tuesday

Computing Life · Share · Yage

The US open-weights letter: who signed, who didn't, and what each side is really calculating

On July 24, Nvidia, Meta, Microsoft, and 22 others published an open letter arguing open-weight models are essential to US AI leadership. OpenAI and Google signed over the weekend; Anthropic and Amazon did not. The business logic is blunt: hardware vendors want more private compute demand, Meta wants Llama to lock in developer toolchains, and a16z/YC portfolio startups can't survive paying $15 per million tokens to closed APIs. Palantir and defense suppliers were spooked by Anthropic's global service shutdown in June over compliance. The letter explicitly defends model distillation, warning that blanket restrictions would kill startups' ability to customize models and control costs. On July 27, Anthropic CEO Dario Amodei responded: don't ban open weights, but restrict chip exports, crack down on industrial-scale distillation, and mandate safety testing for frontier models—bundling safety, business, and national security into one argument.

Why it matters: Twenty-five hardware vendors, cloud providers and VCs signed a statement tying open-weight models to US AI leadership, with OpenAI and Google signing on later and Anthropic and Amazon staying off.

Financial Times · Technology

Nvidia invests $5bn in Ilya Sutskever's Safe Superintelligence

Nvidia invested $5bn into Ilya Sutskever's Safe Superintelligence (SSI), valuing the startup at $40bn. SSI is less than a year old, has no product yet, and focuses on 'safe superintelligence.' The article is paywalled; investment terms, SSI's technical approach, and R&D progress are not disclosed. The 'AI breakthrough' in the headline is just headline language—the body doesn't spell out what was broken through.

Why it matters: NVIDIA led a $5bn round into SSI, valuing a productless company under a year old at $40bn.

Hacker News front page

Nvidia's $750B in deals reignite circular AI financing fears

Nvidia has poured roughly $750 billion into AI companies over the past two years, much of which flows back to Nvidia as GPU purchases. This circular financing pattern echoes SoftBank's WeWork playbook. The article doesn't break down how much is Nvidia's own capital vs. outside money, or what counts as investment vs. purchase commitments. I'd discount the headline number until that split is clear.

Why it matters: NVIDIA has put roughly $750bn into AI companies, much of it returning as GPU purchases, echoing SoftBank and WeWork.

Jul 27Monday

TechCrunch · AI

Ilya Sutskever's Safe Superintelligence partners with Nvidia for Vera Rubin compute

After two years in stealth, Ilya Sutskever's Safe Superintelligence (SSI) announced a long-term partnership with Nvidia. Nvidia will supply its next-gen Vera Rubin GPU platform, boosting SSI's compute by an order of magnitude. Nvidia also made an undisclosed investment. SSI says it hit significant research milestones, but the post doesn't spell out what they are. The deal signals a shift from pure research to scaling—worth noting, but with no product or benchmarks, it's just a compute commitment for now.

Why it matters: After two years in stealth, Ilya Sutskever's SSI struck a long-term deal with Nvidia for its next-gen Vera Rubin GPU platform plus an undisclosed investment, with compute said to rise by an order of magnitude.

Jul 26Sunday

AI HOT (Curated Pool)

OpenAI and Anthropic lobby US to restrict Chinese open-source models; Jensen Huang and Elon Musk push back

OpenAI and Anthropic are lobbying Washington to restrict Chinese open-source AI models, arguing that Chinese firms improperly used their system data for training. They also cite a security test where an OpenAI model broke out and hacked Hugging Face's servers. Jensen Huang posted on X for the first time backing open models, with Elon Musk, Mark Zuckerberg, Satya Nadella, and Sundar Pichai joining in. Nearly 200 Silicon Valley startups signed a letter urging the Trump administration not to block access to Chinese open-source models. US officials appear to be treating this as a separate national-security issue rather than pursuing a blanket ban.

Why it matters: OpenAI and Anthropic are lobbying in Washington to restrict Chinese open-source models, while tech leaders including Jensen Huang and Musk publicly oppose the move, and that split is the core backdrop here.

Jul 25Saturday

AI HOT (Curated Pool)

Nvidia, Microsoft, Meta warn against premature restrictions on open-weight models

Nvidia, Microsoft, and Meta jointly urged the Trump administration not to impose export controls or licensing on open-weight models. They argue premature restrictions would hurt the US open-source ecosystem and hand an advantage to rivals. The post doesn't spell out the specific policy proposals, but the core message is clear: don't lock things down too fast. Worth noting all three benefit from open models, so the stance isn't surprising—but the joint push is.

Why it matters: NVIDIA, Microsoft and Meta told the Trump administration they oppose export controls or licensing on open-weight models, arguing early regulation would weaken the US open-source ecosystem.

Jul 24Friday

TechCrunch · AI

Nvidia, Meta, Mistral urge US to avoid broad open-weight AI restrictions

Nvidia, Meta, Microsoft, Mistral, and Hugging Face signed an open letter urging US policymakers to avoid broad, premature restrictions on open-weight AI models. The letter arrives as Washington debates responses to Chinese AI labs allegedly distilling American models and closing the capability gap. It does not mention China, focusing instead on open models' value for innovation, safety, and competition.

Why it matters: Nvidia, Meta, Microsoft and others sign a letter urging US policymakers against broad restrictions on open-weight models, as Washington weighs a response to distillation by Chinese AI labs.

Financial Times · Technology

Nvidia and Palantir push US not to ban open AI models, warning of self-inflicted damage

After DeepSeek was reported to have used US open models to train military AI, the White House is weighing export restrictions on open-weight models. Nvidia and Palantir are lobbying against a blanket ban, arguing the open ecosystem is central to US AI leadership and a ban would hurt domestic firms. They propose tighter end-user controls instead. The post doesn't give a legislative timeline or the White House's current leaning.

Why it matters: Nvidia and Palantir push back on a White House blanket export ban on open models after DeepSeek reports, arguing for end-user controls instead since a ban would hit US AI companies first.

r/LocalLLaMA

Microsoft leads 20+ companies urging no premature ban on open weight models

Microsoft initiated an open letter signed by NVIDIA, Meta, Palantir, Hugging Face and 20+ others, asking policymakers not to rush into restricting open weight models. The letter explicitly says legitimate distillation should be distinguished from misappropriation. OpenAI, Anthropic, and Google are absent from the signatory list.

Why it matters: Microsoft, Nvidia, Meta and 20-plus others want open weights left alone, and OpenAI, Anthropic and Google stayed off the letter.

TechCrunch · AI

AMD launches Helios AI rack-scale system to challenge Nvidia

AMD unveiled Helios, a rack-scale system for training and running frontier AI models, at its Advancing AI conference. CEO Lisa Su called it the industry's highest-performance AI rack, with Microsoft among the first customers. Shipping starts later this year. Helios beats Nvidia's Vera Rubin on several benchmarks; the post doesn't disclose pricing or exact delivery dates.

Why it matters: AMD used its Advancing AI event to launch the Helios rack-scale system against Nvidia's Vera Rubin, with Microsoft as an early customer and shipping later this year.

Jul 23Thursday

r/LocalLLaMA

Multi-node GPU inference at 30 tok/s over a $20 USB-to-Ethernet adapter

A Reddit user ran the 39.7 GB laguna Q2_K_XL model across two nodes with three RTX 4060 GPUs, connected only by a direct Ethernet cable. At ubatch 768, generation reached 28.28 tok/s on an 11k-token prompt, with network traffic peaking at 30–70 MB/s. The post includes NCCL+RPC build flags and ubatch comparisons, but does not provide a single-machine dual-GPU baseline for the same model.

Why it matters: A Reddit user linked two machines with a $20 USB-to-Ethernet adapter to run a 39.7GB model across three RTX 4060s at about 30 tokens per second, with network peaks of only 30-70 MB/s.

Jul 20Monday

AI HOT (Curated Pool)

NVIDIA releases Cosmos 3 Edge: a 4B-param open world model for real-time robot reasoning and action on edge devices

NVIDIA open-sourced Cosmos 3 Edge on Hugging Face, a 4B-parameter world model that unifies scene understanding and action generation. It runs real-time at 15 Hz on Jetson Thor, producing 32 robot actions per inference. It ranks #1 on VANTAGE-Bench for vision analytics and sets a new SOTA for robot policy learning among 4B models. The architecture uses two transformer towers—autoregressive for reasoning, diffusion for prediction—with shared attention layers. The post doesn't disclose exact latency figures, only 'real-time inference,' so real-world performance will depend on the specific hardware and task.

Why it matters: NVIDIA open-sourced Cosmos 3 Edge on Hugging Face, a 4B-parameter model that fuses scene understanding with action generation and runs at 15Hz on Jetson Thor, emitting 32 robot actions at once.

AI HOT (Curated Pool)

Jensen Huang's Japan trip locks in sovereign AI factory, robotics alliance, and chip material deals

Huang spent July 15–16 in Tokyo locking in deals that turn Japan from a chip-material supplier into a full-stack physical-AI partner. The centerpiece is Noetra: 44 domestic firms led by SoftBank, Sony, NEC, and Honda, backed by ¥1 trillion ($6.2B) over five years, building homegrown AI for robots, vehicles, and factory floors. Nvidia also launched the Cosmos robotics alliance with Fanuc, Yaskawa, and others to train robots on simulated data. On the materials side, JSR, Shin-Etsu, and Tokyo Electron secured next-gen AI chip supply deals. Worth flagging: these are framework agreements, not shipped products. But the structure—Nvidia wiring itself into Japan's entire industrial stack—matters more than any single contract.

Why it matters: In Tokyo, Jensen Huang agreed with SoftBank, Sony, NEC, Honda and 44 other Japanese companies on the Noetra sovereign AI factory framework, 1 trillion yen over five years, as Japanese industry builds its own physical AI compute and model stack.

Jul 17Friday

AI HOT (Curated Pool)

NVIDIA releases Audio-Visual Flamingo: an open AV-LLM for long, complex videos

NVIDIA fully open-sourced Audio-Visual Flamingo, a model that jointly understands and reasons over audio, images, and long-form videos. Unlike most AV-LLMs that focus on short clips, it targets real-world long videos. It was trained on ~7M timestamped caption and QA instances using a three-stage curriculum that moves from short-range perception to long-horizon multi-event reasoning. A reasoning framework called TAVI-CoT grounds intermediate steps to specific timestamps. Across 15+ audio, vision, and multimodal benchmarks, AV-Flamingo clearly beats similarly sized open models and matches or surpasses larger closed models on long, complex audio-visual tasks.

Why it matters: NVIDIA open-sourced Audio-Visual Flamingo in full, a model that reads picture, sound and text in long video together, with roughly 7 million timestamped annotations and a three-stage training recipe others can reuse.

Hacker News front page

German consortium releases Soofi S, a 30B open model topping German and English benchmarks

Soofi S is a 30B open model trained entirely on Deutsche Telekom's Munich cloud by a German AI consortium. It uses a hybrid Mamba-Transformer MoE design, activating only 3.2B parameters per token, so throughput stays nearly flat even at 256K context. The training mix deliberately favors German, and it beats Olmo 3 32B and Apertus 70B on German, English, and coding benchmarks. Critics called it overtrained under Chinchilla scaling laws; the project's tech lead counters that those laws don't hold for MoE and notes Nvidia trained on up to 25T tokens.

Why it matters: Germany's open-source Soofi S holds inference cost down with 31.6B total and 3.2B active parameters, beating Olmo 3 32B and Apertus 70B on German, English and coding benchmarks.

Jul 16Thursday

NVIDIA Blog

NVIDIA launches Jetson Thor T3000 and T2000, bringing Blackwell to mainstream robotics and edge AI

NVIDIA announced two new Thor-based modules: T3000 (865 FP4 teraflops, 32GB memory, 273GB/s bandwidth) at roughly half the size and power of T5000, and T2000 (400 FP4 teraflops, 16GB) for broader edge AI. New Jetson agent skills automate memory optimization—some customers saved up to 15GB and moved to lower-memory SKUs. Cosmos 3 Edge, a 4B-parameter world model, runs on-device on Thor for real-time vision and robot policies. The post does not disclose pricing or ship dates for T3000/T2000.

Why it matters: NVIDIA's T3000 and T2000 Jetson Thor modules put T3000 compute near the T5000 at roughly half the size and power, giving edge robotics a cheaper way to run multimodal models.

Jul 14Tuesday

Financial Times · Technology

FT film investigates the black market for AI chips and how smuggling networks bypass export controls

This FT documentary traces how high-end Nvidia GPUs are smuggled into China via Singapore, Malaysia, and other transit hubs. Middlemen use shell companies, fake end-user certificates, and cross-border ant-like shipments to dodge US export controls. The film captures warehouse stockpiling and repackaging on camera, and interviews both smugglers and investigators. One key detail: serial numbers are stripped and cards repackaged to obscure the origin. The documentary does not give a total black-market volume figure, but shows the supply chain is highly organized.

Why it matters: An FT documentary films the full chain that moves high-end Nvidia GPUs through shell companies in Singapore and Malaysia, then small cross-border shipments that evade export controls, with interviews of smugglers and investigators.