NVIDIA

AMD unveiled Helios, a rack-scale system for training and running frontier AI models, at its Advancing AI conference. CEO Lisa Su called it the industry's highest-performance AI rack, with Microsoft among the first customers. Shipping starts later this year. Helios beats Nvidia's Vera Rubin on several benchmarks; the post doesn't disclose pricing or exact delivery dates.

A Reddit user ran the 39.7 GB laguna Q2_K_XL model across two nodes with three RTX 4060 GPUs, connected only by a direct Ethernet cable. At ubatch 768, generation reached 28.28 tok/s on an 11k-token prompt, with network traffic peaking at 30–70 MB/s. The post includes NCCL+RPC build flags and ubatch comparisons, but does not provide a single-machine dual-GPU baseline for the same model.

NVIDIA open-sourced Cosmos 3 Edge on Hugging Face, a 4B-parameter world model that unifies scene understanding and action generation. It runs real-time at 15 Hz on Jetson Thor, producing 32 robot actions per inference. It ranks #1 on VANTAGE-Bench for vision analytics and sets a new SOTA for robot policy learning among 4B models. The architecture uses two transformer towers—autoregressive for reasoning, diffusion for prediction—with shared attention layers. The post doesn't disclose exact latency figures, only 'real-time inference,' so real-world performance will depend on the specific hardware and task.

Huang spent July 15–16 in Tokyo locking in deals that turn Japan from a chip-material supplier into a full-stack physical-AI partner. The centerpiece is Noetra: 44 domestic firms led by SoftBank, Sony, NEC, and Honda, backed by ¥1 trillion ($6.2B) over five years, building homegrown AI for robots, vehicles, and factory floors. Nvidia also launched the Cosmos robotics alliance with Fanuc, Yaskawa, and others to train robots on simulated data. On the materials side, JSR, Shin-Etsu, and Tokyo Electron secured next-gen AI chip supply deals. Worth flagging: these are framework agreements, not shipped products. But the structure—Nvidia wiring itself into Japan's entire industrial stack—matters more than any single contract.

NVIDIA fully open-sourced Audio-Visual Flamingo, a model that jointly understands and reasons over audio, images, and long-form videos. Unlike most AV-LLMs that focus on short clips, it targets real-world long videos. It was trained on ~7M timestamped caption and QA instances using a three-stage curriculum that moves from short-range perception to long-horizon multi-event reasoning. A reasoning framework called TAVI-CoT grounds intermediate steps to specific timestamps. Across 15+ audio, vision, and multimodal benchmarks, AV-Flamingo clearly beats similarly sized open models and matches or surpasses larger closed models on long, complex audio-visual tasks.

Soofi S is a 30B open model trained entirely on Deutsche Telekom's Munich cloud by a German AI consortium. It uses a hybrid Mamba-Transformer MoE design, activating only 3.2B parameters per token, so throughput stays nearly flat even at 256K context. The training mix deliberately favors German, and it beats Olmo 3 32B and Apertus 70B on German, English, and coding benchmarks. Critics called it overtrained under Chinchilla scaling laws; the project's tech lead counters that those laws don't hold for MoE and notes Nvidia trained on up to 25T tokens.

NVIDIA announced two new Thor-based modules: T3000 (865 FP4 teraflops, 32GB memory, 273GB/s bandwidth) at roughly half the size and power of T5000, and T2000 (400 FP4 teraflops, 16GB) for broader edge AI. New Jetson agent skills automate memory optimization—some customers saved up to 15GB and moved to lower-memory SKUs. Cosmos 3 Edge, a 4B-parameter world model, runs on-device on Thor for real-time vision and robot policies. The post does not disclose pricing or ship dates for T3000/T2000.

This FT documentary traces how high-end Nvidia GPUs are smuggled into China via Singapore, Malaysia, and other transit hubs. Middlemen use shell companies, fake end-user certificates, and cross-border ant-like shipments to dodge US export controls. The film captures warehouse stockpiling and repackaging on camera, and interviews both smugglers and investigators. One key detail: serial numbers are stripped and cards repackaged to obscure the origin. The documentary does not give a total black-market volume figure, but shows the supply chain is highly organized.

Nvidia cut its authorized Asian buyer list from 11 to 5 after the US Commerce Department found chips were being re-routed to China through Southeast Asia and the Middle East. Dropped buyers include distributors and server assemblers in Malaysia, Vietnam, and the UAE. Remaining buyers must sign stricter end-use declarations, and Nvidia is now using software to track chip destinations. The list shrink is the company's biggest self-policing move since export controls began—though it doesn't mean every loophole is closed.

At a Morgan Stanley NDR, Jensen Huang delivered three signals: quarterly revenue is approaching $100B and growth is still accelerating; Rubin Ultra is not delayed and will ship next year; a leading AI lab that previously relied almost entirely on ASICs now sources nearly 50% of its compute from Nvidia GPUs—widely read as Anthropic. Nvidia sees growth coming from AI labs, cloud hyperscalers, and sovereign AI. Its CPU business is targeting $20B this year. Morgan Stanley kept a $288 target and said the real bottleneck is no longer demand but delivery constrained by memory, power, and data center space.

The US Commerce Department removed the UAE from its strictest export control tier, clearing a path for Nvidia and others to sell AI chips there. The UAE was previously in the most restricted group over concerns about tech leaking to China. The downgrade means approvals for high-end GPUs for local data centers and AI projects will be much simpler. The post doesn't specify chip models or volume caps, but notes Microsoft and G42's joint venture as a beneficiary.

SK Hynix debuted on Nasdaq, raising $26.5bn in the year's largest global IPO. The funds are earmarked for HBM capacity expansion, feeding Nvidia and other AI chipmakers. The post doesn't disclose the offering price or first-day move, but the size alone shows the market is still doubling down on AI compute supply chains.

Gradium builds ultra-low-latency voice models so AI conversations feel instant, without awkward pauses. It first came out of stealth last December with $70M, then reopened the seed round to bring in Nvidia and others, hitting $100M total. The cash goes toward opening a Bay Area office and competing for talent near Anthropic and OpenAI—a telling move for a Paris-based startup. It already counts Renault as a customer, but faces stiff competition from ElevenLabs (valued at $11B) and Google's Gemini voice capabilities.

Nvidia's stock dropped 15% from its May peak, now cheaper than the S&P 500 average on a forward earnings basis. Money is still pouring into AI infra, but mostly into memory companies — Micron nearly tripled over the same period. The GPU shortage has eased; memory is now the data center bottleneck. The post cites Bloomberg for details but doesn't include revenue figures itself.

France's competition authority confirmed its antitrust investigation into Nvidia is nearly done, with a formal Statement of Objections expected soon. The probe, which began with a raid in September 2023, focuses on two issues: heavy developer lock-in to CUDA, making it hard to switch hardware, and Nvidia's investments in AI cloud firms like CoreWeave that may reinforce its dominance. Nvidia holds over 70% of the global AI accelerator market. A Statement of Objections does not mean guilt—Nvidia can defend itself in writing and at hearings, and a final ruling could take over a year. If abuse is proven, fines can reach 10% of global annual revenue, potentially billions of dollars. Nvidia has not publicly commented on the latest update.

Ant Lingbo open-sourced LingBot-Video, the first MoE-based video generation model built for embodied AI. It has 30B total parameters but activates only ~3B during inference, roughly 3× faster than a dense model of similar size. Training used 70,000 hours of robot-related video—dexterous manipulation, navigation, egocentric interaction. On the RBench benchmark for robot manipulation videos it scored 0.620, ahead of Wan2.6 (0.607) and Seedance 1.5 Pro (0.584). Internal tests also place it above NVIDIA Cosmos 3 and Hunyuan Video 1.5 on physical plausibility and motion consistency. The model targets robot action prediction, simulation data generation, and world-model research. Code is public.

Grok 4.5 is SpaceXAI's strongest model, tuned for coding, agentic tasks, and knowledge work. It scores 62% on DeepSWE 1.0 and 64.7% resolve rate on SWE Bench Pro, though it trails Fable and GPT 5.5 on most listed benchmarks. The standout number is token efficiency: 15,954 output tokens on average per SWE Bench Pro task, 4.2× fewer than Opus 4.8. Inference speed is 80 TPS, priced at $2/$6 per million input/output tokens. The model was trained across tens of thousands of GB300 GPUs, with RL focused on multi-step software engineering. The post doesn't disclose parameter count, context window, or a precise EU launch date beyond mid-July. Available now in Grok Build, Cursor, and via API.

NVIDIA introduces a tri-mode LM that switches between AR, diffusion, and self-speculation decoding in a single architecture. Trained with a joint AR-diffusion objective: diffusion handles lookahead planning, AR supplies left-to-right priors. In self-speculation mode, diffusion drafts and AR verifies, beating multi-token prediction (MTP) on acceptance rate and real-device efficiency. A speed-of-light analysis shows diffusion can produce up to 76.5% more tokens per forward pass than self-speculation under an optimal sampler. The family scales to 3B, 8B, and 14B parameters, covering base, instruct, and vision-language variants. The 8B model decodes 6× more tokens per forward than Qwen3-8B at comparable accuracy, yielding 4× higher throughput on SPEED-Bench with SGLang on a GB200 GPU. The post doesn't disclose open-weight plans or a release timeline.

SemiAnalysis reports: just three months after Jensen showed Kyber NVL144 at GTC, the project has slipped more than 12 months, now targeting 2028. The NVL72x2 back-to-back rack architecture has also been cancelled, limiting Rubin Ultra's scale-out domain. The post is the first in a thread; detailed reasons aren't spelled out yet.

Nvidia plans to let fast-growing startups pay for compute with a cut of future revenue instead of cash. The program, called Nvidia Ignite, targets companies with $10M–$500M in annual revenue that aren't yet profitable. The post doesn't spell out the revenue-share percentage or deal terms—sounds like Nvidia is picking winners while GPUs are scarce, but the execution details are still vague.