NVIDIA

Nvidia published research showing its AVO harness pushed a non-frontier model to 100% on ARC-AGI 3. The harness handles planning, error correction, and memory for long-horizon tasks, proving the wrapper matters more than raw model capability. The post doesn't name the underlying model, parameter count, latency, or cost—so hold off on production timelines.

Nari Labs open-sourced a Qwen3-TTS 1.7B CustomVoice serving implementation that hits sub-50 ms p95 time-to-first-audio at 10 RPS on a single H100 SXM with zero underruns. They benchmarked against vLLM-Omni, SGLang-Omni, VoxServe, and M*—default p95 latencies ranged from 277 to 1,160 ms at 1 RPS. At full utilization the system costs roughly $2 per 1M characters, compared to $100 for ElevenLabs V3 and $49 for Cartesia Sonic 3.5. Key optimizations include dynamic leading-silence trimming (~80 ms saved) and tuned codec-frame accumulation. Code and benchmarks are public; the post does not disclose underrun details at higher concurrency or long-form performance.

Poolside struck a $6B non-exclusive licensing deal plus a $1B investment from NVIDIA at a $12B pre-money valuation. The deal transfers Poolside's model factory and 109 employees to NVIDIA, while the founders stay to pivot the company. The founders call it neither an acquisition nor an acquihire. They missed a 6-week window to raise $2B for a 40,000 GB300 cluster last year, and now say frontier compute requirements have gone vertical. Poolside's infrastructure spinout PIC is building a 1.2GW datacenter in Texas with ambitions to scale to 7GW. The founders believe open source will commoditize human-level intelligence but superintelligence won't be, and they haven't shared the new vision yet.

The US blocked NVIDIA through four rounds of public rule updates; China blocked it through silent, document-free bans. Two generations of RTX 5090D died in different countries. Of 400,000 approved H200 exports, only 20,000 were cleared. China's logic: first ask Huawei if it can take over, then close the door. Huawei stacks 384 chips to beat GB200 NVL72 but uses 4x the power, sustained by cheap electricity. The two machines are converging: the US slides toward discretion, China hardens discretion into rules.

Inco AI released DFlash 2, adding a lightweight path selector on top of parallel speculative decoding. Instead of keeping only the top-1 candidate per position, it picks a coherent path from the top 16, raising accepted tokens per verification from 4.27 to 6.79. On Qwen3.8-27B with SGLang, throughput reaches 2.7–3.4× autoregressive decoding at batch size 1, with roughly 1% added cycle latency. SGLang, vLLM, llama.cpp, and oMLX already support it; DFlash models have been downloaded over 3.5 million times on Hugging Face.

Chinese regulators have quietly eased import restrictions on Nvidia H200 chips, allowing select cloud providers and data center operators to purchase them. The H200 is an upgraded H100 with higher memory bandwidth, useful for training large models. The change came through relaxed approval practices rather than a formal policy document. The post does not name which companies received licenses, nor does it specify the timeline or volume caps. This looks like a tactical tweak in enforcement, not a reversal of export control direction.

NVIDIA signed residual value guarantees for OpenAI's Ohio data center lease, capping its exposure at $105 billion—roughly its entire FY2026 operating cash flow. OpenAI lacks a credit rating, so the guarantee lets SB Energy borrow to build the campus. In return, the site must exclusively use NVIDIA's full-stack hardware, and NVIDIA also invested $1.5 billion in SB Energy. The deal makes NVIDIA supplier, landlord shareholder, and tenant guarantor all at once, with chip payments ultimately flowing back to it. Payouts trigger only if OpenAI defaults, and only cover the shortfall after the facility is re-leased or sold. The article argues this is closer to vendor credit enhancement than a subprime rerun: no margin calls, and the debt sits mostly in private credit. If the AI cycle turns, the most exposed are GPU-collateralized neocloud lenders, OpenAI's cash burn, and SoftBank's bridge loan—not NVIDIA's balance sheet.

Nvidia plans to back OpenAI's Ohio data centre project with $100bn, delivered through GPU purchases and infrastructure investment rather than direct cash. OpenAI leads the project, which will become its core compute base for training and inference. The article is paywalled; construction timeline, GPU specs, and power supply details are not disclosed.

Groq raised $350M at a $3.5B valuation, down from $6.9B last September. The former AI chip startup is now a neocloud, buying Nvidia GPUs and building data centers for inference services. Disruptive led the round, with Nvidia planning to participate. The pivot accelerated after Nvidia hired Groq's founder late last year.

Nvidia is putting $1.5B into SB Energy, a SoftBank- and OpenAI-backed data center developer, to become the sole compute supplier for OpenAI's Ports-Pike site in Ohio. The campus starts at 4.25 GW and can scale to 8 GW. Nvidia will also extend up to $105B in credit for construction. A $33B natural gas plant will power it, built on former DOE uranium-enrichment land. The deal is essentially Nvidia locking in long-term chip orders with cash and credit, not a pure financial bet.

The author runs Qwen3.8 27B at its full 256K context on a single 24GB RTX PRO 4000 SFF, averaging 50.44 tok/s. The gain comes from a custom NVFP4 quant that protects sensitive layers, embedded MTP speculative decoding, and tuned CUDA kernels—not from any single component. Target-only decoding hits 21.19 tok/s; MTP pushes it to 59.46 tok/s. At a nearly full 256K cache, throughput drops to 12.61 tok/s without OOM. The post doesn't disclose total cost, but it's a detailed engineering log, not a plug-and-play recipe.

Nvidia plans to back the first phase of OpenAI's Ohio data center with up to $105 billion, mostly in the form of GPUs and other hardware. Nvidia won't operate the facility. The total project is touted as a $500 billion effort, but the post doesn't spell out where the rest of the money comes from or the timeline. Treat the $105 billion as a ceiling—actual spending depends on contracts and construction progress.

OpenAI is partnering with SB Energy, NVIDIA, and the U.S. Department of Energy to build an ~8 GW-IT data center campus at the PORTS-Pike site in Pike County, Ohio. The first 800 MW is expected online in 2028, with a six-year full buildout creating 35,000 construction jobs and 2,500 permanent roles. OpenAI says it will cover all energy and infrastructure costs, use closed-loop air cooling to keep ongoing water use comparable to an office building, and put $40M into a community grant fund. It is also giving $100 in Codex credits to each of ~844,000 Ohio college students. The post doesn't disclose GPU counts or specific model training plans—this reads as a long-term infrastructure play.

WSJ reports Nvidia has slashed the $250 billion in financing it might have guaranteed for OpenAI's infrastructure build-out. The post doesn't spell out the new figure. This directly affects whether mega-projects like Stargate can secure funding as planned—I'd discount the original number until more details land.

Nvidia and Amazon both bet on Texas power in the same week—Nvidia investing up to $3B in grid developer Lancium, Amazon building a 5,000 MW on-site gas plant in Pecos County. Chips are arriving, but transformer lead times exceed 128 weeks, and only 8.9 GW of 474 GW in Texas load applications have been approved. The power-on date is becoming a tighter bottleneck than GPUs.

Nvidia lined up Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs, and KKR to commit up to $500 billion for AI data centers. The real move is Nvidia using its own balance sheet to guarantee the residual value of older GPUs, turning them into lendable collateral. Bond markets spooked briefly until CEO Jensen Huang clarified. I'd discount the $500B headline—it's a ceiling, not signed deals. The post doesn't spell out the guarantee triggers or how much cash Nvidia must set aside.

The FT reports that major Wall Street banks are assigning longer depreciation lives to Nvidia AI chips than to traditional servers. Goldman Sachs, Morgan Stanley and JPMorgan estimate useful lives of 6–7 years, versus 4–5 years for conventional hardware. The rationale: chips remain powerful enough to be repurposed for inference or leased after next-gen launches. This looks more like a financial assumption than a technical finding. The article does not include official comments from Nvidia or auditors on these schedules.

NVIDIA added a 30B-parameter MoE model, Nemotron 3.5 Lightning, to its Nemotron 3 family. It targets specialized tasks inside multi-agent systems, delivering 4x faster output and 30% faster agentic task completion than peers. It runs locally on RTX PCs, DGX workstations, and Jetson. The company also open-sourced NeMo Switchyard, a routing library that directs requests to the best model for each job without app rewrites. CrowdStrike, Harvey, and CodeRabbit are already using customized versions. The post does not disclose pricing or a release timeline.

The Information reports, citing project participants, that Nvidia is building the Nemotron 4 series, with the largest model reaching at least 1 trillion parameters. Nvidia VP of GenAI Kari Briski said in an email that the investment is driven by the belief that 'every company and every country needs accessible frontier open-source models.' Final training isn't done yet, but employees think it could be ready by late fall. Nvidia is one of the few US big-tech firms actively releasing open-weight models, aiming to broaden AI adoption and boost demand for its GPUs. The post does not disclose benchmark scores or pricing.

Ben Thompson draws a direct line from Nvidia's current position to the 1873 railroad bond collapse. He traces how Jay Cooke funded the Northern Pacific Railway through retail bonds—12% commission, $200 in stock per $1,000 bond sold—until credit tightened in September 1873, triggering a multi-year depression. Liaquat Ahamed's new book '1873' converts the era's $500M annual railway bonds to roughly $600B today, matching projected 2026 Big Tech AI investment. Microsoft CEO Satya Nadella cited the book on the latest earnings call. The post notes Microsoft is the only hyperscaler still ramping spend, but the paywall cuts off the rest of the analysis—no specific verdict on Nvidia's risk is disclosed.