Deployment & engineering

Running models in practice: inference optimization, memory and cost, serving architecture and infrastructure choices.

455 picksRelated topicsOpen source Data & training On-device AI

Latest picks

301–320 of 455

May 8Friday

NVIDIA BlogMay 8, 03:14

Powering the Next American Century: Chris Wright and NVIDIA’s Ian Buck on Genesis Mission

The U.S. DOE and NVIDIA are building two AI supercomputers at Argonne; Equinox uses 10,000 Grace Blackwell GPUs. Solstice will use 100,000 Vera Rubin GPUs, which Buck said reach 5,000 exaflops. The key bottleneck is grid work: Wright said AI can cut interconnection studies from years to weeks or hours.

Why it matters: HKR-H/K/R all pass: the GPU counts, DOE-NVIDIA role, and grid bottleneck are concrete. NVIDIA-blog sourcing keeps it below must-write; this fits the 78–84 band.

Take

NVIDIA is tying sovereign compute to the energy bottleneck, and the sales motion is obvious: GPUs are no longer just cloud inventory, they become machinery for state approval systems. Equinox gets 10,000 Grace Blackwell GPUs; Solstice gets 100,000 Vera Rubin GPUs; Ian Buck cites 5,000 exaflops. The sharper claim is Chris Wright saying AI can cut grid interconnection studies from years to weeks or hours.

I don’t buy the clean “AI fixes the grid” framing. Interconnection queues are slow because of rules, transmission buildout, local permitting, and cost allocation, not just simulation runtime. NVIDIA’s better move is institutional: if DOE treats AI simulation as approval infrastructure, the GPU cluster stops being a training box and starts sitting inside the operating layer of the energy system.

AI HOT (Curated Pool)May 8, 02:45

DeepSeek 4: Flash Local Inference Engine for Metal

DeepSeek 4 Flash is open-sourced on GitHub for offline inference on Apple Silicon Macs. The post says it uses Metal Performance Shaders to reduce latency and memory use, but discloses no benchmark numbers. The key item is the Metal local inference stack, not another model wrapper.

Why it matters: HKR-H/K/R pass: the hook is offline Apple Silicon inference, with GitHub OSS, MPS, and a clear run target. No latency or memory benchmarks, and not an official DeepSeek model launch, so it stays near the featured floor.

Take

ds4 is open on GitHub, and the title says it is a DeepSeek 4 Flash local inference engine for Metal. The captured body is mostly GitHub navigation, not a technical README. It gives no tokens/sec, memory curve, quantization format, model provenance, or context length. I read this as a local-inference stack signal, not a model launch.

Apple Silicon local LLM work has never lacked demos; it has lacked clean, repeatable Metal paths. llama.cpp already made GGUF plus Metal the default path for many Mac users. Apple’s MLX also has developer mindshare inside the Mac ecosystem. If ds4 only wraps DeepSeek 4 Flash through MPS, the value is thin; if it cleans up KV cache, prefill, and decode kernels, then it has real engineering weight.

The DeepSeek name will pull attention, but the page does not show official DeepSeek involvement. The repo path is antirez/ds4, and antirez carries real open-source credibility from Redis. That matters for low-latency systems taste. Still, LLM inference is gated by matrix kernels, quantization behavior, and cache layout, not maintainer reputation.

I am wary of the “lower latency and memory use” claim. Metal Performance Shaders are a mechanism, not a benchmark result. Same Mac model, same quantization, same prompt length, same context window: then tokens/sec means something. Without that, this is a directional claim wearing a performance label.

Ollama, LM Studio, llama.cpp, and MLX already occupy the Mac offline-inference surface. ds4 needs a hard advantage in setup friction, throughput, memory ceiling, or model compatibility. The useful next artifact is not a nicer tagline; it is a reproducible command and a benchmark table. Until then, Metal is a promising backend name, not proof of speed.

May 7Thursday

AI HOT (Curated Pool)May 7, 23:42

Notes From Inside China’s AI Labs

The author visited several leading Chinese AI labs and reported three patterns. The post says some Chinese tasks beat GPT-4, while firms build 100B-scale base models and 10B-scale vertical models. Watch compression and private deployment under compute constraints.

Why it matters: HKR-H/K/R all pass: first-hand lab access, concrete scale claims, and China/compute/deployment resonance. This is strong analysis, not a model release or funding event, so it fits the 78–84 band.

AI HOT (Curated Pool)May 7, 23:02

SenseNova-U1 Open-Sources 8-Step Distilled LoRA, Speeds Diffusion Inference by 11x

SenseNova-U1 open-sourced an 8-step distilled LoRA that cuts diffusion generation from 100 steps to 8. GPU inference time drops from 23 seconds to 2 seconds, with ComfyUI workflows for text-to-image, image editing, and interleaved generation. The key signal is distillation for latency, not parameter scale.

Why it matters: HKR-H/K/R all pass: the 11x speedup hooks attention, the post gives step and latency numbers, and open LoRA affects diffusion deployment cost. Scope stays within image generation, so this is featured, not P1.

QbitAI · WeChatMay 7, 21:36

Zhejiang University and Alibaba MetaCompress reaches 90% token compression for multi-turn VQA

Zhejiang University and Alibaba proposed MetaCompress, a learned token-compression framework that generates a compression mapping from the input image alone for multi-turn VQA. The article says it can remove 90% of visual tokens while preserving accuracy, and reports only 1.71% overlap between optimally retained tokens and high-attention tokens.

Why it matters: HKR-H/K/R all pass: 90% visual-token compression, no accuracy loss, and image-conditioned mapping give builders a testable cost-cutting mechanism. Zhejiang/Alibaba plus CVPR 2026 is strong research signal, not a platform-level product release.

Take

MetaCompress lands because it attacks the proxy, not the budget. Multi-turn VQA breaks prompt-conditioned pruning: the first question does not predict the third one. The paper’s sharpest number is the 1.71% overlap between optimally retained tokens and high-attention tokens. That is a nasty result for CLS- or prompt-attention pruning heuristics like FastV, and it gives the method a cleaner reason to exist than “we compressed tokens too.”

I still discount the “no accuracy drop” claim until the absolute benchmark tables, latency numbers, and training cost are checked outside the article. The body says MetaCompress beats FastV and PruMerge at 70% and 90% compression, with end-to-end cost near uniform downsampling. Code and arXiv are public, so this is testable. If it holds on LLaVA-NeXT-style multi-scale LVLMs, visual-token count stops being the dumbest bottleneck in multi-turn vision chat.

r/LocalLLaMAMay 7, 17:56

Running Qwen3.5/Qwen3.6 with NextN MTP in llama.cpp on one RTX 3090 Ti

A Reddit user posted a llama.cpp guide for Qwen3.5/3.6 with NextN MTP on one RTX 3090 Ti. It requires two unmerged PRs, #22400 and #22673; Qwen3.6-35B-A3B-MTP reaches 157 tok/s at 350W, 1700MHz, with q8 KV. The key reproducible detail is nextn=q8_0 quant override; missing it yields “////” output.

Why it matters: HKR-H/K/R all pass: single-GPU 157 tok/s is a strong hook, and the PR/power settings make it testable. Scope stays narrow because it is a Reddit guide using unmerged PRs.

Latent SpaceMay 7, 13:57

Anthropic-SpaceXAI's 300MW/$5B/yr Deal for Colossus I, ARR Growth Is 8000% Annualized

Anthropic announced a SpaceX compute partnership, doubled Claude Code’s 5-hour limits for Pro, Max, Team, and seat-based Enterprise, raised Opus API limits, and said Claude inference would ramp on Colossus within days; the post treats the 300MW and $5B-per-year figures as widely circulated but not canonized in Anthropic’s own announcement.

Why it matters: HKR-H/K/R all pass: the compute-deal numbers and Claude Code limit changes are concrete and practitioner-relevant. The 300MW/$5B/year claim is unofficial, so it stays below P1.

Take

Anthropic used the event to buy breathing room for Claude Code. The official news is a SpaceX compute partnership, Claude inference ramping on Colossus within days, doubled 5-hour limits for Pro, Max, Team, and seat-based Enterprise, plus higher Opus API limits. The 300MW and $5B-per-year figures are outside estimates, not Anthropic’s contract language, so don’t quote them like papered terms.

I trust the quota move more than the ARR theater. Any model lab can flash growth math; raising Claude Code’s short-window limits means usable inference is arriving, not just future capacity on slides. The xAI angle is also messy in a useful way: Colossus I stops looking like a pure training fortress and starts looking like a neocloud asset. Musk fighting OpenAI while renting the biggest cluster to Anthropic is the part practitioners should actually price in.

Synced · WeChatMay 7, 10:05

Musk Announces xAI Dissolution, Leasing 220,000 GPUs to Anthropic

Musk confirmed xAI will dissolve, with Grok and X-related operations folded into SpaceXAI. SpaceX and Anthropic signed a deal giving Claude access to Colossus 1’s 220,000+ Nvidia GPUs and 300 MW of compute. The key change is quota: Claude Code’s five-hour rate limit doubles, and Pro/Max peak-hour cuts are removed.

Why it matters: HKR all pass: xAI dissolution plus 220k GPUs for Anthropic is a top-tier twist; 300 MW and Claude Code quota changes add testable detail; it hits compute, competition, and developer limits. Single-source status keeps it at 96.

Computing Life · Share · YageMay 7, 08:00

Anthropic Locks Up Compute Channels as xAI Rents Its Castle to a Rival

Anthropic signed four compute contracts in six months covering AWS Trainium, Google TPU, SpaceXAI Colossus 1, and CoreWeave; during the same window, xAI rented the Colossus 1 supercomputing center to a competitor while GPU utilization stood at 11%.

Why it matters: HKR-H/K/R all pass: Anthropic’s four compute deals and xAI leasing Colossus 1 create a sharp competitive angle with concrete numbers. Single-source strategy analysis keeps it in the 78–84 band, below same-day must-write news.

Financial Times · TechnologyMay 7, 06:40

Arm projects $2bn in sales of its new AI chip from next year

Arm projects $2bn in sales for its first in-house AI chip from next year. The RSS snippet says the SoftBank-backed UK group has strong demand; the post does not disclose customers, pricing, process node, or delivery cadence.

Why it matters: FT authority plus a $2bn sales projection gives HKR-K, and Arm’s own AI chip adds HKR-H/R. Missing customers, process, price, and delivery cadence keep it at the featured threshold.

Financial Times · TechnologyMay 7, 06:08

SpaceX to Rent Data Centre Capacity to Anthropic

SpaceX will rent data centre capacity to Anthropic, confirming a compute leasing arrangement. The RSS snippet says Anthropic is adding compute to match growth; the post does not disclose capacity, term, or pricing.

Why it matters: FT confirms SpaceX will rent data-center capacity to Anthropic. HKR-H comes from the odd pairing; HKR-K has the deal fact but no scale or price; HKR-R hits compute scarcity, so it clears featured but not 78+.

Take

Anthropic will rent data center capacity from SpaceX, and the article discloses no scale, term, or price. I would not read this as a grand alliance. The simpler read is that Claude demand is forcing Anthropic to source capacity wherever physical infrastructure already exists, even outside the normal hyperscaler lane.

The missing details matter a lot. The article does not say whether this is training capacity or inference capacity. It does not name the accelerators: Nvidia H100, H200, B200, or something else. It does not say whether Anthropic is renting bare metal, hosted power and space, or a managed slice of SpaceX infrastructure. Those are very different deals. Training capacity affects model cadence. Inference capacity affects Claude availability, latency, and enterprise SLAs. Bare metal creates migration work. Hosted capacity means Anthropic may bring more of its own stack.

My read leans toward inference pressure. Anthropic has won real usage through the Claude Sonnet line, especially in coding, document workflows, and long-context enterprise tasks. After Sonnet 3.5, the product stopped being a lab demo and became daily infrastructure for a lot of teams. Inference demand is ugly because peaks matter. Once enterprises wire Claude into support, coding, search, and internal tools, availability becomes more important than a leaderboard delta. OpenAI has Azure as the primary compute backbone. Google DeepMind has internal TPU capacity. Anthropic has major cloud relationships with Amazon and Google, but investment agreements do not magically create the right racks at the right time.

SpaceX showing up here is less strange than it first sounds. The shared asset across Musk companies is not just capital. It is the ability to compress power, land, networking, procurement, and construction timelines. xAI’s Colossus build in Memphis showed that muscle clearly, with public claims around a 100,000-GPU Nvidia cluster and further expansion plans. SpaceX also runs heavy simulation, telemetry, Starlink networking, and internal compute workloads. It is not starting from zero on data center operations. Anthropic renting capacity from SpaceX looks like an AI lab bypassing the hyperscaler queue and buying from someone that already solved a local physical bottleneck.

I still have doubts about the strategic weight of this deal. The FT headline confirms a leasing arrangement. The RSS snippet only says Anthropic is racing to add computing power. It does not say SpaceX is providing GPUs. It does not say Starlink is involved. It does not disclose megawatts, rack count, location, or duration. If this is a few megawatts or a short-term block of cabinets, it is a patch. If it is hundreds of megawatts with multi-year commitments and accelerator access, then Anthropic’s supply-chain posture has changed. The current text does not support that stronger claim.

There is also an awkward competitive angle. Anthropic has built its public identity around safety, enterprise trust, and compliance. SpaceX sits inside the broader Musk orbit, and that orbit includes xAI. Grok competes directly with Claude in developer workflows, enterprise search, agent tooling, and assistant use cases. A data center lease can be properly isolated, of course. But enterprise customers will ask about operational access, network separation, audit controls, and data-handling boundaries. The article discloses none of that. If Anthropic treats this as a normal capacity lease, it still has to answer procurement teams that will not ignore the xAI adjacency.

The broader pattern is that model companies are drifting from a model-quality race into a compute-availability race. OpenAI has Microsoft Azure and has pushed ever larger infrastructure plans. Anthropic has dual backing from Amazon and Google. Meta builds massive internal clusters for Llama and its ads systems. xAI is betting on construction speed. This SpaceX-Anthropic deal fits that pattern: the compute market is fragmenting, and non-cloud infrastructure owners are becoming part of the supply pool.

I do not buy the easy version of the story that SpaceX is suddenly an AI cloud vendor. The article gives no cloud product, no pricing, no wider customer plan, and no platform roadmap. Right now it looks like a directed capacity transaction. For Anthropic, the deal’s value depends on available megawatts and the translated cost per million tokens. For SpaceX, it depends on whether unused or expandable capacity can be monetized without hurting launch, Starlink, or Musk-adjacent AI demand. Without those numbers, the honest judgment stays at the supply-chain level.

So I would file this under “non-cloud capacity entering frontier-model infrastructure pools.” It does not prove Anthropic and SpaceX are strategically aligned. It does not prove AWS or Google failed Anthropic. It proves something more concrete: top-tier model demand is high enough that every usable rack, power contract, and fast-built facility is back on the market.

r/LocalLLaMAMay 7, 04:36

GB10 inference engine Atlas is open source, with Qwen3.6-35B-FP8 over 100 tok/s

Avarok open-sourced Atlas, an inference engine running Qwen3.5-35B at ~111 tok/s sustained on one DGX Spark. It uses Rust+CUDA, a ~2.5GB image, and sub-2-minute cold start; the author claims 3.0–3.3x vLLM in tests. The key details are Blackwell SM120/121 kernels, NVFP4/FP8, and MTP decoding.

Why it matters: HKR-H/K/R pass: open-source inference engine, 35B FP8 at 111 tok/s, and a direct vLLM comparison. Single Reddit sourcing and unreproduced benchmarks keep it at the lower featured band.

r/LocalLLaMAMay 7, 03:54

Exaggerated PCI-E Bandwidth Concerns?

Reddit user ziphnor tested 2x RTX 5060 Ti 16GB with vLLM TP=2 and 32k-context prefill. PCIe peaked at 3–4 GB/s, about 40–50% of a PCIe 4.0 x4 link. Prefill reached ~840–850, 1500, and 1600–1700 t/s; the post does not disclose decode bandwidth.

Why it matters: HKR-H/K/R all pass: a myth-busting PCIe bandwidth test with concrete vLLM conditions and numbers. Single Reddit source limits authority, but the named first-person experiment lifts it to the featured threshold.

r/LocalLLaMAMay 7, 02:46

Analysis of 922 Agentic Task Traces Finds DeepSeek v4’s Cost Edge in Caching

A Reddit user analyzed 922 agentic task traces and reported $0.01 per task for DeepSeek v4 Flash versus $1.52 for Opus 4.7. Both used about 960K tokens per task, but DeepSeek showed a 97% cache hit rate versus 87%, with a 0.02 cache read/write price ratio versus 0.08. The key issue is caching, not headline pricing.

Why it matters: HKR-H/K/R all pass: 922 agent traces tie a large cost gap to cache hit rate and cache read/write pricing. Reddit single-source data and incomplete method detail keep it in the 78–84 band.

Bloomberg TechnologyMay 7, 00:34

Anthropic Signs Computing Deal With SpaceX to Meet AI Demand

Anthropic signed a computing deal with Elon Musk’s SpaceX to support growing Claude demand. The post does not disclose capacity, contract value, deployment timing, or infrastructure details. The key issue is whether SpaceX enters Anthropic’s long-term training or inference supply chain.

Why it matters: HKR-H and HKR-R pass: Bloomberg reports an Anthropic-SpaceX compute deal with a strong rivalry and supply-chain angle. HKR-K is weak because scale, spend, GPU count, and training/inference use are undisclosed.

Take

Anthropic signed a compute agreement with SpaceX, but the body gives only one sentence. It discloses no contract value, no GPU type, no capacity, no deployment date, and no training-versus-inference split. So I would not treat this as a grand Anthropic-Musk alignment. The cleaner read is simpler: Claude demand is pushing Anthropic into a messier compute sourcing market.

That matters because Anthropic’s compute story has mostly run through AWS and Google. Amazon has committed billions to Anthropic, and Google has also invested while supplying cloud and TPU capacity. If Claude usage is spiking, the pain is probably not only frontier training. Inference can become the uglier bottleneck. Claude Code-style agent usage burns tokens through repository reads, tool calls, edits, retries, and long sessions. That is very different from a consumer chatbot answering twenty prompts a day.

SpaceX is the odd piece. It is not a normal public cloud. It has facilities, power access, networking assets, and internal AI needs. It also sits near xAI in the Musk universe. But the article does not say whether Anthropic is using SpaceX-owned compute, hosted capacity, networking infrastructure, or a temporary overflow setup. The title gives SpaceX; the body does not disclose any link to Starlink, xAI, Tesla, or a Colossus-like facility. I have doubts about reading SpaceX as a durable Anthropic supplier, because Anthropic sells trust, governance, and enterprise comfort. Musk-linked infrastructure brings speed and resource access, but also governance questions buyers will ask about.

The signal is still useful. AI labs are moving from clean cloud partnerships to opportunistic capacity grabbing. OpenAI has Microsoft and still reaches for Oracle. xAI built a giant Memphis cluster. Meta buys directly at massive scale. Now Anthropic is apparently willing to source from SpaceX. The single-cloud-partner story no longer covers growth at the frontier. If this is inference overflow, the impact stays narrow. If later filings show multi-year reserved capacity or training infrastructure, Anthropic’s supply chain profile changes. With only a title and one RSS sentence, I’d file this as evidence of compute pressure, not evidence of a new AI alliance.

May 6Wednesday

r/LocalLLaMAMay 6, 22:05

Qwen3.6 27B NVFP4 + MTP on a Single RTX 5090: 200k Context in vLLM

A Reddit user ran Qwen3.6 27B NVFP4 on one RTX 5090 32GB and validated 200k context in vLLM. The setup used fp8_e4m3 KV cache, FlashInfer, and MTP with 3 speculative tokens; a 10-run 200k pass completed with 73.6 tok/s mean generation and 70.2s TTFT. The key constraint is 32GB VRAM: logs showed 8.3GiB KV cache and about 30478MiB total GPU use.

Why it matters: HKR-H/K/R all pass: the hook is single-GPU 200k context, with concrete vLLM settings and 10-run stability data. Reddit sourcing keeps it in the 78–84 band, not P1.

TechCrunch · AIMay 6, 21:54

AI boom pushes Samsung to $1T

Samsung crossed a $1 trillion valuation after shares rose on AI chip demand. It is the second Asian company after TSMC to hit the mark; the post does not disclose share gains, revenue, or order mix.

Why it matters: HKR-H/K/R pass, but HKR-K is thin: the post gives market cap and ranking, not stock move, revenue, or order mix. Treat as an AI-infrastructure finance milestone at the featured floor.

Take

Samsung crossed $1 trillion, and the article gives only AI chip demand plus the TSMC comparison. That is too thin to treat as a clean semiconductor victory lap. For AI practitioners, the useful read is not the round-number valuation. It is that public markets are pricing the layers around GPUs again: memory, foundry, advanced packaging, and supply assurance. The problem is that the post discloses no share move, revenue growth, HBM order mix, customer names, or segment split. Without those, the $1 trillion print is a market signal, not an operating proof point.

I have doubts about the clean “AI demand lifted Samsung” framing. TSMC’s trillion-dollar case was easier to underwrite: leading-edge nodes, CoWoS, Apple, Nvidia, AMD, 3nm and 2nm roadmaps. Those pieces connected directly to AI accelerator supply. Samsung is messier. It has memory, foundry, mobile, displays, and consumer electronics inside the same ticker. AI demand can mean HBM3E and HBM4, 2nm GAA foundry hopes, custom ASIC work, or simply a broad semiconductor beta trade. Each version deserves a different multiple. The article does not separate them.

The outside context matters here. SK Hynix has been the cleaner HBM winner through the H100, H200, and Blackwell cycle because it moved earlier with Nvidia-grade HBM supply. Micron also turned its story from cyclical DRAM into AI infrastructure through HBM3E. Samsung, meanwhile, has spent the last cycle answering questions about HBM yield and Nvidia qualification. I have not verified which specific orders this TechCrunch post refers to. If the article cannot say Samsung secured a specific share of Nvidia Blackwell or post-Blackwell HBM supply, “AI-driven chip demand” remains a broad phrase. It can be true and still hide the most important part.

For infrastructure teams, the practical implication depends on which Samsung business is actually moving. If the re-rating comes from HBM supply improving, the 2026 bottleneck shifts from raw GPU access toward rack delivery, networking, and power. If it comes from foundry share gains, AMD, custom ASIC teams, and Korean accelerator efforts get more room because TSMC’s packaging and leading-node queues loosen. If it is just a broad AI equity trade, it tells us little about cluster costs or model training capacity. The article gives zero numbers to choose among those paths.

So I would file this under “AI supply-chain pricing is spreading,” not “Samsung caught TSMC.” A $1 trillion valuation is a trading result, not a technical conclusion. Samsung needs hard evidence to make the multiple stick: HBM share, advanced packaging capacity, and named AI customer orders. The title gives the milestone. The body does not give the proof. Right now, the market is paying for Samsung’s AI supply option; it has not shown that option converting into durable cash flow.

NVIDIA BlogMay 6, 19:30

NVIDIA Spectrum-X AI-Native Ethernet Fabric Adds MRC for Gigascale AI

NVIDIA added MRC support to Spectrum-X Ethernet, letting one RDMA connection spread traffic across multiple paths. MRC ran in Blackwell deployments, with microsecond failure bypass and hardware rerouting. The key detail is the OCP open specification and multiplane support for clusters up to hundreds of thousands of GPUs.

Why it matters: HKR-K/R are solid: MRC stripes one RDMA flow across paths, detects failures in microseconds, and is tied to Blackwell deployments. HKR-H is narrow and the source is vendor-owned, so this stays below major release level.

r/LocalLLaMAMay 6, 17:35

2.5x Faster Inference with Qwen 3.6 27B Using MTP on 48GB

A llama.cpp PR adds MTP support for Qwen 3.6 27B, with a reported 2.5x inference speedup. The author measured 28 tok/s on a Mac M2 Max 96GB and shared GGUF builds, compile steps, and a 262144-context server command. The key detail is turbo4 4.25-bit KV cache: a 48GB Mac runs Q5_K_M at 262K context.

Why it matters: HKR-H/K/R all pass: the hook is concrete, the post names mechanisms and numbers, and local coding-agent cost resonates. Single Reddit source and setup complexity keep it in the low featured band.

Latent SpaceMay 6, 13:40

AINews: Silicon Valley Gets Serious About Services

Anthropic and OpenAI announced enterprise services companies: Anthropic’s unnamed JV is funded with $1.5 billion, while OpenAI’s The Deployment Company has raised about $4 billion at a $10 billion pre-money valuation.

Why it matters: HKR-H/K/R all pass: the hook is labs turning into services operators, with $1.5B and ~$4B figures. The scale and OpenAI/Anthropic names put it in must-write territory.

Take

OpenAI and Anthropic are moving straight into Accenture territory. OpenAI’s The Deployment Company has raised about $4B at a $10B pre-money valuation, while Anthropic’s JV with Blackstone, Hellman & Friedman, and Goldman Sachs has $1.5B behind it, with $300M from each main participant. That is not startup SI money; it is PE-backed channel capture for model labs.

I don’t buy the clean story that agents just flow into knowledge work. The described engagement is old-school consulting: a small team embeds with the customer, identifies where Claude matters, then builds tailored systems with Anthropic Applied AI. Aaron Levie’s list—IT upgrades, context plumbing, workflow redesign, human-agent boundaries, adoption, change management—is the services playbook with better models attached. Tessera raising a Series A for system integration the same day is the tell. The labs want the services margin before integrators turn them into dumb model suppliers.