Skip to content

Deployment & engineering

Running models in practice: inference optimization, memory and cost, serving architecture and infrastructure choices.

Latest picks

41–60 of 609

Nov 4Wednesday

TechCrunch · AI

Anthropic's compute costs climb to 58% of revenue as losses widen

Anthropic's updated IPO filing shows quarterly revenue rising from $11.5 billion to $17 billion, while compute costs grew from 48% to 58% of revenue and operating losses widened. The company is buying expensive short-term compute to meet fast-growing demand.

Why it matters: Revenue is growing, but compute costs are taking a bigger share, so supply conditions are squeezing margins.

The Verge · AI

Apple bets on AI across its own and third-party tech to grow revenue

Apple turns AI use into revenue through hardware sales, a cut of third-party AI app subscriptions, and planned paid tiers of its own AI services. Last quarter's capital expenditure was $2.2 billion, against $77.3 billion for Amazon and $51.4 billion for Alphabet; those figures cover total capex, not AI alone.

Why it matters: Apple makes money from AI through hardware, app subscription cuts and paid tiers of its own services, while spending far less on capex than peers building infrastructure.

Nov 3Tuesday

Hacker News front page

deepsense.ai lists ten coding agent harness patterns for real code repositories

deepsense.ai has written up ten coding agent harness practices meant to make AI-assisted development more reliable through repository knowledge, just-in-time context and verification feedback. The team tested them with Codex and Claude Code. It recommends a short AGENTS.md that links to deeper docs, code organized by task with tests and past decisions, and shared verification commands for humans, agents and CI.

Why it matters: The post turns hands-on coding agent experience into repository docs, task-scoped context loading and a bounded verification loop, so repeated mistakes become maintainable tests and rules.

The Decoder

Anthropic quarterly revenue hits 12x year-ago level as net loss reaches $23.3 billion

Anthropic's quarterly revenue came in near $17 billion, twelve times the same period a year earlier, while operating costs hit $17.5 billion and the quarterly net loss widened to $23.3 billion.

Why it matters: Revenue grew twelvefold year over year yet operations still lost money, with near-term compute purchases and an employee donation match adding to pre-IPO cost pressure.

Nov 2Monday

Hacker News front page

China's Commerce and Science Ministries draft export controls covering frontier models and agents

China's Ministry of Commerce and Ministry of Science and Technology issued Announcement No. 48 on October 16, 2026, proposing 40 new technologies for export bans or restrictions, 23 of them AI-related. Interim export registration rules already apply. The draft catalog takes comments until November 15, 2026. Frontier model thresholds include at least 10^26 FLOPs of training compute, at least 2 trillion parameters, or a top-10 global ranking at export time. Agents get separate capability thresholds.

Why it matters: The draft puts locally deployed restricted models abroad under export management, so firms self-hosting models face supplier licensing and update compliance.

Computing Life · Share · Yage

Why LLM inference splits prefill and decode, and how that leaked user code at Cloudflare

Prefill-decode disaggregation speeds up inference by splitting the two stages, but Cloudflare's GLM-5.3 deployment leaked cache across tenants through a request-handling bug. Its postmortem says 155 long-context replies mixed in other users' conversations or code: over-limit requests were replaced with a one-token placeholder yet still crossed nodes, and decode nodes read stale cache that had not been overwritten.

Why it matters: Cloudflare's fix adds transfer-count checks and delayed memory reclamation, folding data overwrite and page ownership into safety checks when nodes exit abnormally.

Nov 1Sunday

Hacker News front page

Linux TCP use-after-free CVE-2026-98432 explained, CVSS 9.8

A use-after-free flaw in the Linux IPv4 TCP handshake, CVE-2026-98432, carries a CVSS 3.1 score of 9.8 from the kernel CNA, and fixes have landed on several stable branches. Unpatched Linux 4.4 and later kernels are affected. As of 8:00 PM CDT on October 29, Ubuntu releases and RHEL 8, 9 and 10 had no fix, and a kernel update needs a host reboot to take effect.

Why it matters: It maps patch status per distribution and explains how to check the kernel, since updating container images does not replace patching and rebooting the host.

Oct 31Saturday

Hacker News front page

Researchers take over ChatGPT accounts via public share links

A research team found that a malicious public ChatGPT share link can run JavaScript inside a visitor's logged-in session, read private chats that were never shared, and send them out. The attack chains MathLive chart loading, HTML Preview, an unisolated iframe and YouTube JSONP. In the auto-preview version, the victim only has to open the link.

Why it matters: A malicious share link can read and exfiltrate private chats from a logged-in session, showing what missing cross-frame message checks expose.

Computing Life · Share · Yage

Anthropic prospectus: 85.4% pure inference margin, but about 26.3% left after training compute and cloud cuts

An analysis of Anthropic's prospectus adds model iteration, compute and channel costs to the picture. Pure inference gross margin reached 85.4% in the first half of the year, but after training compute and cloud platform revenue shares, roughly 26.3% of revenue remains.

Why it matters: It separates pure inference margin from what is left once training compute and cloud channel fees are counted.

AI HOT · Tips & opinions

OpenRouter tutorial: build a persistent AI agent that monitors Hacker News with the Agent SDK

An OpenRouter tutorial uses TypeScript and @openrouter/agent 0.11.0 to build an agent that checks Hacker News on a schedule and writes summaries. File-based memory stops it from re-reporting the same items after a restart.

Why it matters: It combines scheduled checks, persistent memory, cost limits and human approval into one always-on agent, a structure you can move to repo or status-page monitoring.

TechCrunch · AI

Nvidia in talks to back Nscale's West Virginia AI data center debt

Nvidia is negotiating to guarantee billions of dollars in debt financing for an Anthropic data center Nscale plans in West Virginia. The proposed arrangement is a residual-value guarantee: if Nscale defaults on construction payments, Nvidia would take over the facility temporarily and help find a buyer and new tenants.

Why it matters: Nvidia's financial support for cloud customers now reaches construction risk, beyond leases and chip purchases.

TechCrunch · AI

Tech giants raise AI infrastructure spending as investors worry about cash flow and returns

Alphabet, Amazon, Meta and Microsoft plan more than $740 billion in capital spending this year. Investors are growing more concerned about the cost of AI infrastructure, negative free cash flow and the return on that investment.

Why it matters: Alphabet, Amazon and Meta all show negative free cash flow as they raise capex, so AI infrastructure spending is pressing on the cash flow of the core businesses funding it.

The Verge · AI

Sam Altman says RAM belongs in data centers, not personal computers

On the Cheeky Pint podcast, OpenAI CEO Sam Altman said tight RAM supply should go first to raising cloud utilization. Spreading limited memory across personal computers is not ideal, he said.

Why it matters: Altman uses low memory utilization on personal computers to argue for concentrating RAM in the cloud, as DRAM supply stays constrained.

Oct 30Friday

Hacker News front page

Phorion analyzes SSH backdoor in Claude Code extension on Cursor Marketplace

Phorion found that the official Claude Code for VS Code 2.1.313 extension on Cursor Marketplace had been implanted with a persistent SSH backdoor, and the affected version has been taken down.

Why it matters: Phorion traces the backdoor's file writes and persistence artifacts, so detection keys on file changes and tunnel behavior rather than an SSH enable command that may be missing.

AI HOT · Products

Factory ships Droid 1.0, an enterprise agent harness built on programmatic tool calling

Factory released Droid 1.0, making programmatic tool calling the default mode across several models, with updates to the desktop app, CLI and Droid SDK. A Script tool lets models write JavaScript in a sandbox and run hundreds of tool calls per model request, passing only needed output into context. Factory's tests show a 15% cost cut on Claude Opus 5.5.

Why it matters: Factory wraps batched tool calls in a sandboxed program, keeping raw results inside it and returning only needed output, which cuts context use and repeat requests on long tasks.

Simon Willison

Spawn builds multiplayer game worlds with Fable-driven autonomous agents

Spawn lets players change multiplayer game worlds through an in-game agent called Savi. Jacob Sansbury says development is now run autonomously by a swarm of Fable-driven agents, at a model token cost above $3 million a month.

Why it matters: Spawn hands production errors straight to agents and shortens the feedback loop with hourly deploys and partial rollbacks, so autonomous coding stays tied to live incident handling.

Oct 29Thursday

AI HOT · Models

Mistral Large 4 (Le Chonk) lands on Hugging Face with open weights for a ~1T-parameter multimodal model

Mistral Large 4 (Le Chonk) is now on Hugging Face with open weights. It uses a multimodal, multilingual MoE architecture with text and image input and text output. The model has about 1T total parameters, 49B active parameters and a 1M-token context window, ships in official FP8 and NVFP4 versions, and its license restricts model-as-a-service businesses.

Why it matters: Open weights and several deployment paths let security teams set their own usage policy and runtime for vulnerability reproduction and patching work.

The Verge · AI

Anthropic files for Nasdaq listing, asking Wall Street to believe in AGI

Anthropic has filed its S-1 to list on Nasdaq. A Decoder interview breaks down the financials and the business risk of chasing AGI. A SemiAnalysis analyst traces where Anthropic's revenue comes from and how its customers spend, and notes that future growth depends on enterprise demand widening beyond coding.

Why it matters: It separates Anthropic's disclosed revenue and customer spending from the growth assumptions its listing case rests on.

AI HOT · Tips & opinions

OpenRouter tutorial: extracting tables from PDFs with an LLM

An OpenRouter tutorial sends a PDF plus a strict JSON schema to pull tables into rows with explicit data types. Field descriptions handle negative numbers in parentheses, footnotes and merged cells. Across 5 test PDFs, 2 of them scans, models that read the PDF directly extracted all 644 cells correctly, a result the post limits to this test set.

Why it matters: It pairs a strict row schema with field-level cleanup rules and catches dropped rows in otherwise normal responses using empty-result and truncation checks.

AI HOT · Industry

Alphabet Q3: annualized revenue hits $500B, Google Cloud revenue up 103%

Sundar Pichai posted Alphabet's Q3 results: annualized revenue run rate reached $500B and total revenue grew 25% year over year. Google Cloud revenue rose 103%, first-party model APIs handle nearly 32B tokens per minute, up 40% quarter over quarter. Search query growth was the highest in five years. He also cited Argon and Carbon as frontier leaders and the new world model Genie 4.

Why it matters: Alphabet's Q3 total revenue grew 25% year over year while Google Cloud revenue rose 103%, so cloud is growing faster than the company overall.