Deployment & engineering

DeepSeek released V4 with two MoE checkpoints, Pro and Flash, both supporting a 1M-token context. Pro has 1.6T total and 49B active parameters; Flash has 284B total and 13B active. The key detail is KV cost: Pro uses 27% of V3.2 single-token FLOPs and 10% of its KV cache; Flash uses 10% and 7%.

The post claims Claude desktop can enable developer mode while signed out, then use an API base URL and key to connect third-party inference services. It lists Help → Troubleshooting → Enable developer mode, then after restart configure third-party inference under Developer and apply locally. The key point is that this looks like a client-side entry point; the post does not disclose Anthropic's support status or model scope.

Hugging Face published a guide for a Transformers.js Chrome extension using Gemma 4 E2B. It defines three MV3 entry points: background service worker, side panel, and content script. The key design keeps local inference in the background and uses messaging plus a tool loop.

Tesla raised its spending plan to $25bn, with Musk directing more capital toward AI-linked projects. The RSS snippet names self-driving taxis, trucks, robots, and chip factories, and says the increase will be “very significant”; the post does not disclose the time frame, line items, or model details. The key signal is that Tesla is funding a full stack, not just model training.

ServiceNow released SuperApriel-15B-Instruct, a single-checkpoint 15B model with 8 deployment presets spanning 1.0× to 10.7× decode throughput at 32K sequence length. It has 48 decoder layers with 4 mixer variants per layer and up to 262K context positions depending on runtime; the key point is that speed-quality tradeoffs and speculative decoding are exposed from the same weights.

OpenAI says WebSockets in the Responses API speed up the Codex agent loop, using connection-scoped caching to cut API overhead and improve latency. The RSS snippet confirms the mechanism, but the post does not disclose latency deltas, throughput numbers, or workload conditions. The key point is transport-layer optimization, not a new model.

SenseAuto released Sage, an in-car multimodal edge model with 32B total params and 3B active params, and says it scored 94% on PinchBench, above Claude Opus 4.6 at 93.3% and GPT-5.4 at 90.5%. The post says Sage runs on Nvidia OrinX with about 0.5s TTFT, 0.03s TPOT, and 80 tok/s throughput; its SCOUT training method cuts GPU hours by about 60%, and ERL raises complex-task completion by 20%. The key point is not the headline race but whether a 3B-active model can sustain multi-step tool use on device.

Apple presents a two-stage cross-architecture distillation path that converts Pythia-1B Transformer into a 1B HedgeMamba, reaching 14.11 perplexity with 10B tokens, about 2.7% of the teacher data. The teacher scores 13.86 PPL, while direct Transformer-to-Mamba distillation jumps above 100; the method first aligns with Hedgehog linear attention, then maps into Mamba initialization and fine-tunes. The key point is the path, not one trick: long-context inference shifts from quadratic to linear cost, and the post says downstream results on ARC, PIQA, BoolQ, RACE, and LogiQA approach the teacher.

Honor said it preinstalls its YOYO Claw on MagicBook and claims 50% lower total token use than an OpenClaw setup. The post says it ships with 5 primary agents and 23 sub-agents, plus local processing, second-step confirmation, and kernel-level encryption. The practical angle is packaging agents as a device default, but the post does not disclose model names, hardware specs, pricing, or launch timing.

Anthropic and Amazon agreed a $100bn AI infrastructure deal aimed at expanding chip supply and compute capacity. The RSS snippet says Anthropic moved after outages this year; the post does not disclose term, financing structure, chip source, or delivery scale. The key point is capacity lock-in, not a generic partnership.

Anthropic expanded its collaboration with Amazon to secure up to 5 gigawatts of compute for training and deploying Claude. Capacity starts coming online this quarter, with nearly 1 gigawatt expected by end-2026; the post does not disclose contract value, chip type, or data center locations.

Google plans to release new AI chips focused on inference, directly challenging Nvidia. The RSS snippet confirms the inference focus, but the post does not disclose launch timing, model names, performance, pricing, or customers. The real signal is rising competition on inference silicon supply, not the show's other rocket or IPO items.

Google plans to announce a new generation of custom TPUs this week, aimed at AI inference workloads. The RSS snippet confirms only the timing and chip focus; model names, performance, power, and pricing are not disclosed. Watch inference cost and supply, not the headline alone.

Import AI 454 covers HiFloat4, Anthropic automated alignment R&D, and a Chinese model safety study. HiFloat4 reached about 1.0% relative BF16 loss on Ascend NPUs, versus MXFP4's about 1.5%. Anthropic's Claude Opus 4.6 AARs used 800 hours and about $18,000 to raise PGR from a 0.23 human baseline to 0.97.

A Reddit user fine-tuned Gemma 4 26B on 800 labeled earnings-call transcripts and ran inference on 2,400 transcripts over 3 years on one RTX 4090 in about 14 hours. On 600 out-of-sample transcripts, one signal linked vaguer CFO guidance to about 1.8% sector-relative underperformance over 5 days with IC 0.04. A stronger signal showed 0.85 correlation with sector returns after checks and was discarded as a ghost factor; the key point is factor sanity checks, not the profit claim.

Cloudflare released Unweight, a lossless system that compresses LLM weights by 15% to 22% with bit-exact outputs preserved. The snippet says it targets memory-bandwidth bottlenecks on GPUs like NVIDIA H100 by compressing only the BF16 exponent byte; over 99% of weights in a typical layer use 16 exponent values, saving about 3 GB VRAM on an 8B model. The key detail is on-chip decompression plus four autotuned execution paths; the post does not disclose throughput results or model coverage in the excerpt.

Nikkei Asia says DRAM suppliers may meet only about 60% of global demand by end-2027, and SK Group's chairman says the shortage may last until 2030. The post cites a 12% annual output growth needed for 2026-2027 versus only 7.5% planned, with new capacity prioritizing HBM over consumer DRAM. The key point is structural reallocation to AI data centers, not a short-lived price spike.

Cerebras has filed for an IPO, confirming it is moving toward a public listing. The post only discloses two deals: AWS will use Cerebras chips in Amazon data centers, and an OpenAI contract is reportedly worth over $10 billion; offering size, valuation, and timing are not disclosed.

Moonshot says Kimi Linear makes KV cache transfer practical across datacenters, with a 20x scaled-up model showing 1.54x throughput and 64% lower P90 TTFT. The post describes prefill/decode disaggregation across datacenters and heterogeneous hardware; the cost metric and reproducibility details still require the linked arXiv paper.

rtrvr.ai introduced AI Subroutines, which turn a recorded browser task into a callable tool and replay it at zero token cost and zero LLM inference delay. The script runs inside the active tab, reusing auth, CSRF, TLS sessions, and signed headers; recording trims about 300 requests to about 5 and falls back to DOM-only when GraphQL operation IDs are volatile. The part to watch is batching: one LLM call can assign parameters for a 500-row sheet and launch 500 subroutines.