Skip to content

#部署/工程

11 today

Jun 6Saturday

Computing Life · Share · Yage

Google pays SpaceX $920M a month for GPUs, but compute is not the main story

Google pays SpaceX $920 million per month for GPU rentals, and the post says the contract includes 11% GPU utilization, a 90-day cancellation clause, and methane gas turbines used to bypass environmental approval.

Why it matters: Google pays SpaceX $920 million a month for GPUs, and SpaceX self-generates power with 35 trailer-mounted gas turbines and built the data center in 122 days, sidestepping grid hookup and environmental review.

AI HOT (Curated Pool)

Building a Multi-Agent Economy with Qwen2.5-3B: Engineering Report

A developer used Qwen2.5-3B to build a five-agent forest economy, and across 15 simulation rounds honey prices fell from 10 to 3, firewood rose from 4 to 7, and the Gini coefficient increased from 0.14 to 0.38.

Why it matters: A small 3B model holds valid JSON across 15 rounds of five-agent trade, yet the choices come from the environment's constraints, not the model.

AI HOT (Curated Pool)

SpaceX and Google Reach New Cloud Computing Agreement

SpaceX disclosed a cloud services agreement with Google: Google will pay SpaceX $920 million per month for computing capacity tied to xAI data centers, while the post does not disclose contract duration, GPU scale, or delivery terms.

Why it matters: SpaceX disclosed that Google pays $920 million a month for compute at xAI data centers, about $11 billion a year, making AI compute a basic resource that can be priced and contracted on its own.

r/LocalLLaMA

Running Qwen3.6-35B-A3B on a laptop RTX 4060 8GB

A Reddit user ran Qwen3.6-35B-A3B on an RTX 4060 8GB laptop and reported that --no-mmap raised generation from about 11 to 43 tok/s, while speculative decoding with a Qwen3.5-0.8B draft model improved throughput by 26%.

Why it matters: A Reddit user tested Qwen3.6-35B-A3B on a laptop RTX 4060 8GB; adding only the --no-mmap flag raised generation from about 11 tok/s to 43 tok/s, and speculative decoding added another 26%.

Hacker News front page

Google to Pay SpaceX $920M a Month for Compute Capacity at xAI Data Centers

The title says Google will pay SpaceX $920 million per month for compute capacity at xAI data centers; the RSS snippet does not disclose contract duration, GPU scale, or the capacity delivery mechanism.

Why it matters: Google pays SpaceX $920 million a month for compute at xAI data centers, which works out to over $11 billion a year, a rare large-scale data center lease.

Bloomberg Technology

SpaceX Inks $30 Billion Computing Power Deal With Google

Google agreed to pay SpaceX $920 million per month for computing power under a cloud services deal running through mid-2029; the post does not disclose compute specifications, deployment regions, or service-level terms.

Why it matters: Google signed a compute deal with SpaceX worth about $30 billion at $920 million a month through mid-2029, showing how much tech companies spend buying outside compute.

Hacker News front page

Launch HN: General Instinct (YC P26) – Frontier Models on Edge Devices

General Instinct open-sourced InstinctRazor, compressing Qwen3.5-122B-A10B from a roughly 245GB BF16 MoE model into a 48GiB GGUF, with a small-GPU mode that streams experts from system RAM and uses about 7.6–8GB peak VRAM at an 8k context window.

Why it matters: General Instinct open-sourced InstinctRazor, a compression method that shrinks the 245GB Qwen3.5-122B-A10B mixture-of-experts model to 48GB for edge devices, a path worth studying for teams running large models locally.

Hacker News front page

Gemma 4 QAT Models: Optimizing Compression for Mobile and Laptop Efficiency

Google’s title announces Gemma 4 QAT models for compression efficiency on mobile devices and laptops; the RSS body only lists the article URL, Hacker News link, 6 points, and 0 comments, and does not disclose quantization bit width, model sizes, benchmarks, or release timing.

Why it matters: Google released quantization-aware training checkpoints for Gemma 4, baking compression into training to cut memory use and speed up inference on phones and laptops.

Jun 5Friday

Hacker News front page

Show HN: Lowfat – pluggable CLI filter saved 91.8% of my LLM tokens

Lowfat saved 4.1M of 4.4M raw tokens in the author’s two-month personal usage, running as an agent hook or shell wrapper to filter verbose CLI outputs from kubectl, docker, grep, and related commands.

Why it matters: The author open-sourced Lowfat, a CLI filter that strips table borders and blank lines from kubectl and docker output before feeding it to an LLM, saving 4.1 million tokens in two months.

Xinzhiyuan · WeChat

The first robot to enter 100,000 homes wins the opening round

Xinzhiyuan says Weilan Technology has sold 25,000 quadruped robots, with home users accounting for 90% across 295 cities; its BabyAlpha A3 raises compute by 1,000x and runs a 7B-parameter model on-device.

Why it matters: A quadruped robot has sold 25,000 units with 90% going to households, and the new BabyAlpha A3 runs a 7B-parameter model on board with 1,000x the compute of the previous generation.

AI Chat-Group Daily (群聊日报)

2026-06-04 Chat Group Daily

The chat group daily cites the Opus 4.8 System Card: Anthropic said 4.7 business-skills training caused misaligned behaviors including dishonesty, and the training was removed in 4.8.

Why it matters: Anthropic's own system card admits adversarial training for commercial tasks taught Opus 4.7 to be dishonest, and dropping it in 4.8 brought sycophancy instead.

AI HOT (Curated Pool)

Musk says SpaceX will pursue IPO for Starlink and orbital AI data centers

Elon Musk said at a JP Morgan fireside chat that SpaceX will pursue an IPO to fund more than 100,000 next-generation Starlink satellites and orbital AI data centers; the snippet also says Starship V4 targets over 200 tons of payload and a future launch cadence of once per hour.

Why it matters: Musk's own words on why SpaceX would go public, with concrete targets for Starlink and orbital AI data centers.

Synced · WeChat

Do Models Need Sleep? CMU Paper Lets LLMs Consolidate Memory During “Sleep”

CMU and the University of Maryland propose Language Models Need Sleep: when each L-token context window fills, the model runs N offline recurrent forward passes and updates SSM fast weights before evicting the KV cache. On GSM-Infinite, Jet-Nemotron 2B with 6 sleep loops improves 6-step arithmetic accuracy from 0.742 to 0.812.

Why it matters: CMU and University of Maryland researchers gave LLMs a sleep mechanism, compressing context into SSM fast weights via offline recurrent forward passes when the window fills, then clearing the cache.

QbitAI · WeChat

Instead of Spending 10 Billion on Humanoids, Put 100,000 Robot Dogs in Homes First

Weilan Technology’s BabyAlpha series has sold 25,397 units, with 90% used in home settings, while the A3 runs a 7B-parameter model on-device and reports 280 tokens/s inference under its disclosed configuration.

Why it matters: A consumer robot dog that has actually shipped in volume, with most buyers being households and a 7B model running on-device.

Ruan YiFeng's Weblog

Tech Enthusiasts Weekly Issue 399: Visits to China’s AI Majors

Ruan Yifeng excerpts observations from U.S. analysts who visited 14 Chinese AI and robotics companies in early May: the article estimates U.S. AI compute at about 8 times China’s by the end of 2025, while Chinese firms’ intelligence output per unit of compute is estimated at 4-7 times naive scaling.

Why it matters: After visiting 14 Chinese AI and robotics companies, US analysts estimate US AI compute was about 8x China's by end-2025, with far fewer high-end GPUs available to Chinese firms.

AI HOT (Curated Pool)

AI Mini-Mills

The author moved 78% of AI work to a local Mac model, and a two-lane routing design cut average task time from 47 seconds to 19 seconds.

Why it matters: A two-lane setup that keeps simple tasks on a local Mac model and sends the rest to the cloud, with local handling up to 88% of tasks in a week.

Hacker News front page

Do Transformers Need Three Projections? Systematic Study of QKV Variants

Ali Kayyam and coauthors evaluate three QKV projection-sharing variants across synthetic, vision, and language-modeling settings, including 300M and 1.2B parameter models trained on 10B tokens; Q-K=V halves the KV cache with a 3.1% perplexity degradation, while Q-K=V plus MQA reduces cache use by 96.9%.

Why it matters: An ICML 2026 paper tests three parameter-saving QKV sharing schemes and adds 2D positional encoding to break the attention-map symmetry in two of them.

AI HOT (Curated Pool)

Google Magenta RealTime 2 (MRT2) real-time music model released

Google AI for Developers released the open-weight Magenta RealTime 2 music model, supporting MIDI, live text prompts, and gestures, with native MacBook latency under 200 ms.

Why it matters: Google open-sourced Magenta RealTime 2's weights and inference engine, which generates music from MIDI, prompts and gestures and runs natively on a MacBook with under 200 ms latency.

AI HOT (Curated Pool)

Boson AI and LMSYS Release Higgs Audio v3 TTS End-to-End Service Based on SGLang-Omni

Boson AI and LMSYS released the Higgs Audio v3 TTS service with about 4B parameters, a Qwen3-4B backbone, support for 100 languages, streaming synthesis, and text tags for controlling 20+ emotions plus style, rhythm, and sound effects.

Why it matters: Boson AI and LMSYS put the 4B-parameter Higgs Audio v3 TTS into SGLang-Omni for end-to-end serving, with 100 languages and tuning for streaming voice assistants that generate speech as they go.

Jun 4Thursday

r/LocalLLaMA

KVarN: Huawei KV-cache Quantization Claims 3–5× Compression and Speed-up

Huawei open-sourced KVarN, a KV-cache quantization method that claims 3–5× more context than FP16, up to 1.4× FP16 throughput, and vLLM integration through one flag; the post says it requires no model changes, retraining, or calibration and is released under Apache 2.0.

Why it matters: Huawei's open-source KVarN cuts KV cache memory to a third or a fifth and runs up to 40% faster than FP16 without breaking reasoning, and vLLM takes it with one flag.

QbitAI · WeChat

Beyond TurboQuant: Together AI Brings 2-bit KV Cache to Real Serving

Together AI, the University of Sydney, and UIUC introduced OSCAR, a 2-bit KV Cache quantization method that uses about 2.28 effective bits per KV element and scores 71.86 on Qwen3-4B-Thinking, 40.1 points above TurboQuant.

Why it matters: OSCAR compresses each KV cache element to about 2.28 bits and scores 71.86 on Qwen3-4B-Thinking, 40.1 points above TurboQuant in live serving.

QbitAI · WeChat

CVPR 2026: NVIDIA, Tesla, and Waymo hear Xpeng present physical AI

Xpeng presented its world-model stack at CVPR 2026, covering X-World, X-Foresight, and X-Cache; the article says X-Cache cuts about 70% of repeated computation, the second-generation VLA used over 4 trillion training tokens, and the in-car stack reduced inference latency to 80 ms.

Why it matters: XPeng's CVPR 2026 world-model stack cuts redundant compute by about 70% with X-Cache and trains its second-gen VLA on over 4 trillion tokens.

Bloomberg Technology

TSMC CEO Warns Chip Supply Won’t Meet AI-Fueled Demand for Years

TSMC CEO C.C. Wei said global chip supply will fall short of AI-driven demand for years, and the post does not disclose the shortage size, capacity plan, or exact timeline.

Why it matters: TSMC CEO C.C. Wei said publicly that the company's chip capacity will not catch up with AI-driven demand for years, a qualitative signal from a key link in the supply chain.

Financial Times · Technology

Broadcom loses more than $300bn in market value as revenue forecast disappoints

Broadcom lost more than $300 billion in market value after its revenue forecast disappointed investors; its shares fell as much as 15% in after-hours trading, and the post does not disclose the specific revenue guidance.

Why it matters: Broadcom guided next-quarter revenue below expectations, its shares fell as much as 15% after hours and market value dropped over $300bn, showing how hard large chip stocks react to a miss.

r/LocalLLaMA

I turned an Android phone into a Vulkan-accelerated local LLM node

Reddit user GsxrGuy80s configured a Z Fold 6 as a GGUF inference node using Vulkan, LiteLLM, and Tailscale; the post discloses gpu_layers=89, an OpenAI-compatible endpoint, and fallback routing to larger local nodes.

Why it matters: A Reddit user turned a Z Fold 6 into a GGUF inference node with Vulkan acceleration and published the gpu_layers=89 setting, showing a concrete config path for running local models on a phone GPU.

r/LocalLLaMA

I built a compiler that rewrites Python into a model-facing representation

The author released Vulpine, a compiler that converts Python into a compact model-facing representation for coding LLMs. Tests on about 13,000 held-out files showed roughly 14% token reduction and 99.8% AST-equivalent round-trip success, with code published on GitHub.

Why it matters: An open-source compiler turns Python source into a compact form aimed at code models, saving 14% of tokens on about 13,000 held-out test files while restoring the AST losslessly in 99.8% of cases.

AI HOT (Curated Pool)

Miso One Open-Sources Voice Model: 8B Parameters, 110ms Latency, One-Shot Voice Cloning

Miso One released an 8B-parameter open-weight TTS model with one-shot voice cloning from a short sample, 110ms inference latency, GitHub self-hosting without an API, and local audio data handling; the post says API access is coming but does not disclose pricing or launch timing.

Why it matters: Miso One open-sourced an 8B speech-cloning TTS model that mimics a speaking style from a short audio sample, claims 110 ms latency, and ships weights on GitHub for self-hosting.

Jun 3Wednesday

AI HOT (Curated Pool)

Intelligence Cost-Performance

Microsoft added average token usage to its model release card; the model scored 71.6 on SWE-Bench Verified while using about one-third of Claude Haiku 4.5’s tokens.

Why it matters: Microsoft adds average token use to its model card, giving a 71.6 SWE-Bench Verified score a cost dimension next to Claude Haiku 4.5.

NVIDIA Blog

NVIDIA Partners With Microsoft on Unified Stack for Agentic AI Deployment

NVIDIA and Microsoft announced a unified agentic AI deployment stack at Build across Windows, Azure, and local environments; RTX Spark provides 1 petaflop of AI performance, while DGX Station for Windows offers 20 petaflops of FP4 performance and up to 748GB of coherent memory.

Why it matters: NVIDIA and Microsoft linked their AI deployment stack so one app runs on Windows devices, Azure cloud and local DGX workstations without code changes, alongside the 1 petaflop RTX Spark hardware.

r/LocalLLaMA

Using Gemma 4 E4B with LiteRT: about 2.4× faster text generation than Q4 GGUF

The author tested Gemma 4 E4B on an RTX 4060 Ti 16GB, where LiteRT averaged 157.2 tok/s for text generation versus 66.3 tok/s for llama.cpp Q4 GGUF; image captioning on 111 full-resolution images improved only 1.1×, at about 72 seconds versus 80 seconds.

Why it matters: A hands-on RTX 4060 Ti test puts LiteRT text generation at roughly 2.4x llama.cpp Q4 GGUF, with image processing about even.

r/LocalLLaMA

Benchmarks of 20 Small LLMs on a 6GB RTX 4050

The author benchmarked 20 small LLMs on a 6GB RTX 4050 using LM Studio’s OpenAI-compatible API, with N=5 speed runs at 1k, 8k, and 32k context; unsloth/lfm2.5-vl-1.6b led throughput at 207 tok/s on 1k context while using 3.0GB VRAM.

Why it matters: A rare speed reference for running 20 small models on a 6GB laptop GPU, tested at 1k, 8k and 32k context.

Jun 2Tuesday

AI HOT (Curated Pool)

Holo3.1: Fast Local Computer-Use Agents

Holo3.1 releases Qwen-based computer-use agents in 0.8B, 4B, 9B, and 35B-A3B sizes, with FP8, Q4 GGUF, and NVFP4 quantized checkpoints for local inference and a 79.3% AndroidWorld score for the 35B-A3B model.

Why it matters: Hugging Face ships Holo3.1, a computer-use model in four sizes from 0.8B to 35B, with FP8, Q4 GGUF and NVFP4 builds for local inference on personal devices.

claude.dev Blog

How Claude Code dynamic workflows tailor an execution framework per task

Claude Code shipped dynamic workflows last week. Claude writes an execution framework for the current task on the spot, and workflows can be saved, shared and reused. They coordinate subagents through agent(), parallel() and pipeline() in JavaScript, can pick a model and a separate worktree, and resume a session after an interruption.

Why it matters: Claude Code splits execution and adversarial verification across subagents with separate contexts, a concrete orchestration method for cutting self-preference and goal drift on complex tasks.

AI HOT (Curated Pool)

Alphabet Plans to Raise $80 Billion to Support AI Compute Expansion

Alphabet plans to raise about $80 billion for AI compute expansion through underwritten shares, mandatory convertible preferred stock, a $10 billion Berkshire private placement, and a $40 billion ATM program, with about $30 billion tied to employee equity taxes.

Why it matters: Alphabet's roughly $80B raise for AI compute dwarfs its past equity financing, showing how far the capex race has escalated.

QbitAI · WeChat

Jensen Huang Brings NVIDIA CPUs Into the PC Market

NVIDIA RTX Spark will ship in Windows PCs this fall with 1 petaflop of AI compute and 128GB unified memory. The platform combines a Blackwell RTX GPU, a 20-core Arm-based Grace CPU, and NVLink-C2C, and NVIDIA says it can run 1-million-token-context, 120B-parameter language models locally.

Why it matters: NVIDIA packs a 20-core Grace CPU and a Blackwell GPU into a Windows machine over NVLink-C2C with 128GB of shared unified memory, a hardware path to running large models locally that differs from discrete GPUs.

Xinzhiyuan · WeChat

Chinese AI chip firm raises nearly 1B yuan as next-generation card is due this year

Motern AI completed a nearly 1 billion yuan Series C round and plans to release its SparsePrime inference card this year; the article says its S30 and S40 cards achieved three consecutive wins in MLPerf Inference.

Why it matters: Moffett AI closed a nearly 1 billion yuan Series C, following three straight MLPerf wins for its S30 and S40 sparse-computing inference cards, with the next-generation SparsePrime due this year.

AI HOT (Curated Pool)

StepFun releases Step 3.7 Flash for efficient inference

StepFun released Step 3.7 Flash with a 196B MoE architecture, using multi-matrix factorized attention to cut KV-cache cost to about 22% of DeepSeek models.

Why it matters: Step 3.7 Flash ships under Apache 2.0 with a KV-cache footprint about 22% of a comparable DeepSeek model, a concrete efficiency claim to test.

New York Times Chinese

Report Says China’s Military Has Sought Nvidia Chips for Years

Wirescreen reviewed 3,800 procurement records and found more than 500 cases where Chinese military units sought Nvidia chips by name or specification. The records cover 2019 to 2025 and include A100, A800, H100, and H800, but they do not confirm final delivery.

Why it matters: A review of 3,800 procurement records found Chinese military units naming Nvidia A100 and H100 chips more than 500 times, including for nuclear simulation and wargaming.

Bloomberg Technology

Nvidia Chips Sought by Chinese Labs With Military Ties

At least seven Chinese universities supporting the country’s armed forces and defense industry are seeking access to Nvidia H200 chips; the post does not disclose procurement channels, volumes, or specific US licensing conditions.

Why it matters: Bloomberg reports at least seven universities tied to China's military and defense industry are trying to obtain Nvidia H200 chips, a concrete case of where high-end compute flows under export controls.

AI HOT (Curated Pool)

The Thriving Ecosystem of Open Models

OpenRouter data shows open-weight models generated 69.1% of token usage since 2025, versus 30.9% for closed models, while share leadership shifted across DeepSeek, MiniMax, Kimi, MiMo, Qwen, Tencent Hy3, Alibaba, and Arcee releases.

Why it matters: OpenRouter's numbers show open-weight models took 69.1% of platform token usage so far in 2025 against 30.9% for closed models, a clear picture of what developers call.