Skip to content

#编码

10 today

May 9Saturday

r/LocalLLaMA

80 tok/sec and 128K context on 12GB VRAM with Qwen3.6 35B A3B and llama.cpp MTP

Reddit user janvitos ran Qwen3.6-35B-A3B-MTP-GGUF with a llama.cpp MTP PR on an RTX 4070 Super. The posted benchmark shows 69.2-81.9 tok/s, 0.694-0.947 draft acceptance, 131072 context, and a -fitt 1536 setting that reserves 1536 MB for the draft model and KV cache.

Why it matters: Reddit user janvitos runs Qwen3.6 35B A3B on a 12GB RTX 4070 Super and posts measured settings for 69.2 to 81.9 tok/s at 128K context.

AI HOT (Curated Pool)

Using Codex to debug and verify fixes in parallel

The author uses Codex in temporary crabbox environments to recreate bug states, verify failures, apply fixes, and re-verify them, while running 10 sessions in parallel to avoid local state pollution and speed loss.

Why it matters: The author reproduces, fixes and verifies bugs with Codex in throwaway sandboxes, running 10 sessions in parallel so the local machine stays clean.

QbitAI · WeChat

Why Perfect AI Agents Do Not Exist: Five Design Philosophies and Trade-offs Behind Claude Code

MBZUAI VILA Lab and UCL analyze Claude Code v2.1.88 source code and identify 5 design philosophies, 13 design principles, 7 permission layers, and 5 context-compaction layers behind its production-agent architecture.

Why it matters: A teardown of Claude Code's source shows how Anthropic constrains the model inside a tight engineering frame instead of adding features.

Synced · WeChat

OpenAI's Jiayi Weng: Is the Next AI Training Paradigm Beyond Gradients?

OpenAI researcher Jiayi Weng proposes Heuristic Learning: codex gpt-5.4 reached a perfect 864 score on Breakout and generated 342 search trajectories across Atari 57, with updates applied to code, tests, replays, and memory rather than neural-network weights.

Why it matters: OpenAI researcher Weng Jiayi proposes heuristic learning, where models improve by editing code, tests and memory rather than updating weights.

Latent Space

Anthropic growing 10x/year while others lay off over 10% of staff

Anthropic is described as growing 10x annually and being valued at $1T-$1.2T, while the post cites layoffs of 40% at Block, 14% at Coinbase, and 20% at Cloudflare under AI-readiness framing.

Why it matters: Anthropic's annualized revenue is growing 80x while other labs cut over 10% of staff, showing money and talent concentrating at the top.

r/LocalLLaMA

MTP + TurboQuant Running: Qwen3.6-27B Hits 80+ t/s on a Single RTX 4090

indrasmirror ran Qwen3.6-27B-Heretic-v2 on a single RTX 4090 with 262K context, TBQ4_0 KV cache, and MTP draft 3, improving throughput from about 43 t/s to 80-87 t/s with roughly 73% MTP draft acceptance.

Why it matters: indrasmirror pushed Qwen3.6-27B to 262K context on one RTX 4090, using MTP speculative decoding to lift generation from about 43 t/s to 80-87 t/s at a 73% draft acceptance rate.

AI HOT (Curated Pool)

Claude Code Practice: The Effectiveness of HTML Output

Thariq Shihipar recommends requesting HTML output from Claude, and the post cites GPT-5.5 generating an interactive Linux vulnerability page with SVG diagrams, interactive components, and in-page navigation.

Why it matters: Anthropic's Thariq Shihipar suggests having Claude output HTML instead of Markdown, while Simon Willison recalls how GPT-4's 8192-token limit once made Markdown the cheaper choice.

May 8Friday

Hacker News front page

Show HN: Git for AI Agents

regent-vcs released the open-source re_gent project for AI-agent version control, currently supporting Claude Code, with workflows for tracking why an agent changed files, rewinding sessions, and bisecting agent actions; the post does not disclose the license, storage format, or installation details.

Why it matters: regent-vcs's open-source re_gent adds Git-like version control to Claude Code, recording why the AI changed files, supporting conversation rollback, and using bisection to find which step caused a problem.

AI HOT (Curated Pool)

Running Codex Safely at OpenAI

OpenAI runs Codex with four safeguards: sandbox isolation, human approval, strict network policies, and native agent telemetry; the post does not disclose evaluation metrics, incident rates, or enterprise deployment requirements.

Why it matters: OpenAI published its internal Codex deployment security plan, splitting sandbox isolation, human approval, network allowlists and agent logs into four layers that others can adapt when setting code agent permission boundaries.

Synced · WeChat

OpenAI launches official CLI for terminal-based model access

OpenAI released the open-source openai-cli, letting developers call Responses, cloud tools, image generation and editing, speech transcription, and TTS from a single terminal command.

Why it matters: A terminal command replaces SDK integration for chat, image generation and speech, which lowers the setup cost for quick tests.

AI HOT (Curated Pool)

Adaptive Parallel Reasoning: A New Paradigm for Efficient Reasoning Scaling

BAIR’s post describes adaptive parallel reasoning, where ThreadWeaver and Multiverse dynamically control parallel threads for math and code reasoning; the RSS snippet does not disclose benchmark scores, latency reductions, or reproducible settings.

Why it matters: Two new parallel reasoning methods let the model decide when to branch and how many branches to open, instead of relying on external rules to split tasks.

Ruan YiFeng's Weblog

Technology Enthusiast Weekly Issue 395: The Third Way of Software Development

Ruanyifeng Weekly issue 395 frames AI-assisted coding as a “mystery house” style of software development and cites HN SOTA, which ranks model popularity by scanning 200 top Hacker News topics each day and their programming or AI discussions.

Why it matters: In his weekly, Ruan Yifeng frames AI-assisted programming as mystery-house development, sets it beside the cathedral and bazaar models of open source, and argues it may become the default for individuals and small teams.

AI HOT (Curated Pool)

Codex Plugin Now Supports Parallel Runs Across Chrome Tabs

OpenAI says Codex now runs in Chrome on macOS and Windows. The plugin works across tabs in the background without taking browser control; the post does not disclose version, concurrency limits, or enterprise policy.

Why it matters: OpenAI's Codex plugin now runs web and app tasks in parallel across background Chrome tabs on macOS and Windows without taking over the user's browser.

AI HOT (Curated Pool)

Agent Pull Requests Are Everywhere: How to Review Them

GitHub published a guide for reviewing pull requests generated by AI agents. The snippet lists 3 focus areas: code changes, logic or security bugs, and pre-merge technical debt. The key issue is a review process before automated commits reach production.

Why it matters: A GitHub blog post lays out a three-step method for reviewing AI agent pull requests, from reading the diff to hunting logic and security bugs to clearing tech debt before merge.

May 7Thursday

AI HOT (Curated Pool)

Trillion-parameter instruction model Ling-2.6-1T released

inclusionAI says Ling-2.6-1T is now live on OpenRouter. The trillion-parameter instruction model uses “fast thinking” and claims top AIME26 and SWE-bench Verified results with about 75% lower cost. The post does not disclose pricing, context length, or full benchmark scores.

Why it matters: inclusionAI put its trillion-parameter instruction model Ling-2.6-1T on OpenRouter, pitched at fast thinking and claiming inference costs about 75% lower than comparable models for advanced coding and agent workflows.

Hacker News front page

AlphaEvolve: Gemini-powered coding agent scaling impact across fields

Google DeepMind describes AlphaEvolve as a Gemini-powered coding agent; the body is only an RSS snippet. The title discloses coding-agent scope and cross-field impact, but the post does not disclose model version, benchmarks, or deployments.

Why it matters: DeepMind explains how AlphaEvolve, its Gemini-powered coding agent, is being applied across several fields, giving readers a look at one approach to cross-domain use of coding agents.

OpenAI News

Scaling Trusted Access for Cyber with GPT-5.5 and GPT-5.5-Cyber

OpenAI expanded Trusted Access for Cyber to GPT-5.5 and GPT-5.5-Cyber. The RSS snippet says access is for verified defenders; the post does not disclose criteria, pricing, or benchmark data.

Why it matters: OpenAI extends its trusted network access program to GPT-5.5 and GPT-5.5-Cyber, letting verified security practitioners run vulnerability analysis and malware triage on stronger models while offensive operations stay blocked.

r/LocalLLaMA

Running Qwen3.5/Qwen3.6 with NextN MTP in llama.cpp on one RTX 3090 Ti

A Reddit user posted a llama.cpp guide for Qwen3.5/3.6 with NextN MTP on one RTX 3090 Ti. It requires two unmerged PRs, #22400 and #22673; Qwen3.6-35B-A3B-MTP reaches 157 tok/s at 350W, 1700MHz, with q8 KV. The key reproducible detail is nextn=q8_0 quant override; missing it yields “////” output.

Why it matters: A Reddit user posts a hands-on llama.cpp guide for running Qwen3.5 and 3.6 on a single RTX 3090 Ti, built on two unmerged PRs and covering NextN MTP speculative decoding setup.

Latent Space

Anthropic-SpaceXAI's 300MW/$5B/yr Deal for Colossus I, ARR Growth Is 8000% Annualized

Anthropic announced a SpaceX compute partnership, doubled Claude Code’s 5-hour limits for Pro, Max, Team, and seat-based Enterprise, raised Opus API limits, and said Claude inference would ramp on Colossus within days; the post treats the 300MW and $5B-per-year figures as widely circulated but not canonized in Anthropic’s own announcement.

Why it matters: Anthropic is renting xAI's 300MW Memphis Colossus I cluster for Claude inference, a deal estimated at $5B a year that puts xAI into the compute rental business.

AI HOT (Curated Pool)

Amp releases Neo CLI as coding agents shift toward long-horizon workflows

Amp released Neo, a CLI tool covering remote orchestration, automatic context compression, and a Plugin API. Neo lets local threads be controlled remotely, allows all operations by default, and moves safety control to plugins; the post does not disclose version, pricing, or performance gains.

Why it matters: Amp launched Neo CLI, which hands local threads to remote control and auto-compresses context, allows all operations by default and moves safety checks into a plugin system, pushing coding assistants toward long-chain autonomous runs.

Synced · WeChat

TACO Lets CLI Agents Drop Useless Context Through Self-Evolving Compression

TACO proposes a training-free terminal-observation compression framework, improving success rate and token efficiency on TerminalBench 1.0/2.0 and related benchmarks. It evolves rules within tasks, writes validated rules to a global pool, and finds 24.6%–44.1% low-value redundancy in TerminalBench 2.0 raw prompts. The key signal is stability: Top-30 rule retention exceeds 90% after multiple evolution rounds.

Why it matters: TACO lets a command-line agent write its own correction rules during autonomous iteration and reuse them from a global pool, cutting terminal output without extra training.

Synced · WeChat

Claude, GPT and Gemini score 0% completion on ProgramBench

ProgramBench tested Claude Opus 4.7, GPT-5.4 and Gemini 3.1 Pro, with 0% full completion on rebuilding software projects. It gives only executables and usage docs, removes source/tests, and grades behavioral equivalence via agent-driven fuzzing. The key signal is system-level engineering, not function-level code generation.

Why it matters: The author of SWE-Bench launched ProgramBench, a new benchmark that asks models to rebuild complete software projects from scratch using only executables and docs; Claude, GPT and Gemini all scored zero.

Synced · WeChat

Musk Announces xAI Dissolution, Leasing 220,000 GPUs to Anthropic

Musk confirmed xAI will dissolve, with Grok and X-related operations folded into SpaceXAI. SpaceX and Anthropic signed a deal giving Claude access to Colossus 1’s 220,000+ Nvidia GPUs and 300 MW of compute. The key change is quota: Claude Code’s five-hour rate limit doubles, and Pro/Max peak-hour cuts are removed.

Why it matters: Musk confirmed xAI's dissolution, folding Grok and X into SpaceXAI while renting Colossus 1's 220,000 GPUs to Anthropic, a shift in two AI rivals' positions.

AI HOT (Curated Pool)

Open Slide lets AI write PPT code

Open Slide builds PPTs with React, using a workflow designed for AI agents. It integrates SVGL with 1,500+ brand logos, supports manual edits, and lets AI read user comments for revisions.

Why it matters: Open Slide turns decks into React components, so AI can read comments and edit the file directly, with over 1,500 brand logos wired in.

r/LocalLLaMA

GB10 inference engine Atlas is open source, with Qwen3.6-35B-FP8 over 100 tok/s

Avarok open-sourced Atlas, an inference engine running Qwen3.5-35B at ~111 tok/s sustained on one DGX Spark. It uses Rust+CUDA, a ~2.5GB image, and sub-2-minute cold start; the author claims 3.0–3.3x vLLM in tests. The key details are Blackwell SM120/121 kernels, NVFP4/FP8, and MTP decoding.

Why it matters: Avarok open-sourced Atlas, a Rust and CUDA inference engine, hitting about 111 tok/s for Qwen3.5-35B on a DGX Spark, which the author puts at 3.0 to 3.3 times vLLM.

May 6Wednesday

r/LocalLLaMA

2.5x Faster Inference with Qwen 3.6 27B Using MTP on 48GB

A llama.cpp PR adds MTP support for Qwen 3.6 27B, with a reported 2.5x inference speedup. The author measured 28 tok/s on a Mac M2 Max 96GB and shared GGUF builds, compile steps, and a 262144-context server command. The key detail is turbo4 4.25-bit KV cache: a 48GB Mac runs Q5_K_M at 262K context.

Why it matters: A llama.cpp PR adds MTP support for Qwen 3.6 27B, measured at 2.5x faster inference with 262k context on 48GB, a usable setup for local agentic coding.

Latent Space

AINews: Silicon Valley Gets Serious About Services

Anthropic and OpenAI announced enterprise services companies: Anthropic’s unnamed JV is funded with $1.5 billion, while OpenAI’s The Deployment Company has raised about $4 billion at a $10 billion pre-money valuation.

Why it matters: Anthropic and Blackstone and others formed a joint venture services firm with $1.5 billion, sending small teams in first to scope Claude use cases before engineers build custom systems.

Synced · WeChat

DeepSeek Version of Claude Code Tops Trending Chart With 8,700 Stars

DeepSeek TUI topped GitHub trending with over 8,700 stars. Hunter Bown built it in Rust for local terminal use with DeepSeek V4, supporting chat, file edits, shell commands, and task management. The key detail is RLM mode: up to 16 V4 Flash subtasks, plus a 1M-token context window and approval gates.

Why it matters: Developer Hunter Bown's Rust-written DeepSeek TUI has over 8,700 GitHub stars, letting users chat, edit files and run shell commands against DeepSeek V4 from the local terminal.

Xinzhiyuan · WeChat

Coding at 12, Building a $2B Google Business at 28: He Tells Young People to Stop Chasing Coding

Xinzhiyuan says Alon Chen coded at 12 and managed a $2B Google business at 28. He argues Gen Z should stop chasing coding, citing 30% AI-written Microsoft code and 25%+ at Google. The sharper signal is execution, problem framing, and communication, not coding as a sole moat.

Why it matters: Alon Chen, 28, runs a $2 billion business at Google and cites Microsoft's 30% and Google's 25%-plus AI-generated code to argue the moat around pure coding is thinning.

r/LocalLLaMA

DeepSeek V4 at 17x lower cost prompted a local-vs-cloud coding workflow test

Reddit user spencer_kw logged a 10-day coding workflow and retested 150 tasks on local Qwen 3.6 27B versus cloud models. Local was equivalent for 65% of tasks, acceptable for 20%, and cloud was needed for 15%; the API bill fell from $85/month to about $22. The useful signal is task-based routing, not headline model pricing alone.

Why it matters: A concrete split of which coding tasks run on a local Qwen model and which still need the cloud, with the API bill to match.

May 5Tuesday

r/LocalLLaMA

ProgramBench: Can We Really Rebuild Huge Binaries from Scratch?

ProgramBench released 200 tasks for agents rebuilding programs from target executables and usage files. The team spent about $50k generating 6M lines of black-box behavioral tests, with no internet or decompilation. GitHub, Hugging Face, and Docker images are open-sourced, with pip-based evaluation available.

Why it matters: ProgramBench gives agents 200 tasks to rebuild programs from nothing but a binary and its docs, with no network or decompiling, and the results show agents mostly cannot do it.

Synced · WeChat

Anthropic cofounder says AI self-improvement has a 60% chance by 2028

Anthropic cofounder Jack Clark says human-free AI R&D has over a 60% chance by end-2028. He cites SWE-Bench, CORE-Bench, MLE-Bench, and PostTrainBench: Claude Mythos Preview reaches 93.9% on SWE-Bench, and Opus 4.5 reaches 95.5% on CORE-Bench. The key signal is longer task horizons and post-training capability, not the “singularity” framing.

Why it matters: A named Anthropic co-founder puts a number on AI doing its own R&D, with two benchmark results attached.

r/LocalLLaMA

MTPLX: 2.24x Faster TPS Native MTP Inference Engine for Apple Silicon

MTPLX raises Qwen3.6-27B on a MacBook Pro M5 Max from 28 to 63 tok/s. The test used 4-bit MLX, temperature 0.6, top_p 0.95, top_k 20, with D3 as the best depth. The key detail is native MTP heads: no external drafter and no second-model memory.

Why it matters: MTPLX on a MacBook Pro M5 Max raised Qwen3.6-27B generation speed from 28 to 63 tokens per second, a 2.24x gain from built-in MTP heads with no separate drafter model to load.

r/LocalLLaMA

Benching Local Qwen as a Codex Validator, Co-agent, and Challenger

robert896r1 tested Qwen3.6 27B GGUF beside Codex as a coding validator and released a reproducible eval suite. The runs covered Bartowski, Unsloth, 65k/128k context, and q8/f16 KV cache; three 128k profiles tied for best, with no measured q8 KV accuracy loss in this suite. The useful signal is the sidecar eval: missed directives, overbuilding, UI judgment, and long-context misses, not a universal leaderboard.

Why it matters: The author runs a GGUF-quantized Qwen3.6 27B beside Codex as a code validator and published a reproducible benchmark covering two quantization sources, 65k and 128k context, and q8 and f16 KV cache precision.

May 4Monday

Import AI (Jack Clark)

Import AI 455: Automating AI Research

Jack Clark argues that no-human-involved AI R&D has a 60%+ chance of arriving by the end of 2028, citing SWE-Bench gains from Claude 2 at about 2% to Claude Mythos Preview at 93.9%, plus METR task horizons rising from 30 seconds in 2022 to 12 hours in 2026.

Why it matters: Jack Clark uses SWE-Bench and METR to put the odds of AI research running without humans above 60% by end-2028, giving a trackable timeline.

r/LocalLLaMA

Deep research report with Hermes Agent and qwen3.6-35b-a3b Q6_K

A Reddit user used Hermes Agent and qwen3.6-35b-a3b Q6_K to produce a 21-page research report. The run took 6 loops and over 5 hours on an RTX 4060, at about 28 tokens/s. The repo includes prompts, scripts, intermediate artifacts, and the final report.

Why it matters: A Reddit user ran Hermes Agent with a quantized qwen3.6-35b on one RTX 4060 through six loops to produce a 21-page report, with prompts and scripts in the repo.

QbitAI · WeChat

DeepSeek-TUI, a “DeepSeek Claude Code,” reaches 2.3k GitHub stars

DeepSeek-TUI reached 2.3k GitHub stars; the Rust project is MIT-licensed. It targets DeepSeek V4 with a 1M-token context, RLM up to 16 V4 Flash subtasks, MCP, Shell, Git, and three control modes. Watch cache misses: uncached tokens cost 10x cached tokens.

Why it matters: DeepSeek-TUI is a Rust terminal coding assistant wired to DeepSeek V4 with 1M-token context, MIT-licensed, for developers studying command-line AI coding tools.

Xinzhiyuan · WeChat

Claude token rankings: Disney employee hits 460,000 calls in 9 days; Meta burns 60T monthly

Xinzhiyuan says Disney tracks Claude use via an AI Adoption Dashboard, with one employee making about 460,000 calls in 9 workdays. It also says Meta used 60 trillion tokens in 30 days, worth about $9B by public API pricing; the post does not show raw tables. The key issue is that input rankings are not outcomes.

Why it matters: One Disney employee made about 460,000 Claude calls in nine working days while Meta burned 60 trillion tokens in the same period, two numbers that show real enterprise AI usage.

最佳拍档 (BestPartners)

Why Claude Code Got Worse: Anthropic’s Review of Three Bugs

The title says Anthropic reviewed Claude Code regressions involving three bugs. It names reasoning-strength changes, a cache optimization error, and a system-prompt length limit; the post does not disclose repro steps, timeline, or fix status. The key point is AI reviewing AI code under engineering constraints.

Why it matters: Anthropic traced Claude Code's performance regression to three concrete causes: a reasoning effort change, a broken cache optimization, and a system prompt length limit.

May 3Sunday

r/LocalLLaMA

Local LLM Benchmark for Backend Generation via Function Calling: GLM vs Qwen vs DeepSeek

AutoBe posted a controlled backend-generation benchmark and says qwen3.5-35b-a3b matches gpt-5.4 on DB/API design. One shopping-mall run uses 200–300M tokens, costing $1,000–$1,500 per model at GPT 5.5 pricing. The key caveat is n=4 projects and self-scoring harness bias.

Why it matters: AutoBe tests database and API design through function calling, and qwen3.5-35b-a3b matches gpt-5.4 on 4 projects, with one mall project burning 200 to 300 million tokens.