Skip to content

#MCP/工具调用

3 today

May 6Wednesday

Xinzhiyuan · WeChat

Salesforce plans to hire 1,000 graduates as agent roles expand

Salesforce CEO Marc Benioff said the company will hire 1,000 graduates or interns for Agentforce growth. The post cites Agentforce ARR up 169% to $800 million, with roles covering prompts, evals, agent supervision, and delivery. The key shift is entry roles moving from execution to agent orchestration and output checks.

Why it matters: Salesforce plans to hire 1,000 new graduates and interns as Agentforce annual recurring revenue reaches $800 million, with roles covering prompt writing, evals, agent supervision and delivery.

TechCrunch · AI

Apple plans to make iOS 27 a Choose Your Own Adventure of AI models

Apple reportedly plans to let iOS 27 users choose third-party AI models for multiple tasks. The RSS snippet does not disclose model names, task scope, launch timing, or integration mechanics.

Why it matters: Apple plans to let users pick third-party large language models to power Siri and other system features in iOS 27, with Google and Anthropic models under test.

The Verge · AI

Apple could let you pick a favorite AI model in iOS 27

Apple plans to let third-party chatbots run system-wide Apple Intelligence in iOS 27, iPadOS 27, and macOS 27. Mark Gurman says Extensions can handle Siri, Writing Tools, and Image Playground this fall. The post does not disclose supported models, pricing, or developer APIs.

Why it matters: Apple plans to open an extension mechanism in iOS 27 and later, letting third-party chatbots take over Siri and other system functions and be set as default, a concrete clue to how open system-level AI entry points may become.

Financial Times · Technology

Meta plans advanced agentic AI assistant for consumers

Meta plans a consumer agentic AI assistant; the RSS body has one sentence. It says Meta is funding an OpenClaw counterpart for everyday task execution. The post does not disclose model size, launch timing, pricing, regions, or permission controls.

Why it matters: Meta is building a consumer agentic AI assistant aimed at products that carry out everyday tasks for users, which shows who the big players are benchmarking against in consumer agents.

NVIDIA Blog

NVIDIA and ServiceNow Partner on Autonomous AI Agents for Enterprises

NVIDIA and ServiceNow expanded their partnership with Project Arc, an enterprise desktop agent. It connects via Action Fabric and uses OpenShell for sandboxed, policy-governed execution. Blackwell delivers over 50x Hopper’s token output per watt and nearly 35x lower cost per million tokens.

Why it matters: NVIDIA and ServiceNow built Project Arc, a desktop AI agent that reaches enterprise software through Action Fabric and runs permissioned actions inside an OpenShell sandbox.

May 5Tuesday

Hacker News front page

Show HN: Airbyte Agents – context for agents across multiple data sources

Airbyte launched Airbyte Agents, using Context Store to index operational data for agents. Its public benchmark reports up to 80% fewer tokens for Gong and 90% for Zendesk versus vendor MCPs. The key point is pre-indexed context, not another MCP wrapper.

Why it matters: Airbyte's Context Store pre-indexes data from Slack, Salesforce and Zendesk so assistants skip repeated API calls, which Airbyte says cuts token use by about 90%.

r/LocalLLaMA

vibevoice.cpp: Microsoft VibeVoice ported to ggml/C++ with no Python at inference

LocalAI released vibevoice.cpp, a ggml/C++ port of Microsoft VibeVoice for CPU, CUDA, Metal, and Vulkan inference. TTS uses a 30s reference clip for 24kHz cloned speech; ASR uses a 7B model with diarized JSON and was tested on 17min audio. The key constraint is memory: 17min CPU Q8_0 peaks near 26GB, with no streaming output yet.

Why it matters: LocalAI rewrote Microsoft VibeVoice's speech synthesis and long-audio transcription as a pure C++ version that runs on CPU, CUDA, Metal and Vulkan, so local deployment no longer needs a Python environment.

r/LocalLLaMA

Prompt injection benchmark: delimiter and strict prompt took Gemma 4 from 21% to 100% defense rate

A Reddit user posted a prompt-injection benchmark covering 15 models, 7 attack types, and 6,100+ cases. The setup wraps untrusted documents in long random delimiters; Gemma 4 E4B rose from 21.6% to 100% defense. The key detail is the reproducible metric: blocked/(blocked+failed).

Why it matters: A Reddit user ran over 6,100 prompt injection tests across 15 models and 7 attack styles, and a long random delimiter plus strict instructions lifted Gemma 4 E4B's defense rate from 21.6% to 100%.

r/LocalLLaMA

DeepSeek V4 Pro matches GPT-5.2 on FoodTruck Bench, 10 weeks later and about 17x cheaper

DeepSeek V4 Pro ranked No. 4 on FoodTruck Bench. The 30-day agentic benchmark uses 34 tools, persistent memory, and daily reflection; its median is within 3% of GPT-5.2 at about 17x lower workload cost. Xiaomi MiMo v2.5 Pro also ranked No. 6, with 5/5 survival, 1,019% median ROI, and $2.41 per run.

Why it matters: DeepSeek V4 Pro placed fourth in the 30-day FoodTruck Bench agent evaluation, with a median score within 3% of GPT-5.2 and a per-turn cost about one seventeenth of it.

Xinzhiyuan · WeChat

$1 for 10 Stars: ICSE Paper Exposes Fake GitHub Star Market

CMU researchers scanned GitHub events from July 2019 to Dec. 2024, flagging 6 million suspected fake stars. StarScout ran on about 20 TiB and found 18,617 repositories and 301,000 accounts. The supply-chain risk is concrete: GitHub deleted 90.42% of flagged repos, and about 30% of live samples were spam, phishing, or malware.

Why it matters: A CMU team scanned five years of GitHub logs and found roughly 6 million suspected fake stars, showing how cheap repo credibility has become.

Synced · WeChat

Agent-World Scales Real-World Environment Synthesis for Evolving General Agents

Agent-World builds 1,978 environments and 19,822 tools to train agents on long-horizon tasks. It combines web mining, tool generation, verifiable task synthesis, and GRPO training, with tasks averaging over 15 turns. The key signal is the scaling link among environment count, self-evolution rounds, and 23 benchmarks.

Why it matters: Agent-World built 1,978 environments and 19,822 tools, chaining web mining, tool generation, task synthesis and GRPO training into one pipeline to train general agents that finish long-horizon tasks averaging more than 15 steps.

r/LocalLLaMA

MTPLX: 2.24x Faster TPS Native MTP Inference Engine for Apple Silicon

MTPLX raises Qwen3.6-27B on a MacBook Pro M5 Max from 28 to 63 tok/s. The test used 4-bit MLX, temperature 0.6, top_p 0.95, top_k 20, with D3 as the best depth. The key detail is native MTP heads: no external drafter and no second-model memory.

Why it matters: MTPLX on a MacBook Pro M5 Max raised Qwen3.6-27B generation speed from 28 to 63 tokens per second, a 2.24x gain from built-in MTP heads with no separate drafter model to load.

May 4Monday

r/LocalLLaMA

M3 Ultra + DGX Spark = M5 Ultra-lite?

A Reddit user benchmarked DGX Spark against M3 Ultra in llama.cpp at pp16384, with Spark 1.4× to 3.4× faster across 4 models. Qwen 27B hit 778 t/s vs 340 t/s, while Mistral 128B hit 241 t/s vs 72 t/s. The concrete tuning note is mmap=0: loading fell from minutes to about 20 seconds.

Why it matters: A Reddit user benchmarked DGX Spark against M3 Ultra at pp16384 context in llama.cpp, with Spark 1.4x to 3.4x faster on Qwen 27B and Mistral 128B.

r/LocalLLaMA

Deep research report with Hermes Agent and qwen3.6-35b-a3b Q6_K

A Reddit user used Hermes Agent and qwen3.6-35b-a3b Q6_K to produce a 21-page research report. The run took 6 loops and over 5 hours on an RTX 4060, at about 28 tokens/s. The repo includes prompts, scripts, intermediate artifacts, and the final report.

Why it matters: A Reddit user ran Hermes Agent with a quantized qwen3.6-35b on one RTX 4060 through six loops to produce a 21-page report, with prompts and scripts in the repo.

QbitAI · WeChat

DeepSeek-TUI, a “DeepSeek Claude Code,” reaches 2.3k GitHub stars

DeepSeek-TUI reached 2.3k GitHub stars; the Rust project is MIT-licensed. It targets DeepSeek V4 with a 1M-token context, RLM up to 16 V4 Flash subtasks, MCP, Shell, Git, and three control modes. Watch cache misses: uncached tokens cost 10x cached tokens.

Why it matters: DeepSeek-TUI is a Rust terminal coding assistant wired to DeepSeek V4 with 1M-token context, MIT-licensed, for developers studying command-line AI coding tools.

Xinzhiyuan · WeChat

Claude token rankings: Disney employee hits 460,000 calls in 9 days; Meta burns 60T monthly

Xinzhiyuan says Disney tracks Claude use via an AI Adoption Dashboard, with one employee making about 460,000 calls in 9 workdays. It also says Meta used 60 trillion tokens in 30 days, worth about $9B by public API pricing; the post does not show raw tables. The key issue is that input rankings are not outcomes.

Why it matters: One Disney employee made about 460,000 Claude calls in nine working days while Meta burned 60 trillion tokens in the same period, two numbers that show real enterprise AI usage.

最佳拍档 (BestPartners)

Why Claude Code Got Worse: Anthropic’s Review of Three Bugs

The title says Anthropic reviewed Claude Code regressions involving three bugs. It names reasoning-strength changes, a cache optimization error, and a system-prompt length limit; the post does not disclose repro steps, timeline, or fix status. The key point is AI reviewing AI code under engineering constraints.

Why it matters: Anthropic traced Claude Code's performance regression to three concrete causes: a reasoning effort change, a broken cache optimization, and a system prompt length limit.

r/LocalLLaMA

Gemma 4 E2B runs well on an 8GB Android phone, powering a private voice notes app

A Reddit user ran Gemma 4 E2B locally on an 8GB OnePlus CE 5 and built a private voice notes app. Whisper Small 244MB transcribes, Gemma 4 E2B 2.4GB splits and tags, and a 10-15s note takes 12-15s end to end. Search uses query expansion, FTS lanes, RRF, and optional Gemma top-K reranking with a 15s fallback.

Why it matters: A Reddit user fit a 2.4GB Gemma 4 E2B and Whisper Small into an 8GB phone for a fully offline voice notes app.

May 3Sunday

r/LocalLLaMA

Local LLM Benchmark for Backend Generation via Function Calling: GLM vs Qwen vs DeepSeek

AutoBe posted a controlled backend-generation benchmark and says qwen3.5-35b-a3b matches gpt-5.4 on DB/API design. One shopping-mall run uses 200–300M tokens, costing $1,000–$1,500 per model at GPT 5.5 pricing. The key caveat is n=4 projects and self-scoring harness bias.

Why it matters: AutoBe tests database and API design through function calling, and qwen3.5-35b-a3b matches gpt-5.4 on 4 projects, with one mall project burning 200 to 300 million tokens.

r/LocalLLaMA

LLM proxy that lets Claude Code talk to any model

DataNebula released open-source rosetta-llm, letting Claude Code call multiple providers through one gateway. It translates Anthropic Messages, OpenAI Chat, and OpenAI Responses, and round-trips encrypted reasoning via the signature field. The key detail is thinking-block fidelity for multi-turn agent prompt-cache hits.

Why it matters: DataNebula's open-source rosetta-llm acts as a translation gateway so Claude Code can call models from other vendors, one route to mixing models.

May 2Saturday

r/LocalLLaMA

I built Semvec: A constant-cost semantic memory for LLMs, looking for testers

A developer released Semvec, replacing unbounded chat history with fixed-size semantic state. Its 48-turn benchmark claims about 76% token reduction, with identical input footprint at turn 10 and 10,000. It supports OpenAI-compatible LLMs, MCP, Claude Code, Cursor, and multi-agent shared state.

Why it matters: Swapping chat history for fixed-size semantic vectors cuts token use about 76% and keeps input cost flat as a conversation grows.

Hacker News front page

Show HN: Filling PDF Forms with AI Using Client-Side Tool Calling

SimplePDF released a Copilot demo that fills PDF forms via client-side tool calling; SimplePDF has 200k+ monthly users. PDFs stay in the browser, with parsing, rendering, and field detection local. The demo uses a DeepSeek V4 Flash proxy by default, with BYOK, cloud, or LM Studio options.

Why it matters: SimplePDF's Copilot runs PDF parsing, rendering and field detection in the browser, so files never leave the machine.

r/LocalLLaMA

Qwen3.6-27B hits 72 tok/s on RTX 3090 with native vLLM on Windows

Reddit user One_Slip1455 released a native Windows vLLM launcher for Qwen3.6-27B, reaching 72 tok/s on an RTX 3090. It reports 64.5 tok/s at ~25k tokens, 53.4 tok/s at 127k ctx on one GPU, and 160k ctx with PP=2 on 2×3090. The key detail is no WSL or Docker, an OpenAI-compatible endpoint, and an INT4 quant path.

Why it matters: A native Windows vLLM launcher runs Qwen3.6-27B on one RTX 3090 without WSL or Docker, hitting 72 tok/s at short context.

QbitAI · WeChat

Apple Support App Accidentally Shipped Claude.md, Revealing Internal Claude Code Use

Apple Support v5.13 shipped a Claude.md file on May 1 and was pulled within 24 hours. The file describes Juno AI and Live Agents switching through a Protocol layer, with client, agent, and assistant messages handled in one flow. The key issue is release review; the post does not disclose how the file entered production.

Why it matters: Apple Support App 5.13 shipped a Claude.md file describing its AI-to-human handoff protocol, then pulled the build within 24 hours, exposing a review gap at a large company.

May 1Friday

r/LocalLLaMA

PFlash: 10x prefill speedup over llama.cpp at 128K on an RTX 3090

PFlash cuts Qwen3.6-27B Q4_K_M 128K TTFT to 24.8s on an RTX 3090, versus 248.4s cold for llama.cpp. It uses a Qwen3-0.6B drafter to score token importance, keeps 5% of spans, and runs C++/CUDA without Python, Triton, or PyTorch. The quality caveat is clear: only NIAH single-needle passes from 32K to 128K; RULER and multi-needle results are not disclosed.

Why it matters: PFlash uses Qwen3-0.6B to pick the 5% of chunks that matter, cutting first-token latency on a 128K-token RTX 3090 run from 248.4s to 24.8s.

The Verge · AI

Pentagon strikes classified AI deals with OpenAI, Google, and Nvidia, but not Anthropic

The Pentagon signed classified AI-use deals with 7 firms: OpenAI, Google, Microsoft, Amazon, Nvidia, xAI, and Reflection. Anthropic was excluded as a supply-chain risk; the post does not disclose contract value, model scope, or deployment terms.

Why it matters: Seven companies including OpenAI, Google and Nvidia signed classified AI deals with the Pentagon, while Anthropic was left out over supply-chain risk.

r/LocalLLaMA

MiMo-V2.5-Pro: the actual best open-weights model

Reddit user cjami benchmarked Xiaomi MiMo-V2.5-Pro in autonomous Blood on the Clocktower games. It scored 88% as Good and 48% as Evil, with 183,639 output tokens per game, $0.99 cost, and a 0.4% tool-call error rate. The key comparison is Kimi K2.6: 580,000 tokens, $2.65, and 10–15 hours per game.

Why it matters: A Reddit user had MiMo-V2.5-Pro play Blood on the Clocktower against itself, where good won 88% and evil 48%, showing where open models still fall short on cooperative reasoning and deception.

The Verge · AI

Microsoft wants lawyers to trust its new AI agent in Word documents

Microsoft launched Legal Agent in Word for legal teams, focused on tasks such as contract review. It follows legal workflows, reviews clauses against a playbook, and handles tracked changes; the post does not disclose pricing or rollout scope.

Why it matters: Microsoft's Legal Agent for Word reviews contracts clause by clause against a preset rulebook and handles tracked changes, built by the Robin AI team it acquired.

Xinzhiyuan · WeChat

Claude Code's Real Story: 98.4% of What Works Is Engineering, Not AI

VILA-Lab analyzed 512,000 lines of Claude Code v2.1.88 and found 1.6% tied to AI decision logic. The other 98.4% is deterministic infrastructure: permissions, context, tool routing, and error recovery. The key shift is harness design, not longer prompts.

Why it matters: VILA-Lab reverse-engineered Claude Code's 512,000 lines and found only 1.6% relates to AI decisions; the other 98.4% is engineering infrastructure like permission control, context management and tool routing.

Xinzhiyuan · WeChat

OpenAI upgrades Codex to control Macs and run cross-app tasks

OpenAI upgraded Codex with Slack, Google Workspace, and Microsoft 365 integrations. Mike Russell tested Codex on a Mac across Adobe Audition, Photoshop, and Firefly, finishing in about 8 minutes with an 85–90 score. The key shift is OS-level computer control, not code completion.

Why it matters: OpenAI wired Codex into Slack, Google Workspace and Microsoft 365, letting the assistant act across apps on a Mac, shifting the focus from writing code to doing everyday office tasks.

Latent Space

[AINews] Agents for Everything Else: Codex for Knowledge Work, Claude for Creative Work

OpenAI expanded Codex to non-coding work, with CUA reported 42% faster. The update connects Microsoft, Google, and Salesforce, covering docs, slides, spreadsheets, research, and planning. The key signal is GUI-agent productization, not one benchmark score.

Why it matters: OpenAI pushed Codex beyond code into documents, slides and spreadsheets with Microsoft, Google and Salesforce integrations, while Anthropic added Blender and Adobe creative apps to Claude.

r/LocalLLaMA

32x AMD MI50 32GB runs Kimi K2.6 at 9.7 t/s TG and 264 t/s PP

Reddit user ai-infos ran Kimi K2.6 int4 on 32 AMD MI50 32GB GPUs, reaching 9.7 tok/s TG on 136 output tokens. PP hit 263 tok/s on 14,564 input tokens using vllm-gfx906-mobydick across two 16-GPU nodes over 10G Ethernet. Power was about 640W idle and 4,800W peak inference; PCIe bandwidth and the vLLM distributed stack are the real bottlenecks.

Why it matters: A concrete cost-per-token datapoint for anyone weighing used AMD MI50s against new accelerators for self-hosted inference.

Hacker News front page

Show HN: Pu.sh – a full coding-agent harness in 400 lines of shell

Pu.sh ships a coding-agent harness in about 400 lines of shell, using only sh, curl, and awk. It supports Anthropic and OpenAI, 7 tools, REPL, auto-compaction, checkpoint/resume, pipe mode, and 90 no-API tests. It excludes TUI, streaming, images, OAuth, and Windows.

Why it matters: Pu.sh builds a full coding-agent harness in about 400 lines of shell, covering tool calls, context compaction and resumable runs, a minimal readable reference for anyone who wants the core agent loop without heavy dependencies.

Bloomberg Technology

AI Payoff in Focus During Tech Earnings Bonanza | Bloomberg Tech 4/30/2026

Bloomberg Tech covered AI payoff in tech earnings, saying Alphabet and Amazon show clearer returns while Meta lags. Anthropic is weighing funding at a valuation above $900B; Stripe’s John Collison discussed AI tools and a Google partnership. The post does not disclose AI spending amounts.

Why it matters: Bloomberg Tech compared AI returns at Alphabet, Amazon and Meta, finding the first two clearer and Meta behind, while Anthropic's new round could value it above $900 billion.

TechCrunch · AI

After Dissing Anthropic for Limiting Mythos, OpenAI Restricts Access to Cyber, Too

OpenAI will first roll out GPT-5.5 Cyber only to “critical cyber defenders.” The RSS snippet does not disclose eligibility rules, pricing, or launch timing. The access-tiering model is the key detail for practitioners.

Why it matters: OpenAI gave GPT-5.5 Cyber first to critical cyber defenders while ordinary users wait, after Sam Altman criticized Anthropic for limiting Mythos.

TechCrunch · AI

Stripe introduces Link, a digital wallet autonomous AI agents can use

Stripe introduced Link, a digital wallet for cards, banks, subscriptions, and AI-agent spending. The post cites approval flows, but does not disclose fees, limits, or merchant coverage. Watch the authorization boundary for agent payments.

Why it matters: Stripe's Link lets users authorize AI agents to pay under an approval flow, which is the part worth studying.

The Verge · AI

Meta is running get-rich-quick ads for its AI tools

The Verge says Meta-owned Manus ran quick-money ads for AI tools after a $2B acquisition. The pitch targets local firms with no or bad websites. Manus also paid creators for Instagram, YouTube, and TikTok promotion; some TikTok accounts were removed after inquiry.

Why it matters: An investigation shows how Meta's own ad platform carries get-rich-quick pitches for the AI site builder it acquired.

Apr 30Thursday

Ben's Bites

Building Gets Easier

Ben’s Bites lists agent tooling updates from Cloudflare, Stripe, Cursor SDK and others, with over 10 product leads. Cloudflare lets agents create accounts, buy domains, get API tokens and deploy; Stripe adds Agentic Commerce Suite, Link CLI and agent-ready Treasury accounts. The key shift is external permissions becoming agent-readable interfaces.

Why it matters: Cloudflare turned account setup, domain purchase, tokens and deploys into interfaces AI agents can call directly, while Stripe gives agents payment ability, shifting permission boundaries from people to agents.

claude.dev Blog

Building Claude Code: designing agents around prompt caching

The Claude Code team shared engineering lessons on prompt caching, keeping the request prefix stable to cut latency and cost in long agent sessions. Put static content first, update state through messages, avoid switching models or adding and removing tools mid-session, and use defer_loading to load tools late. When compacting context, reuse the original session's system prompt, tool definitions and history, then append the compaction request so it hits the cache. The team also tracks cache hit rate and treats an abnormal drop as an incident.

Why it matters: The Claude Code team applies cache prefix stability to prompt ordering, tool loading and context compaction, a transferable caching method for long agent sessions.

r/LocalLLaMA

Notes on what actually breaks when you run a coding agent on small local models

A Reddit user tested small local and free-tier cloud models for weeks on multi-file coding tasks. Sub-7B structured output was unreliable; failures included markdown fences, wrong-file edits, and read/write misclassification, with post-processing and validation as fixes.

Why it matters: After weeks of testing sub-7B local models on multi-file coding tasks, the author logs the three places structured output breaks most and the fixes, from post-processing to JSON schema validation.