Skip to content

MCP & tool use

How models connect to the outside world: the MCP ecosystem, function calling and tool integrations.

824 picksRelated topicsAgentsAI codingOpen source

Latest picks

161–180 of 824

Jun 1Monday

QbitAI · WeChat

How Cloud Models Reach the Physical World: CMG Lion Rock AI Lab Uses LiOS for Embodied AI

CMG Lion Rock AI Lab released the LiOS edge-cloud architecture for embodied robotics, reporting about 30 ms one-way latency from local camera to cloud GPU memory in cross-machine tests, and open-sourced the low-latency video transmission module plus the LeFold laundry-folding dataset.

Why it matters: China Merchants Group's Lion Rock Lab open-sourced the LiOS edge-cloud stack, measuring about 30 ms one-way latency from a local camera to cloud GPU memory, plus a low-latency video module and the LeFold clothes-folding dataset.

r/LocalLLaMA

Deepseek V4 Flash performance on DGX Spark

A Reddit user ran DeepSeek-V4-Flash with vLLM on two ASUS GX10 DGX Spark nodes and reported 1,680 prefill tokens/s plus 39.8 decode tokens/s at a 256K context with MTP=2; the setup uses TP=2 over RoCE, fp8 KV cache, and fits about 1M tokens safely in KV cache.

Why it matters: A Reddit user clustered two ASUS GX10 units and benchmarked DeepSeek-V4-Flash prefill and decode at 256K context, publishing the full tensor-parallel and RoCE network setup.

AI HOT (Curated Pool)

NVIDIA Releases FOX Factory Operations Blueprint for Autonomous Factory Management Agents

NVIDIA released the FOX factory operations blueprint at GTC Taipei, and Foxconn used it to build the MoMClaw multi-agent system with an expected 80% reduction in root-cause analysis time.

Why it matters: Nvidia used GTC Taipei to show FOX, a factory-operations blueprint where multiple AI agents run production lines, and Foxconn already built MoMClaw on it.

AI HOT (Curated Pool)

NVIDIA Releases RTX Spark and Local AI Agent Security and Performance Updates

NVIDIA released RTX Spark, a Windows PC for local AI agents with 1 petaflops of AI compute and 128GB of unified memory. OpenShell uses new Windows security primitives with Microsoft, while llama.cpp optimizations raise Qwen 27B throughput by up to 2x.

Why it matters: At Computex Nvidia showed RTX Spark, which runs large models locally with 1 petaflops and 128GB unified memory, plus an OpenShell runtime built with Microsoft to keep agents on-device.

AI HOT (Curated Pool)

Qwen3.7-Plus: Multimodal Agent Intelligence

Qwen Studio lists seven capability areas: chatbots, image and video understanding, image generation, document processing, web search integration, tool use, and artifact generation; the post does not disclose Qwen3.7-Plus parameters, pricing, or release timing.

Why it matters: Qwen folds vision and language into one model that reads screens, drives apps and writes frontend code from screenshots, scoring 70.3 on Terminal Bench 2.0.

r/LocalLLaMA

I ported NVIDIA Parakeet speech-to-text to ggml: same output as NeMo, faster, GGUF-quantized, no Python

mudler_it ported NVIDIA Parakeet speech-to-text models to C++/ggml with no Python or PyTorch, reporting byte-for-byte NeMo parity on f32/f16, up to about 5x GPU speedups on larger TDT and hybrid models, and GGUF quantization across f16, q8_0, q6_k, q5_k, and q4_k.

Why it matters: A developer ported NVIDIA's Parakeet speech-to-text model to C++ and ggml, dropping Python and PyTorch, matching NeMo byte-for-byte at f32 and f16 and running about 5x faster on GPU.

May 31Sunday

AI HOT (Curated Pool)

Apple WWDC AI Upgrade: Gemini-Distilled Model Runs Locally, With Heavy External Dependencies

Apple will present Siri and on-device AI upgrades at next month’s WWDC, with iPhones running a smaller Gemini-distilled model locally while complex queries route to Google Cloud using Nvidia confidential computing.

Why it matters: Apple will show at WWDC that it distills Gemini into a small model running locally on iPhone, while complex requests still route to Google Cloud, leaving the stack clearly dependent on outside providers.

r/LocalLLaMA

Use any model and provider with the official OpenAI Codex Desktop App without modifying its code

Reddit user thibautrey describes a 3-step setup: edit Codex Desktop config.toml, store an API key, and use a multicodex proxy alias to map gpt-5.3-codex to MiniMax-Latest. The post lists a local base_url of 127.0.0.1:1455 and says the proxy disguises returned model names as gpt-5.3-codex.

Why it matters: A three-step config recipe from Reddit user thibautrey: edit config.toml and map model names through a multicodex proxy, so Codex Desktop reaches MiniMax-Latest without code changes.

Synced · WeChat

Microsoft open-sources SkillOpt for training Agent skill documents, reaching 3.3k stars in a week

Microsoft open-sourced SkillOpt, a text-space optimization framework that trains Agent skill documents without changing model weights; the paper reports best or tied-best results across 52 combinations covering 7 target models, 6 benchmarks, and 3 execution environments.

Why it matters: Microsoft's open-source SkillOpt leaves model weights alone and instead iterates the skill documents written for agents, with experiments spanning 52 combinations across 7 target models, 6 benchmarks and 3 environments.

QbitAI · WeChat

Fudan and Tongyi introduce ToolCUA for GUI-Tool path selection in agents

Fudan University and Tongyi Lab introduced ToolCUA-8B, which reaches 46.85% accuracy on OSWorld-MCP after training with about 4k synthetic tools and 180k interleaved GUI-Tool trajectory steps.

Why it matters: Fudan and the Qwen team train an agent to pick the right on-screen tool with 4,000 synthetic tools and 180,000 cross-trajectory steps, hitting 46.85% on OSWorld-MCP with an 8B model.

AI HOT (Curated Pool)

Run Python ASGI Apps in the Browser with Pyodide and Service Workers

Simon Willison demonstrated running Python ASGI apps in the browser with Pyodide and Service Workers, with Claude Opus 4.8 assisting development, and showed two working demos: a basic ASGI FastCGI demo and Datasette 1.0a31.

Why it matters: Simon Willison runs a Python ASGI app entirely in the browser with Pyodide and a Service Worker, no backend server, giving serverless deployment a portable path.

May 30Saturday

TechCrunch · AI

I put Google’s 24/7 AI assistant Gemini Spark to work, and it’s actually pretty useful

TechCrunch tested Google’s Gemini Spark as a 24/7 AI assistant for inbox summaries and local event planning; the RSS snippet does not disclose pricing, release timing, or why Google made it a separate product.

Why it matters: A TechCrunch editor tested Google's Gemini Spark as an around-the-clock assistant for email summaries and local event planning, and how well such always-on assistants finish real tasks is the main point.

AI HOT (Curated Pool)

Nano Banana Pro and Nano Banana 2 officially released

Google AI Developers released Nano Banana Pro and Nano Banana 2, mapped to gemini-3-pro-image and gemini-3.1-flash-image. The post says both are production-ready through the Gemini API, but does not disclose pricing, benchmarks, or runtime limits.

Why it matters: Google put its gemini-3-pro-image and gemini-3.1-flash-image models on the Gemini API under the names Nano Banana Pro and Nano Banana 2, so developers can call them directly.

Xinzhiyuan · WeChat

Claude AI fluency scorecard surfaces, with strong users scoring 7.5

Anthropic is testing a Claude AI Fluency scorecard that analyzes Chat, Cowork, and Claude Code history against 11 observable behaviors, with an 11-point maximum score. The underlying study used 9,830 anonymized multi-turn conversations, and iteration appeared in 85.7% of high-quality conversations.

Why it matters: Anthropic scored users on 11 behavioral metrics drawn from 9,830 anonymous multi-turn conversations, and 85.7% of high-quality chats involved repeated revision and follow-up questions.

QbitAI · WeChat

RUC and Zhizhi Institute Open-Source Claw Agent Data, Training, and Evaluation Pipeline

Renmin University of China and Zhizhi Institute open-sourced ClawGym, a Claw Agent framework with 13.5K synthetic executable tasks, 200 benchmark tasks, model checkpoints, training data, and training code; ClawGym-30B-A3B scores 56.82 on ClawGym-Bench and exceeds Qwen3-235B-A23B in the reported evaluation.

Why it matters: Renmin University and Zhizhi Research open-sourced ClawGym, releasing 13,500 executable tasks, training code, model weights and a 200-task benchmark as a reproducible starting point for agent training.

AI HOT (Curated Pool)

Codex Can Manage Conversation Threads and Parallel Tasks

Codex can now create, search, organize, and pin conversation threads inside the Codex interface, and start worktrees for parallel tasks.

Why it matters: OpenAI's Codex interface adds thread management and parallel task worktrees, letting it create, search, organize and pin chat threads, an interface-layer expansion for anyone watching coding agent tools.

AI HOT (Curated Pool)

Codex now supports computer use on Windows

OpenAI added Windows computer-use support for Codex, letting users start, review, and guide tasks on a Windows PC through the ChatGPT mobile app; the post states this is an early experience and does not disclose pricing or rollout scope.

Why it matters: OpenAI added Windows computer-use to Codex, so tasks on a PC can be started and directed from the ChatGPT phone app, now in early access.

AI HOT (Curated Pool)

OpenRouter supports model-generated file patches

OpenRouter now supports apply_patch, a server-side tool that lets any model propose file edits through the Responses API using V4A diffs, covering file creation, updates, and deletion, with OpenRouter validating diff syntax on the server.

Why it matters: OpenRouter adds an apply_patch tool to its Responses API, letting models emit V4A diffs that the server syntax-checks before touching files.

May 29Friday

The Verge · AI

Adobe’s Conversational AI Agent Is a Mediocre Design Intern

The Verge tested Adobe Firefly AI Assistant in beta. It can operate Adobe design apps as a conversational middleman, rather than only generating images or video. The post says it explains edit steps clearly, but the results were not impressive. The RSS snippet does not disclose pricing, release timing, or the full list of supported apps.

Why it matters: A Verge editor tries Adobe's Firefly AI assistant beta, which drives design software through conversation instead of generating images, and finds the output mediocre.

AI HOT (Curated Pool)

Xiaomi Open-Sources Controllable Video Foley Model ControlFoley

Xiaomi’s large model application team open-sourced ControlFoley, a controllable video Foley model supporting three tasks: text-guided video dubbing, text-controlled video dubbing, and reference-audio-controlled video dubbing, with code, model weights, and an online demo released.

Why it matters: Xiaomi open-sources ControlFoley, letting video sound effects be specified by text or reference audio instead of guessed by the model, while staying aligned to on-screen motion.