Skip to content

#开源/仓库

2 today

May 21Thursday

AI HOT (Curated Pool)

Tencent open-sources Hy-MT2 multilingual translation model

Tencent open-sourced the Hy-MT2 multilingual translation model with support for translation across 33 languages; its 1.8B version uses AngelSlim 1.25-bit quantization, occupies 440 MB of storage, and runs locally on mainstream mobile chipsets.

Why it matters: Tencent open-sourced Hy-MT2; the 1.8B build quantized to 1.25-bit is just 440MB and runs 33-language translation locally on mainstream phone chips.

May 20Wednesday

r/LocalLLaMA

Running DeepSeek-V4 locally on 4 legacy RTX 2080 Ti GPUs with W8A8 at 255 prefill tok/s

A Reddit user ran DeepSeek-V4-Flash locally on 4 RTX 2080 Ti GPUs, reporting 284B total parameters, 13B active parameters, a sub-$2,500 build, custom Turing CUDA kernels, W8A8 quantization, 1TB DDR4 ECC RAM, and about 255 prefill tokens/s.

Why it matters: A Reddit user ran the 284B-parameter DeepSeek-V4-Flash locally on four used RTX 2080 Ti cards for under $2,500, using W8A8 quantization and custom Turing CUDA kernels.

r/LocalLLaMA

Public repository Codegraph claims 94% fewer Claude, Cursor, Codex, and OpenCode tool calls locally

Codegraph uses a pre-indexed knowledge graph for symbol relationships, call graphs, and code structure. In the VS Code test, it reduced tool calls from 52 to 3 and runtime from 1m37s to 17s.

Why it matters: Codegraph indexes symbols and call chains into a code knowledge graph, cutting a VS Code test from 52 tool calls to 3 and 1m37s to 17s.

r/LocalLLaMA

Floor for local meeting summarization on a 6GB GPU: Qwen3.5 0.8B works in 57s, Granite 4 350M hallucinates

The author tested VoiceFlow 1.6.0 on an RTX 3060 Laptop 6GB, where Qwen3.5 0.8B summarized a 4-minute meeting in 57 seconds with 16K context, while Granite 4 350M returned summaries in 0.6-2.8 seconds but fabricated Binance and Star Trek content.

Why it matters: A user tested two small models on a 6GB RTX 3060 laptop: Qwen3.5 0.8B summarized a 4-minute meeting in 57 seconds, while the faster Granite 4 350M made things up.

AI HOT (Curated Pool)

NVIDIA open-sources first 4-bit infrastructure for ultra-long video generation

NVIDIA researchers open-sourced LongLive 2.0, an end-to-end long-video generation infrastructure covering training and inference with 4-bit quantization, FP4 quantization, parallel acceleration, KV-cache optimization, and 45.7 FPS generation on a 5B model.

Why it matters: NVIDIA open-sourced all training and inference code for LongLive 2.0, hitting 45.7 fps at 4-bit quantization on a 5B-parameter model, a reusable path to cheaper long-video generation.

May 19Tuesday

Hacker News front page

Show HN: Forge takes an 8B model from 53% to 99% on agentic tasks

Forge adds five guardrail layers to self-hosted LLM tool calling, raising Ministral 8B to 99.3% across 18 multi-step agentic scenarios, with the accepted ACM CAIS ’26 paper covering 97 model/backend configurations and 50 runs per scenario.

Why it matters: Forge used five layers of guardrails to lift Ministral 8B from 53% to 99.3% task success across 18 multi-step agent scenarios, covering 97 model and backend combinations.

r/LocalLLaMA

ByteDance released an open-source model that attempts broad multimodal tasks with 3B parameters

ByteDance released Lance, an open-source unified multimodal model with 3B active parameters that supports image and video understanding, generation, and editing, and the post says it was trained from scratch with a staged multi-task recipe under a 128-A100-GPU budget.

Why it matters: ByteDance open-sourced Lance, which puts image and video understanding, generation and editing in one model with 3B active parameters, plus the staged multi-task training recipe and 128-A100 setup.

AI HOT (Curated Pool)

Horizon Open-Sources 400M-Parameter Robot Control Model HoloMotion-1

Horizon Robotics Lab open-sourced HoloMotion-1, a 400M-parameter full-body humanoid control model that uses MoE sparse activation and KV-cache inference to reach about 300 FPS on-device, with code and a technical report released.

Why it matters: Horizon Robotics' lab open-sourced HoloMotion-1, a 400M-parameter whole-body control model for humanoid robots, reaching about 300FPS on-device via MoE sparse activation and KV-cache, well above the usual 50Hz control rate.

May 18Monday

Hacker News front page

Show HN: InsForge – Open-source Heroku for coding agents

InsForge released an Apache 2.0 backend platform that lets coding agents deploy, operate, and debug backend systems through one CLI install command and Skills.

Why it matters: InsForge bundles database, auth, storage and an AI gateway into an open-source backend that coding agents install with one command, then deploy, operate and debug on their own.

QbitAI · WeChat

openJiuwen open-sources JiuwenSwarm, a multi-agent swarm coordination framework

openJiuwen released and open-sourced JiuwenSwarm with four components: Agent Swarm, Swarm Skills, Skills Hub, and self-evolution, and the framework supports HOTS and HITS modes for human participation in multi-agent workflows.

Why it matters: The openJiuwen community open-sourced JiuwenSwarm for coordinating multiple AI agents, split into agent clusters, cluster skills, a skill library and self-evolution.

r/LocalLLaMA

I built a coding agent that gets 87% on benchmarks with a 4B parameter model

SmallCode passes 87 of 100 benchmark tasks with Gemma 4 activating 4B parameters per token. The author attributes the result to compound tools, compile and lint feedback, task decomposition after two repeated failures, and optional escalation to Claude or OpenAI for one task.

Why it matters: The author built a coding agent on a 4B parameter model that solved 87 of 100 tasks by having it compile, run lint and fix errors, splitting a task into smaller subtasks after two failures.

AI HOT (Curated Pool)

Open-source tool exposes security risks and detection gaps in AI API relays

api-relay-audit audits AI API relay risks with verifiable three-state decisions and transparent logs, covering AC-1 tool-call rewriting, AC-2 error-response leakage, and context truncation, while the author has published the methodology, comparison results, quick-reference table, and the open-source tool.

Why it matters: The open-source api-relay-audit tool splits relay-station behavior into three reproducible checks: rewriting tool calls, leaking model identity through errors, and truncating context, with methods and comparisons published.

May 17Sunday

Hacker News front page

Show HN: Semble – Code search for agents that uses 98% fewer tokens than grep

MinishLab open-sourced Semble, a code-search tool for agents that combines Model2Vec embeddings, BM25, RRF fusion, and reranking; on a 63-repo benchmark, it used 98% fewer tokens than grep+read, reached 0.854 NDCG@10, and ran CPU queries in about 1.5 ms.

Why it matters: MinishLab's open-source Semble chains lightweight semantic embeddings, BM25 and reranking into one retrieval pipeline, scoring NDCG@10 0.854 across 63 code repos at about 1.5ms CPU per query.

AI HOT (Curated Pool)

Latest Open Artifacts #21: Gemma 4, DeepSeek V4, Kimi K2.6, MiMo 2.5, GLM-5.1, and More

Open AI model teams released Gemma 4, DeepSeek V4, Kimi K2.6, MiMo 2.5, GLM-5.1, and other versions this month, and the post says they were tested under CAISI’s V4 evaluation framework, but the RSS snippet does not disclose scores.

Why it matters: Five open models, including DeepSeek V4, Gemma 4 and Kimi K2.6, all shipped new versions in the same month, giving anyone tracking open-model release cadence and version choice a single list.

AI HOT (Curated Pool)

Ring-2.6-1T Open-Sourced and Listed on OpenRouter for Agent Workflows

AntLingAGI open-sourced Ring-2.6-1T and listed it on OpenRouter with a 75% discount through the end of May; the trillion-scale reasoning model targets agent workflows, including planning, tool use, context maintenance, and complex task execution, using Async RL and IcePop training methods.

Why it matters: AntLingAGI open-sourced its trillion-parameter Ring-2.6-1T model and put it on OpenRouter for agent workflows that plan steps, call tools and hold long context, at 25% off on the platform through the end of May.

May 16Saturday

Hacker News front page

SANA-WM, a 2.6B open-source world model for 1-minute 720p video

SANA-WM’s title says the project is a 2.6B open-source world model for 1-minute 720p video; the RSS body only lists the project URL, Hacker News comments URL, 9 points, and 8 comments, and the post does not disclose training data, license terms, inference cost, evaluation setup, or benchmark results.

Why it matters: NVIDIA open-sources SANA-WM, a 2.6B world model that turns one image plus a camera trajectory into a minute of 720p video, with a two-stage pipeline for long-video quality and motion consistency.

AI HOT (Curated Pool)

Ignoring Token Costs, Using 100 AI Instances to Automate an Open Source Project

The OpenClaw team runs about 100 Codex instances to handle code review, security analysis, issue deduplication, test reproduction, task creation from meetings, spam filtering, and performance regression monitoring.

Why it matters: The OpenClaw team runs about 100 Codex instances at once, handing code review, security scans, issue triage, test reproduction and performance regression monitoring to AI in bulk.

May 15Friday

AI HOT (Curated Pool)

X open-sources the “For You” feed recommendation algorithm

X open-sourced the For You recommendation pipeline on GitHub, using a Grok-based Phoenix Transformer to score candidate posts and predict engagement probabilities such as likes, replies, and reposts.

Why it matters: X published the recommendation pipeline behind its For You feed on GitHub, including code, pretrained models and content-understanding services, with a Grok-based Phoenix model scoring candidate posts.

AI HOT (Curated Pool)

Feishu Open-Source CLI Tool Gets 10,000 Stars in 45 Days with Visible AI Operations

Feishu’s open-source lark-cli gained over 10,000 GitHub stars in 45 days, letting AI create groups and documents through the command line with each operation previewable and reviewable.

Why it matters: Feishu open-sourced the lark-cli command-line tool, which passed 10,000 GitHub stars in 45 days and shows each AI action before confirming it, unlike cloud MCP tools that run as a black box.

QbitAI · WeChat

Understand LeCun’s JEPA World Model in 160 Lines of Code

A developer released the keon/jepa teaching repository with five JEPA variants implemented as standalone PyTorch files, ranging from 160 to 278 lines, depending only on PyTorch and torchvision; the post reports iJEPA runs on CIFAR-10 for 100 epochs and reaches 52.7% linear-probe accuracy, while V-JEPA, C-JEPA, and LeWorldModel use toy or synthetic datasets.

Why it matters: The open teaching repo keon/jepa breaks LeCun's JEPA world model into five single-file PyTorch implementations, the shortest 160 lines, with iJEPA reaching 52.7% linear probe accuracy on CIFAR-10 after 100 epochs.

May 14Thursday

r/LocalLLaMA

Open-source one-prompt-to-cinematic-reel pipeline on one GPU with FLUX.2 and Wan2.2-I2V

The developer open-sourced StudioMI300, an 8-stage sequential pipeline that turns one English sentence into a 720p MP4 on a single AMD Instinct MI300X, cutting end-to-end time from 25.9 minutes to 10.4 minutes per clip.

Why it matters: StudioMI300 runs the whole 8-step path from one prompt to a 720p short film on a single MI300X, with a vision critic and auto-retry step holding output quality in check.

AI HOT (Curated Pool)

Tencent Open-Sources Agent Memory to Cut Token Usage by 61%

Tencent Cloud open-sourced TencentDB Agent Memory, using context offloading and a Mermaid task canvas to reduce token usage by up to 61% in multi-task continuous sessions while supporting OpenClaw integration and local SQLite storage.

Why it matters: Tencent Cloud open-sourced TencentDB Agent Memory, which draws task execution as a collapsible task map in Mermaid and pairs it with context offloading to cut token use by 61% on long tasks.

QbitAI · WeChat

Chinese GPU Vendor Hosts Open Source Meetup With SGLang Core Developers

Moore Threads said at the SGLang × MUSA Meetup that the MUSA backend has been merged into SGLang mainline, with 47 PRs submitted and 41 merged as of May 12.

Why it matters: Moore Threads merged its MUSA backend for SGLang into the main branch, with 47 pull requests filed and 41 merged, a usable playbook for domestic GPUs joining mainstream inference frameworks.

AI HOT (Curated Pool)

OpenSquilla Open-Source Project Uses Smart Routing and Local Retrieval to Cut LLM Costs

OpenSquilla combines local model routing, vector retrieval, incremental sending, and cache hits to reduce transmitted tokens by more than 90%, while routing simple tasks to cheaper models and complex tasks to stronger models without spending tokens on the routing decision.

Why it matters: OpenSquilla runs model routing decisions locally, judging question difficulty without spending tokens, and cuts actual transfer volume below a tenth through incremental sending and cache hits.

r/LocalLLaMA

sensenova/SenseNova-U1-A3B-MoT · Hugging Face

SenseNova published SenseNova-U1-A3B-MoT on Hugging Face; the post lists A3B MoT, 8B MoT, and 0.4B LoRA weight links, and says the NEO-unify architecture unifies multimodal understanding, reasoning, and generation in one model family.

Why it matters: SenseTime released the SenseNova-U1-A3B-MoT weights on Hugging Face, using the NEO-unify architecture to fold multimodal understanding, reasoning and generation into one model family, plus 0.4B LoRA weights.

May 13Wednesday

AI HOT (Curated Pool)

Open-source psql_bm25s speeds up PostgreSQL retrieval for multi-agent systems by 23x

The team open-sourced psql_bm25s, a native PostgreSQL access method for exact BM25 retrieval, and says it runs about 23x faster than pg_search on standard benchmarks.

Why it matters: A native Postgres access method that claims roughly 23x the speed of pg_search, letting teams keep search inside the primary database.

r/LocalLLaMA

The Trillion-Parameter Dilemma: MiMo-V2.5-Pro Open-Sourced at 1.02T Parameters

Xiaomi open-sourced MiMo-V2.5-Pro with 1.02T parameters, 42B active parameters, a 1M context window, and an MIT license; the author ran 125 Claude Code sessions through the API, spending $70.12 for 387,380,436 tokens with a 96.3% cache hit rate.

Why it matters: A concrete cost benchmark for self-hosting versus API calls, built from 125 Claude Code tasks and 387M tokens.

Xinzhiyuan · WeChat

Tsinghua-affiliated team open-sources MiniCPM-V 4.6, a 1.3B model tunable on one RTX 4090

ModelBest, Tsinghua University, and OpenBMB open-sourced MiniCPM-V 4.6, a 1.3B multimodal model that supports full fine-tuning on one RTX 4090 and offers 4x/16x visual token compression for accuracy or speed trade-offs.

Why it matters: ModelBest, Tsinghua and OpenBMB open-source MiniCPM-V 4.6 at 1.3B parameters, small enough to fully fine-tune on one RTX 4090, with 4x and 16x visual token compression modes.

r/LocalLLaMA

A real transformer language model running locally on a stock Game Boy Color

maddiedreese ran Andrej Karpathy’s TinyStories-260K on a stock Game Boy Color with INT8 weights, fixed-point math, an MBC5 ROM, bank-switched cartridge storage, and KV cache in cartridge SRAM; the demo uses no phone, PC, Wi‑Fi, link cable, or cloud inference, but output is extremely slow and gibberish.

Why it matters: HKR-H/K/R all pass: a named first-person experiment with concrete model and memory details. Impact stays low-featured because it is a Reddit hardware hack with slow, garbled output, not a usable product or model release.

Hacker News front page

Show HN: Needle Distills Gemini Tool Calling into a 26M Model

Cactus open-sourced Needle, a 26M-parameter tool-calling model that reaches 6,000 tok/s prefill and 1,200 tok/s decode on consumer devices, with MIT-licensed weights released on Hugging Face.

Why it matters: Cactus distilled Gemini's tool calling into a 26M-parameter model that runs locally on consumer devices at 6,000 tokens per second prefill and 1,200 per second generation.

r/LocalLLaMA

Needle: We Distilled Gemini Tool Calling Into a 26M Model

Cactus Compute open-sourced Needle, a 26M-parameter tool-calling model that reaches 6,000 tok/s prefill and 1,200 tok/s decode on consumer devices, using an attention-and-gating architecture with no MLPs.

Why it matters: Cactus Compute distilled Gemini's tool calling into a 26M-parameter model and reports 6,000 tokens per second prefill on consumer devices, a lightweight option for on-device tool use.

May 12Tuesday

AI HOT (Curated Pool)

How Open Model Ecosystems Compound

China’s open AI model community forms a self-reinforcing loop, with domestic open model downloads rising by more than 200% quarter over quarter.

Why it matters: The author argues trial-and-error compute can be 80% of frontier model costs, and Chinese labs share what failed in technical reports, so an open ecosystem compounds cheaper future R&D.

AI HOT (Curated Pool)

Exporting consumer data for personalized AI Agent services

The author surveyed export methods across 5 consumer platforms: Taobao supports exports, JD.com needs a Codex-built Chrome extension, Ele.me can provide Excel exports by request, Meituan Waimai has no method, and JD.com plus Dianping tools are open sourced.

Why it matters: A developer tests how to export spending data from Taobao, JD, Ele.me, Meituan Waimai and Dianping, and writes an open-source Chrome extension with Codex to pull JD orders.

Synced · WeChat

ByteDance Open-Sources DreamLite for Offline Mobile Image Generation and Editing

ByteDance open-sourced DreamLite, a 0.39B-parameter unified diffusion model that generates or edits a 1024×1024 image on an iPhone 17 Pro in about 3 seconds, using 4-step DMD2 distillation and on-device offline inference without cloud dependency.

Why it matters: ByteDance open-sourced DreamLite, a 390M-parameter unified diffusion model that generates or edits a 1024×1024 image locally on an iPhone 17 Pro in about 3 seconds, using DMD2 distillation to cut inference to 4 steps.

r/LocalLLaMA

I catalogued every way local models break JSON output and built a repair library across 288 model calls

Reddit user kexxty ran 288 structured-output calls through OpenRouter models, including Llama 3, Mistral, Command R, DeepSeek, and Qwen, and found similar JSON failure categories across local and API-only models. The MIT-licensed Python library outputguard validates against JSON Schema, applies 15 ordered repair strategies, includes 2,001 tests, and has no LLM provider dependency.

Why it matters: Reddit user kexxty ran 288 structured output tests across Llama 3, Mistral, DeepSeek and others, categorized how local models break JSON, and open-sourced a repair library, outputguard.

May 11Monday

AI HOT (Curated Pool)

Anthropic open-sources full-stack financial AI templates

Anthropic open-sourced a financial services AI template library on GitHub, including 10 end-to-end agents, 7 vertical industry plugins, and MCP connectors for 11 financial data providers, with deployment paths from personal plugins to enterprise APIs and integrations for Microsoft 365 and private cloud.

Why it matters: Anthropic open-sourced a full-stack finance AI template on GitHub with 10 agents, 7 plugins and connectors to 11 data vendors, giving finance AI projects a reusable engineering starting point.

May 10Sunday

r/LocalLLaMA

We tried vectors, ASTs, and brute-force context stuffing for code retrieval; LLM semantic graphs worked best

ByteBell open-sourced a code indexing system that stores per-file LLM-generated purpose, summary, business context, entities, classes, functions, keywords, and imports in a Neo4j graph, then uses full-text search instead of vector similarity, with SHA-256 diffing to reindex only changed files and keep LLM calls proportional to churn.

Why it matters: ByteBell open-sourced its code index after testing vectors, ASTs and raw context stuffing, and landed on LLM-written semantics in a Neo4j graph queried by full-text search.

r/LocalLLaMA

I have DeepSeek V4 Pro at home

Reddit user fairydreaming ran DeepSeek V4 Pro Q4_K_M with a modified llama.cpp CUDA repo on one RTX PRO 6000 Blackwell Max-Q workstation GPU, using an 859GB model file; the shared log reports a 1M context window and 8.6 tokens per second generation speed.

Why it matters: A Reddit user ran the 859GB DeepSeek V4 Pro on a single RTX PRO 6000 workstation card with a modified llama.cpp, a concrete reference for local inference hardware limits.

r/LocalLLaMA

BeeLlama.cpp: DFlash and TurboQuant with reasoning and vision support

Anbeeld released BeeLlama.cpp, a llama.cpp fork that runs Qwen 3.6 27B Q5 with 200k context and vision on a single RTX 3090 or 4090; the title claims 2–3x faster than baseline and a 135 tps peak.

Why it matters: Anbeeld's llama.cpp fork BeeLlama.cpp adds DFlash memory-saving attention and TurboQuant quantization, letting Qwen 3.6 27B run 200k context on a single 3090 at 2 to 3 times baseline speed.

May 9Saturday

AI HOT (Curated Pool)

YC CEO Open-Sources Personal AI OS GBrain for a Compounding Second Brain

Y Combinator CEO Garry Tan open-sourced GBrain, a personal AI operating system that processed more than 20 books in five months and manages over 100,000 pages of structured knowledge.

Why it matters: Garry Tan open-sourced his own GBrain, which processed over 20 books in five months and built more than 100,000 pages of structured knowledge, giving a reference for splitting modules when managing personal data with models.