Skip to content

#开源/仓库

2 today

Jun 9Tuesday

r/LocalLLaMA

2X tk/s on 1× MI50: Qwen3.6-27B inference rises from 19.4 to 38.1 tk/s

bigattichouse raised Qwen3.6-27B throughput on a single MI50 from 19.4 to 38.1 tk/s by running same-model parallel computations for Q8-or-lower quantization, exploiting unused compute lanes instead of adding a smaller speculative decoding model.

Why it matters: A user ran two concurrent Qwen3.6-27B computations on a single MI50, lifting generation from 19.4 to 38.1 tokens/s by exploiting compute small quants leave idle instead of loading a side model.

r/LocalLLaMA

Levi: Run AlphaEvolve on Your Local Qwen 30B

LEVI runs an AlphaEvolve-like search system with Qwen3-30B-A3B and reports tests on ADRS, IFBench, and HotpotQA, claiming up to 35x lower cost overall and up to 12x fewer evals under the same single-model, same-budget comparison.

Why it matters: The open-source Levi project runs AlphaEvolve-style search on a local Qwen3-30B-A3B, and its author measured up to 35x lower cost and 12x fewer evaluations at equal budget on three benchmarks.

Jun 8Monday

r/LocalLLaMA

Luce Spark: a 35B MoE on a 16 GB GPU, without the offload tax

Luce Spark runs Qwen3.6 35B-A3B at 13.3 GiB peak VRAM on an RTX 3090 by keeping hot experts on GPU, swapping cold experts through a bounded async cache, and using one fused graph for decode at about 100 tok/s.

Why it matters: A concrete recipe for running a 35B MoE on a 16 GB card, with the memory numbers and throughput to judge it by.

r/LocalLLaMA

OpenEnv Is Now Owned by HF, Torch, Prime Intellect, Unsloth, Modal, Mercor, and More

OpenEnv moved to committee coordination with 9 initial members, including Meta-PyTorch, Unsloth, Modal, Prime Intellect, Nvidia, and Mercor, while the post describes it as a tool for creating agent execution environments such as terminals and browsers.

Why it matters: OpenEnv moves from single-team control to a committee of nine organizations including PyTorch, Unsloth and Modal, so anyone training agents can see who governs the execution environment.

AI HOT (Curated Pool)

Open-source community backs OpenEnv for agentic reinforcement learning

Hugging Face announced broader OpenEnv access, coordinated by a committee from Meta-PyTorch, Reflection, and Unsloth; the project provides Gymnasium-style APIs and first-class MCP support for terminal and browser agent environments.

Why it matters: Hugging Face handed coordination of the OpenEnv agent training environment to a community committee whose first members include Meta-PyTorch, Unsloth and Nvidia, moving governance from one company to many.

Jun 7Sunday

QbitAI · WeChat

Chinese open-source framework targets stable 5-minute AI long-video generation

JD open-sourced JoyAI-Echo, a long audio-video generation framework for 5-minute consistent videos, using cross-modal memory, DMD post-training for about 7.5x faster inference, and real-time upscaling from 720P to 1K or 2K output.

Why it matters: JD's open-source JoyAI-Echo uses a cross-modal memory module to keep characters and scenes consistent across 5-minute videos, with roughly 7.5x faster inference.

Jun 6Saturday

r/LocalLLaMA

Big week for open AI, with 25+ notable open-weight drops across every modality

Victor M summarized 25+ open-weight model releases in one week, including NVIDIA Nemotron 3 Ultra, a 550B hybrid Mamba-MoE with 55B active parameters and a 1M-token context window.

Why it matters: More than 25 open-weight models shipped in a week across text, image and speech, with NVIDIA's Nemotron 3 Ultra at 550B parameters and a 1M token context.

Synced · WeChat

Video AI Moves to 5 Minutes: Fully Open Source, One-Pass Generation, No Blind-Box Sampling

JD open-sourced JoyAI-Echo, a long audio-video generation framework that supports up to 5 minutes of cross-shot audiovisual consistency, local repainting, 8-step DMD distillation, and output up to 1472×2560 resolution.

Why it matters: JD open-sourced JoyAI-Echo, which generates video with audio up to five minutes long and keeps visuals and sound consistent across shots, giving long-video generation a reusable open path.

r/LocalLLaMA

dots.tts 2B SOTA TTS from RedNote

RedNote released dots.tts, a 2B-parameter open-source TTS model under Apache 2.0. It uses a fully continuous architecture, supports 48 kHz synthesis and zero-shot voice cloning, and maps text directly to speech without a phoneme pipeline.

Why it matters: RedNote open-sourced dots.tts, a 2B-parameter TTS model under Apache 2.0, with a fully continuous text-to-speech architecture, 48kHz output and zero-shot voice cloning.

Jun 5Friday

AI HOT (Curated Pool)

Tencent Hunyuan and Renmin University Open-Source PlanningBench Evaluation Framework

Tencent Hunyuan and Renmin University Gaoling School of Artificial Intelligence open-sourced PlanningBench, a scalable and verifiable LLM planning evaluation and training framework with 30+ real-world planning tasks, automatic verification, and training support.

Why it matters: Tencent Hunyuan and Renmin University's Gaoling School open-sourced PlanningBench, which tests whether models can break a task into executable steps across 30-plus real scenarios, with automatic verification built in.

Hacker News front page

Anthropic's open-source framework for AI-powered vulnerability discovery

Anthropic published an open-source framework for AI-powered vulnerability discovery, and the HN item shows 58 points and 19 comments; the post does not disclose the framework mechanism, benchmark results, or deployment scope.

Why it matters: Anthropic open-sourced defending-code-reference-harness on GitHub, chaining threat modeling, code scanning, vulnerability triage and patching into one customizable automated pipeline, an engineering path for AI in vulnerability discovery.

Jun 4Thursday

r/LocalLLaMA

KVarN: Huawei KV-cache Quantization Claims 3–5× Compression and Speed-up

Huawei open-sourced KVarN, a KV-cache quantization method that claims 3–5× more context than FP16, up to 1.4× FP16 throughput, and vLLM integration through one flag; the post says it requires no model changes, retraining, or calibration and is released under Apache 2.0.

Why it matters: Huawei's open-source KVarN cuts KV cache memory to a third or a fifth and runs up to 40% faster than FP16 without breaking reasoning, and vLLM takes it with one flag.

Xinzhiyuan · WeChat

Silicon Valley CEO backs MiniMax M3 as it tops open-source rankings amid Chinese community debate

MiniMax M3 ranks first among open-source models on Artificial Analysis, and the article says it supports a 1M-token context window, used 100T-scale pretraining, and will open-source its weights and full technical report within 10 days.

Why it matters: MiniMax M3 tops Artificial Analysis's open-source ranking with a 1M token context and hundreds of trillions of pretraining tokens, and the weights and tech report are promised within 10 days.

AI HOT (Curated Pool)

OpenJarvis: A Local-First Framework for On-Device Personal AI Agents

Stanford researchers released OpenJarvis, an open-source local-first framework that runs reasoning, agents, memory, and learning on device, decomposes personal AI into five primitives, stays within 3.2 points of top cloud models, and cuts marginal API cost by about 800x.

Why it matters: OpenJarvis runs reasoning, tool calls, memory, learning and self-coordination locally on a phone or PC, so data never has to leave the device.

r/LocalLLaMA

I built a compiler that rewrites Python into a model-facing representation

The author released Vulpine, a compiler that converts Python into a compact model-facing representation for coding LLMs. Tests on about 13,000 held-out files showed roughly 14% token reduction and 99.8% AST-equivalent round-trip success, with code published on GitHub.

Why it matters: An open-source compiler turns Python source into a compact form aimed at code models, saving 14% of tokens on about 13,000 held-out test files while restoring the AST losslessly in 99.8% of cases.

Jun 3Wednesday

AI HOT (Curated Pool)

Google DeepMind open-sources a toolkit for scientific agents

Google DeepMind released Science Skills on GitHub for scientific-discovery agent workflows; the post does not disclose the license, benchmark results, or numeric token-efficiency gains.

Why it matters: Google DeepMind open-sourced its Science Skills toolkit on GitHub for building autonomous agents in scientific discovery, packaging core scientific task abilities and, the team says, improving token efficiency.

Jun 2Tuesday

AI HOT (Curated Pool)

To Avoid Paying $120, I Turned a Computer Cleaner into an Open-Source Skill

The author open-sourced a cross-platform AI cleaning skill for Mac and Windows, generating interactive HTML reports from file scans; in a test, it freed nearly 120GB, compared with CleanMyMac identifying 15.8GB.

Why it matters: The author turned a personal disk-cleanup routine into an open-source skill that scans a machine, produces a green-yellow-red HTML report and adds safe execute buttons, working on both Mac and Windows.

Xinzhiyuan · WeChat

CAS Opens MobileGym, a Browser-Based Agent Training Environment for Mobile Apps

CASIA released MobileGym, a browser-based Android simulation environment covering 28 apps, with about 400MB per instance, 3-second cold start, JSON state snapshots, and programmatic task verification for mobile-agent training and evaluation.

Why it matters: A browser-based Android simulator with 28 apps and JSON snapshots gives agent builders a cheap test bed.

Jun 1Monday

AI HOT (Curated Pool)

MiniMax Releases Open-Source M3 with Coding, Long-Context, and Multimodal Capabilities

MiniMax released the open-source M3 model with coding, a 1M-token context window, and native multimodal support; M3 scores 59.0% on SWE-Bench Pro, 83.5% on BrowseComp, and costs about one-twelfth per token versus GPT-5.5.

Why it matters: MiniMax has open-sourced M3, putting code, million-token long context and native multimodality in one model, scoring 59.0% on SWE-Bench Pro against GPT-5.5's 58.6%.

AI HOT (Curated Pool)

OpenBMB Releases Two UltraData Open Datasets, Tops HuggingFace Trending

OpenBMB, Tsinghua NLP, and Modelbest released two UltraData open datasets: Ultra-FineWeb-L3 contains 600B+ tokens, including 400B+ English and 200B+ Chinese tokens, while UltraData-SFT-2605 contains 15M+ SFT samples with thinking and non-thinking labels.

Why it matters: OpenBMB with Tsinghua NLP and Modelbest released Ultra-FineWeb-L3 and a second dataset, including over 200B tokens of synthetic Chinese pretraining data ready for pretraining and instruction tuning.

AI HOT (Curated Pool)

NVIDIA Open-Sources Cosmos 3, Its First Generalist Model for Physical AI

NVIDIA open-sourced Cosmos 3 at GTC Taipei, releasing two variants, Super 32B and Nano 8B, with model weights, code, and datasets made available.

Why it matters: NVIDIA open-sourced all of Cosmos 3's weights, code and datasets in 32B and 8B versions, giving robotics work a ready physical-world understanding and action-generation model.

r/LocalLLaMA

I ported NVIDIA Parakeet speech-to-text to ggml: same output as NeMo, faster, GGUF-quantized, no Python

mudler_it ported NVIDIA Parakeet speech-to-text models to C++/ggml with no Python or PyTorch, reporting byte-for-byte NeMo parity on f32/f16, up to about 5x GPU speedups on larger TDT and hybrid models, and GGUF quantization across f16, q8_0, q6_k, q5_k, and q4_k.

Why it matters: A developer ported NVIDIA's Parakeet speech-to-text model to C++ and ggml, dropping Python and PyTorch, matching NeMo byte-for-byte at f32 and f16 and running about 5x faster on GPU.

May 31Sunday

Synced · WeChat

Microsoft open-sources SkillOpt for training Agent skill documents, reaching 3.3k stars in a week

Microsoft open-sourced SkillOpt, a text-space optimization framework that trains Agent skill documents without changing model weights; the paper reports best or tied-best results across 52 combinations covering 7 target models, 6 benchmarks, and 3 execution environments.

Why it matters: Microsoft's open-source SkillOpt leaves model weights alone and instead iterates the skill documents written for agents, with experiments spanning 52 combinations across 7 target models, 6 benchmarks and 3 environments.

May 30Saturday

QbitAI · WeChat

RUC and Zhizhi Institute Open-Source Claw Agent Data, Training, and Evaluation Pipeline

Renmin University of China and Zhizhi Institute open-sourced ClawGym, a Claw Agent framework with 13.5K synthetic executable tasks, 200 benchmark tasks, model checkpoints, training data, and training code; ClawGym-30B-A3B scores 56.82 on ClawGym-Bench and exceeds Qwen3-235B-A23B in the reported evaluation.

Why it matters: Renmin University and Zhizhi Research open-sourced ClawGym, releasing 13,500 executable tasks, training code, model weights and a 200-task benchmark as a reproducible starting point for agent training.

May 29Friday

AI HOT (Curated Pool)

Xiaomi Open-Sources Controllable Video Foley Model ControlFoley

Xiaomi’s large model application team open-sourced ControlFoley, a controllable video Foley model supporting three tasks: text-guided video dubbing, text-controlled video dubbing, and reference-audio-controlled video dubbing, with code, model weights, and an online demo released.

Why it matters: Xiaomi open-sources ControlFoley, letting video sound effects be specified by text or reference audio instead of guessed by the model, while staying aligned to on-screen motion.

May 28Thursday

Xinzhiyuan · WeChat

Tsinghua Team Open-Sources PilotDeck Agent System, Claims 70% Token Cost Reduction

Tsinghua THUNLP, ModelBest, OpenBMB, and AI9stars open-sourced PilotDeck; the article says its sub-agent routing reduced cost from $12.58 to $2.83 in a Xiaohongshu content-generation test, while preserving separate WorkSpaces, editable memory, and per-session routing logs.

Why it matters: Tsinghua NLP and other teams open-sourced PilotDeck, giving sub-agents separate workspaces and editable memory with scheduling logs, a reference implementation for multi-agent workflows.

Synced · WeChat

Chinese pretrained embodied model Wall-OSS-0.5 is open sourced

X Square Robot open sourced Wall-OSS-0.5, a VLA model whose 400k pretraining checkpoint scored above 80 on 4 of 17 real-robot zero-shot tasks, with weights, code, training recipe, ablations, and a DMuon optimizer implementation released.

Why it matters: X Square Robot open-sources Wall-OSS-0.5, a vision-language-action model with a 400k-step pretrained checkpoint, weights, code and training recipe; 4 of 17 real-robot zero-shot tasks top 80% success.

r/LocalLLaMA

I built a 103B-token Usenet corpus from 1980–2013

OwnerByDane released a 103.1B-token Usenet corpus covering 1980–2013, 408M posts, and 18,347 newsgroups, with free 5K-post-per-hierarchy samples and full-corpus licensing available.

Why it matters: The corpus holds 103.1 billion tokens across 408 million posts from 1980 to 2013, all real Usenet speech, giving researchers text free of AI-generated content.

AI HOT (Curated Pool)

Open-source FastVideo Dreamverse real-time video generation tool

Hao AI Lab open-sourced FastVideo Dreamverse, a real-time video generation tool that generates a 30-second 1080p video in 7 seconds under the stated setup of one NVIDIA B200 GPU and LTX-2.

Why it matters: Hao AI Lab open-sourced FastVideo Dreamverse, which pairs LTX-2 with a single NVIDIA B200 to generate 30 seconds of 1080p video in 7 seconds, code and blog included.

May 27Wednesday

AI HOT (Curated Pool)

Perplexity open-sources Unigram tokenizer to reduce CPU usage

Perplexity open-sourced a rebuilt Unigram tokenizer that reduces CPU usage by 5-6x, targeting tokenization latency when small rerankers and embedding models run on GPUs in single-digit milliseconds.

Why it matters: Perplexity open-sourced a rewritten Unigram tokenizer that cuts CPU tokenization cost 5 to 6 times in reranking and embedding pipelines, so tokenization stops slowing down responses.

AI HOT (Curated Pool)

AI Builds AI: ModelBest Open-Sources ForgeTrain, a Training Framework Written by AI

ModelBest, Tsinghua University, and OpenBMB open-sourced ForgeTrain, described as the first production-grade LLM training framework written entirely by AI with zero human code, and ModelBest used it to pretrain MiniCPM5-1B on Huawei Ascend chips.

Why it matters: ModelBest, Tsinghua and OpenBMB open-sourced ForgeTrain, a training framework written entirely by AI, and used it to pretrain MiniCPM5-1B on Huawei Ascend chips, a concrete path to automating training pipelines.

May 26Tuesday

AI HOT (Curated Pool)

SenseNova-U1 full training code open-sourced for multimodal multitask training

OpenSenseNova released the full SenseNova-U1 training code on GitHub under Apache-2.0, supporting an 8B dense model, an A3B MoE architecture, and multimodal tasks such as text-to-image generation, image editing, interleaved generation, and text-visual understanding.

Why it matters: SenseTime open-sourced SenseNova-U1's full training code on GitHub under Apache-2.0, covering 8B dense and A3B MoE variants, with one framework handling text-to-image, image editing, interleaved generation and understanding.

r/LocalLLaMA

[OSS] dlmserve: First Serving Engine for Diffusion Language Models

dlmserve released an MIT-licensed serving engine for diffusion language models, with LLaDA-8B-Instruct support and 2.5x HF throughput at batch=4. It exposes an OpenAI-compatible /v1/chat/completions API, batches at the denoising-step level, runs in 12GB VRAM, and adds about 1.8x throughput with optional LocalLeap acceleration.

Why it matters: A Reddit user open-sourced dlmserve, an OpenAI-compatible inference server for diffusion language models, reporting LLaDA-8B throughput at batch=4 that is 2.5x HuggingFace's.

AI HOT (Curated Pool)

ModelBest open-sources MiniCPM5-1B, topping sub-2B models on AA-Index

ModelBest open-sourced MiniCPM5-1B, a 1B-parameter edge language model that beats all sub-2B models on AA-Index, uses a 0.5GB weight file after INT4 quantization, and runs on phones and browsers.

Why it matters: ModelBest, Tsinghua and OpenBMB open-sourced the 1B MiniCPM5-1B, which tops the AA-Index among sub-2B models and runs on phones and browsers at 0.5GB after INT4 quantization.

r/LocalLLaMA

Shard - Getting to 10× KV Cache Compression

Shard reduces Llama-3.1-8B KV memory by about 10× at 8K context and 11× at 32K, with no measured drop on NIAH or LongBench, using PCA plus int4 quantization for K and Hadamard rotation plus vector quantization for V.

Why it matters: Shard compresses KV cache memory by about 90% on Llama-3.1-8B, roughly 10x at 8K context and 11x at 32K, using PCA plus int4 for keys and Hadamard rotation plus vector quantization for values.

May 25Monday

r/LocalLLaMA

Computer-use sandbox framework for Codex on headless Linux

superSmitty9999 released ai-sandbox-manager as a PoC that uses LXC templates to give Codex sudo access, browser use, Docker, and shared GPU access, with a hook that blocks git push while the agent works inside isolated copies.

Why it matters: A concrete recipe for giving Codex sudo, a browser and a shared GPU inside an LXC template while a hook blocks git push, so full-auto work stays contained.

Synced · WeChat

A 1B-Gaussian 3D World Runs in the Browser, Outperforming Fei-Fei Li’s Spark

Manycore Tech open-sourced Aholo Viewer, a browser-based 3D Gaussian Splatting viewer that used half the memory of Spark 2.0 in a 300M-Gaussian test, loaded 2x faster, rendered 3x faster, and supports scenes with up to 1B Gaussian points.

Why it matters: A browser-side 3D Gaussian splatting viewer with concrete memory, load and render numbers against Spark 2.0, plus a 1-billion-point claim.

May 23Saturday

r/LocalLLaMA

club-rdna16: Practical 16GB AMD/Radeon local LLM testing repo

club-rdna16 publishes a practical 16GB Radeon local LLM testing repo, with an RX 6900 XT running llama.cpp on ROCm/HIP and Qwen3.6 35B-A3B reaching a stable 131k context using q8 KV cache.

Why it matters: A public test repo shows Qwen3.6 35B-A3B holding 131k context with q8 KV cache on an RX 6900 XT, giving 16GB AMD card owners a measured config to copy.

r/LocalLLaMA

Experts first llama.cpp

comanderxv published a llama.cpp fork that caches MoE experts in 12GB VRAM; on an RTX 2060 with Qwen3.6-35B-A3B, throughput rose from 19/22 tk/s to 26 tk/s at about a 62% expert-cache hit rate.

Why it matters: comanderxv opened an experts first branch for llama.cpp that tunes MoE memory scheduling, lifting a 12GB RTX 2060 from 19/22 tk/s to 26 tk/s.

May 22Friday

AI HOT (Curated Pool)

NetEase Youdao Open-Sources Ziyue 4 Multimodal and Text-to-Speech Models

NetEase Youdao open-sourced its Ziyue 4.0 multimodal and text-to-speech models, with the 27B multimodal model reporting 81.4% accuracy on Chinese math reasoning tasks and the speech model supporting 14 languages.

Why it matters: NetEase Youdao open-sources a 27B multimodal model and a speech synthesis model, with the former scoring 81.4% on Chinese math and science problems.