Skip to content

Open source

Open models, frameworks and repositories: open weights, community hits and the balance between open and closed.

Latest picks

121–140 of 388

Aug 13Thursday

Computing Life · Share · Yage

DeepSeek open-sources DSH: agent loop as a hot-swappable plugin, paving the way for self-evolving agents

DeepSeek released its first agent harness, DSH, as open source on August 13. Unlike Codex or Claude Code, DSH treats the agent loop itself as a plugin that can be swapped at runtime. The Cordis runtime handles hot reloads, dependency notifications, and transactional rollbacks. For everyday coding, declarative plugins plus a quick restart are enough—DSH's imperative model adds complexity. But if you want an agent that can generate new tools or replace its own control flow mid-run, DSH is the only option with the infrastructure in place. The post does not disclose performance benchmarks or production-scale data.

Why it matters: DeepSeek open-sourced DSH, an agent harness that makes the control loop a swappable runtime plugin, an architectural break from the fixed pipelines in Codex and Claude Code.

AI HOT (Curated Pool)

Alibaba open-sources Qwen3.8-2.4T-A95B: 2.4T MoE, 95B active, native 256K context

Alibaba's Qwen team open-sourced its first Qwen-Max-level weights. Qwen3.8-2.4T-A95B has 2.4T total parameters with 95B active per token, native 262K context expandable to 1.01M tokens. It uses a 512-expert MoE, routing 10 experts plus one shared expert per token, and includes multi-token prediction training. The model targets coding, office tasks, research, and long-horizon agent workflows. Benchmarks against Opus 4.8, Fable 5, and GPT 5.6 Sol show mixed results, with top scores on PaperBench and IFBench among listed models. Post-training combines combinatorial environment scaling, a unified reward system, and an online data balancer to reduce gradient variance. The post does not disclose the open-source license or inference hardware requirements.

Why it matters: Alibaba opened the weights of its cloud flagship Qwen model, a 2.4T-parameter MoE with 95B active and native 256K context, giving a concrete reference point for open-model limits.

Aug 12Wednesday

Hugging Face Blog

Liquid AI releases LFM2.5-VL-3B, a vision-language model for edge devices

Liquid AI open-sourced LFM2.5-VL-3B, a 3B-param vision-language model that runs on local hardware. It skips long reasoning chains and answers directly, targeting real-time and on-device use. Four main upgrades: screen/UI understanding, natural-language object grounding, multi-image reasoning, and stronger function calling. The post includes benchmark comparisons and CPU/GPU inference speed, but doesn't give exact latency numbers.

Why it matters: Liquid AI open-sourced the 3B-parameter LFM2.5-VL-3B for on-device use, upgrading screen understanding, image pointing, multi-image understanding and tool calling.

Hacker News front page

NVIDIA ships Nemotron 3.5 Lightning and NeMo Switchyard for faster, smarter agent routing

NVIDIA added a 30B-parameter MoE model, Nemotron 3.5 Lightning, to its Nemotron 3 family. It targets specialized tasks inside multi-agent systems, delivering 4x faster output and 30% faster agentic task completion than peers. It runs locally on RTX PCs, DGX workstations, and Jetson. The company also open-sourced NeMo Switchyard, a routing library that directs requests to the best model for each job without app rewrites. CrowdStrike, Harvey, and CodeRabbit are already using customized versions. The post does not disclose pricing or a release timeline.

Why it matters: Nvidia released Nemotron 3.5 Lightning, a 30B-parameter model aimed at code review and security alert monitoring in multi-agent systems, which Nvidia says outputs 4x faster than comparable models.

Aug 11Tuesday

Mistral AI

Mistral launches regional inference endpoints and a Priority Tier, adding third-party open models like GLM-5.2

Mistral announced general availability of Mistral Regional Endpoints, letting customers choose whether inference runs in Europe or the US. Mistral Priority Tier also entered public preview, offering custom rate limits and an availability commitment backed by an SLA.

Why it matters: Mistral puts regional inference endpoints, a Priority Tier with an SLA and third-party open models on one infrastructure, a concrete sample of what AI sovereignty looks like in practice.

Aug 10Monday

Hacker News front page

Zuckerberg attacks closed AI rivals as Meta returns to open models

Zuckerberg called out OpenAI and Google by name in an internal meeting, arguing open models will win long-term. He confirmed Meta's next Llama generation will stay fully open and said AI teams are merging into product units to speed up shipping. No release date or specs were disclosed.

Why it matters: Zuckerberg named OpenAI and Google in an internal meeting, confirmed the next Llama stays fully open source, and folded the AI team into the product group to ship faster.

AI HOT (Curated Pool)

SGLang adds Day-0 inference support for Meta's local agent model Muse Glimmer

Meta released Muse Glimmer, a 30B multimodal model built for local agentic workflows. SGLang ships Day-0 support with dedicated optimizations: on a single RTX 5090 with NVFP4 quantization and DFlash speculative decoding, per-user decode hits 236 tok/s and total throughput reaches 1,452 tok/s. The model uses a hybrid of sliding-window and full-sequence attention with a 128k+ context window. Apple Silicon is supported via the MLX backend, though speculative decoding isn't available there yet.

Why it matters: SGLang shipped support the day Meta released Muse Glimmer and tuned inference for local agent workflows, hitting 1,452 tokens per second on one RTX 5090.

Hacker News front page

Meta open-sources Muse Glimmer, a 30B agentic model that runs locally on a single GPU

Meta released Muse Glimmer weights under Apache 2.0. It's a 30B model built for always-on local agent workflows, small enough to run on a Mac or PC with a single consumer GPU. 4-bit quantization shrinks it below 20 GB, leaving room for KV cache and the vision encoder within a 24 GB or 32 GB envelope. Training used logit distillation from a larger Muse Spark teacher, followed by mid-training on long-context agent data and post-training with SFT, on-policy distillation, and RL. Meta's benchmarks show it outperforming Gemma4-31B and Qwen3.6-27B on agentic, coding, multimodal, and safety evals. The post doesn't disclose specific latency numbers, only that inference optimizations were applied to keep it responsive.

Why it matters: Meta open-sourced a 30B model under Apache 2.0 that fits under 20 GB at 4-bit, so a single consumer GPU can host a local agent workflow.

AI HOT (Curated Pool)

NVIDIA Releases NemotronLabs VoiceChat 11B: An Open Full-Duplex Speech-to-Speech Model with ~450 ms Turn-Taking and Live Tool Calling

NVIDIA open-sourced an 11B end-to-end speech-to-speech model that handles streaming understanding and generation in one network, skipping the usual ASR-LLM-TTS pipeline. Measured turn-taking latency is 448 ms, and it supports live tool calling during conversation. Weights and code are public.

Why it matters: NVIDIA open-sourced the weights and code of NemotronLabs VoiceChat 11B, an 11-billion-parameter end-to-end speech model that streams listening and speaking in one network with about 448 ms barge-in latency.

Aug 8Saturday

AI HOT (Curated Pool)

Tencent Hunyuan open-sources production inference kernels and integrates them into SGLang

Tencent Hunyuan open-sourced its production-proven Attention, Router GEMM, and MoE kernels as HPC-Ops and merged them into SGLang's main branch. On H20, Hy3-FP8 TPOT dropped by up to 48.8%; the Attention kernel averaged 2.25× faster than FlashInfer/FlashAttention, and Router GEMM ran 1.30–3.22× faster than FP32 cuBLAS with lower error. H200 validation passed, with the MoE kernel hitting 4.21× over Triton on Qwen3.

Why it matters: Tencent Hunyuan open-sourced Attention, Router GEMM and MoE operators honed in production and merged them into the SGLang main branch, offering concrete fixes for GPU idle time caused by varying request lengths in MoE inference.

Hacker News front page

Oracle bans AI-generated code from OpenJDK while Ellison says AI writes Oracle's own code

Oracle told OpenJDK contributors: use LLMs privately for debugging and review, but don't submit AI-generated code to repos or pull requests, citing safety, security, and IP risks. That stance clashes with Larry Ellison's recent claim that AI models now write Oracle's code, and co-CEO Mike Sicilia's praise of AI tools for letting smaller teams ship faster. Oracle is spending $70 billion this year on datacenter expansion, which prompted S&P to downgrade its rating to BBB-, one notch above junk, over uncertain returns.

Why it matters: Oracle set a new rule for OpenJDK banning AI-generated code submissions over security, reliability and intellectual property risk, while allowing private use of large models for debugging and review.

Aug 7Friday

Hacker News front page

Herdr joins Y Combinator F26, open-source agent runtime stays free

Herdr is a runtime and TUI for CLI coding agents, letting agents run persistently across machines. Solo developer Can Celik built it to 25k GitHub stars and 340k downloads, and is now joining Y Combinator's F26 batch to turn it into a company. The runtime stays free under Apache-2.0, the core remains small, and everything else goes through plugins—over 500 already exist, plus community-built Raycast, Stream Deck, and iOS clients. The post doesn't disclose funding amount or team size.

Why it matters: After taking his command-line agent runtime to 25,000 GitHub stars and 340,000 downloads, solo developer Can Celik joins YC F26 while the runtime stays Apache-2.0 open source.

AI HOT (Curated Pool)

Agent Plugins 1.0.0: Google, Amazon, Microsoft, and others ship a unified agent plugin spec

Agent Plugins 1.0.0 is an open, vendor-neutral spec that packages Agent Skills and MCP servers into a portable directory. Google joins Amazon, Cursor, Microsoft, OpenAI, and Vercel as a core maintainer. The format is deliberately minimal: plugin.json declares only a name and schema, skills live in skills/, and MCP servers go in mcp.json with explicit transport types. v1 intentionally omits install mechanisms, permission models, and sandboxing—those are left to each client. The post also notes that a single skill or single MCP server doesn't need a plugin; the format earns its keep when components must travel together.

Why it matters: Google joins Amazon, Microsoft, OpenAI and Vercel in the core maintainer group, packaging agent skills and MCP servers into a portable directory, giving cross-vendor plugin formats a reference point.

Aug 6Thursday

Hacker News front page

Prime Intellect open-sources Prime Agent, a coding harness that lets models manage their own context, tools, and sub-agents

Prime Intellect released Prime Agent, an open-source coding harness where models treat context as variables and sub-agent calls as functions inside a persistent IPython kernel. Two core abstractions drive it: RLM gives the model programmatic access to its own history and tools, while Continual Harness lets the agent create, update, and delete its own prompts, skills, and memory at runtime. A background daemon manages all sessions with attach/detach, crash recovery, and agent-to-agent messaging. The repo is public on GitHub and installs with a single curl command.

Why it matters: Prime Intellect open-sourced Prime Agent, which treats context as variables and sub-agent calls as functions inside a persistent IPython environment, a reusable approach to context retention.

Aug 5Wednesday

Hacker News front page

A char-level transformer trained from scratch on an $8 ESP32-S3

Carloscodix open-sourced qapla, a char-level transformer trained entirely on an $8 ESP32-S3 chip. The chip runs the full training loop, not just inference, with backprop hand-written in C. The repo doesn't disclose parameter count, dataset size, or training time, but the code is public with 6 commits. Treat this as an extreme engineering demo rather than a practical tool—fitting training onto a microcontroller is the wild part.

Why it matters: A developer ran a full character-level Transformer training loop, backprop included, on an $8 ESP32-S3 in hand-written C, a reference for end-to-end training on very low-resource hardware.

Hacker News front page

Flowise is shutting down; repo to be archived in August

Flowise is winding down operations, citing a shift toward coding agents like Claude Code that handle complexity better than rigid low-code workflows. Active development stops July 29, the GitHub repo will be archived on August 10, and official support ends August 31. The Apache 2.0 code remains available for anyone to fork and maintain.

Why it matters: The Flowise team is shutting the project down, freezing code on July 29 and archiving the repo in August, citing developers moving to coding assistants like Claude Code.

AI HOT (Curated Pool)

LLM 0.32 adds reasoning traces, OpenAI Responses, server-side tools, and smarter logging

Simon Willison shipped LLM 0.32, the biggest update since launch. Reasoning traces now stream to stderr so you can pipe clean output elsewhere. The new default model is GPT-5.6 Luna. Server-side tools like OpenAI's code interpreter and web search are supported, and the Anthropic plugin adds matching tools plus an MCP connector. The Python API drops the forced conversation abstraction—you pass a messages list directly and use stream_events() to separate reasoning, text, and tool calls. Logging switches to a Git-like content-addressable store to avoid duplicating long contexts.

Why it matters: LLM 0.32 sends a reasoning model's thinking to stderr and leaves only clean results on stdout, so output can be piped straight into other tools.

Aug 4Tuesday

Hacker News front page

Soup: fine-tune an 8B model on a 4 GB laptop GPU with one config and one command

Soup wraps LLM fine-tuning into a single-command workflow that runs on as little as 4 GB of VRAM. It uses QLoRA with Unsloth acceleration and supports mainstream 8B models like Llama, Mistral, and Qwen. You prepare a JSONL dataset, write a YAML config, and run `soup run`. A built-in Streamlit UI lets you test the model in the browser. The README doesn't disclose exact training speed or memory numbers, but it emphasizes that everything works on a regular laptop GPU.

Why it matters: Soup wraps QLoRA fine-tuning in a command-line tool that trains 8B Llama, Mistral and Qwen models on 4GB of VRAM, started with one soup run command.

AI Chat-Group Daily (群聊日报)

Qwen 3.8 Max matches Fable 5 at 2.4T params, open weights next week

Qwen 3.8 Max launched with Terminal Bench 2.1 score 86.6 and PaperBench 93.0, beating Fable 5's 88.8. A 500-yuan token plan burned out in one day; the model lands between Luna and Terra, with price as the main draw. Open weights for both Qwen 3.8 Max and Qwen 3.8-27B drop next week. DS V4 Flash hit 8T tokens consumed in a single day, topping weekly charts—the group sees tokens becoming a commodity. On tools: an M5Stick voice dongle turns a keychain into an agent remote, LoopX keeps agent state across 200+ hours, and reverse-skill injects reverse-engineering toolchain knowledge into coding agents. The wildest methodology story: an agent autonomously downloaded a local Qwen mid-translation task and auto-installed Whisper when its API key ran out of funds.

Why it matters: Qwen 3.8 Max launched at 2.4 trillion parameters, scored 93.0 on PaperBench against Fable 5's 88.8, and weights open next week.

Computing Life · Share · Yage

Perplexity open-sources Numbat to normalize agent behavior across Claude Code, Codex, and other clients into one security rule set

Engineers routinely use Claude Code, Codex, OpenCode, and others, but each tool has different hook names, log formats, and blocking capabilities, making unified security enforcement difficult. Perplexity open-sourced Numbat (Apache 2.0), a static Go binary that normalizes actions from different clients into five event types—command.exec, file.write, etc.—and applies 52 CEL rules for cross-client checks. Built-in rules default to monitor-only and automatically fall back to detect-only on complex commands to avoid breaking dev scripts. Numbat handles behavioral observation and detection normalization, not physical sandboxing; synchronous blocking for OpenCode is still unsupported, and its SQLite log parser remains deferred.

Why it matters: Perplexity open-sourced Numbat, which normalizes the interception hooks and log formats of different coding assistants like Claude Code and Codex into unified security rules, giving teams running multiple assistants a cross-client management approach.