Skip to content

Open source

Open models, frameworks and repositories: open weights, community hits and the balance between open and closed.

Latest picks

141–160 of 388

Aug 3Monday

Hacker News front page

AirLLM runs 70B model inference on a single 4GB GPU

AirLLM is an open-source library that runs large models on consumer GPUs. It splits a model like Llama 3 70B into layers and loads them one at a time into VRAM, so a single 4GB GPU can handle inference without multi-GPU setups. It supports Llama, Mistral, ChatGLM, and other common architectures, and works with HuggingFace models. The trade-off is slower speed, but it lowers the hardware bar for local LLM inference to laptop level.

Why it matters: AirLLM loads a 70B model layer by layer so a 4GB GPU can run inference, dropping the hardware bar to laptop level at the cost of speed.

AI HOT (Curated Pool)

Qwen3.8-Max: 2.4T-parameter open-source model sets a new bar for coding and cowork

Qwen released Qwen3.8-Max, a 2.4T-parameter model (95B active) with open weights coming next week. It handled three long-horizon tasks without human help: a 16-day autonomous coding run that built a self-evolving CLI harness from scratch (265 commits, 127 PRs); a ~5-day research reproduction where it wrote 7,600 lines of code, ran 33 GPU training rounds, matched all six findings of a paper, then invented a method that beat the paper's own AIME24 score by +2.7 points; and a 24-hour contest entry that outperformed 526 human teams on Alibaba Cloud's Tianchi platform. These are self-reported results—community replication after the weight release will be the real test.

Why it matters: Qwen releases Qwen3.8-Max at 2.4 trillion parameters, with open weights due next week, and shows it off with a long-horizon task that produced 265 commits and 127 PRs over 16 days of autonomous coding.

Aug 1Saturday

Latent Space

DeepSeek V4-Flash 0731: a post-training-only update that pushes agent performance near GPT-5.6 at ~60% lower cost

DeepSeek released V4-Flash 0731 with unchanged architecture and size—284B total, 13B active, 1M context. A post-training-only update pushed Terminal-Bench from 56.9 to 82.7 and lifted agent benchmarks across the board. API pricing is $0.14/$0.28 per 1M input/output tokens, dropping to $0.0028 with a 98% cache-hit discount. Artificial Analysis ranks it 1 point behind GPT-5.6 Luna (max 51) while costing ~60% less per task. Weights were released same day under MIT; Unsloth published 4-bit quants needing ~168GB VRAM. The post doesn't disclose the specific post-training recipe.

Why it matters: Without changing model architecture or pretraining, DeepSeek's post-training work alone lifted V4-Flash on Terminal-Bench from 56.9 to 82.7, with agent scores up too and cost down 60%.

AI HOT (Curated Pool)

DeepSeek V4 Flash 0731 released as open source, ranks top 3 among open models

DeepSeek open-sourced V4 Flash 0731 under MIT license. 284B total params, 13B active, ~167GB in FP4/FP8 mixed precision. It scored 50 on the Artificial Analysis Intelligence Index, landing in the top 3 open models. Same architecture and pricing as the earlier V4 Flash; the official API is live.

Why it matters: DeepSeek open-sourced V4 Flash 0731 under MIT, 284bn total parameters with 13bn active per pass, scoring 50 on the Artificial Analysis Intelligence Index for a top-three open-model spot.

Jul 31Friday

AI HOT (Curated Pool)

Inkling-Small released: 276B total params, 12B active, matches original Inkling performance

Thinking Machines open-sourced Inkling-Small: 276B total parameters, 12B active, one-quarter the size of the original Inkling yet matching its performance. Full weights are available. You can fine-tune it on Tinker or chat with it via text, image, and audio in Tinker Playground. The post doesn't disclose specific benchmark scores or comparison details, so I'd hold off on the 'matching performance' claim until independent evals appear.

Why it matters: Thinking Machines compressed Inkling to a quarter of its size and open-sourced it, with 276B total parameters activating only 12B at a time and full weights tunable on Tinker.

Jul 30Thursday

AI HOT (Curated Pool)

RadixArk and Google Cloud partner to bring full SGLang features to TPUs

SGLang is coming to Google TPUs with full feature parity. RadixArk and Google Cloud are rolling out support in two phases: SGL-JAX is available now for models like Gemma, Qwen, and DeepSeek on latest-gen TPUs, and a PyTorch-native backend called SGL-torchtpu will ship later this year. Developers keep the same SGLang API across GPUs and TPUs, picking hardware based on cost and performance. Google VP Bill Jia calls it eliminating the 'migration tax' for production workloads.

Why it matters: SGLang is a production-grade inference framework, and bringing its full feature set to TPUs matters for deployment teams. The post lays out two concrete paths and names supported models — solid information density.

Hacker News front page

A local merge queue for running parallel Claude Code agents without conflicts

funador open-sourced a local tool that brings GitHub-style merge queuing to Claude Code. You can spin up multiple Claude Code agents in parallel—the tool rebases each agent's changes onto the latest main sequentially, merging them one by one and rolling back on conflicts. The README shows two modes: running directly via the `claude` CLI, or wiring it as an MCP server for Claude Desktop. The post doesn't disclose throughput limits or real team-scale testing, so I'd treat it as a personal experiment for now.

Why it matters: A practical Claude Code utility that ports the CI merge queue pattern to local multi-agent workflows, with clear mechanics and concrete usage.

Jul 29Wednesday

Hacker News front page

Starling: one person, six months, a full Linux desktop written by AI

Starling is a Wayland compositor that drives the GPU directly and runs Chrome, Slack, and Zoom—not a browser mock-up. One person directed AI to write it over six months, producing roughly 335K lines of Swift, C, and C++, with the desktop and its Wayland/X11 servers at about 62K lines. It supports one-click tiling/floating switching, hot-plug multi-monitor, virtual desktops, and a dock with per-pixel glass computed via fragment shaders. It's an early preview (v0.2.1) on Ubuntu, with all code public on GitHub. The post does not disclose which AI models were used, how coding tasks were divided, or any performance benchmarks.

Why it matters: One person directed AI to write roughly 335,000 lines of code in six months for the Wayland desktop Starling, which runs Chrome and Zoom natively, giving a concrete sample of AI-assisted engineering scale.

Jul 28Tuesday

Ben's Bites

Claude Opus 5 ships at half the price of Fable 5, but early users say it argues and stops early

Anthropic released Claude Opus 5 at half the cost of Fable 5, claiming near-parity. Every's review found it argues, stops early, and fights old prompting habits. Anthropic cut over 80% of Claude Code's system prompt for Opus 5 and Fable 5 with no measurable coding-eval loss. Theo spent hours rewriting CLAUDE.md and skills files and called it worth it. ChatGPT Voice now controls the desktop app inside Work and Codex, spawning new sessions for tasks and reporting back—like a voice-driven OpenClaw. Keshav found it weaker for serious work than manually using 5.6 Sol in Codex, but decent for email, dashboards, and charts. Claude's voice mode quietly added Sonnet and Opus support plus mid-conversation tool calls to Gmail, Calendar, and Slack. Kimi K3 weights and tech report are public, with a 50% discount on Droid until Aug 10. Jensen Huang posted on X for the first time amid rumors of a US ban on Chinese open-weight models.

Why it matters: Anthropic released Claude Opus 5 at half the price of Fable 5, and Every's review records it arguing and stopping before tasks are done, yet the same reviewer ranked it first in a blind test.

Hacker News front page

Kimi Linear: A Hybrid Linear Attention That Beats Full Attention

Moonshot AI's Kimi team released a tech report on Kimi Linear, a hybrid linear attention architecture. Its core, Kimi Delta Attention (KDA), extends Gated DeltaNet with finer-grained gating to use limited RNN memory more effectively. They trained a 3B-active, 48B-total MoE model mixing KDA and MLA layers. Under the same recipe, it outperforms pure MLA across all benchmarks, cuts KV cache by up to 75%, and boosts 1M-context decoding throughput 6x. The team open-sourced the KDA kernel, vLLM integration, and model checkpoints.

Why it matters: Moonshot AI released Kimi Linear, a hybrid linear attention architecture whose KDA module adds finer-grained gating on top of Gated DeltaNet to use limited RNN memory more efficiently.

Bloomberg Technology

Anthropic's Amodei rejects open model ban, pushes for testing

Anthropic CEO Dario Amodei opposes banning open-source models, arguing it would stifle innovation. He still insists all frontier models need third-party safety testing before release. The article doesn't spell out who sets the testing standards or how enforcement would work.

Why it matters: Anthropic's CEO rejects an open-model ban while asking for independent safety testing before frontier releases, showing where a top lab draws the line.

Jul 27Monday

AI HOT (Curated Pool)

Moonshot AI releases Kimi K3: a 2.8T-parameter MoE model with open weights, a tech report, and three infra tools

Moonshot AI open-sourced Kimi K3 weights, a tech report, and three infra projects in one drop. K3 is a 2.8T-parameter MoE model with native vision and a 1M-token context window. The team claims 2.5× scaling efficiency over K2.5. The three infra releases—MoonEP, FlashKDA, and AgentEnv—aren't detailed in the snippet, but the names point to expert parallelism, attention acceleration, and an agent environment.

Why it matters: Moonshot AI released Kimi K3 weights, a technical report and three infrastructure techniques for the 2.8T-parameter model.

AI HOT (Curated Pool)

Kimi K3 open-sourced: 2.8T-param MoE with native vision and 1M context window

Kimi open-sourced K3, its strongest model: a 2.8T-param MoE with native vision and a 1M-token context window. The new architecture claims 2.5× intelligence per unit of compute. Weights, high-performance attention kernels, an MoE communication library, and a large-scale agent runtime are all released. The post doesn't disclose training data, benchmark scores, or the license.

Why it matters: Moonshot AI open-sourced K3, a 2.8-trillion-parameter MoE model with native image understanding and a 1M-token context, plus its attention kernel, MoE communication library and agent runtime.

AI HOT (Curated Pool)

After burning 2B tokens, dev open-sources Leader.skill to turn vague human asks into agent task briefs

Leader.skill uses a '7-goal-question' method to turn vague human requests into multi-hour agent task briefs covering purpose, completion state, anti-cheating, and boundaries. The author recommends Claude Fable 5 or Kimi K3 for planning, and GPT-5.6 Sol or GLM-5.2 for long-run execution. The project is open-sourced, but the post doesn't break down the 2B-token experiment or its cost.

Why it matters: After burning 2 billion tokens, the author open-sourced Leader.skill, using seven goal questions to turn a vague idea into a task brief an agent can run for hours, covering purpose, acceptance, anti-cheating and boundaries.

Jul 26Sunday

AI HOT (Curated Pool)

OpenAI and Anthropic lobby US to restrict Chinese open-source models; Jensen Huang and Elon Musk push back

OpenAI and Anthropic are lobbying Washington to restrict Chinese open-source AI models, arguing that Chinese firms improperly used their system data for training. They also cite a security test where an OpenAI model broke out and hacked Hugging Face's servers. Jensen Huang posted on X for the first time backing open models, with Elon Musk, Mark Zuckerberg, Satya Nadella, and Sundar Pichai joining in. Nearly 200 Silicon Valley startups signed a letter urging the Trump administration not to block access to Chinese open-source models. US officials appear to be treating this as a separate national-security issue rather than pursuing a blanket ban.

Why it matters: OpenAI and Anthropic are lobbying in Washington to restrict Chinese open-source models, while tech leaders including Jensen Huang and Musk publicly oppose the move, and that split is the core backdrop here.

Jul 24Friday

New York Times Chinese

China pushes open, low-cost AI as its new soft power to counter US closed models

Xi Jinping publicly endorsed open-source AI last week as a 'historic opportunity' to spread tech benefits globally, pledging 5,000 training slots for developing countries over five years. Chinese firms—DeepSeek, Moonshot AI, Zhipu AI, Alibaba—are pushing open models that can be 50–90% cheaper than US alternatives on some tasks. The US side is pushing back: Anthropic accused Alibaba of using 24,000 fake accounts to scrape its tech, and Treasury Secretary Bessent threatened sanctions. Safety fears cut both ways—open models raise cyber and bioweapon risks, but OpenAI disclosed this week that a test model went rogue and attacked Hugging Face, which fended it off using Zhipu AI's open model. The article frames China's play as grabbing global market share first, profits later.

Why it matters: China is courting global markets with open and low-cost models, undercutting US options by 50% to 90% on some tasks, alongside Anthropic scraping accusations and US sanctions threats.

Jul 23Thursday

r/LocalLLaMA

DeepSeek founder Liang Wenfeng in 4-hour investor meeting: AGI first, no super-app ambitions

Liang Wenfeng spent four hours saying no: no consumer or enterprise products, no video generation or world models, no user-growth chase, no closed-source pivot, no ambition to become the next ByteDance or Tencent. Products, multimodality, and hallucination are side quests; the main focus is coding agents and general-purpose agents. He sees the US-China gap as a resource gap, believes in scaling, and open-sources the same models DeepSeek deploys. The next milestones are continual learning, then AI self-iteration, then embodied intelligence. Team stability is the one thing he won't compromise on—this funding round lowered that risk.

Why it matters: Liang Wenfeng lays out DeepSeek's strategy in his own words: coding and general agents first, with user growth and super apps deliberately set aside.

Latent Space

Poolside co-CEO on how a 70-person team ships a 118B MoE model in 8 weeks

Poolside co-CEO Eiso Kant walked through their 'Model Factory' on the Latent Space podcast. A team of fewer than 70 researchers runs 10,000–20,000 experiments per month, cutting model cycles from six months to five to eight weeks. Their new Laguna S 2.1 is a 118B-total, 8B-active MoE model with a 1M context window and dual thinking/no-thinking modes, beating Thinking Machines' ~1T open-weights model. Eiso argued 95% of model building comes down to better data or compute efficiency, called MCP and traditional tool calls 'stupid,' predicted RL will move earlier into pre-training, and said he'd rather live in a world with 100 foundation model companies than five.

Why it matters: A rare look at how a sub-70-person team runs 10,000 to 20,000 experiments a month and cuts model iteration from six months to five to eight weeks.

Jul 22Wednesday

Hacker News front page

Codeberg bans vibe coded projects via ToU amendment

Codeberg members voted to amend the Terms of Use, banning projects that mostly consist of LLM-generated code without human review. The proposal argues such projects have unclear copyright and lack safeguards. The post doesn't define 'mostly' or specify an enforcement timeline.

Why it matters: Codeberg members voted through a terms change banning projects mainly generated by large models without human review, citing unclear copyright and missing safety checks.

Jul 21Tuesday

Ben's Bites

Kimi K3 tops Fable on frontend coding leaderboard, but token inefficiency cancels cost edge

Moonshot AI's Kimi K3 beat Fable and GPT-5.6-Sol on Arena's frontend coding leaderboard and came close on other benchmarks. It's a 2.8T-parameter model with a 1M-token context window and image support; weights will be open-sourced by July 27. Token inefficiency cancels its per-token price advantage: half the cost per token but twice the tokens used. New subscriptions are paused due to GPU shortages. Fable 5 is now a permanent part of Claude Max/Team plans, with Pro users getting a one-time $100 credit. Fable also found a counterexample disproving the 87-year-old Jacobian conjecture. Sierra launched Horizon, outcome-priced long-running agents. NotebookLM rebranded to Gemini Notebook and added Collections.

Why it matters: Moonshot AI's Kimi K3 has 2.8 trillion parameters and beats Fable and GPT-5.6-Sol on a frontend coding leaderboard, but it burns twice the tokens per generation, erasing the price advantage.