Skip to content

Data & training

The training side: datasets, synthetic data, pre- and post-training methods, compute and training cost.

Latest picks

61–80 of 173

Aug 4Tuesday

Hacker News front page

Soup: fine-tune an 8B model on a 4 GB laptop GPU with one config and one command

Soup wraps LLM fine-tuning into a single-command workflow that runs on as little as 4 GB of VRAM. It uses QLoRA with Unsloth acceleration and supports mainstream 8B models like Llama, Mistral, and Qwen. You prepare a JSONL dataset, write a YAML config, and run `soup run`. A built-in Streamlit UI lets you test the model in the browser. The README doesn't disclose exact training speed or memory numbers, but it emphasizes that everything works on a regular laptop GPU.

Why it matters: Soup wraps QLoRA fine-tuning in a command-line tool that trains 8B Llama, Mistral and Qwen models on 4GB of VRAM, started with one soup run command.

Jul 31Friday

AI HOT (Curated Pool)

Inkling-Small released: 276B total params, 12B active, matches original Inkling performance

Thinking Machines open-sourced Inkling-Small: 276B total parameters, 12B active, one-quarter the size of the original Inkling yet matching its performance. Full weights are available. You can fine-tune it on Tinker or chat with it via text, image, and audio in Tinker Playground. The post doesn't disclose specific benchmark scores or comparison details, so I'd hold off on the 'matching performance' claim until independent evals appear.

Why it matters: Thinking Machines compressed Inkling to a quarter of its size and open-sourced it, with 276B total parameters activating only 12B at a time and full weights tunable on Tinker.

Jul 20Monday

Product Hunt · AI

Thinking Machines releases Inkling, a 975B open-weights multimodal model built for fine-tuning

Thinking Machines launched Inkling on Product Hunt, a 975B MoE open-weights model with 41B active parameters and 1M context window. It handles text, images, and audio natively, with controllable reasoning effort, under Apache 2.0. The companion Tinker API handles LoRA fine-tuning without infrastructure overhead, aimed at researchers who want full control over data and algorithms. The post does not disclose benchmark scores or pricing.

Why it matters: Thinking Machines open-sourced Inkling, a 975B-parameter MoE multimodal model that activates 41B parameters per inference under Apache 2.0, aimed at fine-tuning.

Jul 16Thursday

Hacker News front page

Thinking Machines releases Inkling: a 975B-param open-weights MoE model with 41B active params

Thinking Machines open-sourced Inkling, a 975B-total-param, 41B-active MoE model with a 1M-token context window, pretrained on 45T multimodal tokens. It handles text, images, and audio natively, with controllable thinking effort, and is positioned as a customizable base rather than a benchmark leader. A 12B-active Inkling-Small preview was also announced. The team demoed self-fine-tuning on their Tinker platform: the model wrote a training job, ran it, and switched to the new weights in about 27 minutes. Weights are on Hugging Face; fine-tuning is available on Tinker.

Why it matters: Thinking Machines open-sourced Inkling, a 975B-parameter mixture-of-experts model that activates 41B parameters per inference, handles text, images and audio natively, and trained on 45 trillion tokens.

Jul 15Wednesday

Hugging Face Blog

Thinking Machines releases Inkling: a 1T-param, natively multimodal open model

Inkling is an open ~1T-param model that natively accepts image, audio, and text inputs with a 1M context window. Trained on 45T multimodal tokens, it uses a MoE architecture with 975B total and 41B active parameters. It includes MTP speculative decoding layers for faster inference and ships in BF16 and NVFP4 variants. Hugging Face provides day-0 support in transformers, SGLang, vLLM, and llama.cpp, covering agentic coding, multimodal vision, and audio tasks.

Why it matters: Thinking Machines released Inkling, a 975B-parameter MoE with 41B active, native text, image and audio support, a 1M-token context window, and 45 trillion multimodal training tokens.

Jul 14Tuesday

Hacker News front page

Thinking Machines argues the future worth building is human-shaped, not AI-automated

Thinking Machines lays out its technical philosophy: AI should extend human will and judgment, not replace them. The post draws on Hayek's distributed knowledge argument and Toyota's return to craftsmanship, arguing models must be as diverse and distributed as the people they serve. No model specs or release timelines are disclosed.

Why it matters: Thinking Machines argues AI should extend human judgment rather than replace it, citing Hayek and Toyota's veteran workers to back decentralized, fine-tunable models.

Hacker News front page

DoorDash uses LLM juries and multimodal AI to tag food items, beating human accuracy by 20%

DoorDash's catalog has millions of items with wildly inconsistent names, making manual tagging slow and expensive. They built an AI metadata platform that uses multimodal models—text, images, and web search—to infer attributes like spiciness or cuisine type. Instead of human review, an 'LLM jury' of multiple strong models votes independently and aggregates a consensus, lifting annotation accuracy roughly 20% above typical human reviewers. Context-optimization agents iterate prompts in minutes, adding another 20%+ precision gain and speeding up prompt development 10x. They auto-generate training data to fine-tune small models that match frontier LLM quality at 10% of the inference cost. Distributed inference cut backfill time for millions of items from over a month to a few days. The post doesn't disclose which models, latency, or per-item cost.

Why it matters: DoorDash uses juries of several large models to auto-label dish attributes like spiciness and cuisine, beating ordinary human review by about 20 points of accuracy and showing a reusable pattern for multimodal data labeling.

Jun 10Wednesday

r/LocalLLaMA

Fine-tuned Qwen2.5-7B to 96% of Claude Haiku using about $3 of API calls

A Reddit user fine-tuned Qwen2.5-7B with 1,040 DV-DPO preference pairs, costing about $3 at Claude Haiku rates, and reported 96% composite performance versus Claude Haiku on a domain task, with 11-second latency on a 4-bit T4 setup.

Why it matters: A Reddit user fine-tuned Qwen2.5-7B on 1,040 preference samples for about $3 in API calls and no human labelers, reaching 96% of Claude Haiku's score on a domain-specific task.

Jun 9Tuesday

AI HOT (Curated Pool)

Tencent Hunyuan Releases UniRL, a Unified Multimodal RL Infrastructure

Tencent Hunyuan released UniRL, using one post-training loop to cover diffusion and flow-matching models, LLM/VLM systems, and unified multimodal models, while open-sourcing two algorithms, DRPO and Flow-DPPO.

Why it matters: Tencent Hunyuan open-sources UniRL, putting RL training for diffusion, flow matching, language and vision-language models into one post-training loop, with models and algorithms decoupled for free combination.

Bloomberg Technology

Musk’s xAI Taps Starlink Staffer to Run Grok Training Team

xAI brought in an executive from SpaceX’s Starlink service to run the Grok training team, replacing college-aged engineer Diego Pasini; the RSS snippet does not disclose the executive’s name, tenure, or training process.

Why it matters: xAI moved an executive over from SpaceX's Starlink division to run the Grok training team, replacing previous lead Diego Pasini.

Jun 8Monday

AI HOT (Curated Pool)

Hivemind launches continuous learning for AI coding agents

Hivemind released continuous learning for AI coding agents, collecting trajectories from Claude Code, Codex, Cursor, Hermes, and Pi, converting them into reusable skills stored in users’ cloud storage, with SkillOpt matching or leading all 52 test settings.

Why it matters: Hivemind turns coding-assistant session traces from Claude Code, Codex and Cursor into reusable skills stored on a personal cloud drive and synced across tools.

AI HOT (Curated Pool)

VoxCPM2 technical report released

OpenBMB released the VoxCPM2 technical report, covering a 2B-parameter speech generation model trained on more than 2 million hours of multilingual speech data, with support for 30 languages and 9 Chinese dialects.

Why it matters: ModelBest open-sourced VoxCPM2, a 2-billion-parameter model under Apache 2.0, trained on over 2 million hours of data covering 30 languages and 9 Chinese dialects, with voice design, cloning and continuation all released.

Google DeepMind

Google DeepMind publishes Sierra Leone AI tutoring trial results

Google DeepMind published results from a pre-registered randomized controlled trial in Sierra Leone. Students using Guided Learning gained 0.258 standard deviations in math over the control group, equal to roughly 1.2 to 1.7 years of normal learning progress in eight weeks.

Why it matters: A preregistered randomized controlled trial in Sierra Leone by Google DeepMind found students using Guided Learning gained 0.258 standard deviations in math, equal to about 1.2 to 1.7 years of normal schooling in eight weeks.

Jun 7Sunday

QbitAI · WeChat

Kuaishou Kling Proposes VLM-as-Teacher for Test-Time Video Reasoning Optimization

City University and Kuaishou Kling proposed VLM-as-Teacher, which uses VLM feedback to optimize VGM LoRA at test time, reporting a 16.7-point average gain and raising VBVR-Bench from 0.666 to 0.781.

Why it matters: Kuaishou Kling and CityU use a vision-language model as a test-time teacher, feeding LoRA updates to a video generator so it follows text rules while it generates.

AI HOT (Curated Pool)

AI Substitution Wave: Three Forces Reshape Cost Structures

Coinbase, Lindy, Harvey, and Cursor shifted workloads to cheaper models; Harvey reported Kimi 2.6 reached a 15% all-pass rate on Legal Agent Benchmark, versus Opus at 14%, with 100 tasks costing $84 versus $954.

Why it matters: Foundation labs moving up the stack, closed models raising prices and open models being good enough pushed Coinbase and Lindy to route or fully switch tasks to cheaper models.

AI HOT (Curated Pool)

Five Labs, Five Minds: Building a Multi-Model Financial Drama Game with Small Models

Thousand Token Wood v2 uses four small models from different labs to drive agents in a financial simulation game, with vLLM 0.22.1’s CUDA toolkit dependency identified as the main serving friction, while a fine-tuned 0.5B Qwen reached 0% self-trading and 100% valid quotes.

Why it matters: Small models from four labs play market roles while the player lends, spreads real and fake tips, shorts and bribes, with model differences driving the game's feel.

Jun 6Saturday

AI HOT (Curated Pool)

Google Colab CLI Released

Google released the Colab CLI, which lets developers and AI agents connect local terminals to remote Colab runtimes, request high-performance GPUs, run local Python scripts remotely, and retrieve artifacts such as logs or fine-tuned Gemma 3 adapters.

Why it matters: Google's Colab CLI lets developers rent A100 or T4 GPUs from a local terminal, run Python scripts, and pull models, datasets and replayable notebook logs back to their machine.

Hacker News front page

Launch HN: General Instinct (YC P26) – Frontier Models on Edge Devices

General Instinct open-sourced InstinctRazor, compressing Qwen3.5-122B-A10B from a roughly 245GB BF16 MoE model into a 48GiB GGUF, with a small-GPU mode that streams experts from system RAM and uses about 7.6–8GB peak VRAM at an 8k context window.

Why it matters: General Instinct open-sourced InstinctRazor, a compression method that shrinks the 245GB Qwen3.5-122B-A10B mixture-of-experts model to 48GB for edge devices, a path worth studying for teams running large models locally.

Jun 5Friday

Xinzhiyuan · WeChat

Anthropic warns of AI self-acceleration as OpenAI is said to cross a reliability threshold

Xinzhiyuan cites a Yann Dubois interview saying OpenAI crossed a reliability threshold around last December, while Anthropic’s internal data says per-person quarterly code contribution reached 8× the Q1 2024 level by Q2 2026.

Why it matters: Anthropic warns that AI R&D has entered a self-accelerating phase, while Yann Dubois says OpenAI crossed a reliability threshold around last December, pointing to the same debate over capability and safety pacing.

Jun 3Wednesday

AI HOT (Curated Pool)

Build 2026: Microsoft tops Google in image generation while catching up on reasoning

Microsoft announced seven in-house AI models at Build 2026, including its first reasoning model, one new tuning method, and one autonomous background AI agent; the RSS snippet does not disclose model names, benchmarks, or release dates.

Why it matters: Microsoft shipped seven in-house models at Build 2026, and its trillion-parameter MAI-Thinking-1 reasoning model beat Anthropic Sonnet 4.6 in internal blind tests while landing near DeepSeek V3.2 on public benchmarks.