Soup: fine-tune an 8B model on a 4 GB laptop GPU with one config and one command
Soup wraps LLM fine-tuning into a single-command workflow that runs on as little as 4 GB of VRAM. It uses QLoRA with Unsloth acceleration and supports mainstream 8B models like Llama, Mistral, and Qwen. You prepare a JSONL dataset, write a YAML config, and run `soup run`. A built-in Streamlit UI lets you test the model in the browser. The README doesn't disclose exact training speed or memory numbers, but it emphasizes that everything works on a regular laptop GPU.
Why it matters: Soup wraps QLoRA fine-tuning in a command-line tool that trains 8B Llama, Mistral and Qwen models on 4GB of VRAM, started with one soup run command.