Skip to content

On-device AI

AI on phones, laptops and edge devices: small models, local inference and edge chips.

Latest picks

21–21 of 21

Jan 30, 2025Thursday

Mistral AI

Mistral AI releases Mistral Small 3, a 24B model under Apache 2.0

Mistral AI released Mistral Small 3, a 24B model built for low-latency tasks, with pretrained and instruction-tuned checkpoints under Apache 2.0. The company says it matches Llama 3.3 70B instruct, runs more than 3x faster on the same hardware, and scores above 81% on MMLU. The model was not trained with RL or synthetic data.

Why it matters: Mistral AI benchmarks Small 3 against Llama 3.3 70B and reports more than 3x the speed on the same hardware.