Skip to content
Hugging Face Blog

A 350M model fine-tuned with GRPO in 100 steps lifts structured-output compliance from 22.6% to 29.7%

Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps

A hands-on guide from Hugging Face and Liquid AI that fine-tunes LFM2.5-350M with GRPO via the TRL library. Using only 500 samples and 100 training steps on a free Colab GPU, structured-output compliance on the IFStruct benchmark jumps from 22.6% to 29.7%. The post includes the full notebook, reward-function design, and a local evaluation setup with llama.cpp on a MacBook.

Why it matters: Hugging Face published a full TRL GRPO recipe for a 350M model, and 100 steps lifted IFStruct structured-output pass rate from 22.6% to 29.7%.

Read the original ↗Export Markdown