Hugging Face reproduces RL training for coding models to paint watercolours with TRL and OpenEnv

用 TRL 和 OpenEnv 训练编码模型画水彩：Hugging Face 全流程开源复现

Sergio Paniego open-sourced a reproduction of Surya Narreddi's RL pipeline that trains Qwen to paint watercolours via p5.js code. He used TRL for GRPO training, OpenEnv for the RL environment, and HPSv3 as the scorer, running everything on Hugging Face Jobs and Spaces. After 110 steps, Qwen3.5-35B-A3B generates watercolour flowers with brush-like textures, though composition and colour control remain unstable. All artifacts—reference pool, environment, scripts, and model—are public, with a single training run costing about $15–20.