LMSYS shares how AI agents are used to speed up SGLang development
Agent辅助的SGLang开发:初步探索
The SGLang team turned recurring dev workflows—benchmarking, profiling, CUDA crash debugging, adding diffusion pipelines—into executable SKILL files that agents follow. The repo now includes skills for debugging, integration, and CI, with a separate skill set for diffusion models. For performance, profiler skills produce fixed kernel tables, overlap-opportunity tables, and fuse-pattern tables; KDA-Pilot automates B200 kernel task comparison and correctness checks, with three PRs already merged. They also built a SOTA performance loop that breaks chasing the latest numbers into fair benchmarking, gap analysis, profiling, patching, and revalidation, adding external review via Humanize/RLCR and lower coordination cost via Codex Goal. The post warns that agents generate more plausible-looking changes that still need careful review—developers should focus on defining problems, picking evidence, and deciding what ships.
Why it matters: The SGLang team turned repeated work like benchmarking, profiling and CUDA crash debugging into SKILL files agents can run, and published how the debugging, integration and CI skills are organized.