Distilling DeepSeek into GPT-OSS Doesn't Transfer Censorship
Show HN: Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try it
CTGT distilled a 120B finance model from DeepSeek V4 Flash. Across 152 matched prompt pairs, the teacher scored 45.45 points more censored on China-sensitive topics, but the student showed no censorship at all—four US lab judges agreed. Self-distillation on corrected outputs matched the DeepSeek-taught model on financial reasoning, at 62× lower cost than Inkling. Code, data, and models are open.
Why it matters: CTGT distilled DeepSeek V4 Flash into a 120B finance model, and 152 paired tests show the teacher's censorship leanings did not carry over to the student.