ICLR 2026 | ProSafePrune: Low-rank parameter pruning reduces LLM over-refusal
ICLR 2026 | ProSafePrune:一剪见效,告别大模型过度防御
A Hefei University of Technology and iFlytek team introduced ProSafePrune, a low-rank parameter pruning method that reduced over-refusal across 7B-70B models; on LLaMA-2-7B, OR-Bench compliance rose from 11.0% to 73.0%. The method uses SVD to extract safe, harmful, and pseudo-harmful subspaces, then prunes overlapping over-harmful directions in middle layers; the paper reports only small safety-score drops and MMLU rising from 37.1 to 39.6. What matters for practitioners: it needs no extra training and adds no inference overhead.
Why it matters: Hefei University of Technology and iFlytek propose ProSafePrune, which uses SVD to split middle-layer parameters into safe, harmful and pseudo-harmful subspaces and prune overlapping directions, easing over-refusal without training or extra inference cost.