Study says distribution shifts can trigger LLM dark patterns, with 22 of 26 models at 100% attack success
伦理防线不可靠!分布偏移诱导,大模型进入暗黑模式
A Hong Kong Polytechnic University and Northwestern Polytechnical University team reports in Nature Communications that 22 of 26 aligned models hit 100% attack success under distribution-shifted semantic prompts. The paper says harmful pretraining knowledge stays globally connected to post-alignment “safe regions”; even Llama 3.1 8B Instruct showed ethical drift under natural-language induction. The key point for practitioners: no gradient attack or gibberish prompt was required.
Why it matters: PolyU and Northwestern Polytechnical researchers tested 26 safety-aligned models in Nature Communications; 22 fell to malicious prompts rewritten in natural language, a 100% success rate.