English

Sugar-Coated Poison: Benign Generation Unlocks LLM Jailbreaking

Cryptography and Security 2025-09-23 v3 Computation and Language

Abstract

With the increasingly deep integration of large language models (LLMs) across diverse domains, the effectiveness of their safety mechanisms is encountering severe challenges. Currently, jailbreak attacks based on prompt engineering have become a major safety threat. However, existing methods primarily rely on black-box manipulation of prompt templates, resulting in poor interpretability and limited generalization. To break through the bottleneck, this study first introduces the concept of Defense Threshold Decay (DTD), revealing the potential safety impact caused by LLMs' benign generation: as benign content generation in LLMs increases, the model's focus on input instructions progressively diminishes. Building on this insight, we propose the Sugar-Coated Poison (SCP) attack paradigm, which uses a "semantic reversal" strategy to craft benign inputs that are opposite in meaning to malicious intent. This strategy induces the models to generate extensive benign content, thereby enabling adversarial reasoning to bypass safety mechanisms. Experiments show that SCP outperforms existing baselines. Remarkably, it achieves an average attack success rate of 87.23% across six LLMs. For defense, we propose Part-of-Speech Defense (POSD), leveraging verb-noun dependencies for syntactic analysis to enhance safety of LLMs while preserving their generalization ability.

Keywords

Cite

@article{arxiv.2504.05652,
  title  = {Sugar-Coated Poison: Benign Generation Unlocks LLM Jailbreaking},
  author = {Yu-Hang Wu and Yu-Jie Xiong and Hao Zhang and Jia-Chen Zhang and Zheng Zhou},
  journal= {arXiv preprint arXiv:2504.05652},
  year   = {2025}
}

Comments

Accepted by EMNLP2025

R2 v1 2026-06-28T22:50:18.524Z