English

DSCD: Large Language Model Detoxification with Self-Constrained Decoding

Computation and Language 2025-10-16 v1

Abstract

Detoxification in large language models (LLMs) remains a significant research challenge. Existing decoding detoxification methods are all based on external constraints, which require additional resource overhead and lose generation fluency. This work proposes Detoxification with Self-Constrained Decoding (DSCD), a novel method for LLM detoxification without parameter fine-tuning. DSCD strengthens the inner next-token distribution of the safety layer while weakening that of hallucination and toxic layers during output generation. This effectively diminishes toxicity and enhances output safety. DSCD offers lightweight, high compatibility, and plug-and-play capabilities, readily integrating with existing detoxification methods for further performance improvement. Extensive experiments on representative open-source LLMs and public datasets validate DSCD's effectiveness, demonstrating state-of-the-art (SOTA) performance in both detoxification and generation fluency, with superior efficiency compared to existing methods. These results highlight DSCD's potential as a practical and scalable solution for safer LLM deployments.

Keywords

Cite

@article{arxiv.2510.13183,
  title  = {DSCD: Large Language Model Detoxification with Self-Constrained Decoding},
  author = {Ming Dong and Jinkui Zhang and Bolong Zheng and Xinhui Tu and Po Hu and Tingting He},
  journal= {arXiv preprint arXiv:2510.13183},
  year   = {2025}
}

Comments

Accepted at EMNLP 2025 MainConference

R2 v1 2026-07-01T06:38:12.204Z