English
Related papers

Related papers: Self-Detoxifying Language Models via Toxification …

200 papers

Language models (LMs) can reproduce (or amplify) toxic language seen during training, which poses a risk to their practical application. In this paper, we conduct extensive experiments to study this phenomenon. We analyze the impact of…

Computation and Language · Computer Science 2022-03-08 Canwen Xu , Zexue He , Zhankui He , Julian McAuley

Existing approaches for Large language model (LLM) detoxification generally rely on training on large-scale non-toxic or human-annotated preference data, designing prompts to instruct the LLM to generate safe content, or modifying the model…

Computation and Language · Computer Science 2025-06-03 Yuanhe Tian , Mingjie Deng , Guoqing Jin , Yan Song

Recent breakthroughs in Large Language Models (LLMs) have revealed remarkable generative capabilities and emerging self-regulatory mechanisms, including self-correction and self-rewarding. However, current detoxification techniques rarely…

Computation and Language · Computer Science 2026-01-21 Kaituo Zhang , Zhimeng Jiang , Na Zou

Due to language models' propensity to generate toxic or hateful responses, several techniques were developed to align model generations with users' preferences. Despite the effectiveness of such methods in improving the safety of model…

Computation and Language · Computer Science 2023-09-06 Daniel Scalena , Gabriele Sarti , Malvina Nissim , Elisabetta Fersini

Transformer-based language models are able to generate fluent text and be efficiently adapted across various natural language generation tasks. However, language models that are pretrained on large unlabeled web text corpora have been shown…

Computation and Language · Computer Science 2022-07-28 Farshid Faal , Ketra Schmitt , Jia Yuan Yu

Transformer-based Language Models (LMs) have achieved impressive results on natural language understanding tasks, but they can also generate toxic text such as insults, threats, and profanity, limiting their real-world applications. To…

Computation and Language · Computer Science 2023-07-06 Jin Myung Kwak , Minseon Kim , Sung Ju Hwang

To reduce the toxic degeneration in a pretrained Language Model (LM), previous work on Language Model detoxification has focused on reducing the toxicity of the generation itself (self-toxicity) without consideration of the context. As a…

Computation and Language · Computer Science 2023-01-26 Jing Qian , Xifeng Yan

With adversarial or otherwise normal prompts, existing large language models (LLM) can be pushed to generate toxic discourses. One way to reduce the risk of LLMs generating undesired discourses is to alter the training of the LLM. This can…

Computation and Language · Computer Science 2023-02-28 Meng Cao , Mehdi Fatemi , Jackie Chi Kit Cheung , Samira Shabanian

The generation of toxic content by large language models (LLMs) remains a critical challenge for the safe deployment of language technology. We propose a novel framework for implicit knowledge editing and controlled text generation by…

Computation and Language · Computer Science 2025-06-02 Tassilo Klein , Moin Nabi

Text detoxification aims to minimize the risk of language models producing toxic content. Existing detoxification methods of directly constraining the model output or further training the model on the non-toxic corpus fail to achieve a…

Computation and Language · Computer Science 2024-10-14 Zecheng Tang , Keyan Zhou , Juntao Li , Yuyang Ding , Pinzheng Wang , Bowen Yan , Rejie Hua , Min Zhang

Detoxification is a task of generating text in polite style while preserving meaning and fluency of the original toxic text. Existing detoxification methods are designed to work in one exact language. This work investigates multilingual and…

Computation and Language · Computer Science 2022-06-07 Daniil Moskovskiy , Daryna Dementieva , Alexander Panchenko

Pretrained neural language models (LMs) are prone to generating racist, sexist, or otherwise toxic language which hinders their safe deployment. We investigate the extent to which pretrained LMs can be prompted to generate toxic language,…

Computation and Language · Computer Science 2020-09-29 Samuel Gehman , Suchin Gururangan , Maarten Sap , Yejin Choi , Noah A. Smith

Reducing the likelihood of generating harmful and toxic output is an essential task when aligning large language models (LLMs). Existing methods mainly rely on training an external reward model (i.e., another language model) or fine-tuning…

Language models (LMs) must be both safe and equitable to be responsibly deployed in practice. With safety in mind, numerous detoxification techniques (e.g., Dathathri et al. 2020; Krause et al. 2020) have been proposed to mitigate toxic LM…

Computation and Language · Computer Science 2021-04-14 Albert Xu , Eshaan Pathak , Eric Wallace , Suchin Gururangan , Maarten Sap , Dan Klein

Intrinsic self-correction refers to the phenomenon where a language model refines its own outputs purely through prompting, without external feedback or parameter updates. While this approach improves performance across diverse tasks, its…

Computation and Language · Computer Science 2026-02-12 Yu-Ting Lee , Fu-Chieh Chang , Yu-En Shu , Hui-Ying Shih , Pei-Yuan Wu

Large language models (LLMs) exhibit impressive language capabilities but remain vulnerable to malicious prompts and jailbreaking attacks. Existing knowledge editing methods for LLM detoxification face two major challenges. First, they…

Computation and Language · Computer Science 2025-05-29 Yifan Lu , Jing Li , Yigeng Zhou , Yihui Zhang , Wenya Wang , Xiucheng Li , Meishan Zhang , Fangming Liu , Jun Yu , Min Zhang

Existing detoxification methods for large language models mainly focus on post-training stage or inference time, while few tackle the source of toxicity, namely, the dataset itself. Such training-based or controllable decoding approaches…

Computation and Language · Computer Science 2026-04-22 Wei Shao , Yihang Wang , Gaoyu Zhu , Ziqiang Cheng , Lei Yu , Jiafeng Guo , Xueqi Cheng

Despite the remarkable achievements of language models (LMs) across a broad spectrum of tasks, their propensity for generating toxic outputs remains a prevalent concern. Current solutions involving finetuning or auxiliary models usually…

Computation and Language · Computer Science 2024-08-13 Yu Li , Han Jiang , Chuanyang Gong , Zhihua Wei

Discriminative pre-trained language models (PLMs) learn to predict original texts from intentionally corrupted ones. Taking the former text as positive and the latter as negative samples, the PLM can be trained effectively for…

Computation and Language · Computer Science 2022-12-02 Zhuosheng Zhang , Hai Zhao , Masao Utiyama , Eiichiro Sumita

Detoxification in large language models (LLMs) remains a significant research challenge. Existing decoding detoxification methods are all based on external constraints, which require additional resource overhead and lose generation fluency.…

Computation and Language · Computer Science 2025-10-16 Ming Dong , Jinkui Zhang , Bolong Zheng , Xinhui Tu , Po Hu , Tingting He
‹ Prev 1 2 3 10 Next ›