English
Related papers

Related papers: Detoxification of Large Language Models through Ou…

200 papers

Language model detoxification aims to minimize the risk of generating offensive or harmful content in pretrained language models (PLMs) for safer deployment. Existing methods can be roughly categorized as finetuning-based and…

Computation and Language · Computer Science 2023-10-17 Chak Tou Leong , Yi Cheng , Jiashuo Wang , Jian Wang , Wenjie Li

Recent breakthroughs in Large Language Models (LLMs) have revealed remarkable generative capabilities and emerging self-regulatory mechanisms, including self-correction and self-rewarding. However, current detoxification techniques rarely…

Computation and Language · Computer Science 2026-01-21 Kaituo Zhang , Zhimeng Jiang , Na Zou

This paper investigates using knowledge editing techniques to detoxify Large Language Models (LLMs). We construct a benchmark, SafeEdit, which covers nine unsafe categories with various powerful attack prompts and equips comprehensive…

Computation and Language · Computer Science 2024-05-29 Mengru Wang , Ningyu Zhang , Ziwen Xu , Zekun Xi , Shumin Deng , Yunzhi Yao , Qishen Zhang , Linyi Yang , Jindong Wang , Huajun Chen

Large Language Models (LLMs) have demonstrated great potential as generalist assistants, showcasing powerful task understanding and problem-solving capabilities. To deploy LLMs as AI assistants, it is crucial that these models exhibit…

Artificial Intelligence · Computer Science 2025-02-12 Huanqian Wang , Yang Yue , Rui Lu , Jingxin Shi , Andrew Zhao , Shenzhi Wang , Shiji Song , Gao Huang

The emerging success of large language models (LLMs) heavily relies on collecting abundant training data from external (untrusted) sources. Despite substantial efforts devoted to data cleaning and curation, well-constructed LLMs have been…

Computation and Language · Computer Science 2024-02-26 Tianlin Li , Qian Liu , Tianyu Pang , Chao Du , Qing Guo , Yang Liu , Min Lin

Large language models (LLMs) exhibit impressive language capabilities but remain vulnerable to malicious prompts and jailbreaking attacks. Existing knowledge editing methods for LLM detoxification face two major challenges. First, they…

Computation and Language · Computer Science 2025-05-29 Yifan Lu , Jing Li , Yigeng Zhou , Yihui Zhang , Wenya Wang , Xiucheng Li , Meishan Zhang , Fangming Liu , Jun Yu , Min Zhang

Existing detoxification methods for large language models mainly focus on post-training stage or inference time, while few tackle the source of toxicity, namely, the dataset itself. Such training-based or controllable decoding approaches…

Computation and Language · Computer Science 2026-04-22 Wei Shao , Yihang Wang , Gaoyu Zhu , Ziqiang Cheng , Lei Yu , Jiafeng Guo , Xueqi Cheng

Pre-trained language models (LMs) are shown to easily generate toxic language. In this work, we systematically explore domain-adaptive training to reduce the toxicity of language models. We conduct this study on three dimensions: training…

Computation and Language · Computer Science 2022-10-25 Boxin Wang , Wei Ping , Chaowei Xiao , Peng Xu , Mostofa Patwary , Mohammad Shoeybi , Bo Li , Anima Anandkumar , Bryan Catanzaro

Language models (LMs) can reproduce (or amplify) toxic language seen during training, which poses a risk to their practical application. In this paper, we conduct extensive experiments to study this phenomenon. We analyze the impact of…

Computation and Language · Computer Science 2022-03-08 Canwen Xu , Zexue He , Zhankui He , Julian McAuley

With adversarial or otherwise normal prompts, existing large language models (LLM) can be pushed to generate toxic discourses. One way to reduce the risk of LLMs generating undesired discourses is to alter the training of the LLM. This can…

Computation and Language · Computer Science 2023-02-28 Meng Cao , Mehdi Fatemi , Jackie Chi Kit Cheung , Samira Shabanian

Transformer-based Language Models (LMs) have achieved impressive results on natural language understanding tasks, but they can also generate toxic text such as insults, threats, and profanity, limiting their real-world applications. To…

Computation and Language · Computer Science 2023-07-06 Jin Myung Kwak , Minseon Kim , Sung Ju Hwang

Text detoxification aims to minimize the risk of language models producing toxic content. Existing detoxification methods of directly constraining the model output or further training the model on the non-toxic corpus fail to achieve a…

Computation and Language · Computer Science 2024-10-14 Zecheng Tang , Keyan Zhou , Juntao Li , Yuyang Ding , Pinzheng Wang , Bowen Yan , Rejie Hua , Min Zhang

Detoxification in large language models (LLMs) remains a significant research challenge. Existing decoding detoxification methods are all based on external constraints, which require additional resource overhead and lose generation fluency.…

Computation and Language · Computer Science 2025-10-16 Ming Dong , Jinkui Zhang , Bolong Zheng , Xinhui Tu , Po Hu , Tingting He

Detoxification is a task of generating text in polite style while preserving meaning and fluency of the original toxic text. Existing detoxification methods are designed to work in one exact language. This work investigates multilingual and…

Computation and Language · Computer Science 2022-06-07 Daniil Moskovskiy , Daryna Dementieva , Alexander Panchenko

The widespread dissemination of toxic content on social media poses a serious threat to both online environments and public discourse, highlighting the urgent need for detoxification methods that effectively remove toxicity while preserving…

Machine Learning · Computer Science 2025-07-08 Jing Yu , Yibo Zhao , Jiapeng Zhu , Wenming Shao , Bo Pang , Zhao Zhang , Xiang Li

We present UniDetox, a universally applicable method designed to mitigate toxicity across various large language models (LLMs). Previous detoxification methods are typically model-specific, addressing only individual models or model…

Computation and Language · Computer Science 2025-04-30 Huimin Lu , Masaru Isonuma , Junichiro Mori , Ichiro Sakata

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of safety is imperative for deploying LMs in the real world; to…

We propose a constraint learning schema for fine-tuning Large Language Models (LLMs) with attribute control. Given a training corpus and control criteria formulated as a sequence-level constraint on model outputs, our method fine-tunes the…

Computation and Language · Computer Science 2024-10-10 Tao Meng , Ninareh Mehrabi , Palash Goyal , Anil Ramakrishna , Aram Galstyan , Richard Zemel , Kai-Wei Chang , Rahul Gupta , Charith Peris

Transformer-based language models are able to generate fluent text and be efficiently adapted across various natural language generation tasks. However, language models that are pretrained on large unlabeled web text corpora have been shown…

Computation and Language · Computer Science 2022-07-28 Farshid Faal , Ketra Schmitt , Jia Yuan Yu

Modern Large Language Models (LLMs) are excellent at generating synthetic data. However, their performance in sensitive domains such as text detoxification has not received proper attention from the scientific community. This paper explores…

Computation and Language · Computer Science 2025-09-11 Sergey Pletenev , Daniil Moskovskiy , Alexander Panchenko
‹ Prev 1 2 3 10 Next ›