English
Related papers

Related papers: Detoxification for LLM: From Dataset Itself

200 papers

Text detoxification is a textual style transfer (TST) task where a text is paraphrased from a toxic surface form, e.g. featuring rude words, to the neutral register. Recently, text detoxification methods found their applications in various…

Computation and Language · Computer Science 2024-04-03 Daryna Dementieva , Nikolay Babakov , Alexander Panchenko

Transformer-based Language Models (LMs) have achieved impressive results on natural language understanding tasks, but they can also generate toxic text such as insults, threats, and profanity, limiting their real-world applications. To…

Computation and Language · Computer Science 2023-07-06 Jin Myung Kwak , Minseon Kim , Sung Ju Hwang

Large language models (LLMs) exhibit exceptional performance but pose inherent risks of generating toxic content, restricting their safe deployment. While traditional methods (e.g., alignment) adjust output preferences, they fail to…

Machine Learning · Computer Science 2026-01-13 Zenghao Duan , Zhiyi Yin , Zhichao Shi , Liang Pang , Shaoling Jing , Zihe Huang , Jiayi Wu , Yu Yan , Jingcheng Deng , Huawei Shen , Xueqi Cheng

Large Language Models (LLMs) have significantly advanced natural language processing (NLP) tasks but also pose ethical and societal risks due to their propensity to generate harmful content. Existing methods have limitations, including the…

Computation and Language · Computer Science 2025-05-22 Ximing Dong , Dayi Lin , Shaowei Wang , Ahmed E. Hassan

The opacity in developing large language models (LLMs) is raising growing concerns about the potential contamination of public benchmarks in the pre-training data. Existing contamination detection methods are typically based on the text…

Computation and Language · Computer Science 2024-10-31 Feng Yao , Yufan Zhuang , Zihao Sun , Sunan Xu , Animesh Kumar , Jingbo Shang

Existing approaches to multilingual text detoxification are hampered by the scarcity of parallel multilingual datasets. In this work, we introduce a pipeline for the generation of multilingual parallel detoxification data. We also introduce…

Computation and Language · Computer Science 2025-08-18 Daniil Moskovskiy , Nikita Sushko , Sergey Pletenev , Elena Tutubalina , Alexander Panchenko

Harmful and offensive communication or content is detrimental to social bonding and the mental state of users on social media platforms. Text detoxification is a crucial task in natural language processing (NLP), where the goal is removing…

Computation and Language · Computer Science 2024-04-05 Ali Pesaranghader , Nikhil Verma , Manasa Bharadwaj

The emerging success of large language models (LLMs) heavily relies on collecting abundant training data from external (untrusted) sources. Despite substantial efforts devoted to data cleaning and curation, well-constructed LLMs have been…

Computation and Language · Computer Science 2024-02-26 Tianlin Li , Qian Liu , Tianyu Pang , Chao Du , Qing Guo , Yang Liu , Min Lin

Large Language Models (LLMs) have demonstrated impressive performance across various tasks, yet they remain vulnerable to generating toxic content, necessitating detoxification strategies to ensure safe and responsible deployment. Test-time…

Computation and Language · Computer Science 2025-10-03 Yisong Xiao , Aishan Liu , Siyuan Liang , Zonghao Ying , Xianglong Liu , Dacheng Tao

Large language models (LLMs) trained on webscale data can produce toxic outputs, raising concerns for safe deployment. Prior defenses, based on applications of DPO, NPO, and similar algorithms, reduce the likelihood of harmful…

Large Language Models (LLMs) and Vision Language Models (VLMs) have recently shown promising capabilities in various scientific domain. In particular, these advances have opened new opportunities in drug discovery, where the ability to…

Artificial Intelligence · Computer Science 2026-05-13 Jueon Park , Wonjune Jang , Jiwoo Lee , Yein Park , Jaewoo Kang

The spread of toxic content online is an important problem that has adverse effects on user experience online and in our society at large. Motivated by the importance and impact of the problem, research focuses on developing solutions to…

Computation and Language · Computer Science 2023-08-11 Xinlei He , Savvas Zannettou , Yun Shen , Yang Zhang

Large language models (LLMs) are now ubiquitous in user-facing applications, yet they still generate undesirable toxic outputs, including profanity, vulgarity, and derogatory remarks. Although numerous detoxification methods exist, most…

Computation and Language · Computer Science 2025-10-24 Agam Goyal , Vedant Rathi , William Yeh , Yian Wang , Yuen Chen , Hari Sundaram

Toxic content detection is crucial for online services to remove inappropriate content that violates community standards. To automate the detection process, prior works have proposed varieties of machine learning (ML) approaches to train…

Computation and Language · Computer Science 2023-12-14 Jiang Zhang , Qiong Wu , Yiming Xu , Cheng Cao , Zheng Du , Konstantinos Psounis

Large language models pretrained on extensive web corpora demonstrate remarkable performance across a wide range of downstream tasks. However, a growing concern is data contamination, where evaluation datasets may be contained in the…

Computation and Language · Computer Science 2024-07-12 Medha Palavalli , Amanda Bertsch , Matthew R. Gormley

Large language models (LLMs) frequently generate toxic content, posing significant risks for safe deployment. Current mitigation strategies often degrade generation quality or require costly human annotation. We propose CAUSALDETOX, a…

Computation and Language · Computer Science 2026-04-17 Yian Wang , Yuen Chen , Agam Goyal , Hari Sundaram

Large language models can produce toxic or inappropriate text even for benign inputs, creating risks when deployed at scale. Detoxification is therefore important for safety and user trust, particularly when we want to reduce harmful…

Computation and Language · Computer Science 2026-02-04 Baturay Saglam , Dionysis Kalogerias

Detoxification is a task of generating text in polite style while preserving meaning and fluency of the original toxic text. Existing detoxification methods are designed to work in one exact language. This work investigates multilingual and…

Computation and Language · Computer Science 2022-06-07 Daniil Moskovskiy , Daryna Dementieva , Alexander Panchenko

We propose a constraint learning schema for fine-tuning Large Language Models (LLMs) with attribute control. Given a training corpus and control criteria formulated as a sequence-level constraint on model outputs, our method fine-tunes the…

Computation and Language · Computer Science 2024-10-10 Tao Meng , Ninareh Mehrabi , Palash Goyal , Anil Ramakrishna , Aram Galstyan , Richard Zemel , Kai-Wei Chang , Rahul Gupta , Charith Peris

Effective toxic content detection relies heavily on high-quality and diverse data, which serve as the foundation for robust content moderation models. Synthetic data has become a common approach for training models across various NLP tasks.…

Computation and Language · Computer Science 2025-02-25 Zheng Hui , Zhaoxiao Guo , Hang Zhao , Juanyong Duan , Lin Ai , Yinheng Li , Julia Hirschberg , Congrui Huang