English
Related papers

Related papers: K/DA: Automated Data Generation Pipeline for Detox…

200 papers

Counterfactual data augmentation (CDA) is a method for controlling information or biases in training datasets by generating a complementary dataset with typically opposing biases. Prior work often either relies on hand-crafted rules or…

Machine Learning · Computer Science 2025-02-26 Mitchell Plyler , Min Chi

In recent years, creating and managing knowledge bases have become crucial to the retail product and enterprise domains. We present an automatic knowledge base construction system that mines data from documents. This system can generate…

Computation and Language · Computer Science 2022-07-18 Minsang Kim , Sang-hyun Je , Eunjoo Park

Query auto-completion (QAC) plays a crucial role in modern search systems. However, in real-world applications, there are two pressing challenges that still need to be addressed. First, there is a need for hierarchical personalized…

Computation and Language · Computer Science 2025-05-28 Zhibo Wang , Xiaoze Jiang , Zhiheng Qin , Enyun Yu , Han Li

Text detoxification is a textual style transfer (TST) task where a text is paraphrased from a toxic surface form, e.g. featuring rude words, to the neutral register. Recently, text detoxification methods found their applications in various…

Computation and Language · Computer Science 2024-04-03 Daryna Dementieva , Nikolay Babakov , Alexander Panchenko

Recent advancements in open-domain dialogue systems have been propelled by the emergence of high-quality large language models (LLMs) and various effective training methodologies. Nevertheless, the presence of toxicity within these models…

Computation and Language · Computer Science 2024-05-22 San Kim , Gary Geunbae Lee

Detoxification is a task of generating text in polite style while preserving meaning and fluency of the original toxic text. Existing detoxification methods are designed to work in one exact language. This work investigates multilingual and…

Computation and Language · Computer Science 2022-06-07 Daniil Moskovskiy , Daryna Dementieva , Alexander Panchenko

Due to language models' propensity to generate toxic or hateful responses, several techniques were developed to align model generations with users' preferences. Despite the effectiveness of such methods in improving the safety of model…

Computation and Language · Computer Science 2023-09-06 Daniel Scalena , Gabriele Sarti , Malvina Nissim , Elisabetta Fersini

Despite the evolution of language models, they continue to portray harmful societal biases and stereotypes inadvertently learned from training data. These inherent biases often result in detrimental effects in various applications.…

Computation and Language · Computer Science 2024-07-24 Ewoenam Kwaku Tokpo , Toon Calders

Adversarial purification using generative models demonstrates strong adversarial defense performance. These methods are classifier and attack-agnostic, making them versatile but often computationally intensive. Recent strides in diffusion…

Machine Learning · Computer Science 2026-04-10 Himanshu Singh , A V Subramanyam

Online hate speech detection has become an important issue due to the growth of online content, but resources in languages other than English are extremely limited. We introduce K-MHaS, a new multi-label dataset for hate speech detection…

Computation and Language · Computer Science 2022-10-03 Jean Lee , Taejun Lim , Heejun Lee , Bogeun Jo , Yangsok Kim , Heegeun Yoon , Soyeon Caren Han

Warning: this paper contains model outputs exhibiting offensiveness and biases. Recently pre-trained language models (PLMs) have prospered in various natural language generation (NLG) tasks due to their ability to generate fairly fluent…

Computation and Language · Computer Science 2023-06-05 Zonghan Yang , Xiaoyuan Yi , Peng Li , Yang Liu , Xing Xie

The widespread dissemination of toxic content on social media poses a serious threat to both online environments and public discourse, highlighting the urgent need for detoxification methods that effectively remove toxicity while preserving…

Machine Learning · Computer Science 2025-07-08 Jing Yu , Yibo Zhao , Jiapeng Zhu , Wenming Shao , Bo Pang , Zhao Zhang , Xiang Li

QA models based on pretrained language mod-els have achieved remarkable performance on various benchmark datasets.However, QA models do not generalize well to unseen data that falls outside the training distribution, due to distributional…

Computation and Language · Computer Science 2021-06-25 Seanie Lee , Minki Kang , Juho Lee , Sung Ju Hwang

Despite the remarkable achievements of language models (LMs) across a broad spectrum of tasks, their propensity for generating toxic outputs remains a prevalent concern. Current solutions involving finetuning or auxiliary models usually…

Computation and Language · Computer Science 2024-08-13 Yu Li , Han Jiang , Chuanyang Gong , Zhihua Wei

The adaptation of Large-Scale Language Models (LLMs) to specific domains depends on high-quality fine-tuning datasets, particularly in instructional format (e.g., Question-Answer - Q&A). However, generating these datasets, particularly from…

Machine Learning · Computer Science 2026-01-22 Alex Echeverria , Sávio Salvarino Teles de Oliveira , Fernando Marques Federson

Large pre-trained language models are often trained on large volumes of internet data, some of which may contain toxic or abusive language. Consequently, language models encode toxic information, which makes the real-world usage of these…

Computation and Language · Computer Science 2021-12-16 Andrew Wang , Mohit Sudhakar , Yangfeng Ji

The increasing demand for mental health services has led to the rise of AI-driven mental health chatbots, though challenges related to privacy, data collection, and expertise persist. Motivational Interviewing (MI) is gaining attention as a…

Computation and Language · Computer Science 2025-07-01 Hyunjong Kim , Suyeon Lee , Yeongjae Cho , Eunseo Ryu , Yohan Jo , Suran Seong , Sungzoon Cho

Counterfactual Data Augmentation (CDA) has been one of the preferred techniques for mitigating gender bias in natural language models. CDA techniques have mostly employed word substitution based on dictionaries. Although such…

Computation and Language · Computer Science 2023-11-07 Ewoenam Kwaku Tokpo , Toon Calders

Language models (LMs) can reproduce (or amplify) toxic language seen during training, which poses a risk to their practical application. In this paper, we conduct extensive experiments to study this phenomenon. We analyze the impact of…

Computation and Language · Computer Science 2022-03-08 Canwen Xu , Zexue He , Zhankui He , Julian McAuley

The proliferation of hate speech and offensive comments on social media has become increasingly prevalent due to user activities. Such comments can have detrimental effects on individuals' psychological well-being and social behavior. While…