English
Related papers

Related papers: Mitigating Toxic Degeneration with Empathetic Data…

200 papers

Enabling empathetic behavior in Arabic dialogue agents is an important aspect of building human-like conversational models. While Arabic Natural Language Processing has seen significant advances in Natural Language Understanding (NLU) with…

Computation and Language · Computer Science 2021-03-09 Tarek Naous , Wissam Antoun , Reem A. Mahmoud , Hazem Hajj

The widespread dissemination of toxic content on social media poses a serious threat to both online environments and public discourse, highlighting the urgent need for detoxification methods that effectively remove toxicity while preserving…

Machine Learning · Computer Science 2025-07-08 Jing Yu , Yibo Zhao , Jiapeng Zhu , Wenming Shao , Bo Pang , Zhao Zhang , Xiang Li

Empathetic response generation aims to comprehend the user emotion and then respond to it appropriately. Most existing works merely focus on what the emotion is and ignore how the emotion is evoked, thus weakening the capacity of the model…

Computation and Language · Computer Science 2021-10-12 Jiashuo Wang , Wenjie LI , Peiqin Lin , Feiteng Mu

This paper investigates the empathetic responding capabilities of ChatGPT, particularly its latest iteration, GPT-4, in comparison to human-generated responses to a wide range of emotional scenarios, both positive and negative. We employ a…

Human-Computer Interaction · Computer Science 2024-03-12 Anuradha Welivita , Pearl Pu

Language is a form of symbolic capital that affects people's lives in many ways (Bourdieu1977,1991). As a powerful means of communication, it reflects identities, cultures, traditions, and societies more broadly. Therefore, data in a given…

Computation and Language · Computer Science 2025-06-02 Nedjma Ousidhoum , Meriem Beloucif , Saif M. Mohammad

Empathy plays a pivotal role in fostering prosocial behavior, often triggered by the sharing of personal experiences through narratives. However, modeling empathy using NLP approaches remains challenging due to its deep interconnection with…

Computation and Language · Computer Science 2024-11-01 Muhammad Arslan Manzoor , Yuxia Wang , Minghan Wang , Preslav Nakov

Textual data used to train large language models (LLMs) exhibits multifaceted bias manifestations encompassing harmful language and skewed demographic distributions. Regulations such as the European AI Act require identifying and mitigating…

NLP models are shown to suffer from robustness issues, i.e., a model's prediction can be easily changed under small perturbations to the input. In this work, we present a Controlled Adversarial Text Generation (CAT-Gen) model that, given an…

Computation and Language · Computer Science 2020-10-07 Tianlu Wang , Xuezhi Wang , Yao Qin , Ben Packer , Kang Li , Jilin Chen , Alex Beutel , Ed Chi

With generative AI advancing, empathy in human-AI interaction is essential. While prior work focuses on emotional reflection, emotional exploration, key to deeper engagement, remains overlooked. Existing LLMs rely on text which captures…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-12 Jing-Han Chen , Bo-Hao Su , Ya-Tse Wu , Chi-Chun Lee

Empathetic response from the therapist is key to the success of clinical psychotherapy, especially motivational interviewing. Previous work on computational modelling of empathy in motivational interviewing has focused on offline,…

Computation and Language · Computer Science 2021-05-21 Zixiu Wu , Rim Helaoui , Vivek Kumar , Diego Reforgiato Recupero , Daniele Riboni

Understanding toxicity in user conversations is undoubtedly an important problem. Addressing "covert" or implicit cases of toxicity is particularly hard and requires context. Very few previous studies have analysed the influence of…

Computation and Language · Computer Science 2022-10-19 Atijit Anuchitanukul , Julia Ive , Lucia Specia

In Biomedical Natural Language Processing (BioNLP) tasks, such as Relation Extraction, Named Entity Recognition, and Text Classification, the scarcity of high-quality data remains a significant challenge. This limitation poisons large…

Computation and Language · Computer Science 2025-04-01 Zhengyi Zhao , Shubo Zhang , Bin Liang , Binyang Li , Kam-Fai Wong

Pretraining is the preliminary and fundamental step in developing capable language models (LM). Despite this, pretraining data design is critically under-documented and often guided by empirically unsupported intuitions. To address this, we…

Empathy is a complex cognitive ability based on the reasoning of others' affective states. In order to better understand others and express stronger empathy in dialogues, we argue that two issues must be tackled at the same time: (i)…

Computation and Language · Computer Science 2021-09-22 Hyunwoo Kim , Byeongchang Kim , Gunhee Kim

We explore the representational space of emotions by combining methods from different academic fields. Cognitive science has proposed appraisal theory as a view on human emotion with previous research showing how human-rated abstract event…

Computation and Language · Computer Science 2017-10-24 Andres Campero , Bjarke Felbo , Joshua B. Tenenbaum , Rebecca Saxe

Large Language Models (LLMs) trained on web-scale corpora inherently absorb toxic patterns from their training data. This leads to toxic degeneration where even innocuous prompts can trigger harmful outputs. This phenomenon poses…

Computation and Language · Computer Science 2026-05-18 Mokshit Surana , Archit Rathod , Akshaj Satishkumar

Toxicity is a prevalent social behavior that involves the use of hate speech, offensive language, bullying, and abusive speech. While text-based approaches for toxicity detection are common, there is limited research on processing speech…

Sound · Computer Science 2023-04-25 Ahlam Husni Abu Nada , Siddique Latif , Junaid Qadir

Automatic detection of depression is a rapidly growing field of research at the intersection of psychology and machine learning. However, with its exponential interest comes a growing concern for data privacy and scarcity due to the…

Machine Learning · Computer Science 2024-11-27 Andrea Kang , Jun Yu Chen , Zoe Lee-Youngzie , Shuhao Fu

Despite the excellent performance of black box approaches to modeling sentiment and emotion, lexica (sets of informative words and associated weights) that characterize different emotions are indispensable to the NLP community because they…

Computation and Language · Computer Science 2020-05-19 João Sedoc , Sven Buechel , Yehonathan Nachmany , Anneke Buffone , Lyle Ungar

A good empathetic dialogue system should first track and understand a user's emotion and then reply with an appropriate emotion. However, current approaches to this task either focus on improving the understanding of users' emotion or on…

Computation and Language · Computer Science 2022-08-04 Yuhan Liu , Jun Gao , Jiachen Du , Lanjun Zhou , Ruifeng Xu