English
Related papers

Related papers: MEDIC: A Multimodal Empathy Dataset in Counseling

200 papers

Emotions are one of the important components of the human being, thus they are a valuable part of daily activities such as interaction with people, decision making and learning. For this reason, it is important to detect, recognize and…

Human-Computer Interaction · Computer Science 2025-12-30 Ricardo Vasquez , Diego Riofrío-Luzcando , Joe Carrion-Jumbo , Cesar Guevara

Empathetic dialogue is a human-like behavior that requires the perception of both affective factors (e.g., emotion status) and cognitive factors (e.g., cause of the emotion). Besides concerning emotion status in early work, the latest…

Computation and Language · Computer Science 2023-02-24 Yushan Qian , Bo Wang , Ting-En Lin , Yinhe Zheng , Ying Zhu , Dongming Zhao , Yuexian Hou , Yuchuan Wu , Yongbin Li

Visual Emotion Analysis (VEA) aims at predicting people's emotional responses to visual stimuli. This is a promising, yet challenging, task in affective computing, which has drawn increasing attention in recent years. Most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Jingyuan Yang , Qirui Huang , Tingting Ding , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Videoconferencing is now a frequent mode of communication in both professional and informal settings, yet it often lacks the fluidity and enjoyment of in-person conversation. This study leverages multimodal machine learning to predict…

Machine Learning · Computer Science 2025-03-11 Andrew Chang , Viswadruth Akkaraju , Ray McFadden Cogliano , David Poeppel , Dustin Freeman

People interacting with voice assistants are often frustrated by voice assistants' frequent errors and inability to respond to backchannel cues. We introduce an open-source video dataset of 21 participants' interactions with a voice…

Human-Computer Interaction · Computer Science 2021-04-16 Andrea Cuadra , Hansol Lee , Jason Cho , Wendy Ju

Counseling is carried out as spoken conversation between a therapist and a client. The empathy level expressed by the therapist is considered an important index of the quality of counseling and often assessed by an observer or the client.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-24 Dehua Tao , Tan Lee , Harold Chui , Sarah Luk

This paper presents our approach for the WASSA 2023 Empathy, Emotion and Personality Shared Task. Empathy and distress are human feelings that are implicitly expressed in natural discourses. Empathy and distress detection are crucial…

Computation and Language · Computer Science 2023-12-06 Tanmay Chavan , Kshitij Deshpande , Sheetal Sonawane

Prior efforts to create an autonomous computer system capable of predicting what a human being is thinking or feeling from facial expression data have been largely based on outdated, inaccurate models of how emotions work that rely on many…

Artificial Intelligence · Computer Science 2018-08-06 Trevor Buteau , Damian Lyons

A prevalent shortfall among current empathic AI systems is their inability to recognize when verbal expressions may not fully reflect underlying emotional states. This is because the existing datasets, used for the training of these…

Human-Computer Interaction · Computer Science 2025-09-09 Sharjeel Tahir , Judith Johnson , Jumana Abu-Khalaf , Syed Afaq Ali Shah

Related tasks often have inter-dependence on each other and perform better when solved in a joint framework. In this paper, we present a deep multi-task learning framework that jointly performs sentiment and emotion analysis both. The…

Computation and Language · Computer Science 2019-05-16 Md Shad Akhtar , Dushyant Singh Chauhan , Deepanway Ghosal , Soujanya Poria , Asif Ekbal , Pushpak Bhattacharyya

Empathy is an important characteristic to be considered when building a more intelligent and humanized dialogue agent. However, existing methods did not fully comprehend empathy as a complex process involving three aspects: cognition,…

Computation and Language · Computer Science 2023-02-23 Pan Gao , Donghong Han , Rui Zhou , Xuejiao Zhang , Zikun Wang

A central challenge in affective computing is determining appropriate empathy levels for different interaction contexts. Prior work has characterized two poles: task-focused interactions, where empathy demand is near zero, and emotional…

Human-Computer Interaction · Computer Science 2026-05-29 Tao Wang , Chi-Ching Juan

Feeling emotion is a critical characteristic to distinguish people from machines. Among all the multi-modal resources for emotion detection, textual datasets are those containing the least additional information in addition to semantics,…

Computation and Language · Computer Science 2018-05-31 Sheng-Yeh Chen , Chao-Chun Hsu , Chuan-Chun Kuo , Ting-Hao , Huang , Lun-Wei Ku

The most meaningful connections between people are often fostered through expression of shared vulnerability and emotional experiences in personal narratives. We introduce a new task of identifying similarity in personal stories based on…

Computation and Language · Computer Science 2023-12-07 Jocelyn Shen , Maarten Sap , Pedro Colon-Hernandez , Hae Won Park , Cynthia Breazeal

Automatic emotion recognition is a challenging task. In this paper, we present our effort for the audio-video based sub-challenge of the Emotion Recognition in the Wild (EmotiW) 2018 challenge, which requires participants to assign a single…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Zheng Lian , Ya Li , Jianhua Tao , Jian Huang

Physiological signals hold immense potential for ubiquitous emotion monitoring, presenting numerous applications in emotion recognition. However, harnessing this potential is hindered by significant challenges, particularly in the…

Human-Computer Interaction · Computer Science 2025-03-30 Pragya Singh , Ritvik Budhiraja , Pankaj Jalote , Mohan Kumar , Pushpendra Singh

Emotions recognition is commonly employed for health assessment. However, the typical metric for evaluation in therapy is based on patient-doctor appraisal. This process can fall into the issue of subjectivity, while also requiring…

Human-Computer Interaction · Computer Science 2021-01-21 Jumana Almahmoud , Kruthika Kikkeri

Stickers, while widely recognized for enhancing empathetic communication in online interactions, remain underexplored in current empathetic dialogue research, notably due to the challenge of a lack of comprehensive datasets. In this paper,…

Computation and Language · Computer Science 2024-12-20 Yiqun Zhang , Fanheng Kong , Peidong Wang , Shuang Sun , Lingshuai Wang , Shi Feng , Daling Wang , Yifei Zhang , Kaisong Song

The integration of conversational artificial intelligence (AI) into mental health care promises a new horizon for therapist-client interactions, aiming to closely emulate the depth and nuance of human conversations. Despite the potential,…

Multimedia · Computer Science 2024-10-22 Yuqi Chu , Lizi Liao , Zhiyuan Zhou , Chong-Wah Ngo , Richang Hong

Recent advances in neurosciences and psychology have provided evidence that affective phenomena pervade intelligence at many levels, being inseparable from the cognitionaction loop. Perception, attention, memory, learning, decisionmaking,…

Artificial Intelligence · Computer Science 2008-09-30 Luis Paulo Reis , Daria Barteneva , Nuno Lau