English
Related papers

Related papers: Towards Multimodal Emotional Support Conversation …

200 papers

In today's world, emotional support is increasingly essential, yet it remains challenging for both those seeking help and those offering it. Multimodal approaches to emotional support show great promise by integrating diverse data sources…

Multimodal signals, including text, audio, image, and video, can be integrated into Semantic Communication (SC) systems to provide an immersive experience with low latency and high quality at the semantic level. However, the multimodal SC…

Artificial Intelligence · Computer Science 2024-08-06 Feibo Jiang , Li Dong , Yubo Peng , Kezhi Wang , Kun Yang , Cunhua Pan , Xiaohu You

Emotions play a central role in human communication, shaping trust, engagement, and social interaction. As artificial intelligence systems powered by large language models become increasingly integrated into everyday life, enabling them to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Soumya Dutta

Emotional support is a crucial ability for many conversation scenarios, including social interactions, mental health support, and customer service chats. Following reasonable procedures and using various support skills can help to…

Computation and Language · Computer Science 2021-06-03 Siyang Liu , Chujie Zheng , Orianna Demasi , Sahand Sabour , Yu Li , Zhou Yu , Yong Jiang , Minlie Huang

Affective judgment in real interaction is rarely a purely local prediction problem. Emotional meaning often depends on prior trajectory, accumulated context, and multimodal evidence that may be weak, noisy, or incomplete at the current…

Artificial Intelligence · Computer Science 2026-03-25 Deliang Wen , Ke Sun , Yu Wang

Emotional Support Conversation (ESC) is a typical dialogue that can effectively assist the user in mitigating emotional pressures. However, owing to the inherent subjectivity involved in analyzing emotions, current non-artificial…

Computation and Language · Computer Science 2024-08-05 Huaiwen Zhang , Yu Chen , Ming Wang , Shi Feng

The increasing demand for mental health services has highlighted the need for innovative solutions, particularly in the realm of psychological conversational AI, where the availability of sensitive data is scarce. In this work, we explored…

Human-Computer Interaction · Computer Science 2024-12-31 Alessandro De Grandi , Federico Ravenda , Andrea Raballo , Fabio Crestani

Unlike empathetic dialogues, the system in emotional support conversations (ESC) is expected to not only convey empathy for comforting the help-seeker, but also proactively assist in exploring and addressing their problems during the…

Computation and Language · Computer Science 2023-05-18 Yang Deng , Wenxuan Zhang , Yifei Yuan , Wai Lam

While text-based emotion recognition methods have achieved notable success, real-world dialogue systems often demand a more nuanced emotional understanding than any single modality can offer. Multimodal Emotion Recognition in Conversations…

Computation and Language · Computer Science 2025-09-10 Chengyan Wu , Yiqiang Cai , Yang Liu , Pengxu Zhu , Yun Xue , Ziwei Gong , Julia Hirschberg , Bolei Ma

Emotion recognition in conversations is essential for ensuring advanced human-machine interactions. However, creating robust and accurate emotion recognition systems in real life is challenging, mainly due to the scarcity of emotion…

Computation and Language · Computer Science 2023-08-30 Théo Deschamps-Berger , Lori Lamel , Laurence Devillers

Providing Emotional Support (ES) to soothe people in emotional distress is an essential capability in social interactions. Most existing researches on building ES conversation systems only considered single-turn interactions with users,…

Computation and Language · Computer Science 2022-10-11 Yi Cheng , Wenge Liu , Wenjie Li , Jiashuo Wang , Ruihui Zhao , Bang Liu , Xiaodan Liang , Yefeng Zheng

Applying existing methods to emotional support conversation -- which provides valuable assistance to people who are in need -- has two major limitations: (a) they generally employ a conversation-level emotion label, which is too…

Computation and Language · Computer Science 2022-04-01 Quan Tu , Yanran Li , Jianwei Cui , Bin Wang , Ji-Rong Wen , Rui Yan

The integration of conversational agents into our daily lives has become increasingly common, yet many of these agents cannot engage in deep interactions with humans. Despite this, there is a noticeable shortage of datasets that capture…

Human-Computer Interaction · Computer Science 2025-03-19 Mohammed Althubyani , Zhijin Meng , Shengyuan Xie , Cha Seung , Imran Razzak , Eduardo B. Sandoval , Baki Kocaballi , Francisco Cruz

Automatic emotion recognition plays a key role in computer-human interaction as it has the potential to enrich the next-generation artificial intelligence with emotional intelligence. It finds applications in customer and/or representative…

Sound · Computer Science 2022-02-21 Sarala Padi , Seyed Omid Sadjadi , Dinesh Manocha , Ram D. Sriram

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

Analyzing individual emotions during group conversation is crucial in developing intelligent agents capable of natural human-machine interaction. While reliable emotion recognition techniques depend on different modalities (text, audio,…

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

A prevalent shortfall among current empathic AI systems is their inability to recognize when verbal expressions may not fully reflect underlying emotional states. This is because the existing datasets, used for the training of these…

Human-Computer Interaction · Computer Science 2025-09-09 Sharjeel Tahir , Judith Johnson , Jumana Abu-Khalaf , Syed Afaq Ali Shah

Young people's mental well-being is a global concern, with peer support playing a key role in daily emotional regulation. Conversational agents are increasingly viewed as promising tools for delivering accessible, personalised peer support,…

Human-Computer Interaction · Computer Science 2025-12-01 Ruoyu Wen , Xiaoli Wu , Kunal Gupta , Simon Hoermann , Mark Billinghurst , Alaeddin Nassani , Dwain Allan , Thammathip Piumsomboon
‹ Prev 1 2 3 10 Next ›