English
Related papers

Related papers: MISC: A MIxed Strategy-Aware Model Integrating COM…

200 papers

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

Multimedia · Computer Science 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu

Achieving empathy is a crucial step toward humanized dialogue systems. Current approaches for empathetic dialogue generation mainly perceive an emotional label to generate an empathetic response conditioned on it, which simply treat…

Computation and Language · Computer Science 2023-11-28 Fengyi Fu , Lei Zhang , Quan Wang , Zhendong Mao

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

Incomplete multi-modal emotion recognition (IMER) aims at understanding human intentions and sentiments by comprehensively exploring the partially observed multi-source data. Although the multi-modal data is expected to provide more…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Wen-Jue He , Xiaofeng Zhu , Zheng Zhang

Multimodal empathetic response generation (MERG) aims to generate emotionally engaging and empathetic responses based on users' multimodal contexts. Existing approaches usually rely on an implicit one-pass generation paradigm from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Liping Wang , Cheng Ye , Weidong Chen , Peipei Song , Bo Hu , Zhendong Mao

The 1st edition of the workshop on Mixed-Initiative ConveRsatiOnal Systems (MICROS@ECIR2021) aims at investigating and collecting novel ideas and contributions in the field of conversational systems. Oftentimes, the users fulfill their…

Information Retrieval · Computer Science 2021-01-26 Ida Mele , Cristina Ioana Muntean , Mohammad Aliannejadi , Nikos Voskarides

In most multiagent applications, communication is essential among agents to coordinate their actions, and thus achieve their goal. However, communication often has a related cost that affects overall system performance. In this paper, we…

Multiagent Systems · Computer Science 2021-07-13 Abeer Alshehri , Tim Miller , Liz Sonenberg

Many studies on dialog emotion analysis focus on utterance-level emotion only. These models hence are not optimized for dialog-level emotion detection, i.e. to predict the emotion category of a dialog as a whole. More importantly, these…

Computation and Language · Computer Science 2022-03-24 Yequan Wang , Xuying Meng , Yiyi Liu , Aixin Sun , Yao Wang , Yinhe Zheng , Minlie Huang

Multimodal Emotion Recognition in Conversation (ERC) plays an influential role in the field of human-computer interaction and conversational robotics since it can motivate machines to provide empathetic services. Multimodal data modeling is…

Multimedia · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

This article presents the Cogni-CISMeF project, which aims at improving the health information search engine CISMeF, by including a conversational agent that interacts with the user in natural language. To study the cognitive processes…

Human-Computer Interaction · Computer Science 2009-12-01 Alain Loisel , Nathalie Chaignaud , Jean-Philippe Kotowicz

Information seeking conversations between users and Conversational Search Agents (CSAs) consist of multiple turns of interaction. While users initiate a search session, ideally a CSA should sometimes take the lead in the conversation by…

Information Retrieval · Computer Science 2021-09-14 Mohammad Aliannejadi , Leif Azzopardi , Hamed Zamani , Evangelos Kanoulas , Paul Thomas , Nick Craswel

As emotional support chatbots have recently gained significant traction across both research and industry, a common evaluation strategy has emerged: use help-seeker simulators to interact with supporter chatbots. However, current simulators…

Computation and Language · Computer Science 2026-04-28 Chaewon Heo , Cheyon Jin , Yohan Jo

For modern recommender systems, the use of low-dimensional latent representations to embed users and items based on their observed interactions has become commonplace. However, many existing recommendation models are primarily designed for…

Information Retrieval · Computer Science 2024-12-30 Lianghao Xia , Meiyan Xie , Yong Xu , Chao Huang

Multimodal desire understanding, a task closely related to both emotion and sentiment that aims to infer human intentions from visual and textual cues, is an emerging yet underexplored task in affective computing with applications in social…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Wei Chen , Tongguan Wang , Feiyue Xue , Junkai Li , Hui Liu , Ying Sha

Empathetic conversation is psychologically supposed to be the result of conscious alignment and interaction between the cognition and affection of empathy. However, existing empathetic dialogue models usually consider only the affective…

Artificial Intelligence · Computer Science 2023-05-16 Jinfeng Zhou , Chujie Zheng , Bo Wang , Zheng Zhang , Minlie Huang

Emotion recognition in conversations is challenging due to the multi-modal nature of the emotion expression. We propose a hierarchical cross-attention model (HCAM) approach to multi-modal emotion recognition using a combination of recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-10 Soumya Dutta , Sriram Ganapathy

Understanding emotions during conversation is a fundamental aspect of human communication, driving NLP research for Emotion Recognition in Conversation (ERC). While considerable research has focused on discerning emotions of individual…

Computation and Language · Computer Science 2023-10-23 Shivani Kumar , Ramaneswaran S , Md Shad Akhtar , Tanmoy Chakraborty

Multimodal affective computing, learning to recognize and interpret human affects and subjective information from multiple data sources, is still challenging because: (i) it is hard to extract informative features to represent human affects…

Computation and Language · Computer Science 2018-05-23 Yue Gu , Kangning Yang , Shiyu Fu , Shuhong Chen , Xinyu Li , Ivan Marsic

It may be difficult for some individuals to open up and share their thoughts and feelings in front of a mental health expert. For those who are more at ease with a virtual agent, conversational agents can serve as an intermediate step in…

Computation and Language · Computer Science 2021-11-17 Harsh Sakhrani , Saloni Parekh , Shubham Mahajan

Empathetic Conversational Systems (ECS) are built to respond empathetically to the user's emotions and sentiments, regardless of the application domain. Current ECS studies evaluation approaches are restricted to offline evaluation…

Computation and Language · Computer Science 2024-07-29 Aravind Sesagiri Raamkumar , Siyuan Brandon Loh