English
Related papers

Related papers: Conversation Understanding using Relational Tempor…

200 papers

Conversational Machine Reading (CMR) aims at answering questions in a complicated manner. Machine needs to answer questions through interactions with users based on given rule document, user scenario and dialogue history, and ask questions…

Computation and Language · Computer Science 2021-06-01 Siru Ouyang , Zhuosheng Zhang , Hai Zhao

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

Multimedia · Computer Science 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

Emotion Recognition in Conversations (ERC) aims to predict the emotional state of speakers in conversations, which is essentially a text classification task. Unlike the sentence-level text classification problem, the available supervised…

Computation and Language · Computer Science 2020-10-07 Wenxiang Jiao , Michael R. Lyu , Irwin King

Emotion Recognition in Conversation (ERC) has attracted widespread attention in the natural language processing field due to its enormous potential for practical applications. Existing ERC methods face challenges in achieving generalization…

Computation and Language · Computer Science 2023-09-20 Shanglin Lei , Xiaoping Wang , Guanting Dong , Jiang Li , Yingjian Liu

The recent advancement of pre-trained Transformer models has propelled the development of effective text mining models across various biomedical tasks. However, these models are primarily learned on the textual data and often lack the…

Computation and Language · Computer Science 2021-07-02 Sriram Pingali , Shweta Yadav , Pratik Dutta , Sriparna Saha

We investigate response selection for multi-turn conversation in retrieval-based chatbots. Existing studies pay more attention to the matching between utterances and responses by calculating the matching score based on learned features,…

Computation and Language · Computer Science 2021-01-18 Yongkang Liu , Shi Feng , Daling Wang , Kaisong Song , Feiliang Ren , Yifei Zhang

Adapting large language models to full document translation remains challenging due to the difficulty of capturing long-range dependencies and preserving discourse coherence throughout extended texts. While recent agentic machine…

Computation and Language · Computer Science 2025-11-11 Viet-Thanh Pham , Minghan Wang , Hao-Han Liao , Thuy-Trang Vu

In this paper we consider the task of conversational semantic parsing over general purpose knowledge graphs (KGs) with millions of entities, and thousands of relation-types. We focus on models which are capable of interactively mapping user…

Computation and Language · Computer Science 2023-12-08 Parag Jain , Mirella Lapata

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

Many studies on dialog emotion analysis focus on utterance-level emotion only. These models hence are not optimized for dialog-level emotion detection, i.e. to predict the emotion category of a dialog as a whole. More importantly, these…

Computation and Language · Computer Science 2022-03-24 Yequan Wang , Xuying Meng , Yiyi Liu , Aixin Sun , Yao Wang , Yinhe Zheng , Minlie Huang

Empathetic Response Generation (ERG) is one of the key tasks of the affective computing area, which aims to produce emotionally nuanced and compassionate responses to user's queries. However, existing ERG research is predominantly confined…

Multimedia · Computer Science 2025-02-10 Han Zhang , Zixiang Meng , Meng Luo , Hong Han , Lizi Liao , Erik Cambria , Hao Fei

Speech Emotion Captioning (SEC) has emerged as a notable research direction. The inherent complexity of emotional content in human speech makes it challenging for traditional discrete classification methods to provide an adequate…

State-of-the-art neural dialogue systems excel at syntactic and semantic modelling of language, but often have a hard time establishing emotional alignment with the human interactant during a conversation. In this work, we bring Affect…

Computation and Language · Computer Science 2020-04-17 Nabiha Asghar , Ivan Kobyzev , Jesse Hoey , Pascal Poupart , Muhammad Bilal Sheikh

Human face-to-face communication is a complex multimodal signal. We use words (language modality), gestures (vision modality) and changes in tone (acoustic modality) to convey our intentions. Humans easily process and understand…

Artificial Intelligence · Computer Science 2018-02-06 Amir Zadeh , Paul Pu Liang , Soujanya Poria , Prateek Vij , Erik Cambria , Louis-Philippe Morency

Creating agents that can both appropriately respond to conversations and understand complex human linguistic tendencies and social cues has been a long standing challenge in the NLP community. A recent pillar of research revolves around…

Machine Learning · Computer Science 2022-07-18 Eriq Augustine , Pegah Jandaghi , Alon Albalak , Connor Pryor , Charles Dickens , William Wang , Lise Getoor

Explainable Multimodal Emotion Recognition plays a crucial role in applications such as human-computer interaction and social media analytics. However, current approaches struggle with cue-level perception and reasoning due to two main…

Multimedia · Computer Science 2026-02-06 Hanwen Zhang , Yao Liu , Peiyuan Jiang , Lang Junjie , Xie Jun , Yihui He , Yajiao Deng , Siyu Du , Qiao Liu

Emotion Recognition in Conversations (ERCs) is a vital area within multimodal interaction research, dedicated to accurately identifying and classifying the emotions expressed by speakers throughout a conversation. Traditional ERC approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Xinran Li , Xiaomao Fan , Qingyang Wu , Xiaojiang Peng , Ye Li

Multi-modal conversation emotion recognition (MCER) aims to recognize and track the speaker's emotional state using text, speech, and visual information in the conversation scene. Analyzing and studying MCER issues is significant to…

Artificial Intelligence · Computer Science 2025-11-14 Yuntao Shou , Tao Meng , Wei Ai , Fangze Fu , Nan Yin , Keqin Li

Multimodal sentiment analysis has become an increasingly popular research area as the demand for multimodal online content is growing. For multimodal sentiment analysis, words can have different meanings depending on the linguistic context…

Computation and Language · Computer Science 2022-09-16 Junghun Kim , Jihie Kim

Automated emotion detection in speech is a challenging task due to the complex interdependence between words and the manner in which they are spoken. It is made more difficult by the available datasets; their small size and incompatible…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-16 Amith Ananthram , Kailash Karthik Saravanakumar , Jessica Huynh , Homayoon Beigi