中文
相关论文

相关论文: Mamba-Enhanced Text-Audio-Video Alignment Network …

200 篇论文

Multimodal Emotion Recognition in Conversations (ERC) is a typical multimodal learning task in exploiting various data modalities concurrently. Prior studies on effective multimodal ERC encounter challenges in addressing modality imbalances…

多媒体 · 计算机科学 2024-08-26 Cam-Van Thi Nguyen , The-Son Le , Anh-Tuan Mai , Duc-Trong Le

Multimodal emotion recognition in conversation (ERC) has garnered growing attention from research communities in various fields. In this paper, we propose a Cross-modal Fusion Network with Emotion-Shift Awareness (CFN-ESA) for ERC. Extant…

计算与语言 · 计算机科学 2024-04-16 Jiang Li , Xiaoping Wang , Yingjian Liu , Zhigang Zeng

Emotion recognition in conversation (ERC) aims to identify the emotion of each utterance in a conversation, playing a vital role in empathetic artificial intelligence. With the growing of large language models (LLMs), instruction tuning has…

计算与语言 · 计算机科学 2025-08-19 Hui Ma , Bo Zhang , Jinpeng Hu , Zenglin Shi

Emotion Recognition in Conversation~(ERC) across modalities is of vital importance for a variety of applications, including intelligent healthcare, artificial intelligence for conversation, and opinion mining over chat history. The crux of…

计算与语言 · 计算机科学 2023-06-07 Xingwei Liang , You Zou , Ruifeng Xu

This paper presents our system development for SemEval-2024 Task 3: "The Competition of Multimodal Emotion Cause Analysis in Conversations". Effectively capturing emotions in human conversations requires integrating multiple modalities such…

计算与语言 · 计算机科学 2024-04-03 Arefa , Mohammed Abbas Ansari , Chandni Saxena , Tanvir Ahmad

Multimodal emotion understanding requires effective integration of text, audio, and visual modalities for both discrete emotion recognition and continuous sentiment analysis. We present EGMF, a unified framework combining expert-guided…

计算与语言 · 计算机科学 2026-01-13 Jiaqi Qiao , Xiujuan Xu , Xinran Li , Yu Liu

Emotion Recognition in Conversations (ERC) has been gaining increasing importance as conversational agents become more and more common. Recognizing emotions is key for effective communication, being a crucial component in the development of…

计算与语言 · 计算机科学 2023-06-06 Patrícia Pereira , Helena Moniz , Isabel Dias , Joao Paulo Carvalho

Multimodal Emotion Recognition in Conversations remains a challenging task due to the complex interplay of textual, acoustic and visual signals. While recent models have improved performance via advanced fusion strategies, they often lack…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Guanyu Hu , Dimitrios Kollias , Xinyu Yang

Affective Computing (AC) is essential for advancing Artificial General Intelligence (AGI), with emotion recognition serving as a key component. However, human emotions are inherently dynamic, influenced not only by an individual's…

计算与语言 · 计算机科学 2025-03-31 Yupei Li , Qiyang Sun , Sunil Munthumoduku Krishna Murthy , Emran Alturki , Björn W. Schuller

The advent of deep learning models has made a considerable contribution to the achievement of Emotion Recognition in Conversation (ERC). However, this task still remains an important challenge due to the plurality and subjectivity of human…

计算与语言 · 计算机科学 2024-04-18 Barbara Gendron , Gaël Guibon

Emotion Recognition in Conversations (ERC) has considerable prospects for developing empathetic machines. For multimodal ERC, it is vital to understand context and fuse modality information in conversations. Recent graph-based fusion…

计算与语言 · 计算机科学 2022-03-07 Dou Hu , Xiaolong Hou , Lingwei Wei , Lianxin Jiang , Yang Mo

Emotion Recognition in Conversation (ERC) is critical for enabling natural human-machine interactions. However, existing methods predominantly employ categorical or dimensional emotion annotations, which often fail to adequately represent…

计算与语言 · 计算机科学 2026-03-10 Yoshiki Tanaka , Ryuichi Uehara , Koji Inoue , Michimasa Inaba

In affective computing, the task of Emotion Recognition in Conversations (ERC) has emerged as a focal area of research. The primary objective of this task is to predict emotional states within conversations by analyzing multimodal data…

多媒体 · 计算机科学 2024-11-22 Xiaomin Yu , Feiyang Wang , Ziyue Qiao

Multi-modal Emotion Recognition in Conversation (MERC) has received considerable attention in various fields, e.g., human-computer interaction and recommendation systems. Most existing works perform feature disentanglement and fusion to…

计算与语言 · 计算机科学 2024-05-06 Yuntao Shou , Tao Meng , Fuchen Zhang , Nan Yin , Keqin Li

Emotion Recognition in Conversations (ERC) is essential for building empathetic human-machine systems. Existing studies on ERC primarily focus on summarizing the context information in a conversation, however, ignoring the differentiated…

计算与语言 · 计算机科学 2020-10-16 Yuzhao Mao , Qi Sun , Guang Liu , Xiaojie Wang , Weiguo Gao , Xuan Li , Jianping Shen

Emotion recognition in conversations (ERC) is vital to the advancements of conversational AI and its applications. Therefore, the development of an automated ERC model using the concepts of machine learning (ML) would be beneficial.…

计算与语言 · 计算机科学 2023-06-06 Amitabha Dey , Shan Suthaharan

Emotion is intrinsic to humans and consequently emotion understanding is a key part of human-like artificial intelligence (AI). Emotion recognition in conversation (ERC) is becoming increasingly popular as a new research frontier in natural…

计算与语言 · 计算机科学 2019-05-09 Soujanya Poria , Navonil Majumder , Rada Mihalcea , Eduard Hovy

Multimodal Sentiment Analysis (MSA) stands as a critical research frontier, seeking to comprehensively unravel human emotions by amalgamating text, audio, and visual data. Yet, discerning subtle emotional nuances within audio and video…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Sheng Wu , Xiaobao Wang , Longbiao Wang , Dongxiao He , Jianwu Dang

Multimodal emotion recognition (MER) aims to infer human affect by jointly modeling audio and visual cues; however, existing approaches often struggle with temporal misalignment, weakly discriminative feature representations, and suboptimal…

多媒体 · 计算机科学 2026-01-21 Joe Dhanith P R , Shravan Venkatraman , Vigya Sharma , Santhosh Malarvannan

Multimodal emotion recognition (MER), leveraging speech and text, has emerged as a pivotal domain within human-computer interaction, demanding sophisticated methods for effective multimodal integration. The challenge of aligning features…

音频与语音处理 · 电气工程与系统科学 2024-12-31 Xuechen Wang , Shiwan Zhao , Haoqin Sun , Hui Wang , Jiaming Zhou , Yong Qin