中文
相关论文

相关论文: Exploiting Diverse Feature for Multimodal Sentimen…

200 篇论文

Due to its ability to accurately predict emotional state using multimodal features, audiovisual emotion recognition has recently gained more interest from researchers. This paper proposes two methods to predict emotional attributes from…

音频与语音处理 · 电气工程与系统科学 2022-07-22 Bagus Tris Atmaja , Masato Akagi

Depression has been a leading cause of mental-health illnesses across the world. While the loss of lives due to unmanaged depression is a subject of attention, so is the lack of diagnostic tests and subjectivity involved. Using behavioural…

人工智能 · 计算机科学 2020-10-07 Shivani Shimpi , Shyam Thombre , Snehal Reddy , Ritik Sharma , Srijan Singh

Multimodal sentiment analysis is a very actively growing field of research. A promising area of opportunity in this field is to improve the multimodal fusion mechanism. We present a novel feature fusion strategy that proceeds in a…

计算与语言 · 计算机科学 2018-06-19 N. Majumder , D. Hazarika , A. Gelbukh , E. Cambria , S. Poria

Automated prediction of valence, one key feature of a person's emotional state, from individuals' personal narratives may provide crucial information for mental healthcare (e.g. early diagnosis of mental diseases, supervision of disease…

计算与语言 · 计算机科学 2019-12-03 Aniruddha Tammewar , Alessandra Cervone , Eva-Maria Messner , Giuseppe Riccardi

Multi-modal sentiment analysis plays an important role for providing better interactive experiences to users. Each modality in multi-modal data can provide different viewpoints or reveal unique aspects of a user's emotional state. In this…

机器学习 · 计算机科学 2021-06-23 Debapriya Banerjee , Fotios Lygerakis , Fillia Makedon

Multi-modal recommendation systems aim to enhance performance by integrating an item's content features across various modalities with user behavior data. Effective utilization of features from different modalities requires addressing two…

信息检索 · 计算机科学 2025-02-27 Hang Zhou , Yucheng Wang , Huijing Zhan

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

人机交互 · 计算机科学 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

Multimodal Sentiment Analysis (MSA) aims to recognize human emotions by exploiting textual, acoustic, and visual modalities, and thus how to make full use of the interactions between different modalities is a central challenge of MSA.…

计算与语言 · 计算机科学 2025-02-17 Yubo Gao , Haotian Wu , Lei Zhang

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

Continuous affect prediction in the wild is a very interesting problem and is challenging as continuous prediction involves heavy computation. This paper presents the methodologies and techniques used in our contribution to predict…

音频与语音处理 · 电气工程与系统科学 2020-03-02 Sowmya Rasipuram , Junaid Hamid Bhat , Anutosh Maitra

In this paper, through multi-task ensemble framework we address three problems of emotion and sentiment analysis i.e. "emotion classification & intensity", "valence, arousal & dominance for emotion" and "valence & arousal} for sentiment".…

计算与语言 · 计算机科学 2018-10-16 Md Shad Akhtar , Deepanway Ghosal , Asif Ekbal , Pushpak Bhattacharyya , Sadao Kurohashi

Multimodal machine learning is a core research area spanning the language, visual and acoustic modalities. The central challenge in multimodal learning involves learning representations that can process and relate information from multiple…

计算与语言 · 计算机科学 2018-08-07 Hai Pham , Thomas Manzini , Paul Pu Liang , Barnabas Poczos

Multimodal emotion recognition plays a key role in many domains, including mental health monitoring, educational interaction, and human-computer interaction. However, existing methods often face three major challenges: unbalanced category…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Feng Li , Ke Wu , Yongwei Li

In this paper, we describe the results of the HSEmotion team in two tasks of the seventh Affective Behavior Analysis in-the-wild (ABAW) competition, namely, multi-task learning for simultaneous prediction of facial expression, valence,…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Andrey V. Savchenko

The human language can be expressed through multiple sources of information known as modalities, including tones of voice, facial gestures, and spoken language. Recent multimodal learning with strong performances on human-centric tasks such…

计算与语言 · 计算机科学 2020-10-06 Yao-Hung Hubert Tsai , Martin Q. Ma , Muqiao Yang , Ruslan Salakhutdinov , Louis-Philippe Morency

In this paper, we briefly introduce our submission to the Valence-Arousal Estimation Challenge of the 3rd Affective Behavior Analysis in-the-wild (ABAW) competition. Our method utilizes the multi-modal information, i.e., the visual and…

计算机视觉与模式识别 · 计算机科学 2022-04-01 Liyu Meng , Yuchen Liu , Xiaolong Liu , Zhaopei Huang , Yuan Cheng , Meng Wang , Chuanhe Liu , Qin Jin

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

计算与语言 · 计算机科学 2025-05-09 Nischal Mandal , Yang Li

Emotion semantic inconsistency is an ubiquitous challenge in multi-modal sentiment analysis (MSA). MSA involves analyzing sentiment expressed across various modalities like text, audio, and videos. Each modality may convey distinct aspects…

计算与语言 · 计算机科学 2024-06-06 Yufei Wang , Mengyue Wu

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

Sentiment analysis is a crucial task that aims to understand people's emotional states and predict emotional categories based on multimodal information. It consists of several subtasks, such as emotion recognition in conversation (ERC),…

计算与语言 · 计算机科学 2023-09-06 Zaijing Li , Ting-En Lin , Yuchuan Wu , Meng Liu , Fengxiao Tang , Ming Zhao , Yongbin Li