中文
相关论文

相关论文: Interpretable Multimodal Emotion Recognition using…

200 篇论文

This paper addresses the question of emotion classification. The task consists in predicting emotion labels (taken among a set of possible labels) best describing the emotions contained in short video clips. Building on a standard framework…

计算机视觉与模式识别 · 计算机科学 2017-09-22 Valentin Vielzeuf , Stéphane Pateux , Frédéric Jurie

Different from the emotion recognition in individual utterances, we propose a multimodal learning framework using relation and dependencies among the utterances for conversational emotion analysis. The attention mechanism is applied to the…

计算与语言 · 计算机科学 2019-10-25 Zheng Lian , Jianhua Tao , Bin Liu , Jian Huang

This paper presents an innovative approach to address the challenges of translating multi-modal emotion recognition models to a more practical and resource-efficient uni-modal counterpart, specifically focusing on speech-only emotion…

声音 · 计算机科学 2024-01-09 Muhammad Muaz , Nathan Paull , Jahnavi Malagavalli

Human affective behavior analysis has received much attention in human-computer interaction (HCI). In this paper, we introduce our submission to the CVPR 2022 Competition on Affective Behavior Analysis in-the-wild (ABAW). To fully exploit…

计算机视觉与模式识别 · 计算机科学 2022-04-19 Wei Zhang , Feng Qiu , Suzhen Wang , Hao Zeng , Zhimeng Zhang , Rudong An , Bowen Ma , Yu Ding

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

人机交互 · 计算机科学 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Recognizing emotions from text in multimodal architectures has yielded promising results, surpassing video and audio modalities under certain circumstances. However, the method by which multimodal data is collected can be significant for…

机器学习 · 计算机科学 2021-03-08 A. Sutherland , S. Magg , C. Weber , S. Wermter

Automatic emotion recognition is a hot topic with a wide range of applications. Much work has been done in the area of automatic emotion recognition in recent years. The focus has been mainly on using the characteristics of a person such as…

计算机视觉与模式识别 · 计算机科学 2023-08-02 Zhifeng Wang , Ramesh Sankaranarayana

Emotion recognition is an important research direction in artificial intelligence, helping machines understand and adapt to human emotional states. Multimodal electrophysiological(ME) signals, such as EEG, GSR, respiration(Resp), and…

多媒体 · 计算机科学 2023-08-07 Yunfei Guo , Tao Zhang , Wu Huang

Emotion estimation in music listening is confronting challenges to capture the emotion variation of listeners. Recent years have witnessed attempts to exploit multimodality fusing information from musical contents and physiological signals…

人工智能 · 计算机科学 2016-12-01 Nattapong Thammasan , Ken-ichi Fukui , Masayuki Numao

Emotion recognition is relevant in various domains, ranging from healthcare to human-computer interaction. Physiological signals, being beyond voluntary control, offer reliable information for this purpose, unlike speech and facial…

机器学习 · 计算机科学 2024-10-11 Eleonora Lopez , Aurelio Uncini , Danilo Comminiello

This paper presents an efficient Multi-scale Transformer-based approach for the task of Emotion recognition from Physiological data, which has gained widespread attention in the research community due to the vast amount of information that…

信号处理 · 电气工程与系统科学 2024-08-28 Tu Vu , Van Thong Huynh , Soo-Hyung Kim

Multimodal analysis has recently drawn much interest in affective computing, since it can improve the overall accuracy of emotion recognition over isolated uni-modal approaches. The most effective techniques for multimodal emotion…

计算机视觉与模式识别 · 计算机科学 2024-07-09 R. Gnana Praveen , Eric Granger , Patrick Cardinal

Physiological Signals are the most reliable form of signals for emotion recognition, as they cannot be controlled deliberately by the subject. Existing review papers on emotion recognition based on physiological signals surveyed only the…

人机交互 · 计算机科学 2022-05-24 Zeeshan Ahmad , Naimul Khan

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

多媒体 · 计算机科学 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

Understanding emotions accurately is essential for fields like human-computer interaction. Due to the complexity of emotions and their multi-modal nature (e.g., emotions are influenced by facial expressions and audio), researchers have…

计算机视觉与模式识别 · 计算机科学 2025-01-17 Qize Yang , Detao Bai , Yi-Xing Peng , Xihan Wei

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

多媒体 · 计算机科学 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

计算机视觉与模式识别 · 计算机科学 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Automatic emotion recognition (AER) based on enriched multimodal inputs, including text, speech, and visual clues, is crucial in the development of emotionally intelligent machines. Although complex modality relationships have been proven…

多媒体 · 计算机科学 2021-09-16 Shuyun Tang , Zhaojie Luo , Guoshun Nan , Yuichiro Yoshikawa , Ishiguro Hiroshi

Multimodal emotion recognition aims to integrate text, audio, and video sources to understand human affective states. Although multimodal large language models excel at multimodal reasoning, they typically treat emotion categories as…

机器学习 · 计算机科学 2026-05-20 Zeheng Wang , Bo Zhao , Yijie Zhu , Zhishu Liu , Hui Ma , Ruixin Zhang , Shouhong Ding , Qianyu Xie , Zitong Yu

This paper aims to bring a new lightweight yet powerful solution for the task of Emotion Recognition and Sentiment Analysis. Our motivation is to propose two architectures based on Transformers and modulation that combine the linguistic and…

计算与语言 · 计算机科学 2020-10-06 Jean-Benoit Delbrouck , Noé Tits , Stéphane Dupont