English
Related papers

Related papers: CG-MER: A Card Game-based Multimodal dataset for E…

200 papers

Multimodal emotion recognition (MER) extracts emotions from multimodal data, including visual, speech, and text inputs, playing a key role in human-computer interaction. Attention-based fusion methods dominate MER research, achieving strong…

Artificial Intelligence · Computer Science 2025-06-03 Jiajun He , Jinyi Mi , Tomoki Toda

In recent decades, the field of affective computing has made substantial progress in advancing the ability of AI systems to recognize and express affective phenomena, such as affect and emotions, during human-human and human-machine…

Human-Computer Interaction · Computer Science 2023-05-19 Leena Mathur , Maja J Matarić , Louis-Philippe Morency

Emotion recognition has a pivotal role in affective computing and in human-computer interaction. The current technological developments lead to increased possibilities of collecting data about the emotional state of a person. In general,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Andreea Birhala , Catalin Nicolae Ristea , Anamaria Radoi , Liviu Cristian Dutu

Multimodal emotion analysis performed better in emotion recognition depending on more comprehensive emotional clues and multimodal emotion dataset. In this paper, we developed a large multimodal emotion dataset, named "HED" dataset, to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhongyu Fang , Aoyun He , Qihui Yu , Baopeng Gao , Weiping Ding , Tong Zhang , Lei Ma

The integration of conversational agents into our daily lives has become increasingly common, yet many of these agents cannot engage in deep interactions with humans. Despite this, there is a noticeable shortage of datasets that capture…

Human-Computer Interaction · Computer Science 2025-03-19 Mohammed Althubyani , Zhijin Meng , Shengyuan Xie , Cha Seung , Imran Razzak , Eduardo B. Sandoval , Baki Kocaballi , Francisco Cruz

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen

Automatic emotion recognition has recently gained significant attention due to the growing popularity of deep learning algorithms. One of the primary challenges in emotion recognition is effectively utilizing the various cues (modalities)…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Mijanur Palash , Bharat Bhargava

Affective Computing (AC) is essential for advancing Artificial General Intelligence (AGI), with emotion recognition serving as a key component. However, human emotions are inherently dynamic, influenced not only by an individual's…

Computation and Language · Computer Science 2025-03-31 Yupei Li , Qiyang Sun , Sunil Munthumoduku Krishna Murthy , Emran Alturki , Björn W. Schuller

Emotion recognition is a fundamental component of next-generation human-computer interaction (HCI), enabling machines to perceive, understand, and respond to users' affective states. However, existing systems often rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Ziwen Zhong , Zhitao Shu , Yue Zhao

Emotion Recognition (ER) is the process of identifying human emotions from given data. Currently, the field heavily relies on facial expression recognition (FER) because facial expressions contain rich emotional cues. However, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuanyuan Liu , Lin Wei , Kejun Liu , Yibing Zhan , Zijing Chen , Zhe Chen , Shiguang Shan

Emotion understanding is a complex process that involves multiple components. The ability to recognise emotions not only leads to new context awareness methods but also enhances system interaction's effectiveness by perceiving and…

Human-Computer Interaction · Computer Science 2024-10-27 Rukshani Somarathna , Gelareh Mohammadi

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

Facial expression is one of the most external indications of a person's feelings and emotions. In daily conversation, according to the psychologist, only 7% and 38% of information is communicated through words and sounds respective, while…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Mengyu Rao , Ruyi Bao , Liangshun Dong

Multimodal Emotion Recognition in Conversation (ERC) plays an influential role in the field of human-computer interaction and conversational robotics since it can motivate machines to provide empathetic services. Multimodal data modeling is…

Multimedia · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Emotion Recognition in Conversations (ERC) is an important and active research area. Recent work has shown the benefits of using multiple modalities (e.g., text, audio, and video) for the ERC task. In a conversation, participants tend to…

Computation and Language · Computer Science 2022-11-08 Harsh Agarwal , Keshav Bansal , Abhinav Joshi , Ashutosh Modi

While affective computing has advanced considerably, multimodal emotion prediction in aging populations remains underexplored, largely due to the scarcity of dedicated datasets. Existing multimodal benchmarks predominantly target young,…

Human-Computer Interaction · Computer Science 2026-04-06 Hongbin Chen , Jie Li , Wei Wang , Siyang Song , Xiao Gu , Jianqing Li , Wentao Xiang

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

Training facial emotion recognition models requires large sets of data and costly annotation processes. To alleviate this problem, we developed a gamified method of acquiring annotated facial emotion data without an explicit labeling effort…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Krist Shingjergji , Deniz Iren , Felix Bottger , Corrie Urlings , Roland Klemke

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong