中文
相关论文

相关论文: Multi-modal Approach for Affective Computing

200 篇论文

Emotion detection in older adults is crucial for understanding their cognitive and emotional well-being, especially in hospital and assisted living environments. In this work, we investigate an edge-based, non-obtrusive approach to emotion…

人机交互 · 计算机科学 2025-07-14 Md. Saif Hassan Onim , Andrew M. Kiselica , Himanshu Thapliyal

The wide popularity of digital photography and social networks has generated a rapidly growing volume of multimedia data (i.e., image, music, and video), resulting in a great demand for managing, retrieving, and understanding these data.…

多媒体 · 计算机科学 2019-11-14 Sicheng Zhao , Shangfei Wang , Mohammad Soleymani , Dhiraj Joshi , Qiang Ji

For several decades, electroencephalography (EEG) has featured as one of the most commonly used tools in emotional state recognition via monitoring of distinctive brain activities. An array of datasets have been generated with the use of…

In terms of human-computer interaction, it is becoming more and more important to correctly understand the user's emotional state in a conversation, so the task of multimodal emotion recognition (MER) started to receive more attention.…

计算与语言 · 计算机科学 2024-01-04 Wei Ai , FuChen Zhang , Tao Meng , YunTao Shou , HongEn Shao , Keqin Li

In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expressions. This study explores the potential for detecting a…

多媒体 · 计算机科学 2025-05-13 Jiehui Jia , Huan Zhang , Jinhua Liang

Human emotion is expressed in many communication modalities and media formats and so their computational study is equally diversified into natural language processing, audio signal analysis, computer vision, etc. Similarly, the large…

机器学习 · 计算机科学 2023-08-16 Sven Buechel , Udo Hahn

Expression recognition in in-the-wild video data remains challenging due to substantial variations in facial appearance, background conditions, audio noise, and the inherently dynamic nature of human affect. Relying on a single modality,…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Junhyeong Byeon , Jeongyeol Kim , Sejoon Lim

Recent advancements in EEG-based emotion recognition have shown promising outcomes using both deep learning and classical machine learning approaches; however, most existing studies focus narrowly on binary valence prediction or…

机器学习 · 计算机科学 2025-09-01 Abdul Rehman , Ilona Heldal , Jerry Chun-Wei Lin

Emotions are one of the important components of the human being, thus they are a valuable part of daily activities such as interaction with people, decision making and learning. For this reason, it is important to detect, recognize and…

人机交互 · 计算机科学 2025-12-30 Ricardo Vasquez , Diego Riofrío-Luzcando , Joe Carrion-Jumbo , Cesar Guevara

Automatic emotion recognition has become increasingly important with the rise of AI, especially in fields like healthcare, education, and automotive systems. However, there is a lack of multimodal datasets, particularly involving body…

人工智能 · 计算机科学 2025-09-09 Seyed Muhammad Hossein Mousavi , Atiye Ilanloo

In this paper we address the problem of multi-cue affect recognition in challenging scenarios such as child-robot interaction. Towards this goal we propose a method for automatic recognition of affect that leverages body expressions…

计算机视觉与模式识别 · 计算机科学 2019-09-06 Panagiotis P. Filntisis , Niki Efthymiou , Petros Koutras , Gerasimos Potamianos , Petros Maragos

Negative emotions are linked to the onset of neurodegenerative diseases and dementia, yet they are often difficult to detect through observation. Physiological signals from wearable devices offer a promising noninvasive method for…

人机交互 · 计算机科学 2025-10-28 Muhammad Irfan , Anum Nawaz , Ayse Kosal Bulbul , Riku Klen , Abdulhamit Subasi , Tomi Westerlund , Wei Chen

Emotion recognition is an important component of affective computing, and also human-machine interaction. Unimodal emotion recognition is convenient, but the accuracy may not be high enough; on the contrary, multi-modal emotion recognition…

人机交互 · 计算机科学 2026-02-12 Siyuan Kan , Huanyu Wu , Zhenyao Cui , Fan Huang , Xiaolong Xu , Dongrui Wu

Emotion plays a significant role in our daily life. Recognition of emotion is wide-spread in the field of health care and human-computer interaction. Emotion is the result of the coordinated activities of cortical and subcortical neural…

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

多媒体 · 计算机科学 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

Biomedical signals provide insights into various conditions affecting the human body. Beyond diagnostic capabilities, these signals offer a deeper understanding of how specific organs respond to an individual's emotions and feelings. For…

信号处理 · 电气工程与系统科学 2025-10-08 Pubudu L. Indrasiri , Bipasha Kashyap , Pubudu N. Pathirana

Emotion Recognition in Conversations (ERC) is an important and active research area. Recent work has shown the benefits of using multiple modalities (e.g., text, audio, and video) for the ERC task. In a conversation, participants tend to…

计算与语言 · 计算机科学 2022-11-08 Harsh Agarwal , Keshav Bansal , Abhinav Joshi , Ashutosh Modi

Facial expression perception in humans inherently relies on prior knowledge and contextual cues, contributing to efficient and flexible processing. For instance, multi-modal emotional context (such as voice color, affective text, body pose,…

计算机视觉与模式识别 · 计算机科学 2024-09-05 Florian Blume , Runfeng Qu , Pia Bideau , Martin Maier , Rasha Abdel Rahman , Olaf Hellwich