中文
相关论文

相关论文: Realtime Multimodal Emotion Estimation using Behav…

200 篇论文

Recognizing faces and their underlying emotions is an important aspect of biometrics. In fact, estimating emotional states from faces has been tackled from several angles in the literature. In this paper, we follow the novel route of using…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Lorenzo Berlincioni , Luca Cultrera , Federico Becattini , Alberto Del Bimbo

This article presents our results for the eighth Affective Behavior Analysis in-the-wild (ABAW) competition.Multimodal emotion recognition (ER) has important applications in affective computing and human-computer interaction. However, in…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Ran Liu , Fengyu Zhang , Cong Yu , Longjiang Yang , Zhuofan Wen , Siyuan Zhang , Hailiang Yao , Shun Chen , Zheng Lian , Bin Liu

Speech emotion recognition is a challenging problem because human convey emotions in subtle and complex ways. For emotion recognition on human speech, one can either extract emotion related features from audio signals or employ speech…

计算与语言 · 计算机科学 2020-04-06 Haiyang Xu , Hui Zhang , Kun Han , Yun Wang , Yiping Peng , Xiangang Li

Classifying group-level emotions is a challenging task due to complexity of video, in which not only visual, but also audio information should be taken into consideration. Existing works on multimodal emotion recognition are using bulky…

计算机视觉与模式识别 · 计算机科学 2021-11-12 Lev Evtodienko

Understanding emotional responses in children with Autism Spectrum Disorder (ASD) during social interaction remains a critical challenge in both developmental psychology and human-robot interaction. This study presents a novel deep learning…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Indranil Bhattacharjee , Vartika Narayani Srinet , Anirudha Bhattacharjee , Braj Bhushan , Bishakh Bhattacharya

Estimating emotional states from physiological signals is a central topic in affective computing and psychophysiology. While many emotion estimation systems implicitly assume a stable relationship between physiological features and…

人机交互 · 计算机科学 2025-08-27 Hiroto Sakimura , Takayuki Nagaya , Tomoki Nishi , Tetsuo Kurahashi , Katsunori Kohda , Nobuhiko Muramoto

Current computational-emotion research has focused on applying acoustic properties to analyze how emotions are perceived mathematically or used in natural language processing machine learning models. While recent interest has focused on…

声音 · 计算机科学 2021-07-06 Daniel Szelogowski

Emotion prediction is a key emerging research area that focuses on identifying and forecasting the emotional state of a human from multiple modalities. Among other data sources, physiological data can serve as an indicator for emotions with…

机器学习 · 计算机科学 2022-01-19 Maryam Khalid , Emily Willis

We develop an emotion recognition software for the use with a video conference software for autistic individuals which are unable to recognize emotions properly. It can get an image out of the video stream, detect the emotion in it with the…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Marc Franzen , Michael Stephan Gresser , Tobias Müller , Sebastian Mauser

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

多媒体 · 计算机科学 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

This paper discusses the benefits of incorporating multimodal data for improving latent emotion recognition accuracy, focusing on micro-expression (ME) and physiological signals (PS). The proposed approach presents a novel multimodal…

计算机视觉与模式识别 · 计算机科学 2023-08-24 Liangfei Zhang , Yifei Qian , Ognjen Arandjelovic , Anthony Zhu

Considerable attention has been paid for physiological signal-based emotion recognition in field of affective computing. For the reliability and user friendly acquisition, Electrodermal Activity (EDA) has great advantage in practical…

声音 · 计算机科学 2022-05-16 Guanghao Yin , Shouqian Sun , Dian Yu , Dejian Li , Kejun Zhang

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

计算与语言 · 计算机科学 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

In recent years, deep learning has achieved innovative advancements in various fields, including the analysis of human emotions and behaviors. Initiatives such as the Affective Behavior Analysis in-the-wild (ABAW) competition have been…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Seongjae Min , Junseok Yang , Sangjun Lim , Junyong Lee , Sangwon Lee , Sejoon Lim

Emotional expressions form a key part of user behavior on today's digital platforms. While multimodal emotion recognition techniques are gaining research attention, there is a lack of deeper understanding on how visual and non-visual…

多媒体 · 计算机科学 2021-07-01 Prasanta Bhattacharya , Raj Kumar Gupta , Yinping Yang

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

信号处理 · 电气工程与系统科学 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

Negative emotions are linked to the onset of neurodegenerative diseases and dementia, yet they are often difficult to detect through observation. Physiological signals from wearable devices offer a promising noninvasive method for…

人机交互 · 计算机科学 2025-10-28 Muhammad Irfan , Anum Nawaz , Ayse Kosal Bulbul , Riku Klen , Abdulhamit Subasi , Tomi Westerlund , Wei Chen

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

人机交互 · 计算机科学 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Emergency Medical Services (EMS) responders often operate under time-sensitive conditions, facing cognitive overload and inherent risks, requiring essential skills in critical thinking and rapid decision-making. This paper presents…

人工智能 · 计算机科学 2024-10-27 Keshara Weerasinghe , Saahith Janapati , Xueren Ge , Sion Kim , Sneha Iyer , John A. Stankovic , Homa Alemzadeh

Affective reactions have deep biological foundations, however in humans the development of emotion concepts is also shaped by language and higher-order cognition. A recent breakthrough in AI has been the creation of multimodal language…

人机交互 · 计算机科学 2025-07-29 Zaira Romeo , Alberto Testolin