English
Related papers

Related papers: Nuanced Emotion Recognition Based on a Segment-bas…

200 papers

Emotion recognition is essential for applications in affective computing and behavioral prediction, but conventional systems relying on single-modality data often fail to capture the complexity of affective states. To address this…

Multimedia · Computer Science 2025-09-08 Jianlu Wang , Yanan Wang , Tong Liu

Healthcare robotics requires robust multimodal perception and reasoning to ensure safety in dynamic clinical environments. Current Vision-Language Models (VLMs) demonstrate strong general-purpose capabilities but remain limited in temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Saurav Jha , Stefan K. Ehrlich

Recent advancements in EEG-based emotion recognition have shown promising outcomes using both deep learning and classical machine learning approaches; however, most existing studies focus narrowly on binary valence prediction or…

Machine Learning · Computer Science 2025-09-01 Abdul Rehman , Ilona Heldal , Jerry Chun-Wei Lin

Towards open-ended Video Anomaly Detection (VAD), existing methods often exhibit biased detection when faced with challenging or unseen events and lack interpretability. To address these drawbacks, we propose Holmes-VAD, a novel framework…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Huaxin Zhang , Xiaohao Xu , Xiang Wang , Jialong Zuo , Chuchu Han , Xiaonan Huang , Changxin Gao , Yuehuan Wang , Nong Sang

Partially relevant video retrieval aims to retrieve untrimmed videos using text queries that describe only partial content. However, the inherent asymmetry between brief queries and rich video content inevitably introduces uncertainty into…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Jun Li , Peifeng Lai , Xuhang Lou , Jinpeng Wang , Yuting Wang , Ke Chen , Yaowei Wang , Shu-Tao Xia

Emotion recognition in social situations is a complex task that requires integrating information from both facial expressions and the situational context. While traditional approaches to automatic emotion recognition have focused on…

Human-Computer Interaction · Computer Science 2025-07-18 Bin Han , Cleo Yau , Su Lei , Jonathan Gratch

Emotion being a subjective thing, leveraging knowledge and science behind labeled data and extracting the components that constitute it, has been a challenging problem in the industry for many years. With the evolution of deep learning in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Prudhvi Raj Dachapally

Automatic facial expression recognition is an important research area in the emotion recognition and computer vision. Applications can be found in several domains such as medical treatment, driver fatigue surveillance, sociable robotics,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Sevegni Odilon Clement Allognon , Alessandro L. Koerich , Alceu de S. Britto

In this work we tackle the task of video-based visual emotion recognition in the wild. Standard methodologies that rely solely on the extraction of bodily and facial features often fall short of accurate emotion prediction in cases where…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Ioannis Pikoulis , Panagiotis P. Filntisis , Petros Maragos

Multimodal emotion recognition has recently gained much attention since it can leverage diverse and complementary relationships over multiple modalities (e.g., audio, visual, biosignals, etc.), and can provide some robustness to noisy…

Understanding emotional responses in children with Autism Spectrum Disorder (ASD) during social interaction remains a critical challenge in both developmental psychology and human-robot interaction. This study presents a novel deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Indranil Bhattacharjee , Vartika Narayani Srinet , Anirudha Bhattacharjee , Braj Bhushan , Bishakh Bhattacharya

Facial Action Coding System is an approach for modeling the complexity of human emotional expression. Automatic action unit (AU) detection is a crucial research area in human-computer interaction. This paper describes our submission to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Duy Le Hoai , Eunchae Lim , Eunbin Choi , Sieun Kim , Sudarshan Pant , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

People represent their emotions in a myriad of ways. Among the most important ones is whole body expressions which have many applications in different fields such as human-computer interaction (HCI). One of the most important challenges in…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Peyman Tahghighi , Abbas Koochari , Masoume Jalali

Long video understanding is still challenging for recent Large Video-Language Models (LVLMs) due to the conflict between long-form temporal understanding and detailed spatial perception. LVLMs with a uniform frame sampling mechanism, which…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Shenghao Fu , Qize Yang , Yuan-Ming Li , Xihan Wei , Xiaohua Xie , Wei-Shi Zheng

Facial Expression Recognition (FER) plays a crucial role in human affective analysis and has been widely applied in computer vision tasks such as human-computer interaction and psychological assessment. The 8th Affective Behavior Analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 JunGyu Lee , Kunyoung Lee , Haesol Park , Ig-Jae Kim , Gi Pyo Nam

Tracking an interpretable emotional arc of a conversation via the sentiment of individual utterances processed as a whole is central to both understanding and guiding communication in applied, especially clinical, conversational contexts.…

Artificial Intelligence · Computer Science 2026-05-14 Anamika Ragu , Aneesh Jonelagadda

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Emotion detection presents challenges to intelligent human-robot interaction (HRI). Foundational deep learning techniques used in emotion detection are limited by information-constrained datasets or models that lack the necessary complexity…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 David C. Jeong , Tianma Shen , Hongji Liu , Raghav Kapoor , Casey Nguyen , Song Liu , Christopher A. Kitts

Classifying group-level emotions is a challenging task due to complexity of video, in which not only visual, but also audio information should be taken into consideration. Existing works on multimodal emotion recognition are using bulky…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Lev Evtodienko

This paper reports the analysis of audio and visual features in predicting the continuous emotion dimensions under the seventh Audio/Visual Emotion Challenge (AVEC 2017), which was done as part of a B.Tech. 2nd year internship project. For…

Computer Vision and Pattern Recognition · Computer Science 2017-10-25 Narotam Singh , Nittin Singh , Abhinav Dhall