English
Related papers

Related papers: Context-Aware Academic Emotion Dataset and Benchma…

200 papers

Multimodal Emotion Recognition (MER) aims to perceive human emotions through three modes: language, vision, and audio. Previous methods primarily focused on modal fusion without adequately addressing significant distributional differences…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Jichao Zhu , Jun Yu

Along with the increasing use of unmanned aerial vehicles (UAVs), large volumes of aerial videos have been produced. It is unrealistic for humans to screen such big data and understand their contents. Hence methodological research on the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Lichao Mou , Yuansheng Hua , Pu Jin , Xiao Xiang Zhu

Computer vision has undergone a dramatic revolution in performance, driven in large part through deep features trained on large-scale supervised datasets. However, much of these improvements have focused on static image analysis; video…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Rohit Girdhar , Deva Ramanan

Dynamic Facial Expression Recognition (DFER) aims to identify human emotions from temporally evolving facial movements and plays a critical role in affective computing. While recent vision-language approaches have introduced semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Yu Liu , Leyuan Qu , Hanlei Shi , Di Gao , Yuhua Zheng , Taihao Li

Understanding human affective behaviour, especially in the dynamics of real-world settings, requires Facial Expression Recognition (FER) models to continuously adapt to individual differences in user expression, contextual attributions, and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Nikhil Churamani , Tolga Dimlioglu , German I. Parisi , Hatice Gunes

Understanding learner emotions in online education is critical for improving engagement and personalized instruction. While prior work in emotion recognition has explored multimodal fusion and temporal modeling, existing methods often rely…

Machine Learning · Computer Science 2025-10-13 S M Rafiuddin

Emotion recognition plays a pivotal role in enhancing human-computer interaction, particularly in movie recommendation systems where understanding emotional content is essential. While multimodal approaches combining audio and video have…

Sound · Computer Science 2025-11-25 Xiangrui Xiong , Zhou Zhou , Guocai Nong , Junlin Deng , Ning Wu

In the Massive Open Online Courses (MOOC) learning scenario, the semantic information of instructional videos has a crucial impact on learners' emotional state. Learners mainly acquire knowledge by watching instructional videos, and the…

Multimedia · Computer Science 2024-04-12 Yuan Zhang , Xiaomei Tao , Hanxu Ai , Tao Chen , Yanling Gan

The field of affective computing has seen significant advancements in exploring the relationship between emotions and emerging technologies. This paper presents a novel and valuable contribution to this field with the introduction of a…

Artificial Intelligence · Computer Science 2025-01-15 Nessrine Farhat , Amine Bohi , Leila Ben Letaifa , Rim Slama

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of real-world emotional…

Artificial Intelligence · Computer Science 2024-11-05 Zebang Cheng , Zhi-Qi Cheng , Jun-Yan He , Jingdong Sun , Kai Wang , Yuxiang Lin , Zheng Lian , Xiaojiang Peng , Alexander Hauptmann

Emotion recognition based on physiological signals is a hot topic and has a wide range of applications, like safe driving, health care and creating a secure society. This paper introduces a physiological dataset PAFEW, which is obtained…

Human-Computer Interaction · Computer Science 2020-02-20 Yang Liu , Tom Gedeon , Sabrina Caldwell , Shouxu Lin , Zi Jin

Facial Emotion Analysis (FEA) extends traditional facial emotion recognition by incorporating explainable, fine-grained reasoning. The task integrates three subtasks: emotion recognition, facial Action Unit (AU) recognition, and AU-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jiulong Wu , Yucheng Shen , Lingyong Yan , Haixin Sun , Deguo Xia , Jizhou Huang , Min Cao

Videos can evoke a range of affective responses in viewers. The ability to predict evoked affect from a video, before viewers watch the video, can help in content creation and video recommendation. We introduce the Evoked Expressions from…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Jennifer J. Sun , Ting Liu , Alan S. Cowen , Florian Schroff , Hartwig Adam , Gautam Prasad

Facial expression recognition (FER) is an essential task for understanding human behaviors. As one of the most informative behaviors of humans, facial expressions are often compound and variable, which is manifested by the fact that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Hanting Li , Hongjing Niu , Zhaoqing Zhu , Feng Zhao

The application of activity recognition in the ``AI + Education" field is gaining increasing attention. However, current work mainly focuses on the recognition of activities in manually captured videos and a limited number of activity…

We present M3ER, a learning-based method for emotion recognition from multiple input modalities. Our approach combines cues from multiple co-occurring modalities (such as face, text, and speech) and also is more robust than other methods to…

Signal Processing · Electrical Eng. & Systems 2019-11-25 Trisha Mittal , Uttaran Bhattacharya , Rohan Chandra , Aniket Bera , Dinesh Manocha

A core process in human cognition is analogical mapping: the ability to identify a similar relational structure between different situations. We introduce a novel task, Visual Analogies of Situation Recognition, adapting the classical…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Yonatan Bitton , Ron Yosef , Eli Strugo , Dafna Shahaf , Roy Schwartz , Gabriel Stanovsky

Predicting contextualised engagement in videos is a long-standing problem that has been popularly attempted by exploiting the number of views or the associated likes using different computational methods. The recent decade has seen a boom…

Artificial Intelligence · Computer Science 2022-01-19 Sujit Roy , Gnaneswara Rao Gorle , Vishal Gaur , Haider Raza , Shoaib Jameel

Automated Facial Expression Recognition (FER) is challenging due to intra-class variations and inter-class similarities. FER can be especially difficult when facial expressions reflect a mixture of various emotions (aka compound…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Ali Pourramezan Fard , Mohammad Mehdi Hosseini , Timothy D. Sweeny , Mohammad H. Mahoor

Automatic Emotion Detection (ED) aims to build systems to identify users' emotions automatically. This field has the potential to enhance HCI, creating an individualised experience for the user. However, ED systems tend to perform poorly on…

Human-Computer Interaction · Computer Science 2023-07-27 Annanda Sousa , Karen Young , Mathieu D'aquin , Manel Zarrouk , Jennifer Holloway