English
Related papers

Related papers: Video-based Facial Micro-Expression Analysis: A Su…

200 papers

Facial expression analysis is central to understanding human behavior, yet existing coding systems such as the Facial Action Coding System (FACS) are constrained by limited coverage and costly manual annotation. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Minh Tran , Maksim Siniukov , Zhangyu Jin , Mohammad Soleymani

Videos can evoke a range of affective responses in viewers. The ability to predict evoked affect from a video, before viewers watch the video, can help in content creation and video recommendation. We introduce the Evoked Expressions from…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Jennifer J. Sun , Ting Liu , Alan S. Cowen , Florian Schroff , Hartwig Adam , Gautam Prasad

Facial Expression Recognition faces two core challenges. The first is class imbalance in public datasets, which skews the learning process and weakens generalization. The second is related to privacy and data collection constraints, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ali Azmoudeh , Erdi Sarıtaş , Ömer Yıldırım , Hazım Kemal Ekenel

Emotions play a central role in the social life of every human being, and their study, which represents a multidisciplinary subject, embraces a great variety of research fields. Especially concerning the latter, the analysis of facial…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Fabio Valerio Massoli , Donato Cafarelli , Claudio Gennaro , Giuseppe Amato , Fabrizio Falchi

Complex emotion recognition is a cognitive task that has so far eluded the same excellent performance of other tasks that are at or above the level of human cognition. Emotion recognition through facial expressions is particularly difficult…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Angus Maiden , Bahareh Nakisa

Facial emotion recognition is an essential and important aspect of the field of human-machine interaction. Past research on facial emotion recognition focuses on the laboratory environment. However, it faces many challenges in real-world…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Zheng Lian , Ya Li , Jian-Hua Tao , Jian Huang , Ming-Yue Niu

Human emotions analysis has been the focus of many studies, especially in the field of Affective Computing, and is important for many applications, e.g. human-computer intelligent interaction, stress analysis, interactive games, animations,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Mohammad Rami Koujan , Luma Alharbawee , Giorgos Giannakakis , Nicolas Pugeault , Anastasios Roussos

Micro-Expression (ME) is the spontaneous, involuntary movement of a face that can reveal the true feeling. Recently, increasing researches have paid attention to this field combing deep learning techniques. Action units (AUs) are the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Ling Lo , Hong-Xia Xie , Hong-Han Shuai , Wen-Huang Cheng

Smile detection from unconstrained facial images is a specialized and challenging problem. As one of the most informative expressions, smiles convey basic underlying emotions, such as happiness and satisfaction, which lead to multiple…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Xin Guo , Luisa F. Polanía , Kenneth E. Barner

Visual emotion analysis holds significant research value in both computer vision and psychology. However, existing methods for visual emotion analysis suffer from limited generalizability due to the ambiguity of emotion perception and the…

Artificial Intelligence · Computer Science 2025-07-21 Chuang Chen , Xiao Sun , Zhi Liu

Dynamic facial expression recognition (FER) databases provide important data support for affective computing and applications. However, most FER databases are annotated with several basic mutually exclusive emotional categories and contain…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yuanyuan Liu , Wei Dai , Chuanxu Feng , Wenbin Wang , Guanghao Yin , Jiabei Zeng , Shiguang Shan

Cross-database micro-expression recognition (CDMER) is one of recently emerging and interesting problem in micro-expression analysis. CDMER is more challenging than the conventional micro-expression recognition (MER), because the training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Yuan Zong , Tong Zhang , Wenming Zheng , Xiaopeng Hong , Chuangao Tang , Zhen Cui , Guoying Zhao

Facial expression recognition (FER) algorithms work well in constrained environments with little or no occlusion of the face. However, real-world face occlusion is prevalent, most notably with the need to use a face mask in the current…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Sridhar Sola , Darshan Gera

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

Recognising expressive behaviours in face videos is a long-standing challenge in Affective Computing. Despite significant advancements in recent years, it still remains a challenge to build a robust and reliable system for naturalistic and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Mani Kumar Tellamekala , Shashank Jaiswal , Thomas Smith , Timur Alamev , Gary McKeown , Anthony Brown , Michel Valstar

Datasets play an important role in the progress of facial expression recognition algorithms, but they may suffer from obvious biases caused by different cultures and collection conditions. To look deeper into this bias, we first conduct…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Shan Li , Weihong Deng

In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expressions. This study explores the potential for detecting a…

Multimedia · Computer Science 2025-05-13 Jiehui Jia , Huan Zhang , Jinhua Liang

Facial micro-expression recognition (MER) is a challenging problem, due to transient and subtle micro-expression (ME) actions. Most existing methods depend on hand-crafted features, key frames like onset, apex, and offset frames, or deep…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Zhiwen Shao , Yifan Cheng , Feiran Li , Yong Zhou , Xuequan Lu , Yuan Xie , Lizhuang Ma

Effective human-AI interaction relies on AI's ability to accurately perceive and interpret human emotions. Current benchmarks for vision and vision-language models are severely limited, offering a narrow emotional spectrum that overlooks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Christoph Schuhmann , Robert Kaczmarczyk , Gollam Rabby , Felix Friedrich , Maurice Kraus , Krishna Kalyan , Kourosh Nadi , Huu Nguyen , Kristian Kersting , Sören Auer

This paper discusses the benefits of incorporating multimodal data for improving latent emotion recognition accuracy, focusing on micro-expression (ME) and physiological signals (PS). The proposed approach presents a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Liangfei Zhang , Yifei Qian , Ognjen Arandjelovic , Anthony Zhu