English
Related papers

Related papers: Affective Behaviour Analysis Using Pretrained Mode…

200 papers

Micro-expressions (MEs) are involuntary, low-intensity, and short-duration facial expressions that often reveal an individual's genuine thoughts and emotions. Most existing ME analysis methods rely on window-level classification with fixed…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Zizheng Guo , Bochao Zou , Yinuo Jia , Xiangyu Li , Huimin Ma

In this project, we created a database with two types of annotations used in the emotion recognition domain : Action Units and Valence Arousal to try to achieve better results than with only one model. The originality of the approach is…

Machine Learning · Computer Science 2019-12-17 Valentin Richer , Dimitrios Kollias

The paper describes our proposed methodology for the six basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2022. In Learing from Synthetic Data(LSD) task, facial expression recognition (FER)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Shuyi Mao , Xinpeng Li , Junyao Chen , Xiaojiang Peng

Emotion recognition is a critical aspect of human interaction. This topic garnered significant attention in the field of artificial intelligence. In this study, we investigate the performance of convolutional neural network (CNN) and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Samay Nathani

We present a novel method for constructing Variational Autoencoder (VAE). Instead of using pixel-by-pixel loss, we enforce deep feature consistency between the input and the output of a VAE, which ensures the VAE's output to preserve the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Xianxu Hou , Linlin Shen , Ke Sun , Guoping Qiu

Machine learning using transformers has shown great potential in medical imaging, but its real-world applicability remains limited due to the scarcity of annotated data. In this study, we propose a practical framework for the few-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Mengyu Li , Guoyao Shen , Chad W. Farris , Xin Zhang

We present MuMTAffect, a novel Multimodal Multitask Affective Embedding Network designed for joint emotion classification and personality prediction (re-identification) from short physiological signal segments. MuMTAffect integrates…

Human-Computer Interaction · Computer Science 2025-09-05 Meisam Jamshidi Seikavandi , Fabricio Batista Narcizo , Ted Vucurevich , Andrew Burke Dittberner , Paolo Burelli

In this report, we present our solution for the Action Unit (AU) Detection Challenge, in 8th Competition on Affective Behavior Analysis in-the-wild. In order to achieve robust and accurate classification of facial action unit in the wild…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jun Yu , Yunxiang Zhang , Xilong Lu , Yang Zheng , Yongqi Wang , Lingsi Zhu

Facial Expression Recognition(FER) is one of the most important topic in Human-Computer interactions(HCI). In this work we report details and experimental results about a facial expression recognition method based on state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Donato Cafarelli , Fabio Valerio Massoli , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

The Masked Autoencoder (MAE) has recently demonstrated effectiveness in pre-training Vision Transformers (ViT) for analyzing natural images. By reconstructing complete images from partially masked inputs, the ViT encoder gathers contextual…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Badhan Kumar Das , Gengyan Zhao , Han Liu , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

Utilizing large pre-trained models for specific tasks has yielded impressive results. However, fully fine-tuning these increasingly large models is becoming prohibitively resource-intensive. This has led to a focus on more…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Shreyank N Gowda , Boyan Gao , David A. Clifton

Deep models for facial expression recognition achieve high performance by training on large-scale labeled data. However, publicly available datasets contain uncertain facial expressions caused by ambiguous annotations or confusing emotions,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Yang Liu , Xingming Zhang , Janne Kauttonen , Guoying Zhao

In this paper, we present our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes four sub-challenges of Valence-Arousal (VA) Estimation, Expression (Expr) Classification, Action…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Ziyang Zhang , Liuwei An , Zishun Cui , Ao xu , Tengteng Dong , Yueqi Jiang , Jingyi Shi , Xin Liu , Xiao Sun , Meng Wang

Facial expression manipulation aims at editing facial expression with a given condition. Previous methods edit an input image under the guidance of a discrete emotion label or absolute condition (e.g., facial action units) to possess the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Jun Ling , Han Xue , Li Song , Shuhui Yang , Rong Xie , Xiao Gu

Human emotion recognition plays an important role in human-computer interaction. In this paper, we present our approach to the Valence-Arousal (VA) Estimation Challenge, Expression (Expr) Classification Challenge, and Action Unit (AU)…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Weiwei Zhou , Jiada Lu , Zhaolong Xiong , Weifeng Wang

Engagement estimation from face video remains challenging because facial evidence is often incomplete, labeled data are limited, and engagement annotations are subjective. We present PriorNet, a prior-guided framework that injects…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Alexander Vedernikov

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Large Language Models primarily operate through text-based inputs and outputs, yet human emotion is communicated through both verbal and non-verbal cues, including facial expressions. While Vision-Language Models analyze facial expressions…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Vaibhav Mehra , Guy Laban , Hatice Gunes

Facial Expression Recognition (FER) in the wild is extremely challenging due to occlusions, variant head poses, face deformation and motion blur under unconstrained conditions. Although substantial progresses have been made in automatic FER…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Fuyan Ma , Bin Sun , Shutao Li

Micro-expressions are hard to spot due to fleeting and involuntary moments of facial muscles. Interpretation of micro emotions from video clips is a challenging task. In this paper we propose an affective-motion imaging that cumulates rapid…

Multimedia · Computer Science 2021-04-16 Monu Verma , Santosh Kumar Vipparthi , Girdhari Singh