English
Related papers

Related papers: Using Self-Supervised Auxiliary Tasks to Improve F…

200 papers

Fine-grained emotion recognition (FER) plays a vital role in various fields, such as disease diagnosis, personalized recommendations, and multimedia mining. However, existing FER methods face three key challenges in real-world applications:…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Jingyao Wang , Wenwen Qiang , Changwen Zheng , Fuchun Sun

Facial Expression Recognition is a vital research topic in most fields ranging from artificial intelligence and gaming to Human-Computer Interaction (HCI) and Psychology. This paper proposes a hybrid model for Facial Expression recognition,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Ozioma Collins Oguine , Kanyifeechukwu Jane Oguine , Hashim Ibrahim Bisallah , Daniel Ofuani

Existing facial expression recognition (FER) methods typically fine-tune a pre-trained visual encoder using discrete labels. However, this form of supervision limits to specify the emotional concept of different facial expressions. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Hangyu Li , Yihan Xu , Jiangchao Yao , Nannan Wang , Xinbo Gao , Bo Han

As artificial intelligence (AI) systems become increasingly embedded in our daily life, the ability to recognize and adapt to human emotions is essential for effective human-computer interaction. Facial expression recognition (FER) provides…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Thibault Geoffroy , Myriam Maumy , Lionel Prevost

Facial Expression Recognition (FER) is an important task in computer vision and has wide applications in human-computer interaction, intelligent security, emotion analysis, and other fields. However, the limited size of FER datasets limits…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun Yu , Zhongpeng Cai , Renda Li , Gongpeng Zhao , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Facial affect analysis remains a challenging task with its setting transitioned from lab-controlled to in-the-wild situations. In this paper, we present novel frameworks to handle the two challenges in the 4th Affective Behavior Analysis…

Machine Learning · Computer Science 2022-07-21 Siyang Li , Yifan Xu , Huanyu Wu , Dongrui Wu , Yingjie Yin , Jiajiong Cao , Jingting Ding

Recent advancements in Deep and Self-Supervised Learning (SSL) have led to substantial improvements in Speech Emotion Recognition (SER) performance, reaching unprecedented levels. However, obtaining sufficient amounts of accurately labeled…

Computation and Language · Computer Science 2025-02-25 Bulat Khaertdinov , Pedro Jeuris , Annanda Sousa , Enrique Hortal

Face attribute estimation has many potential applications in video surveillance, face retrieval, and social media. While a number of methods have been proposed for face attribute estimation, most of them did not explicitly consider the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Hu Han , Anil K. Jain , Fang Wang , Shiguang Shan , Xilin Chen

Facial expression plays an important role in understanding human emotions. Most recently, deep learning based methods have shown promising for facial expression recognition. However, the performance of the current state-of-the-art facial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Ping Liu , Yunchao Wei , Zibo Meng , Weihong Deng , Joey Tianyi Zhou , Yi Yang

This paper presents a novel end-to-end LLM-empowered explainable speech emotion recognition (SER) approach. Fine-grained speech emotion descriptor (SED) features, e.g., pitch, tone and emphasis, are disentangled from HuBERT SSL…

This study takes a preliminary step toward teaching computers to recognize human emotions through Facial Emotion Recognition (FER). Transfer learning is applied using ResNeXt, EfficientNet models, and an ArcFace model originally trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Dylan Waldner , Shyamal Mitra

Facial expression recognition (FER) is a fundamental task in affective computing with applications in human-computer interaction, mental health analysis, and behavioral understanding. In this paper, we propose SMILE-VLM, a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Muzammil Behzad

Facial expressions play a fundamental role in human communication. Indeed, they typically reveal the real emotional status of people beyond the spoken language. Moreover, the comprehension of human affect based on visual patterns is a key…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Fabio Valerio Massoli , Donato Cafarelli , Giuseppe Amato , Fabrizio Falchi

Automatically recognizing emotional intent using facial expression has been a thoroughly investigated topic in the realm of computer vision. Facial Expression Recognition (FER), being a supervised learning task, relies heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Syed Sameen Ahmad Rizvi , Aryan Seth , Pratik Narang

Facial expression recognition (FER) is a subset of computer vision with important applications for human-computer-interaction, healthcare, and customer service. FER represents a challenging problem-space because accurate classification…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Ezra Engel , Lishan Li , Chris Hudy , Robert Schleusner

Facial Expression Recognition (FER) plays a crucial role in computer vision and finds extensive applications across various fields. This paper aims to present our approach for the upcoming 6th Affective Behavior Analysis in-the-Wild (ABAW)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Jun Yu , Zhihong Wei , Zhongpeng Cai , Gongpeng Zhao , Zerui Zhang , Yongqi Wang , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Despite the success of deep neural networks on facial action unit (AU) detection, better performance depends on a large number of training images with accurate AU annotations. However, labeling AU is time-consuming, expensive, and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Yong Li , Shiguang Shan

Recent state-of-the-art semi-supervised learning (SSL) methods use a combination of image-based transformations and consistency regularization as core components. Such methods, however, are limited to simple transformations such as…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Chia-Wen Kuo , Chih-Yao Ma , Jia-Bin Huang , Zsolt Kira

Facial Expression Recognition (FER) in the wild is extremely challenging due to occlusions, variant head poses, face deformation and motion blur under unconstrained conditions. Although substantial progresses have been made in automatic FER…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Fuyan Ma , Bin Sun , Shutao Li

In many domains, including online education, healthcare, security, and human-computer interaction, facial emotion recognition (FER) is essential. Real-world FER is still difficult despite its significance because of some factors such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Deeptimaan Banerjee , Prateek Gothwal , Ashis Kumer Biswas