English
Related papers

Related papers: Uncertain Facial Expression Recognition via Multi-…

200 papers

When recognizing emotions, subtle nuances in displays of emotion generate ambiguity or uncertainty in emotion perception. Emotion uncertainty has been previously interpreted as inter-rater disagreement among multiple annotators. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Didan Deng , Liang Wu , Bertram E. Shi

Facial Emotion Recognition is an inherently difficult problem, due to vast differences in facial structures of individuals and ambiguity in the emotion displayed by a person. Recently, a lot of work is being done in the field of Facial…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Aakash Saroop , Pathik Ghugare , Sashank Mathamsetty , Vaibhav Vasani

In this paper, we describe the results of the HSEmotion team in two tasks of the seventh Affective Behavior Analysis in-the-wild (ABAW) competition, namely, multi-task learning for simultaneous prediction of facial expression, valence,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Andrey V. Savchenko

Over the past decades the machine and deep learning community has celebrated great achievements in challenging tasks such as image classification. The deep architecture of artificial neural networks together with the plenitude of available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Jessica Deuschel , Bettina Finzel , Ines Rieger

We present MuMTAffect, a novel Multimodal Multitask Affective Embedding Network designed for joint emotion classification and personality prediction (re-identification) from short physiological signal segments. MuMTAffect integrates…

Human-Computer Interaction · Computer Science 2025-09-05 Meisam Jamshidi Seikavandi , Fabricio Batista Narcizo , Ted Vucurevich , Andrew Burke Dittberner , Paolo Burelli

Despite the success of deep neural networks on facial action unit (AU) detection, better performance depends on a large number of training images with accurate AU annotations. However, labeling AU is time-consuming, expensive, and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Yong Li , Shiguang Shan

Facial Attribute Classification (FAC) has attracted increasing attention in computer vision and pattern recognition. However, state-of-the-art FAC methods perform face detection/alignment and FAC independently. The inherent dependencies…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Longbiao Mao , Yan Yan , Jing-Hao Xue , Hanzi Wang

Facial action unit (AU) detection remains challenging because it involves heterogeneous, AU-specific uncertainties arising at both the representation and decision stages. Recent methods have improved discriminative feature learning, but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yuze Li , Zhilei Liu

Facial Action Unit (AU) detection is a crucial task in affective computing and social robotics as it helps to identify emotions expressed through facial expressions. Anatomically, there are innumerable correlations between AUs, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Xin Liu , Kaishen Yuan , Xuesong Niu , Jingang Shi , Zitong Yu , Huanjing Yue , Jingyu Yang

Dynamic Facial Expression Recognition(DFER) is a rapidly evolving field of research that focuses on the recognition of time-series facial expressions. While previous research on DFER has concentrated on feature learning from a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Feng Liu , Lingna Gu , Chen Shi , Xiaolan Fu

Facial Expression Recognition has a wide application prospect in social robotics, health care, driver fatigue monitoring, and many other practical scenarios. Automatic recognition of facial expressions has been extensively studied by the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Zijian Li , Yan Wang , Bowen Guan , JianKai Yin

Attribute recognition, particularly facial, extracts many labels for each image. While some multi-task vision problems can be decomposed into separate tasks and stages, e.g., training independent models for each task, for a growing set of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Ethan Rudd , Manuel Günther , Terrance Boult

By utilizing label distribution learning, a probability distribution is assigned for a facial image to express a compound emotion, which effectively improves the problem of label uncertainties and noises occurred in one-hot labels. In…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Shasha Mao , Guanghui Shi , Licheng Jiao , Shuiping Gou , Yangyang Li , Lin Xiong , Boxin Shi

Multimodal foundation models have significantly improved feature representation by integrating information from multiple modalities, making them highly suitable for a broader set of applications. However, the exploration of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kaiwen Zheng , Xuri Ge , Junchen Fu , Jun Peng , Joemon M. Jose

In this paper, a deep learning framework is proposed for automatic facial emotion based on deep convolutional networks. In order to increase the generalization ability and the robustness of the method, the dataset size is increased by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Serap Kırbız

Facial expression recognition is an essential task for various applications, including emotion detection, mental health analysis, and human-machine interactions. In this paper, we propose a multi-modal facial expression recognition method…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun-Hwa Kim , Namho Kim , Chee Sun Won

Most facial expression recognition (FER) models are trained on large-scale expression data with centralized learning. Unfortunately, collecting a large amount of centralized expression data is difficult in practice due to privacy concerns…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Hu Ding , Yan Yan , Yang Lu , Jing-Hao Xue , Hanzi Wang

It is difficult to accurately label ambiguous and complex shaped targets manually by binary masks. The weakness of binary mask under-expression is highlighted in medical image segmentation, where blurring is prevalent. In the case of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Lin Wang , Lie Ju , Xin Wang , Wanji He , Donghao Zhang , Yelin Huang , Zhiwen Yang , Xuan Yao , Xin Zhao , Xiufen Ye , Zongyuan Ge

Face images contain a wide variety of attribute information. In this paper, we propose a generalized framework for joint estimation of ordinal and nominal attributes based on information sharing. We tackle the correlation problem between…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Huaqing Yuan , Yi He , Peng Du , Lu Song

Modern artificial intelligence is supported by machine learning models (e.g., foundation models) that are pretrained on a massive data corpus and then adapted to solve a variety of downstream tasks. To summarize performance across multiple…

Machine Learning · Statistics 2025-01-09 Rachel Longjohn , Giri Gopalan , Emily Casleton