English
Related papers

Related papers: MIDAS: Mixing Ambiguous Data with Soft Labels for …

200 papers

Micro-expressions (MEs) are subtle, transient facial changes with very low intensity, almost imperceptible to the naked eye, yet they reveal a person genuine emotion. They are of great value in lie detection, behavioral analysis, and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Thi Bich Phuong Man , Luu Tu Nguyen , Vu Tram Anh Khuong , Thanh Ha Le , Thi Duyen Ngo

Facial expressions and actions differ among different individuals at varying degrees of intensity given responses to external stimuli, particularly among those that are neurodivergent. Such behaviors affect people in terms of overall…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Manuel Serna-Aguilera , Xuan Bac Nguyen , Han-Seok Seo , Khoa Luu

The hindering problem in facial expression recognition (FER) is the presence of inaccurate annotations referred to as noisy annotations in the datasets. These noisy annotations are present in the datasets inherently because the labeling is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Darshan Gera , Badveeti Naveen Siva Kumar , Bobbili Veerendra Raj Kumar , S Balasubramanian

This paper discusses the benefits of incorporating multimodal data for improving latent emotion recognition accuracy, focusing on micro-expression (ME) and physiological signals (PS). The proposed approach presents a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Liangfei Zhang , Yifei Qian , Ognjen Arandjelovic , Anthony Zhu

Humans modify their facial expressions in order to communicate their internal states and sometimes to mislead observers regarding their true emotional states. Evidence in experimental psychology shows that discriminative facial responses…

Computer Vision and Pattern Recognition · Computer Science 2018-01-10 Kaustubh Kulkarni , Ciprian Adrian Corneanu , Ikechukwu Ofodile , Sergio Escalera , Xavier Baro , Sylwia Hyniewska , Juri Allik , Gholamreza Anbarjafari

Micro-expressions are brief, involuntary facial movements that typically last less than half a second and often reveal genuine emotions. Accurately recognizing these subtle expressions is critical for applications in psychology, security,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Vu Tram Anh Khuong , Luu Tu Nguyen , Thi Bich Phuong Man , Thanh Ha Le , Thi Duyen Ngo

As affective robots become integral in human life, these agents must be able to fairly evaluate human affective expressions without discriminating against specific demographic groups. Identifying bias in Machine Learning (ML) systems as a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Ozgur Kara , Nikhil Churamani , Hatice Gunes

Computer-aided diagnosis systems must make critical decisions from medical images that are often noisy, ambiguous, or conflicting, yet today's models are trained on overly simplistic labels that ignore diagnostic uncertainty. One-hot labels…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Ang Nan Gu , Michael Tsang , Hooman Vaseli , Purang Abolmaesumi , Teresa Tsang

The Complex Emotion Recognition System (CERS) deciphers complex emotional states by examining combinations of basic emotions expressed, their interconnections, and the dynamic variations. Through the utilization of advanced algorithms, CERS…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Javad Hassannataj Joloudari , Mohammad Maftoun , Bahareh Nakisa , Roohallah Alizadehsani , Meisam Yadollahzadeh-Tabari

Facial expressions are important cues to observe human emotions. Facial expression recognition has attracted many researchers for years, but it is still a challenging topic since expression features vary greatly with the head poses,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 S. D. Lalitha , K. K. Thyagharajan

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

Due to its ability to accurately predict emotional state using multimodal features, audiovisual emotion recognition has recently gained more interest from researchers. This paper proposes two methods to predict emotional attributes from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Bagus Tris Atmaja , Masato Akagi

While label fusion from multiple noisy annotations is a well understood concept in data wrangling (tackled for example by the Dawid-Skene (DS) model), we consider the extended problem of carrying out learning when the labels themselves are…

Machine Learning · Statistics 2020-08-10 Michael P. J. Camilleri , Christopher K. I. Williams

As a critical psychological stress response, micro-expressions (MEs) are fleeting and subtle facial movements revealing genuine emotions. Automatic ME recognition (MER) holds valuable applications in fields such as criminal investigation…

Human-Computer Interaction · Computer Science 2025-05-12 Shifeng Liu , Xinglong Mao , Sirui Zhao , Peiming Li , Tong Xu , Enhong Chen

Understanding emotional responses in children with Autism Spectrum Disorder (ASD) during social interaction remains a critical challenge in both developmental psychology and human-robot interaction. This study presents a novel deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Indranil Bhattacharjee , Vartika Narayani Srinet , Anirudha Bhattacharjee , Braj Bhushan , Bishakh Bhattacharya

Adapting a deep learning model to a specific target individual is a challenging facial expression recognition (FER) task that may be achieved using unsupervised domain adaptation (UDA) methods. Although several UDA methods have been…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Muhammad Osama Zeeshan , Muhammad Haseeb Aslam , Soufiane Belharbi , Alessandro Lameiras Koerich , Marco Pedersoli , Simon Bacon , Eric Granger

Data augmentation is a way to increase the diversity of available data by applying constrained transformations on the original data. This strategy has been widely used in image classification but has to the best of our knowledge not yet…

Computation and Language · Computer Science 2021-03-31 Tomas Liesting , Flavius Frasincar , Maria Mihaela Trusca

Affective Behavior Analysis is an important part in human-computer interaction. Existing multi-task affective behavior recognition methods suffer from the problem of incomplete labeled datasets. To tackle this problem, this paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Lingfeng Wang , Shisen Wang , Jin Qi , Kenji Suzuki

Mixup~\cite{zhang2017mixup} is a recently proposed method for training deep neural networks where additional samples are generated during training by convexly combining random pairs of images and their associated labels. While simple to…

Machine Learning · Statistics 2020-01-08 Sunil Thulasidasan , Gopinath Chennupati , Jeff Bilmes , Tanmoy Bhattacharya , Sarah Michalak

In this work, we introduce our submission to the 2nd Affective Behavior Analysis in-the-wild (ABAW) 2021 competition. We train a unified deep learning model on multi-databases to perform two tasks: seven basic facial expressions prediction…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Manh Tu Vu , Marie Beurton-Aimar