English
Related papers

Related papers: Facial Emotion Recognition with Noisy Multi-task A…

200 papers

In this paper we explore audiovisual emotion recognition under noisy acoustic conditions with a focus on speech features. We attempt to answer the following research questions: (i) How does speech emotion recognition perform on noisy data?…

Sound · Computer Science 2021-03-03 Michael Neumann , Ngoc Thang Vu

Distant supervision based methods for entity and relation extraction have received increasing popularity due to the fact that these methods require light human annotation efforts. In this paper, we consider the problem of \textit{shifted…

Computation and Language · Computer Science 2020-04-22 Daoyuan Chen , Yaliang Li , Kai Lei , Ying Shen

Over the past few years many research efforts have been devoted to the field of affect analysis. Various approaches have been proposed for: i) discrete emotion recognition in terms of the primary facial expressions; ii) emotion analysis in…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Dimitrios Kollias , Stefanos Zafeiriou

Automatic affect recognition has applications in many areas such as education, gaming, software development, automotives, medical care, etc. but it is non trivial task to achieve appreciable performance on in-the-wild data sets. In-the-wild…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Darshan Gera , Badveeti Naveen Siva Kumar , Bobbili Veerendra Raj Kumar , S Balasubramanian

We propose a meta-learning method for learning from multiple noisy annotators. In many applications such as crowdsourcing services, labels for supervised learning are given by multiple annotators. Since the annotators have different skills…

Machine Learning · Computer Science 2025-06-13 Atsutoshi Kumagai , Tomoharu Iwata , Taishi Nishiyama , Yasutoshi Ida , Yasuhiro Fujiwara

Dynamic facial expression recognition (FER) databases provide important data support for affective computing and applications. However, most FER databases are annotated with several basic mutually exclusive emotional categories and contain…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yuanyuan Liu , Wei Dai , Chuanxu Feng , Wenbin Wang , Guanghao Yin , Jiabei Zeng , Shiguang Shan

Emotion classifiers traditionally predict discrete emotions. However, emotion expressions are often subjective, thus requiring a method to handle subjective labels. We explore the use of crowdsourcing to acquire reliable soft-target labels…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Peter Washington , Onur Cezmi Mutlu , Emilie Leblanc , Aaron Kline , Cathy Hou , Brianna Chrisman , Nate Stockham , Kelley Paskov , Catalin Voss , Nick Haber , Dennis Wall

Over the past two decades, speech emotion recognition (SER) has received growing attention. To train SER systems, researchers collect emotional speech databases annotated by crowdsourced or in-house raters who select emotions from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Huang-Cheng Chou , Chi-Chun Lee

In affective computing, datasets often contain multiple annotations from different annotators, which may lack full agreement. Typically, these annotations are merged into a single gold standard label, potentially losing valuable inter-rater…

Human-Computer Interaction · Computer Science 2025-05-28 Ibrahim Shoer , Engin Erzin

Facial Expression Analysis remains a challenging task due to unexpected task-irrelevant noise, such as identity, head pose, and background. To address this issue, this paper proposes a novel framework, called Norface, that is unified for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Hanwei Liu , Rudong An , Zhimeng Zhang , Bowen Ma , Wei Zhang , Yan Song , Yujing Hu , Wei Chen , Yu Ding

Affective Behavior Analysis is an important part in human-computer interaction. Existing multi-task affective behavior recognition methods suffer from the problem of incomplete labeled datasets. To tackle this problem, this paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Lingfeng Wang , Shisen Wang , Jin Qi , Kenji Suzuki

Classification of human emotions remains an important and challenging task for many computer vision algorithms, especially in the era of humanoid robots which coexist with humans in their everyday life. Currently proposed methods for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Ivona Tautkute , Tomasz Trzcinski , Adam Bielski

Facial valence/arousal, expression and action unit are related tasks in facial affective analysis. However, the tasks only have limited performance in the wild due to the various collected conditions. The 4th competition on affective…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yanan Chang , Yi Wu , Xiangyu Miao , Jiahe Wang , Shangfei Wang

The real-world facial expression recognition (FER) datasets suffer from noisy annotations due to crowd-sourcing, ambiguity in expressions, the subjectivity of annotators and inter-class similarity. However, the recent deep networks have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Darshan Gera , Naveen Siva Kumar Badveeti , Bobbili Veerendra Raj Kumar , S Balasubramanian

Given the similarity between facial expression categories, the presence of compound facial expressions, and the subjectivity of annotators, facial expression recognition (FER) datasets often suffer from ambiguity and noisy labels. Ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Ziyang Zhang , Xiao Sun , Liuwei An , Meng Wang

Human emotions involve basic and compound facial expressions. However, current research on facial expression recognition (FER) mainly focuses on basic expressions, and thus fails to address the diversity of human emotions in practical…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Xinyi Zou , Yan Yan , Jing-Hao Xue , Si Chen , Hanzi Wang

Current deep learning paradigms largely benefit from the tremendous amount of annotated data. However, the quality of the annotations often varies among labelers. Multi-observer studies have been conducted to study these annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Xiaosong Wang , Ziyue Xu , Dong Yang , Leo Tam , Holger Roth , Daguang Xu

When human annotators are given a choice about what to label in an image, they apply their own subjective judgments on what to ignore and what to mention. We refer to these noisy "human-centric" annotations as exhibiting human reporting…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Ishan Misra , C. Lawrence Zitnick , Margaret Mitchell , Ross Girshick

Facial emotion recognition is an essential and important aspect of the field of human-machine interaction. Past research on facial emotion recognition focuses on the laboratory environment. However, it faces many challenges in real-world…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Zheng Lian , Ya Li , Jian-Hua Tao , Jian Huang , Ming-Yue Niu

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…