English
Related papers

Related papers: Training Affective Computer Vision Models by Crowd…

200 papers

Understanding the nuances of speech emotion dataset curation and labeling is essential for assessing speech emotion recognition (SER) model potential in real-world applications. Most training and evaluation datasets contain acted or…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-17 Amrit Romana , Jaya Narain , Tien Dung Tran , Andrea Davis , Jason Fong , Ramya Rasipuram , Vikramjit Mitra

We present a Fourier-based machine learning technique that characterizes and detects facial emotions. The main challenging task in the development of machine learning (ML) models for classifying facial emotions is the detection of accurate…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Aishwarya Gouru , Shan Suthaharan

Multi-emotion sentiment classification is a natural language processing (NLP) problem with valuable use cases on real-world data. We demonstrate that large-scale unsupervised language modeling combined with finetuning offers a practical…

Computation and Language · Computer Science 2018-12-05 Neel Kant , Raul Puri , Nikolai Yakovenko , Bryan Catanzaro

Study Objective: Machine learning models have advanced medical image processing and can yield faster, more accurate diagnoses. Despite a wealth of available medical imaging data, high-quality labeled data for model training is lacking. We…

Mobile digital therapeutics for autism spectrum disorder (ASD) often target emotion recognition and evocation, which is a challenge for children with ASD. While such mobile applications often use computer vision machine learning (ML) models…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Ali Kargarandehkordi , Matti Kaisti , Peter Washington

We consider crowdsourced labeling under a $d$-type worker-task specialization model, where each worker and task is associated with one particular type among a finite set of types and a worker provides a more reliable answer to tasks of the…

Human-Computer Interaction · Computer Science 2021-06-10 Doyeon Kim , Hye Won Chung

Background: When neural network emotion and sentiment classifiers are used in public health informatics studies, biases present in the classifiers could produce inadvertently misleading results. Objective: This study assesses the impact of…

Computation and Language · Computer Science 2021-11-16 Jared Mowery

Human affective behavior analysis aims to delve into human expressions and behaviors to deepen our understanding of human emotions. Basic expression categories (EXPR) and Action Units (AUs) are two essential components in this analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Li Lin , Sarah Papabathini , Xin Wang , Shu Hu

Human data labeling is an important and expensive task at the heart of supervised learning systems. Hierarchies help humans understand and organize concepts. We ask whether and how concept hierarchies can inform the design of annotation…

Human-Computer Interaction · Computer Science 2023-02-24 Rickard Stureborg , Bhuwan Dhingra , Jun Yang

Datasets with noisy labels are a common occurrence in practical applications of classification methods. We propose a simple probabilistic method for training deep classifiers under input-dependent (heteroscedastic) label noise. We assume an…

Machine Learning · Computer Science 2020-11-16 Mark Collier , Basil Mustafa , Efi Kokiopoulou , Rodolphe Jenatton , Jesse Berent

Recent studies have shown that the labels collected from crowdworkers can be discriminatory with respect to sensitive attributes such as gender and race. This raises questions about the suitability of using crowdsourced data for further…

Artificial Intelligence · Computer Science 2019-03-04 Naman Goel , Boi Faltings

Generative adversarial networks offer the possibility to generate deceptively real images that are almost indistinguishable from actual photographs. Such systems however rely on the presence of large datasets to realistically replicate the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Silvan Mertes , Dominik Schiller , Florian Lingenfelser , Thomas Kiderle , Valentin Kroner , Lama Diab , Elisabeth André

Emotional talking-head generation has emerged as a pivotal research area at the intersection of computer vision and multimodal artificial intelligence, with its core value lying in enhancing human-computer interaction through immersive and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Hanlei Shi , Leyuan Qu , Yu Liu , Di Gao , Yuhua Zheng , Taihao Li

Crowdsourcing has attracted much attention for its convenience to collect labels from non-expert workers instead of experts. However, due to the high level of noise from the non-experts, an aggregation model that learns the true label by…

Machine Learning · Computer Science 2021-05-14 Hanlu Wu , Tengfei Ma , Lingfei Wu , Shouling Ji

The impact of culture in visual emotion perception has recently captured the attention of multimedia research. In this study, we pro- vide powerful computational linguistics tools to explore, retrieve and browse a dataset of 16K…

Computation and Language · Computer Science 2016-06-09 Nikolaos Pappas , Miriam Redi , Mercan Topkara , Brendan Jou , Hongyi Liu , Tao Chen , Shih-Fu Chang

Human emotions are inherently ambiguous and impure. When designing systems to anticipate human emotions based on speech, the lack of emotional purity must be considered. However, most of the current methods for speech emotion classification…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-13 Shuiyang Mao , P. C. Ching , Tan Lee

Do men and women perceive emotions differently? Popular convictions place women as more emotionally perceptive than men. Empirical findings, however, remain inconclusive. Most prior studies focus on visual modalities. In addition, almost…

Computation and Language · Computer Science 2019-11-05 Shahan Ali Memon , Hira Dhamyal , Oren Wright , Daniel Justice , Vijaykumar Palat , William Boler , Bhiksha Raj , Rita Singh

Over the past two decades, speech emotion recognition (SER) has received growing attention. To train SER systems, researchers collect emotional speech databases annotated by crowdsourced or in-house raters who select emotions from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Huang-Cheng Chou , Chi-Chun Lee

As the number of applications that use machine learning algorithms increases, the need for labeled data useful for training such algorithms intensifies. Getting labels typically involves employing humans to do the annotation, which directly…

Machine Learning · Computer Science 2013-07-16 Alexandros Ntoulas , Omar Alonso , Vasilis Kandylas

Emotions are reactions that can be expressed through a variety of social signals. For example, anger can be expressed through a scowl, narrowed eyes, a long stare, or many other expressions. This complexity is problematic when attempting to…

Robotics · Computer Science 2021-03-09 Ghazal Saheb Jam , Jimin Rhim , Angelica Lim