English
Related papers

Related papers: Controlling for Confounders in Multimodal Emotion …

200 papers

In this work, we explore the dependencies between speaker recognition and emotion recognition. We first show that knowledge learned for speaker recognition can be reused for emotion recognition through transfer learning. Then, we show the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-13 Raghavendra Pappagari , Tianzi Wang , Jesus Villalba , Nanxin Chen , Najim Dehak

Psychological stress detection is an important task for mental healthcare research, but there has been little prior work investigating the effectiveness of psychological stress models on minority individuals, who are especially vulnerable…

Computation and Language · Computer Science 2023-11-30 Jonathan Ivey , Susan Gauch

While emotion and mood interchangeably used, they differ in terms of duration, intensity and attributes. Even as multiple psychology studies examine the mood-emotion relationship, mood prediction has barely been studied. Recent machine…

Human-Computer Interaction · Computer Science 2023-03-14 Soujanya Narayana , Ramanathan Subramanian , Ibrahim Radwan , Roland Goecke

Emotion classification is a challenging task in NLP due to the inherent idiosyncratic and subjective nature of linguistic expression, especially with code-mixed data. Pre-trained language models (PLMs) have achieved high performance for…

Computation and Language · Computer Science 2024-02-06 Kushal Tatariya , Heather Lent , Johannes Bjerva , Miryam de Lhoneux

Multimodal emotion recognition is an important research topic in artificial intelligence, whose main goal is to integrate multimodal clues to identify human emotional states. Current works generally assume accurate labels for benchmark…

Emotion plays a fundamental role in human interaction, and therefore systems capable of identifying emotions in speech are crucial in the context of human-computer interaction. Speech emotion recognition (SER) is a challenging problem,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Lucas Ueda , João Lima , Leonardo Marques , Paula Costa

Automated emotion detection in speech is a challenging task due to the complex interdependence between words and the manner in which they are spoken. It is made more difficult by the available datasets; their small size and incompatible…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-16 Amith Ananthram , Kailash Karthik Saravanakumar , Jessica Huynh , Homayoon Beigi

There are individual differences in expressive behaviors driven by cultural norms and personality. This between-person variation can result in reduced emotion recognition performance. Therefore, personalization is an important step in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Minh Tran , Yufeng Yin , Mohammad Soleymani

Emotion recognition from speech is one of the key steps towards emotional intelligence in advanced human-machine interaction. Identifying emotions in human speech requires learning features that are robust and discriminative across diverse…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-30 Alison Marczewski , Adriano Veloso , Nívio Ziviani

Computer-supported simulation enables a practical alternative for medical training purposes. This study investigates the co-occurrence of facial-recognition-derived emotions and socially shared regulation of learning (SSRL) interactions in…

Human-Computer Interaction · Computer Science 2025-10-21 Xiaoshan Huang , Tianlong Zhong , Haolun Wu , Yeyu Wang , Ethan Churchill , Xue Liu , David Williamson Shaffer

The aim of this research is development of rule based decision model for emotion recognition. This research also proposes using the rules for augmenting inter-corporal recognition accuracy in multimodal systems that use supervised learning…

Human-Computer Interaction · Computer Science 2016-07-12 Amol Patwardhan , Gerald Knapp

Affective computing - combining sensor technology, machine learning, and psychology - have been studied for over three decades and is employed in AI-powered technologies to enhance emotional awareness in AI systems, and detect symptoms of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Anders Rolighed Larsen , Sneha Das , Nicole Nadine Lønfeldt , Paula Petcu , Line Clemmensen

Multi-modal affect recognition models leverage complementary information in different modalities to outperform their uni-modal counterparts. However, due to the unavailability of modality-specific sensors or data, multi-modal models may not…

Image and Video Processing · Electrical Eng. & Systems 2021-08-03 Vandana Rajan , Alessio Brutti , Andrea Cavallaro

Introduction Schizophrenia is a severe mental disorder, and early diagnosis is key to improving outcomes. Its complexity makes predicting onset and progression challenging. EEG has emerged as a valuable tool for studying schizophrenia, with…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Gideon Vos , Maryam Ebrahimpour , Liza van Eijk , Zoltan Sarnyai , Mostafa Rahimi Azghadi

Affective Computing (AC) is essential for advancing Artificial General Intelligence (AGI), with emotion recognition serving as a key component. However, human emotions are inherently dynamic, influenced not only by an individual's…

Computation and Language · Computer Science 2025-03-31 Yupei Li , Qiyang Sun , Sunil Munthumoduku Krishna Murthy , Emran Alturki , Björn W. Schuller

The subjective perception of emotion leads to inconsistent labels from human annotators. Typically, utterances lacking majority-agreed labels are excluded when training an emotion classifier, which cause problems when encountering ambiguous…

Computation and Language · Computer Science 2024-10-14 Wen Wu , Bo Li , Chao Zhang , Chung-Cheng Chiu , Qiujia Li , Junwen Bai , Tara N. Sainath , Philip C. Woodland

Emotion recognition is involved in several real-world applications. With an increase in available modalities, automatic understanding of emotions is being performed more accurately. The success in Multimodal Emotion Recognition (MER),…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Riccardo Franceschini , Enrico Fini , Cigdem Beyan , Alessandro Conti , Federica Arrigoni , Elisa Ricci

Transformer models have significantly advanced the field of emotion recognition. However, there are still open challenges when exploring open-ended queries for Large Language Models (LLMs). Although current models offer good results,…

Recently, generative adversarial networks and adversarial autoencoders have gained a lot of attention in machine learning community due to their exceptional performance in tasks such as digit classification and face recognition. They map…

Machine Learning · Statistics 2018-06-07 Saurabh Sahu , Rahul Gupta , Ganesh Sivaraman , Wael AbdAlmageed , Carol Espy-Wilson

Feature subspace selection is an important part in speech emotion recognition. Most of the studies are devoted to finding a feature subspace for representing all emotions. However, some studies have indicated that the features associated…

Machine Learning · Computer Science 2016-11-18 Xi Ma , Zhiyong Wu , Jia Jia , Mingxing Xu , Helen Meng , Lianhong Cai