English
Related papers

Related papers: A Pre-trained Audio-Visual Transformer for Emotion…

200 papers

This paper presents a novel approach for the automatic generation of Cued Speech (ACSG), a visual communication system used by people with hearing impairment to better elicit the spoken language. We explore transfer learning strategies by…

Computation and Language · Computer Science 2025-01-10 Sanjana Sankar , Martin Lenglet , Gerard Bailly , Denis Beautemps , Thomas Hueber

Videos can evoke a range of affective responses in viewers. The ability to predict evoked affect from a video, before viewers watch the video, can help in content creation and video recommendation. We introduce the Evoked Expressions from…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Jennifer J. Sun , Ting Liu , Alan S. Cowen , Florian Schroff , Hartwig Adam , Gautam Prasad

Recent models of emotion recognition strongly rely on supervised deep learning solutions for the distinction of general emotion expressions. However, they are not reliable when recognizing online and personalized facial expressions, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Pablo Barros , German I. Parisi , Stefan Wermter

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Previous work has established that a person's demographics and speech style affect how well speech processing models perform for them. But where does this bias come from? In this work, we present the Speech Embedding Association Test…

Computation and Language · Computer Science 2023-10-31 Isaac Slaughter , Craig Greenberg , Reva Schwartz , Aylin Caliskan

Automatic emotion recognition plays a key role in computer-human interaction as it has the potential to enrich the next-generation artificial intelligence with emotional intelligence. It finds applications in customer and/or representative…

Sound · Computer Science 2022-02-21 Sarala Padi , Seyed Omid Sadjadi , Dinesh Manocha , Ram D. Sriram

Dog emotion recognition plays a crucial role in enhancing human-animal interactions, veterinary care, and the development of automated systems for monitoring canine well-being. However, accurately interpreting dog emotions is challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Jinho Baek , Houwei Cao , Kate Blackwell

Speech Emotion Recognition (SER) plays a pivotal role in enhancing human-computer interaction by enabling a deeper understanding of emotional states across a wide range of applications, contributing to more empathetic and effective…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Amirali Soltani Tehrani , Niloufar Faridani , Ramin Toosi

Speech emotion recognition (SER) has drawn increasing attention for its applications in human-machine interaction. However, existing SER methods ignore the information gap between the pre-training speech recognition task and the downstream…

Sound · Computer Science 2023-10-03 Dongyuan Li , Yusong Wang , Kotaro Funakoshi , Manabu Okumura

Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, generating effective…

Sound · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Junaid Qadir , Julien Epps

Emotion recognition plays a pivotal role in enhancing human-computer interaction, particularly in movie recommendation systems where understanding emotional content is essential. While multimodal approaches combining audio and video have…

Sound · Computer Science 2025-11-25 Xiangrui Xiong , Zhou Zhou , Guocai Nong , Junlin Deng , Ning Wu

While pre-trained language models excel at semantic understanding, they often struggle to capture nuanced affective information critical for affective recognition tasks. To address these limitations, we propose a novel framework for…

Computation and Language · Computer Science 2025-03-03 Seungah Son , Andrez Saurez , Dongsoo Har

Emotions lie on a broad continuum and treating emotions as a discrete number of classes limits the ability of a model to capture the nuances in the continuum. The challenge is how to describe the nuances of emotions and how to enable a…

Sound · Computer Science 2022-11-16 Hira Dhamyal , Benjamin Elizalde , Soham Deshmukh , Huaming Wang , Bhiksha Raj , Rita Singh

Emotions widely affect human decision-making. This fact is taken into account by affective computing with the goal of tailoring decision support to the emotional states of individuals. However, the accurate recognition of emotions within…

Computation and Language · Computer Science 2018-11-14 Bernhard Kratzwald , Suzana Ilic , Mathias Kraus , Stefan Feuerriegel , Helmut Prendinger

Emotion and intent recognition from speech is essential and has been widely investigated in human-computer interaction. The rapid development of social media platforms, chatbots, and other technologies has led to a large volume of speech…

Sound · Computer Science 2025-07-11 Zhao Ren , Rathi Adarshi Rammohan , Kevin Scheck , Sheng Li , Tanja Schultz

The purpose of emotion recognition in conversation (ERC) is to identify the emotion category of an utterance based on contextual information. Previous ERC methods relied on simple connections for cross-modal fusion and ignored the…

Computation and Language · Computer Science 2024-05-29 Haoxiang Shi , Xulong Zhang , Ning Cheng , Yong Zhang , Jun Yu , Jing Xiao , Jianzong Wang

The generation of talking avatars has achieved significant advancements in precise audio synchronization. However, crafting lifelike talking head videos requires capturing a broad spectrum of emotions and subtle facial expressions. Current…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Huaize Liu , Wenzhang Sun , Donglin Di , Shibo Sun , Jiahui Yang , Changqing Zou , Hujun Bao

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

Machine Learning · Computer Science 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

In recent years, deep neural networks have demonstrated increasingly strong abilities to recognize objects and activities in videos. However, as video understanding becomes widely used in real-world applications, a key consideration is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Mantas Mazeika , Eric Tang , Andy Zou , Steven Basart , Jun Shern Chan , Dawn Song , David Forsyth , Jacob Steinhardt , Dan Hendrycks

Emotion recognition from speech is a challenging task. Re-cent advances in deep learning have led bi-directional recur-rent neural network (Bi-RNN) and attention mechanism as astandard method for speech emotion recognition, extractingand…

Sound · Computer Science 2021-06-09 Zixuan Peng , Yu Lu , Shengfeng Pan , Yunfeng Liu