English
Related papers

Related papers: EmoGator: A New Open Source Vocal Burst Dataset wi…

200 papers

The successful emotional conversation system depends on sufficient perception and appropriate expression of emotions. In a real-life conversation, humans firstly instinctively perceive emotions from multi-source information, including the…

Computation and Language · Computer Science 2022-03-31 Yunlong Liang , Fandong Meng , Ying Zhang , Jinan Xu , Yufeng Chen , Jie Zhou

Emotional voice conversion (EVC) focuses on converting a speech utterance from a source to a target emotion; it can thus be a key enabling technology for human-computer interaction applications and beyond. However, EVC remains an unsolved…

Emotions play a critical role in our everyday lives by altering how we perceive, process and respond to our environment. Affective computing aims to instill in computers the ability to detect and act on the emotions of human actors. A core…

Computation and Language · Computer Science 2020-08-31 Connor T. Heaton , David M. Schwartz

In this dissertation the practical speech emotion recognition technology is studied, including several cognitive related emotion types, namely fidgetiness, confidence and tiredness. The high quality of naturalistic emotional speech data is…

Sound · Computer Science 2017-09-28 Chengwei Huang

Videos can evoke a range of affective responses in viewers. The ability to predict evoked affect from a video, before viewers watch the video, can help in content creation and video recommendation. We introduce the Evoked Expressions from…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Jennifer J. Sun , Ting Liu , Alan S. Cowen , Florian Schroff , Hartwig Adam , Gautam Prasad

In this work, we tackle a problem of speech emotion classification. One of the issues in the area of affective computation is that the amount of annotated data is very limited. On the other hand, the number of ways that the same emotion can…

Computation and Language · Computer Science 2018-04-02 Egor Lakomkin , Cornelius Weber , Stefan Wermter

Emotions are integral to human social interactions, with diverse responses elicited by various situational contexts. Particularly, the prevalence of negative emotional states has been correlated with negative outcomes for mental health,…

Computation and Language · Computer Science 2024-01-10 Abu Bakar Siddiqur Rahman , Hoang-Thang Ta , Lotfollah Najjar , Azad Azadmanesh , Ali Saffet Gönül

Microblog, an online-based broadcast medium, is a widely used forum for people to share their thoughts and opinions. Recently, Emotion Recognition (ER) from microblogs is an inspiring research topic in diverse areas. In the machine learning…

Machine Learning · Computer Science 2023-01-10 Md. Ahsan Habib , M. A. H. Akhand , Md. Abdus Samad Kamal

Non-verbal Vocalizations (NVs), such as laughter and sighs, are vital for conveying emotion and intention in human speech, yet most existing speech systems neglect them, which severely compromises communicative richness and emotional…

Sound · Computer Science 2026-01-14 Runchuan Ye , Yixuan Zhou , Renjie Yu , Zijian Lin , Kehan Li , Xiang Li , Xin Liu , Guoyang Zeng , Zhiyong Wu

This paper presents a widespread analysis of affective vocal expression classification systems. In this study, state-of-the-art acoustic features are compared to two novel affective vocal prints for the detection of emotional states: the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-07 V. Vieira , R. Coelho , F. Assis

Emotional state recognition through speech is being a very interesting research topic nowadays. Using subliminal information of speech, denominated as prosody, it is possible to recognize the emotional state of the person. One of the main…

Computer Vision and Pattern Recognition · Computer Science 2014-03-20 Inma Mohino-Herranz , Roberto Gil-Pita , Sagrario Alonso-Diaz , Manuel Rosa-Zurera

Existing studies on talking video generation have predominantly focused on single-person monologues or isolated facial animations, limiting their applicability to realistic multi-human interactions. To bridge this gap, we introduce MIT, a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zeyu Zhu , Weijia Wu , Mike Zheng Shou

Emotions are one of the important components of the human being, thus they are a valuable part of daily activities such as interaction with people, decision making and learning. For this reason, it is important to detect, recognize and…

Human-Computer Interaction · Computer Science 2025-12-30 Ricardo Vasquez , Diego Riofrío-Luzcando , Joe Carrion-Jumbo , Cesar Guevara

Understanding emotions in natural language is inherently a multi-dimensional reasoning problem, where multiple affective signals interact through context, interpersonal relations, and situational cues. However, most existing emotion…

Computation and Language · Computer Science 2026-04-02 Hemanth Kotaprolu , Kishan Maharaj , Raey Zhao , Abhijit Mishra , Pushpak Bhattacharyya

Acoustic emotion recognition aims to categorize the affective state of the speaker and is still a difficult task for machine learning models. The difficulties come from the scarcity of training data, general subjectivity in emotion…

Computation and Language · Computer Science 2018-04-02 Egor Lakomkin , Cornelius Weber , Sven Magg , Stefan Wermter

The objective of this paper is speaker recognition under noisy and unconstrained conditions. We make two key contributions. First, we introduce a very large-scale audio-visual speaker recognition dataset collected from open-source media.…

Sound · Computer Science 2020-11-05 Joon Son Chung , Arsha Nagrani , Andrew Zisserman

The process of identifying human emotion and affective states from speech is known as speech emotion recognition (SER). This is based on the observation that tone and pitch in the voice frequently convey underlying emotion. Speech…

Sound · Computer Science 2024-06-18 Nishargo Nigar

Recently, there has been an increasing interest in neural speech synthesis. While the deep neural network achieves the state-of-the-art result in text-to-speech (TTS) tasks, how to generate a more emotional and more expressive speech is…

Computation and Language · Computer Science 2021-06-24 Chenye Cui , Yi Ren , Jinglin Liu , Feiyang Chen , Rongjie Huang , Ming Lei , Zhou Zhao

Emotion plays a crucial role in human conversation. This paper underscores the significance of considering emotion in speech translation. We present the MELD-ST dataset for the emotion-aware speech translation task, comprising…

Computation and Language · Computer Science 2024-05-24 Sirou Chen , Sakiko Yahata , Shuichiro Shimizu , Zhengdong Yang , Yihang Li , Chenhui Chu , Sadao Kurohashi

Some speech recognition tasks, such as automatic speech recognition (ASR), are approaching or have reached human performance in many reported metrics. Yet, they continue to struggle in complex, real-world, situations, such as with distanced…

Computation and Language · Computer Science 2025-07-31 Paige Tuttösí , Mantaj Dhillon , Luna Sang , Shane Eastwood , Poorvi Bhatia , Quang Minh Dinh , Avni Kapoor , Yewon Jin , Angelica Lim