English
Related papers

Related papers: Indian EmoSpeech Command Dataset: A dataset for em…

200 papers

Human speech goes beyond the mere transfer of information; it is a profound exchange of emotions and a connection between individuals. While Text-to-Speech (TTS) models have made huge progress, they still face challenges in controlling the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-14 Guanrou Yang , Chen Yang , Qian Chen , Ziyang Ma , Wenxi Chen , Wen Wang , Tianrui Wang , Yifan Yang , Zhikang Niu , Wenrui Liu , Fan Yu , Zhihao Du , Zhifu Gao , ShiLiang Zhang , Xie Chen

Despite recent strides made in Speech Separation, most models are trained on datasets with neutral emotions. Emotional speech has been known to degrade performance of models in a variety of speech tasks, which reduces the effectiveness of…

Sound · Computer Science 2023-09-15 Jia Qi Yip , Dianwen Ng , Bin Ma , Chng Eng Siong

Advances in text-to-speech (TTS) technology have significantly improved the quality of generated speech, closely matching the timbre and intonation of the target speaker. However, due to the inherent complexity of human emotional…

Sound · Computer Science 2024-12-13 Weizhen Bian , Yubo Zhou , Kaitai Zhang , Xiaohan Gu

In this paper, we study different approaches for classifying emotions from speech using acoustic and text-based features. We propose to obtain contextualized word embeddings with BERT to represent the information contained in speech…

Machine Learning · Computer Science 2024-03-28 Leonardo Pepino , Pablo Riera , Luciana Ferrer , Agustin Gravano

Voice assistants have become an essential tool for people with various disabilities because they enable complex phone- or tablet-based interactions without the need for fine-grained motor control, such as with touchscreens. However, these…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-17 Colin Lea , Zifang Huang , Dhruv Jain , Lauren Tooley , Zeinab Liaghat , Shrinath Thelapurath , Leah Findlater , Jeffrey P. Bigham

As voice assistants (VAs) become increasingly integrated into daily life, the need for emotion-aware systems that can recognize and respond appropriately to user emotions has grown. While significant progress has been made in speech emotion…

Human-Computer Interaction · Computer Science 2025-02-24 Yong Ma , Yuchong Zhang , Di Fu , Stephanie Zubicueta Portales , Danica Kragic , Morten Fjeld

Decoding emotion from brain activity could unlock a deeper understanding of the human experience. While a number of existing datasets align brain data with speech and with speech transcripts, no datasets have annotated brain data with…

Human-Computer Interaction · Computer Science 2026-01-27 Brian Liu , Oiwi Parker Jones

Emotions recognition is commonly employed for health assessment. However, the typical metric for evaluation in therapy is based on patient-doctor appraisal. This process can fall into the issue of subjectivity, while also requiring…

Human-Computer Interaction · Computer Science 2021-01-21 Jumana Almahmoud , Kruthika Kikkeri

Emotion understanding is an essential but highly challenging component of artificial general intelligence. The absence of extensively annotated datasets has significantly impeded advancements in this field. We present EmotionCLIP, the first…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Sitao Zhang , Yimu Pan , James Z. Wang

Emotion recognition in conversation (ERC) aims to detect the emotion for each utterance in a given conversation. The newly proposed ERC models have leveraged pre-trained language models (PLMs) with the paradigm of pre-training and…

Computation and Language · Computer Science 2022-07-28 Jingjie Yi , Deqing Yang , Siyu Yuan , Caiyan Cao , Zhiyao Zhang , Yanghua Xiao

Speaker recognition is a widely used voice-based biometric technology with applications in various industries, including banking, education, recruitment, immigration, law enforcement, healthcare, and well-being. However, while dataset…

Computers and Society · Computer Science 2023-08-21 Casandra Rusti , Anna Leschanowsky , Carolyn Quinlan , Michaela Pnacek , Lauriane Gorce , Wiebke Hutiri

Sentiment analysis, also called opinion mining, is the field of study that analyzes people's opinions,sentiments, attitudes and emotions. Songs are important to sentiment analysis since the songs and mood are mutually dependent on each…

Computation and Language · Computer Science 2018-06-12 Gangula Rama Rohit Reddy , Radhika Mamidi

We develop a task-oriented spoken dialogue system (SDS) that regulates emotional speech based on contextual cues to enable more empathetic news conversations. Despite advancements in emotional text-to-speech (TTS) techniques, task-oriented…

Computation and Language · Computer Science 2025-06-18 Ryuki Matsuura , Shikhar Bharadwaj , Jiarui Liu , Dhatchi Kunde Govindarajan

Prosodic features such as pitch, timing, and intonation are central to spoken communication, conveying emotion, intent, and discourse structure. In text-based settings, where these cues are absent, emojis act as visual surrogates that add…

Computation and Language · Computer Science 2025-08-04 Giulio Zhou , Tsz Kin Lam , Alexandra Birch , Barry Haddow

In the field of audio and speech analysis, the ability to identify emotions from acoustic signals is essential. Human-computer interaction (HCI) and behavioural analysis are only a few of the many areas where the capacity to distinguish…

Human-Computer Interaction · Computer Science 2023-12-22 Md Gulzar Hussain , Mahmuda Rahman , Babe Sultana , Ye Shiren

Social interactions play a crucial role in shaping human behavior, relationships, and societies. It encompasses various forms of communication, such as verbal conversation, non-verbal gestures, facial expressions, and body language. In this…

Machine Learning · Computer Science 2026-05-13 Alice Zhang , Callihan Bertley , Dawei Liang , Edison Thomaz

In Speech Emotion Recognition (SER), textual data is often used alongside audio signals to address their inherent variability. However, the reliance on human annotated text in most research hinders the development of practical SER systems.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Yuanchao Li , Zeyu Zhao , Ondrej Klejch , Peter Bell , Catherine Lai

Emotion is well-recognized as a distinguished symbol of human beings, and it plays a crucial role in our daily lives. Existing vision-based or sensor-based solutions are either obstructive to use or rely on specialized hardware, hindering…

Human-Computer Interaction · Computer Science 2019-08-28 Yu Gu , Yantong Wang , Tao Liu , Yusheng Ji , Zhi Liu , Peng Li , Xiaoyan Wang , Xin An , Fuji Ren

In this paper, SER_AMPEL, a multi-source dataset for speech emotion recognition (SER) is presented. The peculiarity of the dataset is that it is collected with the aim of providing a reference for speech emotion recognition in case of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Alessandra Grossi , Francesca Gasparini

Speech Emotion Recognition (SER) aims to help the machine to understand human's subjective emotion from only audio information. However, extracting and utilizing comprehensive in-depth audio information is still a challenging task. In this…

Sound · Computer Science 2022-03-30 Heqing Zou , Yuke Si , Chen Chen , Deepu Rajan , Eng Siong Chng