English
Related papers

Related papers: SigWavNet: Learning Multiresolution Signal Wavelet…

200 papers

Speech emotion recognition (SER) is vital for obtaining emotional intelligence and understanding the contextual meaning of speech. Variations of consonant-vowel (CV) phonemic boundaries can enrich acoustic context with linguistic cues,…

Sound · Computer Science 2023-07-03 Anna Ollerenshaw , Md Asif Jalal , Rosanna Milner , Thomas Hain

In this work, we address the problem of finegrained traceback of emotional and manipulation characteristics from synthetically manipulated speech. We hypothesize that combining semantic-prosodic cues captured by Speech Foundation Models…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-17 Girish , Mohd Mujtaba Akhtar , Farhan Sheth , Muskaan Singh

Existing speech processing systems consist of different modules, individually optimized for a specific task such as acoustic modelling or feature extraction. In addition to not assuring optimality of the system, the disjoint nature of…

Sound · Computer Science 2020-11-12 Prithvi Suresh , Abhijith Ragav

Traditional techniques for emotion recognition have focused on the facial expression analysis only, thus providing limited ability to encode context that comprehensively represents the emotional responses. We present deep networks for…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Jiyoung Lee , Seungryong Kim , Sunok Kim , Jungin Park , Kwanghoon Sohn

Machine learning methods, such as deep learning, show promising results in the medical domain. However, the lack of interpretability of these algorithms may hinder their applicability to medical decision support systems. This paper studies…

Signal Processing · Electrical Eng. & Systems 2021-07-23 Juan Manuel Mayor-Torres , Mirco Ravanelli , Sara E. Medina-DeVilliers , Matthew D. Lerner , Giuseppe Riccardi

Speech emotion recognition is the task of recognizing the speaker's emotional state given a recording of their utterance. While most of the current approaches focus on inferring emotion from isolated utterances, we argue that this is not…

Computation and Language · Computer Science 2021-09-14 Raghavendra Pappagari , Piotr Żelasko , Jesús Villalba , Laureano Moro-Velazquez , Najim Dehak

One persistent challenge in Speech Emotion Recognition (SER) is the ubiquitous environmental noise, which frequently results in deteriorating SER performance in practice. In this paper, we introduce a Two-level Refinement Network, dubbed…

Sound · Computer Science 2024-09-04 Chengxin Chen , Pengyuan Zhang

Performance in Speech Emotion Recognition (SER) on a single language has increased greatly in the last few years thanks to the use of deep learning techniques. However, cross-lingual SER remains a challenge in real-world applications due to…

Speech emotion recognition (SER) has drawn increasing attention for its applications in human-machine interaction. However, existing SER methods ignore the information gap between the pre-training speech recognition task and the downstream…

Sound · Computer Science 2023-10-03 Dongyuan Li , Yusong Wang , Kotaro Funakoshi , Manabu Okumura

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

Human-Computer Interaction · Computer Science 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Recent analysis on speech emotion recognition has made considerable advances with the use of MFCCs spectrogram features and the implementation of neural network approaches such as convolutional neural networks (CNNs). Capsule networks…

Sound · Computer Science 2021-12-28 Ismail Shahin , Noor Hindawi , Ali Bou Nassif , Adi Alhudhaif , Kemal Polat

Speaker recognition systems are widely used in various applications to identify a person by their voice; however, the high degree of variability in speech signals makes this a challenging task. Dealing with emotional variations is very…

Sound · Computer Science 2022-01-11 Ali Bou Nassif , Ismail Shahin , Ashraf Elnagar , Divya Velayudhan , Adi Alhudhaif , Kemal Polat

Speech emotion recognition (SER) plays a critical role in building emotion-aware speech systems, but its performance degrades significantly under noisy conditions. Although speech enhancement (SE) can improve robustness, it often introduces…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Jing-Tong Tzeng , Carlos Busso , Chi-Chun Lee

In this research, an emotion recognition system is developed based on valence/arousal model using electroencephalography (EEG) signals. EEG signals are decomposed into the gamma, beta, alpha and theta frequency bands using discrete wavelet…

Machine Learning · Computer Science 2019-06-04 Omid Bazgir , Zeynab Mohammadi , Seyed Amir Hassan Habibi

Spectrogram is commonly used as the input feature of deep neural networks to learn the high(er)-level time-frequency pattern of speech signal for speech emotion recognition (SER). \textcolor{black}{Generally, different emotions correspond…

Sound · Computer Science 2022-10-25 Cheng Lu , Wenming Zheng , Hailun Lian , Yuan Zong , Chuangao Tang , Sunan Li , Yan Zhao

Deep image registration has demonstrated exceptional accuracy and fast inference. Recent advances have adopted either multiple cascades or pyramid architectures to estimate dense deformation fields in a coarse-to-fine manner. However, due…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xinxing Cheng , Xi Jia , Wenqi Lu , Qiufu Li , Linlin Shen , Alexander Krull , Jinming Duan

We investigate the performance of features that can capture nonlinear recurrence dynamics embedded in the speech signal for the task of Speech Emotion Recognition (SER). Reconstruction of the phase space of each speech frame and the…

Historically lower-level tasks such as automatic speech recognition (ASR) and speaker identification are the main focus in the speech field. Interest has been growing in higher-level spoken language understanding (SLU) tasks recently, like…

Computation and Language · Computer Science 2022-04-25 Lin Yao , Jianfei Song , Ruizhuo Xu , Yingfang Yang , Zijian Chen , Yafeng Deng

Advancement in speech technology has brought convenience to our life. However, the concern is on the rise as speech signal contains multiple personal attributes, which would lead to either sensitive information leakage or bias toward…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Yu-Lin Huang , Bo-Hao Su , Y. -W. Peter Hong , Chi-Chun Lee

Speech emotion recognition is a challenging task, and extensive reliance has been placed on models that use audio features in building well-performing classifiers. In this paper, we propose a novel deep dual recurrent encoder model that…

Computation and Language · Computer Science 2018-10-11 Seunghyun Yoon , Seokhyun Byun , Kyomin Jung