English
Related papers

Related papers: Speech Emotion Recognition via an Attentive Time-F…

200 papers

Electroencephalography (EEG) is a widely used tool for diagnosing brain disorders due to its high temporal resolution, non-invasive nature, and affordability. Manual analysis of EEG is labor-intensive and requires expertise, making…

Signal Processing · Electrical Eng. & Systems 2024-11-19 Salim Rukhsar , Anil Kumar Tiwari

Attention mechanisms have emerged as important tools that boost the performance of deep models by allowing them to focus on key parts of learned embeddings. However, current attention mechanisms used in speaker recognition tasks fail to…

Sound · Computer Science 2022-07-21 Amirhossein Hajavi , Ali Etemad

Speech Emotion Recognition (SER) is still a complex task for computers with average recall rates usually about 70% on the most realistic datasets. Most SER systems use hand-crafted features extracted from audio signal such as energy, zero…

Sound · Computer Science 2024-02-20 Xiaohui Zhang , Wenjie Fu , Mangui Liang

While speaking at different rates, articulators (like tongue, lips) tend to move differently and the enunciations are also of different durations. In the past, affine transformation and DNN have been used to transform articulatory movements…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-21 Abhayjeet Singh , Aravind Illa , Prasanta Kumar Ghosh

This paper proposes a model for transforming speech features using the frequency-directional attention model for End-to-End (E2E) automatic speech recognition. The idea is based on the hypothesis that in the phoneme system of each language,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-30 Akihiro Dobashi , Chee Siang Leow , Hiromitsu Nishizaki

Emotion recognition from physiological signals remains challenging due to their non-stationary, noisy, and subject-dependent characteristics. This work presents, to the best of our knowledge, the first comprehensive application of liquid…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Anindya Bhattacharjee , Nittya Ananda Biswas , K. A. Shahriar , Adib Rahman

Motivated by the attention mechanism of the human visual system and recent developments in the field of machine translation, we introduce our attention-based and recurrent sequence to sequence autoencoders for fully unsupervised…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Shahin Amiriparian , Pawel Winokurow , Vincent Karas , Sandra Ottl , Maurice Gerczuk , Björn W. Schuller

While deep neural networks have shown impressive results in automatic speaker recognition and related tasks, it is dissatisfactory how little is understood about what exactly is responsible for these results. Part of the success has been…

Sound · Computer Science 2024-07-10 Daniel Neururer , Volker Dellwo , Thilo Stadelmann

Transformer has emerged in speech emotion recognition (SER) at present. However, its equal patch division not only damages frequency information but also ignores local emotion correlations across frames, which are key cues to represent…

Sound · Computer Science 2023-06-05 Cheng Lu , Hailun Lian , Wenming Zheng , Yuan Zong , Yan Zhao , Sunan Li

Speech contains information that is clinically relevant to some diseases, which has the potential to be used for health assessment. Recent work shows an interest in applying deep learning algorithms, especially pretrained large speech…

Sound · Computer Science 2024-07-02 Hok-Shing Lau , Mark Huntly , Nathon Morgan , Adesua Iyenoma , Biao Zeng , Tim Bashford

Recent advances in deep learning have significantly improved multichannel speech enhancement algorithms, yet conventional training loss functions such as the scale-invariant signal-to-distortion ratio (SDR) may fail to preserve fine-grained…

Sound · Computer Science 2025-06-24 Nasser-Eddine Monir , Paul Magron , Romain Serizel

Decoding the speech signal that a person is listening to from the human brain via electroencephalography (EEG) can help us understand how our auditory system works. Linear models have been used to reconstruct the EEG from speech or vice…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-18 Mohammad Jalilpour Monesi , Bernd Accou , Tom Francart , Hugo Van Hamme

Text encodings from automatic speech recognition (ASR) transcripts and audio representations have shown promise in speech emotion recognition (SER) ever since. Yet, it is challenging to explain the effect of each information stream on the…

This work analyzes the constant-Q filterbank-based time-frequency representations for speech emotion recognition (SER). Constant-Q filterbank provides non-linear spectro-temporal representation with higher frequency resolution at low…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-30 Premjeet Singh , Shefali Waldekar , Md Sahidullah , Goutam Saha

For many years, the emotion recognition task has remained one of the most interesting and important problems in the field of human-computer interaction. In this study, we consider the emotion recognition task as a classification as well as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Denis Rangulov , Muhammad Fahim

Speech emotion recognition (SER) has attracted great attention in recent years due to the high demand for emotionally intelligent speech interfaces. Deriving speaker-invariant representations for speech emotion recognition is crucial. In…

Audio and Speech Processing · Electrical Eng. & Systems 2019-03-25 Ming Tu , Yun Tang , Jing Huang , Xiaodong He , Bowen Zhou

Conventional speech enhancement technique such as beamforming has known benefits for far-field speech recognition. Our own work in frequency-domain multi-channel acoustic modeling has shown additional improvements by training a spatial…

Sound · Computer Science 2020-02-10 Taejin Park , Kenichi Kumatani , Minhua Wu , Shiva Sundaram

Speech emotion recognition (SER) remains fragile in real-world conditions because emotional cues are subtle, speaker-dependent, and easily confounded by recording variability, while high-performing deep models typically rely on large and…

Quantum Physics · Physics 2026-05-15 Mahad Mohtashim , Nouhaila Innan , Muhammad Shafique

Speech Self-Supervised Learning (SSL) has demonstrated considerable efficacy in various downstream tasks. Nevertheless, prevailing self-supervised models often overlook the incorporation of emotion-related prior information, thereby…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Rui Liu , Zening Ma

In this work, a novel stack of well-known technologies is presented to determine an automatic method to segment the heart sounds in a phonocardiogram (PCG). We will show a deep recurrent neural network (DRNN) capable of segmenting a PCG…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-17 Alvaro Joaquín Gaona , Pedro David Arini