English
Related papers

Related papers: Speech Emotion Recognition with ASR Transcripts: A…

200 papers

Word Error Rate (WER) is the primary metric used to assess automatic speech recognition (ASR) model quality. It has been shown that ASR models tend to have much higher WER on speakers with speech impairments than typical English speakers.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-23 Jimmy Tobin , Qisheng Li , Subhashini Venugopalan , Katie Seaver , Richard Cave , Katrin Tomanek

ASR Error Detection (AED) models aim to post-process the output of Automatic Speech Recognition (ASR) systems, in order to detect transcription errors. Modern approaches usually use text-based input, comprised solely of the ASR…

Computation and Language · Computer Science 2022-10-27 Zorik Gekhman , Dina Zverinski , Jonathan Mallinson , Genady Beryozkin

Measuring automatic speech recognition (ASR) system quality is critical for creating user-satisfying voice-driven applications. Word Error Rate (WER) has been traditionally used to evaluate ASR system quality; however, it sometimes…

Computation and Language · Computer Science 2022-07-07 Suyoun Kim , Duc Le , Weiyi Zheng , Tarun Singh , Abhinav Arora , Xiaoyu Zhai , Christian Fuegen , Ozlem Kalinli , Michael L. Seltzer

Improving the representation of contextual information is key to unlocking the potential of end-to-end (E2E) automatic speech recognition (ASR). In this work, we present a novel and simple approach for training an ASR context mechanism with…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-30 Uri Alon , Golan Pundak , Tara N. Sainath

Cross-lingual speech emotion recognition (SER) is important for a wide range of everyday applications. While recent SER research relies heavily on large pretrained models for emotion training, existing studies often concentrate solely on…

Sound · Computer Science 2024-07-09 Shreya G. Upadhyay , Carlos Busso , Chi-Chun Lee

Speech emotion recognition (SER) has been a challenging problem in spoken language processing research, because it is unclear how human emotions are connected to various components of sounds such as pitch, loudness, and energy. This paper…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Tai Vu

Automatic Speech Recognition (ASR) has advanced with Speech Foundation Models (SFMs), yet performance degrades on dysarthric speech due to variability and limited data. This study as part of the submission to the Speech Accessibility…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Alexandre Ducorroy , Rachid Riad

We propose EmoDistill, a novel speech emotion recognition (SER) framework that leverages cross-modal knowledge distillation during training to learn strong linguistic and prosodic representations of emotion from speech. During inference,…

Computation and Language · Computer Science 2024-03-18 Debaditya Shome , Ali Etemad

Speech Emotion Recognition (SER) research has faced limitations due to the lack of standard and sufficiently large datasets. Recent studies have leveraged pre-trained models to extract features for downstream tasks such as SER. This work…

Artificial Intelligence · Computer Science 2026-02-10 Ali Shendabadi , Parnia Izadirad , Mostafa Salehi , Mahmoud Bijankhan

Conversational speech normally is embodied with loose syntactic structures at the utterance level but simultaneously exhibits topical coherence relations across consecutive utterances. Prior work has shown that capturing longer context…

Computation and Language · Computer Science 2022-06-02 Bi-Cheng Yan , Hsin-Wei Wang , Shih-Hsuan Chiu , Hsuan-Sheng Chiu , Berlin Chen

Recent research using pre-trained transformer models suggests that just 10 minutes of transcribed speech may be enough to fine-tune such a model for automatic speech recognition (ASR) -- at least if we can also leverage vast amounts of text…

Computation and Language · Computer Science 2023-02-13 Nay San , Martijn Bartelds , Blaine Billings , Ella de Falco , Hendi Feriza , Johan Safri , Wawan Sahrozi , Ben Foley , Bradley McDonnell , Dan Jurafsky

Speech summarization, which generates a text summary from speech, can be achieved by combining automatic speech recognition (ASR) and text summarization (TS). With this cascade approach, we can exploit state-of-the-art models and large…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-17 Takatomo Kano , Atsunori Ogawa , Marc Delcroix , Shinji Watanabe

Speech Emotion Recognition (SER) is to recognize human emotions in a natural verbal interaction scenario with machines, which is considered as a challenging problem due to the ambiguous human emotions. Despite the recent progress in SER,…

Computation and Language · Computer Science 2023-05-11 Lei Kang , Lichao Zhang , Dazhi Jiang

Speech emotion recognition (SER) is crucial for enhancing affective computing and enriching the domain of human-computer interaction. However, the main challenge in SER lies in selecting relevant feature representations from speech signals…

Sound · Computer Science 2024-12-16 Niloy Kumar Kundu , Sarah Kobir , Md. Rayhan Ahmed , Tahmina Aktar , Niloya Roy

Speech Emotion Recognition (SER) is a crucial component in developing general-purpose AI agents capable of natural human-computer interaction. However, building robust multilingual SER systems remains challenging due to the scarcity of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-08 Hsi-Che Lin , Yi-Cheng Lin , Huang-Cheng Chou , Hung-yi Lee

Recent advancements in supervised automatic speech recognition (ASR) have achieved remarkable performance, largely due to the growing availability of large transcribed speech corpora. However, most languages lack sufficient paired speech…

Computation and Language · Computer Science 2025-01-10 Junrui Ni , Liming Wang , Yang Zhang , Kaizhi Qian , Heting Gao , Mark Hasegawa-Johnson , Chang D. Yoo

The accuracy of Automated Speech Recognition (ASR) technology has improved, but it is still imperfect in many settings. Researchers who evaluate ASR performance often focus on improving the Word Error Rate (WER) metric, but WER has been…

Human-Computer Interaction · Computer Science 2017-12-29 Sushant Kafle , Matt Huenerfauth

This study investigates fine-tuning self-supervised learn ing (SSL) models using multi-task learning (MTL) to enhance speech emotion recognition (SER). The framework simultane ously handles four related tasks: emotion recognition, gender…

Sound · Computer Science 2025-08-26 Honghong Wang , Jing Deng , Fanqin Meng , Rong Zheng

We present an approach to reduce the performance disparity between geographic regions without degrading performance on the overall user population for ASR. A popular approach is to fine-tune the model with data from regions where the ASR…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-09 Viet Anh Trinh , Pegah Ghahremani , Brian King , Jasha Droppo , Andreas Stolcke , Roland Maas

It is estimated that around 70 million people worldwide are affected by a speech disorder called stuttering. With recent advances in Automatic Speech Recognition (ASR), voice assistants are increasingly useful in our everyday lives. Many…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-14 Olabanji Shonibare , Xiaosu Tong , Venkatesh Ravichandran
‹ Prev 1 4 5 6 7 8 10 Next ›