English
Related papers

Related papers: Quantifying the Role of Textual Predictability in …

200 papers

A deep Transformer model with good evaluation score does not mean each subnetwork (a.k.a transformer block) learns reasonable representation. Diagnosing abnormal representation and avoiding it can contribute to achieving a better evaluation…

Computation and Language · Computer Science 2021-04-08 Liu Chen , Meysam Asgari

Predicting audio quality in voice synthesis and conversion systems is a critical yet challenging task, especially when traditional methods like Mean Opinion Scores (MOS) are cumbersome to collect at scale. This paper addresses the gap in…

Sound · Computer Science 2023-12-27 Aditya Ravuri , Erica Cooper , Junichi Yamagishi

Producing a large amount of annotated speech data for training ASR systems remains difficult for more than 95% of languages all over the world which are low-resourced. However, we note human babies start to learn the language by the sounds…

Computation and Language · Computer Science 2019-04-11 Yi-Chen Chen , Sung-Feng Huang , Hung-yi Lee , Lin-shan Lee

Automatic pronunciation evaluation plays an important role in pronunciation training and second language education. This field draws heavily on concepts from automatic speech recognition (ASR) to quantify how close the pronunciation of…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-06 Ming Tu , Anna Grabek , Julie Liss , Visar Berisha

Automatic Speech Recognition (ASR) in conversational settings presents unique challenges, including extracting relevant contextual information from previous conversational turns. Due to irrelevant content, error propagation, and redundancy,…

Sound · Computer Science 2024-04-30 Kun Wei , Bei Li , Hang Lv , Quan Lu , Ning Jiang , Lei Xie

Recent studies have shown how self-supervised models can produce accurate speech quality predictions. Speech representations generated by the pre-trained wav2vec 2.0 model allows constructing robust predicting models using small amounts of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-06 Helard Becerra , Alessandro Ragano , Andrew Hines

This paper presents a speech intelligibility model based on automatic speech recognition (ASR), combining phoneme probabilities from deep neural networks (DNN) and a performance measure that estimates the word error rate from these…

Speaker attribution from speech transcripts is the task of identifying a speaker from the transcript of their speech based on patterns in their language use. This task is especially useful when the audio is unavailable (e.g. deleted) or…

Computation and Language · Computer Science 2026-01-27 Cristina Aggazzotti , Matthew Wiesner , Elizabeth Allyn Smith , Nicholas Andrews

Quality of data plays an important role in most deep learning tasks. In the speech community, transcription of speech recording is indispensable. Since the transcription is usually generated artificially, automatically finding errors in…

Computation and Language · Computer Science 2019-07-23 Xiaofei Wang , Jinyi Yang , Ruizhi Li , Samik Sadhu , Hynek Hermansky

Automatic speech recognition (ASR) systems remain brittle on dysarthric and other atypical speech. Recent audio-language models raise the possibility of improving performance by conditioning on additional clinical context at inference time,…

Artificial Intelligence · Computer Science 2026-05-05 Pehuén Moure , Niclas Pokel , Bilal Bounajma , Yingqiang Gao , Roman Boehringer , Longbiao Cheng , Shih-Chii Liu

The increasing reliability of automatic speech recognition has proliferated its everyday use. However, for research purposes, it is often unclear which model one should choose for a task, particularly if there is a requirement for speed as…

Computation and Language · Computer Science 2023-02-24 Ryan Whetten , Mir Tahsin Imtiaz , Casey Kennington

Automatic Speech Recognition (ASR) systems often struggle with transcribing child speech due to the lack of large child speech datasets required to accurately train child-friendly ASR models. However, there are huge amounts of annotated…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-26 Rishabh Jain , Andrei Barcovschi , Mariam Yiwere , Peter Corcoran , Horia Cucu

Automatic Speech Recognition (ASR) offers significant potential to reduce the workload of medical personnel, for example, through the automation of documentation tasks. While numerous benchmarks exist for the English language, specific…

Computation and Language · Computer Science 2026-01-29 Thomas Schuster , Julius Trögele , Nico Döring , Robin Krüger , Matthieu Hoffmann , Holger Friedrich

While end-to-end (E2E) automatic speech recognition (ASR) models excel at general transcription, they struggle to recognize rare or unseen named entities (e.g., contact names, locations), which are critical for downstream applications like…

Computation and Language · Computer Science 2025-12-22 Ramaneswaran Selvakumar , Cindy Tseng , Eesung Kim , Vijendra Raj Apsingekar , Yun Tang

Benchmarks for language-guided embodied agents typically assume text-based instructions, but deployed agents will encounter spoken instructions. While Automatic Speech Recognition (ASR) models can bridge the input gap, erroneous ASR…

Computation and Language · Computer Science 2023-10-11 Allen Chang , Xiaoyuan Zhu , Aarav Monga , Seoho Ahn , Tejas Srinivasan , Jesse Thomason

While automatic speech recognition (ASR) greatly benefits from data augmentation, the augmentation recipes themselves tend to be heuristic. In this paper, we address one of the heuristic approach associated with balancing the right amount…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-17 Vishwanath Pratap Singh , Federico Malato , Ville Hautamaki , Md. Sahidullah , Tomi Kinnunen

Automatic speech recognition (ASR) is a key area in computational linguistics, focusing on developing technologies that enable computers to convert spoken language into text. This field combines linguistics and machine learning. ASR models,…

Computation and Language · Computer Science 2024-06-27 Anish Saha , A. G. Ramakrishnan

Traditional topic identification solutions from audio rely on an automatic speech recognition system (ASR) to produce transcripts used as input to a text-based model. These approaches work well in high-resource scenarios, where there are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-24 Dejan Porjazovski , Tamás Grósz , Mikko Kurimo

Neural sequence-to-sequence systems deliver state-of-the-art performance for automatic speech recognition. When using appropriate modeling units, e.g., byte-pair encoding, these systems are in principle open vocabulary systems. In practice,…

Computation and Language · Computer Science 2026-03-05 Christian Huber , Alexander Waibel

Fast contextual adaptation has shown to be effective in improving Automatic Speech Recognition (ASR) of rare words and when combined with an on-device personalized training, it can yield an even better recognition result. However, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Tsendsuren Munkhdalai , Khe Chai Sim , Angad Chandorkar , Fan Gao , Mason Chua , Trevor Strohman , Françoise Beaufays