English
Related papers

Related papers: Generating Human Readable Transcript for Automatic…

200 papers

Inspired by a human speech chain mechanism, a machine speech chain framework based on deep learning was recently proposed for the semi-supervised development of automatic speech recognition (ASR) and text-to-speech synthesis TTS) systems.…

Computation and Language · Computer Science 2020-11-05 Sashi Novitasari , Andros Tjandra , Tomoya Yanagita , Sakriani Sakti , Satoshi Nakamura

Bootstrapping speech recognition on limited data resources has been an area of active research for long. The recent transition to all-neural models and end-to-end (E2E) training brought along particular challenges as these models are known…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Manuel Giollo , Deniz Gunceler , Yulan Liu , Daniel Willett

Recent advances in speech-aware language models have coupled strong acoustic encoders with large language models, enabling systems that move beyond transcription to produce richer outputs. Among these, word-level timestamp prediction is…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-28 Xulin Fan , Vishal Sunder , Samuel Thomas , Mark Hasegawa-Johnson , Brian Kingsbury , George Saon

ASR systems designed for native English (L1) usually underperform on non-native English (L2). To address this performance gap, \textbf{(i)} we extend our previous work to investigate fine-tuning of a pre-trained wav2vec 2.0 model…

Computation and Language · Computer Science 2022-02-11 Peter Sullivan , Toshiko Shibano , Muhammad Abdul-Mageed

Automatic speech recognition (ASR) systems are typically optimized for verbatim transcription, which preserves disfluencies, filler words, and informal spoken structures that are often unsuitable for downstream writing-oriented…

Computation and Language · Computer Science 2026-05-20 Wanyi Ning , Yinshang Guo , Haitao Qian , Jiyuan Cheng , Weiyuan Feng , Yufei Zhang

In the past few years, it has been shown that deep learning systems are highly vulnerable under attacks with adversarial examples. Neural-network-based automatic speech recognition (ASR) systems are no exception. Targeted and untargeted…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-07 Matías Pizarro , Dorothea Kolossa , Asja Fischer

In this work, we propose a new parameter-efficient learning framework based on neural model reprogramming for cross-lingual speech recognition, which can \textbf{re-purpose} well-trained English automatic speech recognition (ASR) models to…

Training deep neural networks for automatic speech recognition (ASR) requires large amounts of transcribed speech. This becomes a bottleneck for training robust models for accented speech which typically contains high variability in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-11 Nilaksh Das , Sravan Bodapati , Monica Sunkara , Sundararajan Srinivasan , Duen Horng Chau

Alzheimer's disease (AD) is a progressive neurodegenerative disease and recently attracts extensive attention worldwide. Speech technology is considered a promising solution for the early diagnosis of AD and has been enthusiastically…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-05 Ying Qin , Wei Liu , Zhiyuan Peng , Si-Ioi Ng , Jingyu Li , Haibo Hu , Tan Lee

Advancements in deep neural networks have allowed automatic speech recognition (ASR) systems to attain human parity on several publicly available clean speech datasets. However, even state-of-the-art ASR systems experience performance…

Computation and Language · Computer Science 2023-10-17 Chen Chen , Yuchen Hu , Chao-Han Huck Yang , Sabato Macro Siniscalchi , Pin-Yu Chen , Eng Siong Chng

Transfer learning from high-resource languages is known to be an efficient way to improve end-to-end automatic speech recognition (ASR) for low-resource languages. Pre-trained or jointly trained encoder-decoder models, however, do not share…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-12 Changhan Wang , Juan Pino , Jiatao Gu

Improving the representation of contextual information is key to unlocking the potential of end-to-end (E2E) automatic speech recognition (ASR). In this work, we present a novel and simple approach for training an ASR context mechanism with…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-30 Uri Alon , Golan Pundak , Tara N. Sainath

Despite the tremendous success of automatic speech recognition (ASR) with the introduction of deep learning, its performance is still unsatisfactory in many real-world multi-talker scenarios. Speaker separation excels in separating…

Sound · Computer Science 2025-03-25 Yufeng Yang , Hassan Taherian , Vahid Ahmadi Kalkhorani , DeLiang Wang

This paper describes methods for evaluating automatic speech recognition (ASR) systems in comparison with human perception results, using measures derived from linguistic distinctive features. Error patterns in terms of manner, place and…

Computation and Language · Computer Science 2016-12-14 Xiang Kong , Jeung-Yoon Choi , Stefanie Shattuck-Hufnagel

In this work, we exploit speech enhancement for improving a recurrent neural network transducer (RNN-T) based ASR system. We employ a dense convolutional recurrent network (DCRN) for complex spectral mapping based speech enhancement, and…

Sound · Computer Science 2020-11-10 Ashutosh Pandey , Chunxi Liu , Yun Wang , Yatharth Saraf

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement (SE) algorithms. However, monaural SE has not been established as an effective frontend for automatic speech recognition (ASR) in noisy…

Sound · Computer Science 2024-03-12 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

One of the central skills that language learners need to practice is speaking the language. Currently, students in school do not get enough speaking opportunities and lack conversational practice. Recent advances in speech technology and…

Computation and Language · Computer Science 2024-06-06 Janick Michot , Manuela Hürlimann , Jan Deriu , Luzia Sauer , Katsiaryna Mlynchyk , Mark Cieliebak

This paper addresses end-to-end automatic speech recognition (ASR) for long audio recordings such as lecture and conversational speeches. Most end-to-end ASR models are designed to recognize independent utterances, but contextual…

Computation and Language · Computer Science 2021-04-20 Takaaki Hori , Niko Moritz , Chiori Hori , Jonathan Le Roux

End-to-end automatic speech recognition (ASR) commonly transcribes audio signals into sequences of characters while its performance is evaluated by measuring the word-error rate (WER). This suggests that predicting sequences of words…

Computation and Language · Computer Science 2018-12-07 Jan Kremer , Lasse Borgholt , Lars Maaløe

Transformer-based models have demonstrated their effectiveness in automatic speech recognition (ASR) tasks and even shown superior performance over the conventional hybrid framework. The main idea of Transformers is to capture the…

Sound · Computer Science 2022-07-05 Kun Wei , Pengcheng Guo , Ning Jiang