English
Related papers

Related papers: Random Utterance Concatenation Based Data Augmenta…

200 papers

As the interest in large language models grows, the importance of accuracy in automatic speech recognition has become more pronounced. This is especially true for lectures that include specialized terminology. In such cases, the success…

Numerical Analysis · Mathematics 2024-11-12 Kyudan Jung , Nam-Joon Kim , Hyun Gon Ryu , Hyuk-Jae Lee

Speech synthesis might hold the key to low-resource speech recognition. Data augmentation techniques have become an essential part of modern speech recognition training. Yet, they are simple, naive, and rarely reflect real-world conditions.…

Computation and Language · Computer Science 2020-12-25 Deblin Bagchi , Shannon Wotherspoon , Zhuolin Jiang , Prasanna Muthukumar

Unified Speech Recognition (USR) has emerged as a semi-supervised framework for training a single model for audio, visual, and audiovisual speech recognition, achieving state-of-the-art results on in-distribution benchmarks. However, its…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Alexandros Haliassos , Rodrigo Mira , Stavros Petridis

The development of resource-constrained approaches to automatic speech recognition (ASR) is of great interest due to its broad applicability to many low-resource languages for which there is scant usable data. Existing approaches to many…

Computation and Language · Computer Science 2026-03-17 Emma Rafkin , Dan DeGenaro , Xiulin Yang

We consider the task of personalizing ASR models while being constrained by a fixed budget on recording speaker-specific utterances. Given a speaker and an ASR model, we propose a method of identifying sentences for which the speaker's…

Sound · Computer Science 2021-06-03 Abhijeet Awasthi , Aman Kansal , Sunita Sarawagi , Preethi Jyothi

Punctuated text prediction is crucial for automatic speech recognition as it enhances readability and impacts downstream natural language processing tasks. In streaming scenarios, the ability to predict punctuation in real-time is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-31 Hanbyul Kim , Seunghyun Seo , Lukas Lee , Seolki Baek

End-to-end acoustic speech recognition has quickly gained widespread popularity and shows promising results in many studies. Specifically the joint transformer/CTC model provides very good performance in many tasks. However, under noisy and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-20 Wentao Yu , Steffen Zeiler , Dorothea Kolossa

There is a growing interest in the speech community in developing Recurrent Neural Network Transducer (RNN-T) models for automatic speech recognition (ASR) applications. RNN-T is trained with a loss function that does not enforce temporal…

Computation and Language · Computer Science 2020-11-20 Jay Mahadeokar , Yuan Shangguan , Duc Le , Gil Keren , Hang Su , Thong Le , Ching-Feng Yeh , Christian Fuegen , Michael L. Seltzer

This study investigates the impact of integrating a dataset of disordered speech recordings ($\sim$1,000 hours) into the fine-tuning of a near state-of-the-art ASR baseline system. Contrary to what one might expect, despite the data being…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-22 Jimmy Tobin , Katrin Tomanek , Subhashini Venugopalan

Automatic Speech Recognition (ASR) systems introduce word errors, which often confuse punctuation prediction models, turning punctuation restoration into a challenging task. These errors usually take the form of homonyms. We show how…

Computation and Language · Computer Science 2020-04-14 Łukasz Augustyniak , Piotr Szymanski , Mikołaj Morzy , Piotr Zelasko , Adrian Szymczak , Jan Mizgajski , Yishay Carmiel , Najim Dehak

In many cases of machine learning, research suggests that the development of training data might have a higher relevance than the choice and modelling of classifiers themselves. Thus, data augmentation methods have been developed to improve…

Computation and Language · Computer Science 2022-07-25 Markus Bayer , Marc-André Kaufhold , Björn Buchhold , Marcel Keller , Jörg Dallmeyer , Christian Reuter

This paper introduces ASTRA, a novel method for improving Automatic Speech Recognition (ASR) through text injection.Unlike prevailing techniques, ASTRA eliminates the need for sampling to match sequence lengths between speech and text…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-27 Neeraj Gaur , Rohan Agrawal , Gary Wang , Parisa Haghani , Andrew Rosenberg , Bhuvana Ramabhadran

End-to-end Speech Translation is hindered by a lack of available data resources. While most of them are based on documents, a sentence-level version is available, which is however single and static, potentially impeding the usefulness of…

Computation and Language · Computer Science 2023-11-02 Ioannis Tsiamas , José A. R. Fonollosa , Marta R. Costa-jussà

In the realm of spoken language understanding (SLU), numerous natural language understanding (NLU) methodologies have been adapted by supplying large language models (LLMs) with transcribed speech instead of conventional written text. In…

In recent years, automatic speech recognition (ASR) systems have significantly improved, especially in languages with a vast amount of transcribed speech data. However, ASR systems tend to perform poorly for low-resource languages with…

Computation and Language · Computer Science 2024-06-04 Ara Yeroyan , Nikolay Karpov

End-to-end Automatic Speech Recognition (ASR) systems based on neural networks have seen large improvements in recent years. The availability of large scale hand-labeled datasets and sufficient computing resources made it possible to train…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Maxime Burchi , Radu Timofte

Today, many state-of-the-art automatic speech recognition (ASR) systems apply all-neural models that map audio to word sequences trained end-to-end along one global optimisation criterion in a fully data driven fashion. These models allow…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Xianrui Zheng , Yulan Liu , Deniz Gunceler , Daniel Willett

End-to-end speech summarization has been shown to improve performance over cascade baselines. However, such models are difficult to train on very large inputs (dozens of minutes or hours) owing to compute restrictions and are hence trained…

Computation and Language · Computer Science 2023-07-18 Roshan Sharma , Kenneth Zheng , Siddhant Arora , Shinji Watanabe , Rita Singh , Bhiksha Raj

The training of spoken language understanding (SLU) models often faces the problem of data scarcity. In this paper, we put forward a data augmentation method using pretrained language models to boost the variability and accuracy of…

Computation and Language · Computer Science 2021-03-12 Baolin Peng , Chenguang Zhu , Michael Zeng , Jianfeng Gao

Form about four decades human beings have been dreaming of an intelligent machine which can master the natural speech. In its simplest form, this machine should consist of two subsystems, namely automatic speech recognition (ASR) and speech…

Sound · Computer Science 2013-05-08 Urmila Shrawankar , V. M. Thakare