English
Related papers

Related papers: Balanced End-to-End Monolingual pre-training for L…

200 papers

In this paper, we describe several techniques for improving the acoustic and language model of an automatic speech recognition (ASR) system operating on code-switching (CS) speech. We focus on the recognition of Frisian-Dutch radio…

Computation and Language · Computer Science 2018-07-31 Emre Yılmaz , Henk van den Heuvel , David A. van Leeuwen

Recently, end-to-end models have become a popular approach as an alternative to traditional hybrid models in automatic speech recognition (ASR). The multi-speaker speech separation and recognition task is a central task in cocktail party…

Computation and Language · Computer Science 2018-11-07 Xuankai Chang , Yanmin Qian , Kai Yu , Shinji Watanabe

Transformer-based end-to-end (E2E) automatic speech recognition (ASR) systems have recently gained wide popularity, and are shown to outperform E2E models based on recurrent structures on a number of ASR tasks. However, like other E2E…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-30 Mohan Li , Catalin Zorila , Rama Doddipatla

End-to-end (E2E) automatic speech recognition (ASR) models have become standard practice for various commercial applications. However, in real-world scenarios, the long-tailed nature of word distribution often leads E2E ASR models to…

Computation and Language · Computer Science 2024-09-11 Yi-Cheng Wang , Li-Ting Pai , Bi-Cheng Yan , Hsin-Wei Wang , Chi-Han Lin , Berlin Chen

End-to-end (E2E) automatic speech recognition (ASR) models, by now, have shown competitive performance on several benchmarks. These models are structured to either operate in streaming or non-streaming mode. This work presents cascaded…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-29 Arun Narayanan , Tara N. Sainath , Ruoming Pang , Jiahui Yu , Chung-Cheng Chiu , Rohit Prabhavalkar , Ehsan Variani , Trevor Strohman

End-to-end speech recognition is a promising technology for enabling compact automatic speech recognition (ASR) systems since it can unify the acoustic and language model into a single neural network. However, as a drawback, training of…

Computation and Language · Computer Science 2022-02-17 Yotaro Kubo , Shigeki Karita , Michiel Bacchiani

In a pipeline speech translation system, automatic speech recognition (ASR) system will transmit errors in recognition to the downstream machine translation (MT) system. A standard machine translation system is usually trained on parallel…

Computation and Language · Computer Science 2019-10-29 Qiao Cheng , Meiyuan Fang , Yaqian Han , Jin Huang , Yitao Duan

Recently, self-supervised pretraining has achieved impressive results in end-to-end (E2E) automatic speech recognition (ASR). However, the dominant sequence-to-sequence (S2S) E2E model is still hard to fully utilize the self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-15 Keqi Deng , Songjun Cao , Yike Zhang , Long Ma

End-to-end (E2E) models fold the acoustic, pronunciation and language models of a conventional speech recognition model into one neural network with a much smaller number of parameters than a conventional ASR system, thus making it suitable…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-14 Bo Li , Shuo-yiin Chang , Tara N. Sainath , Ruoming Pang , Yanzhang He , Trevor Strohman , Yonghui Wu

End-to-end speech summarization (E2E SSum) directly summarizes input speech into easy-to-read short sentences with a single model. This approach is promising because it, in contrast to the conventional cascade approach, can utilize full…

Computation and Language · Computer Science 2023-06-08 Kohei Matsuura , Takanori Ashihara , Takafumi Moriya , Tomohiro Tanaka , Takatomo Kano , Atsunori Ogawa , Marc Delcroix

To realize robust end-to-end Automatic Speech Recognition(E2E ASR) under radio communication condition, we propose a multitask-based method to joint train a Speech Enhancement (SE) module as the front-end and an E2E ASR model as the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-23 Duo Ma , Nana Hou , Van Tung Pham , Haihua Xu , Eng Siong Chng

In the last decade of automatic speech recognition (ASR) research, the introduction of deep learning brought considerable reductions in word error rate of more than 50% relative, compared to modeling without deep learning. In the wake of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-07 Rohit Prabhavalkar , Takaaki Hori , Tara N. Sainath , Ralf Schlüter , Shinji Watanabe

There are few code switching datasets, labeled or unlabled, that exist today. As a result, ASR requires new methods to utilize the vast monolingual data and models that exist. This paper uses OpenAI's open source ASR model, Whisper, which…

Sound · Computer Science 2025-08-04 Linh Pham

Sequence-to-sequence (S2S) modeling is becoming a popular paradigm for automatic speech recognition (ASR) because of its ability to jointly optimize all the conventional ASR components in an end-to-end (E2E) fashion. This report…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-30 Aswin Shanmugam Subramanian , Xiaofei Wang , Shinji Watanabe , Toru Taniguchi , Dung Tran , Yuya Fujita

Advances in machine learning have made it possible to perform various text and speech processing tasks, such as automatic speech recognition (ASR), in an end-to-end (E2E) manner. E2E approaches utilizing pre-trained models are gaining…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-07 Yukiya Hono , Koh Mitsuda , Tianyu Zhao , Kentaro Mitsui , Toshiaki Wakatsuki , Kei Sawada

In this work, we study leveraging extra text data to improve low-resource end-to-end ASR under cross-lingual transfer learning setting. To this end, we extend our prior work [1], and propose a hybrid Transformer-LSTM based architecture.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-29 Zhiping Zeng , Van Tung Pham , Haihua Xu , Yerbolat Khassanov , Eng Siong Chng , Chongjia Ni , Bin Ma

Many existing works on voice conversion (VC) tasks use automatic speech recognition (ASR) models for ensuring linguistic consistency between source and converted samples. However, for the low-data resource domains, training a high-quality…

Sound · Computer Science 2023-05-25 Mayank Kumar Singh , Naoya Takahashi , Onoe Naoyuki

Motivated by a growing research interest into automatic speech recognition (ASR), and the growing body of work for languages in which code-switching (CS) often occurs, we present a systematic literature review of code-switching in…

Computation and Language · Computer Science 2025-07-11 Maha Tufail Agro , Atharva Kulkarni , Karima Kadaoui , Zeerak Talat , Hanan Aldarmaki

Voice technology has become ubiquitous recently. However, the accuracy, and hence experience, in different languages varies significantly, which makes the technology not equally inclusive. The availability of data for different languages is…

Computation and Language · Computer Science 2023-05-24 Jan Silovsky , Liuhui Deng , Arturo Argueta , Tresi Arvizo , Roger Hsiao , Sasha Kuznietsov , Yiu-Chang Lin , Xiaoqiang Xiao , Yuanyuan Zhang

In recent years, neural models trained on large multilingual text and speech datasets have shown great potential for supporting low-resource languages. This study investigates the performances of two state-of-the-art Automatic Speech…

Computation and Language · Computer Science 2025-07-03 Md Sazzadul Islam Ridoy , Sumi Akter , Md. Aminur Rahman