English
Related papers

Related papers: End-to-end contextual speech recognition using cla…

200 papers

Neural end-to-end (E2E) models have become a promising technique to realize practical automatic speech recognition (ASR) systems. When realizing such a system, one important issue is the segmentation of audio to deal with streaming input or…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-19 Yuya Fujita , Tianzi Wang , Shinji Watanabe , Motoi Omachi

In recent years, the evolution of end-to-end (E2E) automatic speech recognition (ASR) models has been remarkable, largely due to advances in deep learning architectures like transformer. On top of E2E systems, researchers have achieved…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Shiyi Han , Zhihong Lei , Mingbin Xu , Xingyu Na , Zhen Huang

This paper presents an efficient decoding approach for end-to-end automatic speech recognition (E2E-ASR) with large language models (LLMs). Although shallow fusion is the most common approach to incorporate language models into E2E-ASR…

Computation and Language · Computer Science 2025-01-17 Takaaki Hori , Martin Kocour , Adnan Haider , Erik McDermott , Xiaodan Zhuang

We study training a single end-to-end (E2E) automatic speech recognition (ASR) model for three languages used in Kazakhstan: Kazakh, Russian, and English. We first describe the development of multilingual E2E ASR based on Transformer…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-04 Saida Mussakhojayeva , Yerbolat Khassanov , Huseyin Atakan Varol

This work presents our end-to-end (E2E) automatic speech recognition (ASR) model targetting at robust speech recognition, called Integraded speech Recognition with enhanced speech Input for Self-supervised learning representation (IRIS).…

Sound · Computer Science 2022-04-04 Xuankai Chang , Takashi Maekaku , Yuya Fujita , Shinji Watanabe

End-to-end (E2E) models fold the acoustic, pronunciation and language models of a conventional speech recognition model into one neural network with a much smaller number of parameters than a conventional ASR system, thus making it suitable…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-14 Bo Li , Shuo-yiin Chang , Tara N. Sainath , Ruoming Pang , Yanzhang He , Trevor Strohman , Yonghui Wu

Speech-to-text translation pertains to the task of converting speech signals in a language to text in another language. It finds its application in various domains, such as hands-free communication, dictation, video lecture transcription,…

Computation and Language · Computer Science 2024-06-11 Nivedita Sethiya , Chandresh Kumar Maurya

End-to-end (E2E) spoken language understanding (SLU) systems that generate a semantic parse from speech have become more promising recently. This approach uses a single model that utilizes audio and text representations from pre-trained…

Computation and Language · Computer Science 2023-07-25 Suyoun Kim , Akshat Shrivastava , Duc Le , Ju Lin , Ozlem Kalinli , Michael L. Seltzer

Transformer-based end-to-end (E2E) automatic speech recognition (ASR) systems have recently gained wide popularity, and are shown to outperform E2E models based on recurrent structures on a number of ASR tasks. However, like other E2E…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-30 Mohan Li , Catalin Zorila , Rama Doddipatla

End-to-end (E2E) speech recognition architectures assemble all components of traditional speech recognition system into a single model. Although it simplifies ASR system, it introduces contextual ASR drawback: the E2E model has worse…

Computation and Language · Computer Science 2022-02-21 Zhengyi Zhang , Pan Zhou

India is home to multiple languages, and training automatic speech recognition (ASR) systems for languages is challenging. Over time, each language has adopted words from other languages, such as English, leading to code-mixing. Most Indian…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-04 Mari Ganesh Kumar , Jom Kuriakose , Anand Thyagachandran , Arun Kumar A , Ashish Seth , Lodagala Durga Prasad , Saish Jaiswal , Anusha Prakash , Hema Murthy

End-to-end (E2E) models have shown to outperform state-of-the-art conventional models for streaming speech recognition [1] across many dimensions, including quality (as measured by word error rate (WER)) and endpointer latency [2]. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-12 Bo Li , Anmol Gulati , Jiahui Yu , Tara N. Sainath , Chung-Cheng Chiu , Arun Narayanan , Shuo-Yiin Chang , Ruoming Pang , Yanzhang He , James Qin , Wei Han , Qiao Liang , Yu Zhang , Trevor Strohman , Yonghui Wu

We propose a novel approach to end-to-end automatic speech recognition (ASR) to achieve efficient speech in-context learning (SICL) for (i) long-form speech decoding, (ii) test-time speaker adaptation, and (iii) test-time contextual…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-01 Hao Yen , Shaoshi Ling , Guoli Ye

The end-to-end (E2E) automatic speech recognition (ASR) systems are often required to operate in reverberant conditions, where the long-term sub-band envelopes of the speech are temporally smeared. In this paper, we develop a feature…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-21 Rohit Kumar , Anurenjan Purushothaman , Anirudh Sreeram , Sriram Ganapathy

This paper presents our latest investigation on end-to-end automatic speech recognition (ASR) for overlapped speech. We propose to train an end-to-end system conditioned on speaker embeddings and further improved by transfer learning from…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-14 Pavel Denisov , Ngoc Thang Vu

End-to-end (E2E) systems for automatic speech recognition (ASR), such as RNN Transducer (RNN-T) and Listen-Attend-Spell (LAS) blend the individual components of a traditional hybrid ASR system - acoustic model, language model, pronunciation…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Mahaveer Jain , Gil Keren , Jay Mahadeokar , Geoffrey Zweig , Florian Metze , Yatharth Saraf

End-to-end (E2E) automatic speech recognition (ASR) methods exhibit remarkable performance. However, since the performance of such methods is intrinsically linked to the context present in the training data, E2E-ASR methods do not perform…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-22 Yui Sudo , Muhammad Shakeel , Yosuke Fukumoto , Yifan Peng , Shinji Watanabe

The external language models (LM) integration remains a challenging task for end-to-end (E2E) automatic speech recognition (ASR) which has no clear division between acoustic and language models. In this work, we propose an internal LM…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Zhong Meng , Sarangarajan Parthasarathy , Eric Sun , Yashesh Gaur , Naoyuki Kanda , Liang Lu , Xie Chen , Rui Zhao , Jinyu Li , Yifan Gong

Despite the rapid progress of end-to-end (E2E) automatic speech recognition (ASR), it has been shown that incorporating external language models (LMs) into the decoding can further improve the recognition performance of E2E ASR systems. To…

Computation and Language · Computer Science 2022-04-13 Jinchuan Tian , Jianwei Yu , Chao Weng , Yuexian Zou , Dong Yu

While end-to-end (E2E) automatic speech recognition (ASR) models excel at general transcription, they struggle to recognize rare or unseen named entities (e.g., contact names, locations), which are critical for downstream applications like…

Computation and Language · Computer Science 2025-12-22 Ramaneswaran Selvakumar , Cindy Tseng , Eesung Kim , Vijendra Raj Apsingekar , Yun Tang