English
Related papers

Related papers: A Language Agnostic Multilingual Streaming On-Devi…

200 papers

Although recent advances in deep learning technology have boosted automatic speech recognition (ASR) performance in the single-talker case, it remains difficult to recognize multi-talker speech in which many voices overlap. One conventional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-20 Takafumi Moriya , Hiroshi Sato , Tsubasa Ochiai , Marc Delcroix , Takahiro Shinozaki

Thus far, end-to-end (E2E) models have not been shown to outperform state-of-the-art conventional models with respect to both quality, i.e., word error rate (WER), and latency, i.e., the time the hypothesis is finalized after the user stops…

Recently, online end-to-end ASR has gained increasing attention. However, the performance of online systems still lags far behind that of offline systems, with a large gap in quality of recognition. For specific scenarios, we can trade-off…

Sound · Computer Science 2020-10-28 Zhifu Gao , Shiliang Zhang , Ming Lei , Ian McLoughlin

Deploying high-quality automatic speech recognition (ASR) on edge devices requires models that jointly optimize accuracy, latency, and memory footprint while operating entirely on CPU without GPU acceleration. We conduct a systematic…

Artificial Intelligence · Computer Science 2026-04-21 Nenad Banfic , David Fan , Kunal Vaishnavi , Sam Kemp , Sunghoon Choi , Rui Ren , Sayan Shaw , Meng Tang

On-device automatic speech recognition systems face several challenges compared to server-based systems. They have to meet stricter constraints in terms of speed, disk size and memory while maintaining the same accuracy. Often they have to…

Computation and Language · Computer Science 2023-05-18 Markus Nußbaum-Thom , Lyan Verwimp , Youssef Oualil

Monaural multi-speaker automatic speech recognition (ASR) remains challenging due to data scarcity and the intrinsic difficulty of recognizing and attributing words to individual speakers, particularly in overlapping speech. Recent advances…

Computation and Language · Computer Science 2026-05-29 Xinlu He , Jacob Whitehill

With the massive developments of end-to-end (E2E) neural networks, recent years have witnessed unprecedented breakthroughs in automatic speech recognition (ASR). However, the codeswitching phenomenon remains a major obstacle that hinders…

Computation and Language · Computer Science 2024-02-28 Tzu-Ting Yang , Hsin-Wei Wang , Yi-Cheng Wang , Chi-Han Lin , Berlin Chen

Despite recent advances in voice separation methods, many challenges remain in realistic scenarios such as noisy recording and the limits of available data. In this work, we propose to explicitly incorporate the phonetic and linguistic…

The streaming automatic speech recognition (ASR) models are more popular and suitable for voice-based applications. However, non-streaming models provide better performance as they look at the entire audio context. To leverage the benefits…

Sound · Computer Science 2022-08-26 Raviraj Joshi , Subodh Kumar

In voice-enabled applications, a predetermined hotword isusually used to activate a device in order to attend to the query.However, speaking queries followed by a hotword each timeintroduces a cognitive burden in continued conversations.…

Computation and Language · Computer Science 2022-08-30 Shuo-yiin Chang , Guru Prakash , Zelin Wu , Qiao Liang , Tara N. Sainath , Bo Li , Adam Stambler , Shyam Upadhyay , Manaal Faruqui , Trevor Strohman

This paper proposes a model for transforming speech features using the frequency-directional attention model for End-to-End (E2E) automatic speech recognition. The idea is based on the hypothesis that in the phoneme system of each language,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-30 Akihiro Dobashi , Chee Siang Leow , Hiromitsu Nishizaki

End-to-end (E2E) models are becoming increasingly popular for spoken language understanding (SLU) systems and are beginning to achieve competitive performance to pipeline-based approaches. However, recent work has shown that these models…

Computation and Language · Computer Science 2022-08-01 Siddhant Arora , Siddharth Dalmia , Xuankai Chang , Brian Yan , Alan Black , Shinji Watanabe

End-to-end (E2E) systems have achieved competitive results compared to conventional hybrid hidden Markov model (HMM)-deep neural network based automatic speech recognition (ASR) systems. Such E2E systems are attractive due to the lack of…

Computation and Language · Computer Science 2018-02-14 Kartik Audhkhasi , Andrew Rosenberg , Abhinav Sethy , Bhuvana Ramabhadran , Brian Kingsbury

Recently, streaming end-to-end automatic speech recognition (E2E-ASR) has gained more and more attention. Many efforts have been paid to turn the non-streaming attention-based E2E-ASR system into streaming architecture. In this work, we…

Sound · Computer Science 2020-06-03 Shiliang Zhang , Zhifu Gao , Haoneng Luo , Ming Lei , Jie Gao , Zhijie Yan , Lei Xie

We extend the frameworks of Serialized Output Training (SOT) to address practical needs of both streaming and offline automatic speech recognition (ASR) applications. Our approach focuses on balancing latency and accuracy, catering to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-18 Aswin Shanmugam Subramanian , Amit Das , Naoyuki Kanda , Jinyu Li , Xiaofei Wang , Yifan Gong

This work presents our end-to-end (E2E) automatic speech recognition (ASR) model targetting at robust speech recognition, called Integraded speech Recognition with enhanced speech Input for Self-supervised learning representation (IRIS).…

Sound · Computer Science 2022-04-04 Xuankai Chang , Takashi Maekaku , Yuya Fujita , Shinji Watanabe

End-to-end (E2E) spoken language understanding (SLU) can infer semantics directly from speech signal without cascading an automatic speech recognizer (ASR) with a natural language understanding (NLU) module. However, paired utterance…

Computation and Language · Computer Science 2021-02-15 Yao Qian , Ximo Bian , Yu Shi , Naoyuki Kanda , Leo Shen , Zhen Xiao , Michael Zeng

Although end-to-end (E2E) automatic speech recognition (ASR) has shown state-of-the-art recognition accuracy, it tends to be implicitly biased towards the training data distribution which can degrade generalisation. This paper proposes a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-28 Keqi Deng , Philip C. Woodland

ASR endpointing (EP) plays a major role in delivering a good user experience in products supporting human or artificial agents in human-human/machine conversations. Transducer-based ASR (T-ASR) is an end-to-end (E2E) ASR modelling technique…

Language identification is critical for many downstream tasks in automatic speech recognition (ASR), and is beneficial to integrate into multilingual end-to-end ASR as an additional task. In this paper, we propose to modify the structure of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-14 Chao Zhang , Bo Li , Tara Sainath , Trevor Strohman , Sepand Mavandadi , Shuo-yiin Chang , Parisa Haghani