English
Related papers

Related papers: Hierarchical Transformer-based Large-Context End-t…

200 papers

An end-to-end (E2E) speaker-attributed automatic speech recognition (SA-ASR) model was proposed recently to jointly perform speaker counting, speech recognition and speaker identification. The model achieved a low speaker-attributed word…

Sound · Computer Science 2021-01-07 Xuankai Chang , Naoyuki Kanda , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Takuya Yoshioka

Monaural multi-speaker automatic speech recognition (ASR) remains challenging due to data scarcity and the intrinsic difficulty of recognizing and attributing words to individual speakers, particularly in overlapping speech. Recent advances…

Computation and Language · Computer Science 2026-05-29 Xinlu He , Jacob Whitehill

Incorporating longer context has been shown to benefit machine translation, but the inclusion of context in end-to-end speech translation (E2E-ST) remains under-studied. To bridge this gap, we introduce target language context in E2E-ST,…

Computation and Language · Computer Science 2023-09-28 Amir Hussein , Brian Yan , Antonios Anastasopoulos , Shinji Watanabe , Sanjeev Khudanpur

This paper presents Transcribe-to-Diarize, a new approach for neural speaker diarization that uses an end-to-end (E2E) speaker-attributed automatic speech recognition (SA-ASR). The E2E SA-ASR is a joint model that was recently proposed for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-25 Naoyuki Kanda , Xiong Xiao , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Takuya Yoshioka

End-to-end (E2E) systems have achieved competitive results compared to conventional hybrid hidden Markov model (HMM)-deep neural network based automatic speech recognition (ASR) systems. Such E2E systems are attractive due to the lack of…

Computation and Language · Computer Science 2018-02-14 Kartik Audhkhasi , Andrew Rosenberg , Abhinav Sethy , Bhuvana Ramabhadran , Brian Kingsbury

End-to-end (E2E) automatic speech recognition (ASR) models, by now, have shown competitive performance on several benchmarks. These models are structured to either operate in streaming or non-streaming mode. This work presents cascaded…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-29 Arun Narayanan , Tara N. Sainath , Ruoming Pang , Jiahui Yu , Chung-Cheng Chiu , Rohit Prabhavalkar , Ehsan Variani , Trevor Strohman

In this paper we investigate continuous speech recognition using electroencephalography (EEG) features using recently introduced end-to-end transformer based automatic speech recognition (ASR) model. Our results demonstrate that transformer…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-06 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed H Tewfik

Recently, end-to-end (E2E) models become a competitive alternative to the conventional hybrid automatic speech recognition (ASR) systems. However, they still suffer from speaker mismatch in training and testing condition. In this paper, we…

Computation and Language · Computer Science 2020-01-07 Zhiyun Fan , Jie Li , Shiyu Zhou , Bo Xu

Personal rare word recognition in end-to-end Automatic Speech Recognition (E2E ASR) models is a challenge due to the lack of training data. A standard way to address this issue is with shallow fusion methods at inference time. However, due…

The Transformer self-attention network has recently shown promising performance as an alternative to recurrent neural networks in end-to-end (E2E) automatic speech recognition (ASR) systems. However, Transformer has a drawback in that the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-29 Emiru Tsunoo , Yosuke Kashiwagi , Toshiyuki Kumakura , Shinji Watanabe

Improving the representation of contextual information is key to unlocking the potential of end-to-end (E2E) automatic speech recognition (ASR). In this work, we present a novel and simple approach for training an ASR context mechanism with…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-30 Uri Alon , Golan Pundak , Tara N. Sainath

We propose a cross-modal transformer-based neural correction models that refines the output of an automatic speech recognition (ASR) system so as to exclude ASR errors. Generally, neural correction models are composed of encoder-decoder…

Computation and Language · Computer Science 2021-07-06 Tomohiro Tanaka , Ryo Masumura , Mana Ihori , Akihiko Takashima , Takafumi Moriya , Takanori Ashihara , Shota Orihashi , Naoki Makishima

Transducer is one of the mainstream frameworks for streaming speech recognition. There is a performance gap between the streaming and non-streaming transducer models due to limited context. To reduce this gap, an effective way is to ensure…

Computation and Language · Computer Science 2023-06-28 Haitao Tang , Yu Fu , Lei Sun , Jiabin Xue , Dan Liu , Yongchao Li , Zhiqiang Ma , Minghui Wu , Jia Pan , Genshun Wan , Ming'en Zhao

End-to-End automatic speech recognition (ASR) models aim to learn a generalised speech representation to perform recognition. In this domain there is little research to analyse internal representation dependencies and their relationship to…

Computation and Language · Computer Science 2022-11-04 Anna Ollerenshaw , Md Asif Jalal , Thomas Hain

Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional…

With the recent advances in technology, automatic speech recognition (ASR) has been widely used in real-world applications. The efficiency of converting large amounts of speech into text accurately with limited resources has become more…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-09 Yoo Rhee Oh , Kiyoung Park , Jeon Gyu Park

ASR systems often struggle with maintaining syntactic and semantic accuracy in long audio transcripts, impacting tasks like Named Entity Recognition (NER), capitalization, and punctuation. We propose a novel approach that enhances ASR by…

Computation and Language · Computer Science 2025-08-20 Duygu Altinok

Despite the significant progress in end-to-end (E2E) automatic speech recognition (ASR), E2E ASR for low resourced code-switching (CS) speech has not been well studied. In this work, we describe an E2E ASR pipeline for the recognition of CS…

Computation and Language · Computer Science 2019-10-01 Xianghu Yue , Grandee Lee , Emre Yılmaz , Fang Deng , Haizhou Li

Multilingual end-to-end(E2E) models have shown a great potential in the expansion of the language coverage in the realm of automatic speech recognition(ASR). In this paper, we aim to enhance the multilingual ASR performance in two ways,…

Computation and Language · Computer Science 2021-10-18 Rimita Lahiri , Kenichi Kumatani , Eric Sun , Yao Qian

Although large foundation models pre-trained by self-supervised learning have achieved state-of-the-art performance in many tasks including automatic speech recognition (ASR), knowledge distillation (KD) is often required in practice to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-21 Xiaoyu Yang , Qiujia Li , Chao Zhang , Philip C. Woodland