English
Related papers

Related papers: Automatic Speech Recognition with BERT and CTC Tra…

200 papers

This paper proposes a novel label-synchronous speech-to-text alignment technique for automatic speech recognition (ASR). The speech-to-text alignment is a problem of splitting long audio recordings with un-aligned transcripts into…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-22 Yusuke Kida , Tatsuya Komatsu , Masahito Togami

Neural transducers (NT) provide an effective framework for speech streaming, demonstrating strong performance in automatic speech recognition (ASR). However, the application of NT to speech translation (ST) remains challenging, as existing…

Computation and Language · Computer Science 2025-06-04 Amir Hussein , Cihan Xiao , Matthew Wiesner , Dan Povey , Leibny Paola Garcia , Sanjeev Khudanpur

Transformer-based models have demonstrated their effectiveness in automatic speech recognition (ASR) tasks and even shown superior performance over the conventional hybrid framework. The main idea of Transformers is to capture the…

Sound · Computer Science 2022-07-05 Kun Wei , Pengcheng Guo , Ning Jiang

This paper proposes a unified framework, All-in-One ASR, that allows a single model to support multiple automatic speech recognition (ASR) paradigms, including connectionist temporal classification (CTC), attention-based encoder-decoder…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-15 Takafumi Moriya , Masato Mimura , Tomohiro Tanaka , Hiroshi Sato , Ryo Masumura , Atsunori Ogawa

Automatic speech recognition (ASR) has recently become an important challenge when using deep learning (DL). It requires large-scale training datasets and high computational and storage resources. Moreover, DL techniques and machine…

Sound · Computer Science 2023-08-01 Hamza Kheddar , Yassine Himeur , Somaya Al-Maadeed , Abbes Amira , Faycal Bensaali

End-to-end automatic speech recognition (ASR), unlike conventional ASR, does not have modules to learn the semantic representation from speech encoder. Moreover, the higher frame-rate of speech representation prevents the model to learn the…

Artificial Intelligence · Computer Science 2021-03-19 Md Akmal Haidar , Chao Xing , Mehdi Rezagholizadeh

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

Computation and Language · Computer Science 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

Automatic speech recognition (ASR) plays a pivotal role in our daily lives, offering utility not only for interacting with machines but also for facilitating communication for individuals with partial or profound hearing impairments. The…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Billel Essaid , Hamza Kheddar , Noureddine Batel , Muhammad E. H. Chowdhury , Abderrahmane Lakas

Transformers have evolved with great success in various artificial intelligence tasks. Thanks to our recent prevalence of self-attention mechanisms, which capture long-term dependency, phenomenal outcomes in speech processing and…

Computation and Language · Computer Science 2024-08-28 Shruti Singh , Muskaan Singh , Virender Kadyan

In the domain of air traffic control (ATC) systems, efforts to train a practical automatic speech recognition (ASR) model always faces the problem of small training samples since the collection and annotation of speech samples are expert-…

Sound · Computer Science 2021-02-17 Yi Lin , Qin Li , Bo Yang , Zhen Yan , Huachun Tan , Zhengmao Chen

Code-switching speech recognition has attracted an increasing interest recently, but the need for expert linguistic knowledge has always been a big issue. End-to-end automatic speech recognition (ASR) simplifies the building of ASR systems…

Computation and Language · Computer Science 2018-11-02 Ne Luo , Dongwei Jiang , Shuaijiang Zhao , Caixia Gong , Wei Zou , Xiangang Li

We introduce dual-decoder Transformer, a new model architecture that jointly performs automatic speech recognition (ASR) and multilingual speech translation (ST). Our models are based on the original Transformer architecture (Vaswani et…

Computation and Language · Computer Science 2020-11-21 Hang Le , Juan Pino , Changhan Wang , Jiatao Gu , Didier Schwab , Laurent Besacier

Transformer neural networks, particularly Bidirectional Encoder Representations from Transformers (BERT), have shown remarkable performance across various tasks such as classification, text summarization, and question answering. However,…

Machine Learning · Computer Science 2025-02-18 Matteo Bonino , Giorgia Ghione , Giansalvo Cirrincione

Fine-tuned Bidirectional Encoder Representations from Transformers (BERT)-based sequence classification models have proven to be effective for detecting Alzheimer's Disease (AD) from transcripts of human speech. However, previous research…

Computation and Language · Computer Science 2020-11-13 Aparna Balagopalan , Jekaterina Novikova

Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder…

Sound · Computer Science 2018-11-02 Zhe Yuan , Zhuoran Lyu , Jiwei Li , Xi Zhou

Deep learning approaches have been widely used in Automatic Speech Recognition (ASR) and they have achieved a significant accuracy improvement. Especially, Convolutional Neural Networks (CNNs) have been revisited in ASR recently. However,…

Computation and Language · Computer Science 2017-02-28 Yisen Wang , Xuejiao Deng , Songbai Pu , Zhiheng Huang

Automatic Speech Recognition (ASR) systems generalize poorly on accented speech. The phonetic and linguistic variability of accents present hard challenges for ASR systems today in both data collection and modeling strategies. The resulting…

This paper proposes an adaptation method for end-to-end speech recognition. In this method, multiple automatic speech recognition (ASR) 1-best hypotheses are integrated in the computation of the connectionist temporal classification (CTC)…

Computation and Language · Computer Science 2021-04-01 Cong-Thanh Do , Rama Doddipatla , Thomas Hain

Connectionist Temporal Classification has recently attracted a lot of interest as it offers an elegant approach to building acoustic models (AMs) for speech recognition. The CTC loss function maps an input sequence of observable feature…

Computation and Language · Computer Science 2017-08-16 Thomas Zenkel , Ramon Sanabria , Florian Metze , Jan Niehues , Matthias Sperber , Sebastian Stüker , Alex Waibel

Automatic Speech Recognition (ASR) in medical contexts has the potential to save time, cut costs, increase report accuracy, and reduce physician burnout. However, the healthcare industry has been slower to adopt this technology, in part due…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-14 Joel Shor , Ruyue Agnes Bi , Subhashini Venugopalan , Steven Ibara , Roman Goldenberg , Ehud Rivlin