English
Related papers

Related papers: Advancing Connectionist Temporal Classification Wi…

200 papers

The acoustic-to-word model based on the connectionist temporal classification (CTC) criterion was shown as a natural end-to-end (E2E) model directly targeting words as output units. However, the word-based CTC model suffers from the…

Computation and Language · Computer Science 2018-03-16 Jinyu Li , Guoli Ye , Amit Das , Rui Zhao , Yifan Gong

In this work, we investigate two popular end-to-end automatic speech recognition (ASR) models, namely Connectionist Temporal Classification (CTC) and RNN-Transducer (RNN-T), for offline recognition of voice search queries, with up to 2B…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Weiran Wang , Rohit Prabhavalkar , Dongseong Hwang , Qiujia Li , Khe Chai Sim , Bo Li , James Qin , Xingyu Cai , Adam Stooke , Zhong Meng , CJ Zheng , Yanzhang He , Tara Sainath , Pedro Moreno Mengibar

Connectionist Temporal Classification (CTC) is a widely used method for automatic speech recognition (ASR), renowned for its simplicity and computational efficiency. However, it often falls short in recognition performance. In this work, we…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-17 Zengwei Yao , Wei Kang , Xiaoyu Yang , Fangjun Kuang , Liyong Guo , Han Zhu , Zengrui Jin , Zhaoqing Li , Long Lin , Daniel Povey

End-to-end speech recognition systems usually require huge amounts of labeling resource, while annotating the speech data is complicated and expensive. Active learning is the solution by selecting the most valuable samples for annotation.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-12 Jian Luo , Jianzong Wang , Ning Cheng , Jing Xiao

Non-native speech causes automatic speech recognition systems to degrade in performance. Past strategies to address this challenge have considered model adaptation, accent classification with a model selection, alternate pronunciation…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-03 Shahram Ghorbani , Ahmet E. Bulut , John H. L. Hansen

Recent end-to-end Automatic Speech Recognition (ASR) systems demonstrated the ability to outperform conventional hybrid DNN/ HMM ASR. Aside from architectural improvements in those systems, those models grew in terms of depth, parameters…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-06 Ludwig Kürzinger , Dominik Winkelbauer , Lujun Li , Tobias Watzel , Gerhard Rigoll

We present a state-of-the-art end-to-end Automatic Speech Recognition (ASR) model. We learn to listen and write characters with a joint Connectionist Temporal Classification (CTC) and attention-based encoder-decoder network. The encoder is…

Computation and Language · Computer Science 2017-06-12 Takaaki Hori , Shinji Watanabe , Yu Zhang , William Chan

Recently, the acoustic-to-word model based on the Connectionist Temporal Classification (CTC) criterion was shown as a natural end-to-end model directly targeting words as output units. However, this type of word-based CTC model suffers…

Computation and Language · Computer Science 2017-11-29 Jinyu Li , Guoli Ye , Rui Zhao , Jasha Droppo , Yifan Gong

Conventionally, the manner of articulations in speech signal are derived using discriminative signal processing techniques or deep learning approaches. However, training such complex systems involves feature extraction, phoneme force…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-06 Pradeep R , Sreenivasa Rao K

Connectionist temporal classification (CTC) is commonly adopted for sequence modeling tasks like speech recognition, where it is necessary to preserve order between the input and target sequences. However, CTC is only applied to…

Machine Learning · Computer Science 2023-12-18 Zheng Nan , Ting Dang , Vidhyasaharan Sethu , Beena Ahmed

Most current speech technology systems are designed to operate well even in the presence of multiple active speakers. However, most solutions assume that the number of co-current speakers is known. Unfortunately, this information might not…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-02 Midia Yousefi , John H. L. Hansen

This study proposes a text classification algorithm based on large language models, aiming to address the limitations of traditional methods in capturing long-range dependencies, understanding contextual semantics, and handling class…

Computation and Language · Computer Science 2025-12-11 Ning Lyu , Yuxi Wang , Feng Chen , Qingyuan Zhang

Recently, there has been increasing progress in end-to-end automatic speech recognition (ASR) architecture, which transcribes speech to text without any pre-trained alignments. One popular end-to-end approach is the hybrid Connectionist…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-06 Haoran Miao , Gaofeng Cheng , Pengyuan Zhang , Yonghong Yan

Non-autoregressive (NAR) models for automatic speech recognition (ASR) aim to achieve high accuracy and fast inference by simplifying the autoregressive (AR) generation process of conventional models. Connectionist temporal classification…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-29 Yuya Fujita , Shinji Watanabe , Xuankai Chang , Takashi Maekaku

This paper presents BERT-CTC, a novel formulation of end-to-end speech recognition that adapts BERT for connectionist temporal classification (CTC). Our formulation relaxes the conditional independence assumptions used in conventional CTC…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-21 Yosuke Higuchi , Brian Yan , Siddhant Arora , Tetsuji Ogawa , Tetsunori Kobayashi , Shinji Watanabe

Recent work on end-to-end automatic speech recognition (ASR) has shown that the connectionist temporal classification (CTC) loss can be used to convert acoustics to phone or character sequences. Such systems are used with a dictionary and…

Computation and Language · Computer Science 2017-03-23 Kartik Audhkhasi , Bhuvana Ramabhadran , George Saon , Michael Picheny , David Nahamoo

Attention-based methods and Connectionist Temporal Classification (CTC) network have been promising research directions for end-to-end Automatic Speech Recognition (ASR). The joint CTC/Attention model has achieved great success by utilizing…

Computation and Language · Computer Science 2018-11-13 Ruizhi Li , Xiaofei Wang , Sri Harish Mallidi , Takaaki Hori , Shinji Watanabe , Hynek Hermansky

Multilingual models for Automatic Speech Recognition (ASR) are attractive as they have been shown to benefit from more training data, and better lend themselves to adaptation to under-resourced languages. However, initialisation from…

Audio and Speech Processing · Electrical Eng. & Systems 2018-01-24 Sibo Tong , Philip N. Garner , Hervé Bourlard

We report an extension of a Keras Model, called CTCModel, to perform the Connectionist Temporal Classification (CTC) in a transparent way. Combined with Recurrent Neural Networks, the Connectionist Temporal Classification is the reference…

Machine Learning · Computer Science 2019-01-24 Yann Soullard , Cyprien Ruffino , Thierry Paquet

We present results that show it is possible to build a competitive, greatly simplified, large vocabulary continuous speech recognition system with whole words as acoustic units. We model the output vocabulary of about 100,000 words directly…

Computation and Language · Computer Science 2016-11-01 Hagen Soltau , Hank Liao , Hasim Sak