English
Related papers

Related papers: CR-CTC: Consistency regularization on CTC for impr…

200 papers

Modern deep learning models often achieve high overall performance, but consistently fail on specific subgroups. Group distributionally robust optimization (group DRO) addresses this problem by minimizing the worst-group loss, but it fails…

Recent works in speech recognition rely either on connectionist temporal classification (CTC) or sequence-to-sequence models for character-level recognition. CTC assumes conditional independence of individual characters, whereas…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Stavros Petridis , Themos Stafylakis , Pingchuan Ma , Georgios Tzimiropoulos , Maja Pantic

Training automatic speech recognition (ASR) systems requires large amounts of well-curated paired data. However, human annotators usually perform "non-verbatim" transcription, which can result in poorly trained models. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-28 Dongji Gao , Hainan Xu , Desh Raj , Leibny Paola Garcia Perera , Daniel Povey , Sanjeev Khudanpur

We present a state-of-the-art end-to-end Automatic Speech Recognition (ASR) model. We learn to listen and write characters with a joint Connectionist Temporal Classification (CTC) and attention-based encoder-decoder network. The encoder is…

Computation and Language · Computer Science 2017-06-12 Takaaki Hori , Shinji Watanabe , Yu Zhang , William Chan

Multi-talker speech recognition (MTASR) faces unique challenges in disentangling and transcribing overlapping speech. To address these challenges, this paper investigates the role of Connectionist Temporal Classification (CTC) in speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-06 Jiawen Kang , Lingwei Meng , Mingyu Cui , Yuejiao Wang , Xixin Wu , Xunying Liu , Helen Meng

Non-native speech causes automatic speech recognition systems to degrade in performance. Past strategies to address this challenge have considered model adaptation, accent classification with a model selection, alternate pronunciation…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-03 Shahram Ghorbani , Ahmet E. Bulut , John H. L. Hansen

Recent end-to-end Automatic Speech Recognition (ASR) systems demonstrated the ability to outperform conventional hybrid DNN/ HMM ASR. Aside from architectural improvements in those systems, those models grew in terms of depth, parameters…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-06 Ludwig Kürzinger , Dominik Winkelbauer , Lujun Li , Tobias Watzel , Gerhard Rigoll

Connectionist temporal classification (CTC) -based models are attractive in automatic speech recognition (ASR) because of their non-autoregressive nature. To take advantage of text-only data, language model (LM) integration approaches such…

Computation and Language · Computer Science 2022-09-12 Hayato Futami , Hirofumi Inaguma , Sei Ueno , Masato Mimura , Shinsuke Sakai , Tatsuya Kawahara

Conventionally, the manner of articulations in speech signal are derived using discriminative signal processing techniques or deep learning approaches. However, training such complex systems involves feature extraction, phoneme force…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-06 Pradeep R , Sreenivasa Rao K

Self-supervised methods such as Contrastive predictive Coding (CPC) have greatly improved the quality of the unsupervised representations. These representations significantly reduce the amount of labeled data needed for downstream task…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-27 Saurabhchand Bhati , Jesús Villalba , Piotr Żelasko , Laureano Moro-Velazquez , Najim Dehak

We report an extension of a Keras Model, called CTCModel, to perform the Connectionist Temporal Classification (CTC) in a transparent way. Combined with Recurrent Neural Networks, the Connectionist Temporal Classification is the reference…

Machine Learning · Computer Science 2019-01-24 Yann Soullard , Cyprien Ruffino , Thierry Paquet

This paper investigates four types of cross-utterance speech contexts modeling approaches for streaming and non-streaming Conformer-Transformer (C-T) ASR systems: i) input audio feature concatenation; ii) cross-utterance Encoder embedding…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-15 Mingyu Cui , Mengzhe Geng , Jiajun Deng , Chengxi Deng , Jiawen Kang , Shujie Hu , Guinan Li , Tianzi Wang , Zhaoqing Li , Xie Chen , Xunying Liu

Connectionist Temporal Classification (CTC) model is a very efficient method for modeling sequences, especially for speech data. In order to use CTC model as an Automatic Speech Recognition (ASR) task, the beam search decoding with an…

Computation and Language · Computer Science 2023-06-28 Minkyu Jung , Ohhyeok Kwon , Seunghyun Seo , Soonshin Seo

In this paper we introduce various techniques to improve the performance of electroencephalography (EEG) features based continuous speech recognition (CSR) systems. A connectionist temporal classification (CTC) based automatic speech…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-25 Gautam Krishna , Co Tran , Mason Carnahan , Yan Han , Ahmed H Tewfik

Accurate recognition of rare and new words remains a pressing problem for contextualized Automatic Speech Recognition (ASR) systems. Most context-biasing methods involve modification of the ASR model or the beam-search decoding algorithm,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Andrei Andrusenko , Aleksandr Laptev , Vladimir Bataev , Vitaly Lavrukhin , Boris Ginsburg

The network architecture of end-to-end (E2E) automatic speech recognition (ASR) can be classified into several models, including connectionist temporal classification (CTC), recurrent neural network transducer (RNN-T), attention mechanism,…

Sound · Computer Science 2023-05-31 Yui Sudo , Muhammad Shakeel , Brian Yan , Jiatong Shi , Shinji Watanabe

Due to the modality discrepancy between textual and acoustic modeling, efficiently transferring linguistic knowledge from a pretrained language model (PLM) to acoustic encoding for automatic speech recognition (ASR) still remains a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-29 Xugang Lu , Peng Shen , Yu Tsao , Hisashi Kawai

In this work, we explore a Connectionist Temporal Classification (CTC) based end-to-end Automatic Speech Recognition (ASR) model for the Myanmar language. A series of experiments is presented on the topology of the model in which the…

Machine Learning · Computer Science 2021-05-17 Khin Me Me Chit , Laet Laet Lin

The mismatch of speech length and text length poses a challenge in automatic speech recognition (ASR). In previous research, various approaches have been employed to align text with speech, including the utilization of Connectionist…

Computation and Language · Computer Science 2025-10-14 Peng Fan , Wenping Wang , Fei Deng

This paper presents a fully automated approach for identifying speech anomalies from voice recordings to aid in the assessment of speech impairments. By combining Connectionist Temporal Classification (CTC) and encoder-decoder-based…

Sound · Computer Science 2023-08-04 Laurin Wagner , Mario Zusag , Theresa Bloder