English
Related papers

Related papers: Align With Purpose: Optimize Desired Properties in…

200 papers

Connectionist temporal classification (CTC) is widely used for maximum likelihood learning in end-to-end speech recognition models. However, there is usually a disparity between the negative maximum likelihood and the performance metric…

Computation and Language · Computer Science 2017-12-20 Yingbo Zhou , Caiming Xiong , Richard Socher

Connectionist Temporal Classification (CTC) is a widely used approach for automatic speech recognition (ASR) that performs conditionally independent monotonic alignment. However for translation, CTC exhibits clear limitations due to the…

Computation and Language · Computer Science 2022-10-12 Brian Yan , Siddharth Dalmia , Yosuke Higuchi , Graham Neubig , Florian Metze , Alan W Black , Shinji Watanabe

Recently, there has been an increasing interest in end-to-end speech recognition that directly transcribes speech to text without any predefined alignments. One approach is the attention-based encoder-decoder framework that learns a mapping…

Computation and Language · Computer Science 2017-02-02 Suyoun Kim , Takaaki Hori , Shinji Watanabe

Connectionist temporal classification (CTC) provides an end-to-end acoustic model (AM) training strategy. CTC learns accurate AMs without time-aligned phonetic transcription, but sometimes fails to converge, especially in…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-28 Di He , Xuesong Yang , Boon Pang Lim , Yi Liang , Mark Hasegawa-Johnson , Deming Chen

Deploying an end-to-end automatic speech recognition (ASR) model on mobile/embedded devices is a challenging task, since the device computational power and energy consumption requirements are dynamically changed in practice. To overcome the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-18 Jaesong Lee , Jingu Kang , Shinji Watanabe

Code-Switching (CS) remains a challenge for Automatic Speech Recognition (ASR), especially character-based models. With the combined choice of characters from multiple languages, the outcome from character-based models suffers from phoneme…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-24 Burin Naowarat , Thananchai Kongthaworn , Korrawe Karunratanakul , Sheng Hui Wu , Ekapol Chuangsuwanich

Consistency regularization (CR) improves the robustness and accuracy of Connectionist Temporal Classification (CTC) by ensuring predictions remain stable across input perturbations. In this work, we propose Align-Consistency, an extension…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-27 Wanting Huang , Weiran Wang

Phonetic speech transcription is crucial for fine-grained linguistic analysis and downstream speech applications. While Connectionist Temporal Classification (CTC) is a widely used approach for such tasks due to its efficiency, it often…

Connectionist Temporal Classification (CTC) is a widely used method for automatic speech recognition (ASR), renowned for its simplicity and computational efficiency. However, it often falls short in recognition performance. In this work, we…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-17 Zengwei Yao , Wei Kang , Xiaoyu Yang , Fangjun Kuang , Liyong Guo , Han Zhu , Zengrui Jin , Zhaoqing Li , Long Lin , Daniel Povey

Connectionist Temporal Classification has recently attracted a lot of interest as it offers an elegant approach to building acoustic models (AMs) for speech recognition. The CTC loss function maps an input sequence of observable feature…

Computation and Language · Computer Science 2017-08-16 Thomas Zenkel , Ramon Sanabria , Florian Metze , Jan Niehues , Matthias Sperber , Sebastian Stüker , Alex Waibel

Recent works in speech recognition rely either on connectionist temporal classification (CTC) or sequence-to-sequence models for character-level recognition. CTC assumes conditional independence of individual characters, whereas…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Stavros Petridis , Themos Stafylakis , Pingchuan Ma , Georgios Tzimiropoulos , Maja Pantic

Accurate sequence-to-sequence (seq2seq) alignment is critical for applications like medical speech analysis and language learning tools relying on automatic speech recognition (ASR). State-of-the-art end-to-end (E2E) ASR systems, such as…

Machine Learning · Computer Science 2025-11-24 Yacouba Kaloga , Shashi Kumar , Petr Motlicek , Ina Kodrasi

The success of self-attention in NLP has led to recent applications in end-to-end encoder-decoder architectures for speech recognition. Separately, connectionist temporal classification (CTC) has matured as an alignment-free,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Julian Salazar , Katrin Kirchhoff , Zhiheng Huang

We present a simple and efficient auxiliary loss function for automatic speech recognition (ASR) based on the connectionist temporal classification (CTC) objective. The proposed objective, an intermediate CTC loss, is attached to an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-08 Jaesong Lee , Shinji Watanabe

Multilingual models for Automatic Speech Recognition (ASR) are attractive as they have been shown to benefit from more training data, and better lend themselves to adaptation to under-resourced languages. However, initialisation from…

Audio and Speech Processing · Electrical Eng. & Systems 2018-01-24 Sibo Tong , Philip N. Garner , Hervé Bourlard

In this study, we propose advancing all-neural speech recognition by directly incorporating attention modeling within the Connectionist Temporal Classification (CTC) framework. In particular, we derive new context vectors using time…

Computation and Language · Computer Science 2018-03-16 Amit Das , Jinyu Li , Rui Zhao , Yifan Gong

Connectionist temporal classification (CTC) is commonly adopted for sequence modeling tasks like speech recognition, where it is necessary to preserve order between the input and target sequences. However, CTC is only applied to…

Machine Learning · Computer Science 2023-12-18 Zheng Nan , Ting Dang , Vidhyasaharan Sethu , Beena Ahmed

In end-to-end automatic speech recognition (ASR), a model is expected to implicitly learn representations suitable for recognizing a word-level sequence. However, the huge abstraction gap between input acoustic signals and output linguistic…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-09 Yosuke Higuchi , Keita Karube , Tetsuji Ogawa , Tetsunori Kobayashi

The connectionist temporal classification (CTC) enables end-to-end sequence learning by maximizing the probability of correctly recognizing sequences during training. The outputs of a CTC-trained model tend to form a series of spikes…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Hongzhu Li , Weiqiang Wang

Attention-based methods and Connectionist Temporal Classification (CTC) network have been promising research directions for end-to-end Automatic Speech Recognition (ASR). The joint CTC/Attention model has achieved great success by utilizing…

Computation and Language · Computer Science 2018-11-13 Ruizhi Li , Xiaofei Wang , Sri Harish Mallidi , Takaaki Hori , Shinji Watanabe , Hynek Hermansky
‹ Prev 1 2 3 10 Next ›