English
Related papers

Related papers: Multitask Learning with CTC and Segmental CRF for …

200 papers

In this work, we learn a shared encoding representation for a multi-task neural network model optimized with connectionist temporal classification (CTC) and conventional framewise cross-entropy training criteria. Our experiments show that…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-04 Thai-Son Nguyen , Sebastian Stueker , Alex Waibel

We propose a novel discriminative model for sequence labeling called Bregman conditional random fields (BCRF). Contrary to standard linear-chain conditional random fields, BCRF allows fast parallelizable inference algorithms based on…

Machine Learning · Computer Science 2025-06-03 Caio Corro , Mathieu Lacroix , Joseph Le Roux

Recently, end-to-end automatic speech recognition models based on connectionist temporal classification (CTC) have achieved impressive results, especially when fine-tuned from wav2vec2.0 models. Due to the conditional independence…

Computation and Language · Computer Science 2022-03-08 Keqi Deng , Songjun Cao , Yike Zhang , Long Ma , Gaofeng Cheng , Ji Xu , Pengyuan Zhang

Connectionist Temporal Classification (CTC) is a widely used method for automatic speech recognition (ASR), renowned for its simplicity and computational efficiency. However, it often falls short in recognition performance. In this work, we…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-17 Zengwei Yao , Wei Kang , Xiaoyu Yang , Fangjun Kuang , Liyong Guo , Han Zhu , Zengrui Jin , Zhaoqing Li , Long Lin , Daniel Povey

We compare different models for low resource multi-task sequence tagging that leverage dependencies between label sequences for different tasks. Our analysis is aimed at datasets where each example has labels for multiple tasks. Current…

Computation and Language · Computer Science 2020-05-04 Jonas Pfeiffer , Edwin Simpson , Iryna Gurevych

Neural Transducer and connectionist temporal classification (CTC) are popular end-to-end automatic speech recognition systems. Due to their frame-synchronous design, blank symbols are introduced to address the length mismatch between…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-22 Yifan Yang , Xiaoyu Yang , Liyong Guo , Zengwei Yao , Wei Kang , Fangjun Kuang , Long Lin , Xie Chen , Daniel Povey

Existing deep multi-object tracking (MOT) approaches first learn a deep representation to describe target objects and then associate detection results by optimizing a linear assignment problem. Despite demonstrated successes, it is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Jun Xiang , Ma Chao , Guohan Xu , Jianhua Hou

The RNN-Transducers and improved attention-based encoder-decoder models are widely applied to streaming speech recognition. Compared with these two end-to-end models, the CTC model is more efficient in training and inference. However, it…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Zhengkun Tian , Jiangyan Yi , Ye Bai , Jianhua Tao , Shuai Zhang , Zhengqi Wen

Multi-talker speech recognition (MTASR) faces unique challenges in disentangling and transcribing overlapping speech. To address these challenges, this paper investigates the role of Connectionist Temporal Classification (CTC) in speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-06 Jiawen Kang , Lingwei Meng , Mingyu Cui , Yuejiao Wang , Xixin Wu , Xunying Liu , Helen Meng

Connectionist temporal classification (CTC) is commonly adopted for sequence modeling tasks like speech recognition, where it is necessary to preserve order between the input and target sequences. However, CTC is only applied to…

Machine Learning · Computer Science 2023-12-18 Zheng Nan , Ting Dang , Vidhyasaharan Sethu , Beena Ahmed

Previous work has shown that neural encoder-decoder speech recognition can be improved with hierarchical multitask learning, where auxiliary tasks are added at intermediate layers of a deep encoder. We explore the effect of hierarchical…

Computation and Language · Computer Science 2019-03-08 Kalpesh Krishna , Shubham Toshniwal , Karen Livescu

Connectionist Temporal Classification (CTC) and attention mechanism are two main approaches used in recent scene text recognition works. Compared with attention-based methods, CTC decoder has a much shorter inference time, yet a lower…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Wenyang Hu , Xiaocong Cai , Jun Hou , Shuai Yi , Zhiping Lin

We propose a new approach to image segmentation, which exploits the advantages of both conditional random fields (CRFs) and decision trees. In the literature, the potential functions of CRFs are mostly defined as a linear combination of…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Fayao Liu , Guosheng Lin , Ruizhi Qiao , Chunhua Shen

Non-native speech causes automatic speech recognition systems to degrade in performance. Past strategies to address this challenge have considered model adaptation, accent classification with a model selection, alternate pronunciation…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-03 Shahram Ghorbani , Ahmet E. Bulut , John H. L. Hansen

Continuous Sign Language Recognition (CSLR) is a challenging research task due to the lack of accurate annotation on the temporal sequence of sign language data. The recent popular usage is a hybrid model based on "CNN + RNN" for CSLR.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Qidan Zhu , Jing Li , Fei Yuan , Quan Gan

This paper presents a novel framework for multi-talker automatic speech recognition without the need for auxiliary information. Serialized Output Training (SOT), a widely used approach, suffers from recognition errors due to speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-10 Asahi Sakuma , Hiroaki Sato , Ryuga Sugano , Tadashi Kumano , Yoshihiko Kawai , Tetsuji Ogawa

A major challenge in structured prediction is to represent the interdependencies within output structures. When outputs are structured as sequences, linear-chain conditional random fields (CRFs) are a widely used model class which can learn…

Machine Learning · Computer Science 2023-08-14 Sean Papay , Roman Klinger , Sebastian Padó

Recent works on deep conditional random fields (CRF) have set new records on many vision tasks involving structured predictions. Here we propose a fully-connected deep continuous CRF model for both discrete and continuous labelling…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Fayao Liu , Guosheng Lin , Chunhua Shen

For the challenging semantic image segmentation task the most efficient models have traditionally combined the structured modelling capabilities of Conditional Random Fields (CRFs) with the feature extraction power of CNNs. In more recent…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Marvin T. T. Teichmann , Roberto Cipolla

Phonetic speech transcription is crucial for fine-grained linguistic analysis and downstream speech applications. While Connectionist Temporal Classification (CTC) is a widely used approach for such tasks due to its efficiency, it often…