中文
相关论文

相关论文: Sequence Transduction with Graph-based Supervision

200 篇论文

This work introduces TTS-Transducer - a novel architecture for text-to-speech, leveraging the strengths of audio codec models and neural transducers. Transducers, renowned for their superior quality and robustness in speech recognition, are…

音频与语音处理 · 电气工程与系统科学 2025-04-16 Vladimir Bataev , Subhankar Ghosh , Vitaly Lavrukhin , Jason Li

This paper addresses the observed performance gap between automatic speech recognition (ASR) systems based on Long Short Term Memory (LSTM) neural networks trained with the connectionist temporal classification (CTC) loss function and…

计算与语言 · 计算机科学 2018-05-24 Jayadev Billa

The RNN transducer is a promising end-to-end model candidate. We compare the original training criterion with the full marginalization over all alignments, to the commonly used maximum approximation, which simplifies, improves and speeds up…

音频与语音处理 · 电气工程与系统科学 2020-11-20 Albert Zeyer , André Merboldt , Ralf Schlüter , Hermann Ney

Transfer learning aims to solve the data sparsity for a target domain by applying information of the source domain. Given a sequence (e.g. a natural language sentence), the transfer learning, usually enabled by recurrent neural network…

计算与语言 · 计算机科学 2019-02-26 Wanyun Cui , Guangyu Zheng , Zhiqiang Shen , Sihang Jiang , Wei Wang

We present a state-of-the-art end-to-end Automatic Speech Recognition (ASR) model. We learn to listen and write characters with a joint Connectionist Temporal Classification (CTC) and attention-based encoder-decoder network. The encoder is…

计算与语言 · 计算机科学 2017-06-12 Takaaki Hori , Shinji Watanabe , Yu Zhang , William Chan

In this work, we investigate two popular end-to-end automatic speech recognition (ASR) models, namely Connectionist Temporal Classification (CTC) and RNN-Transducer (RNN-T), for offline recognition of voice search queries, with up to 2B…

This paper proposes a modification to RNN-Transducer (RNN-T) models for automatic speech recognition (ASR). In standard RNN-T, the emission of a blank symbol consumes exactly one input frame; in our proposed method, we introduce additional…

音频与语音处理 · 电气工程与系统科学 2024-04-15 Hainan Xu , Fei Jia , Somshubra Majumdar , Shinji Watanabe , Boris Ginsburg

This paper introduces a novel Token-and-Duration Transducer (TDT) architecture for sequence-to-sequence tasks. TDT extends conventional RNN-Transducer architectures by jointly predicting both a token and its duration, i.e. the number of…

音频与语音处理 · 电气工程与系统科学 2023-05-31 Hainan Xu , Fei Jia , Somshubra Majumdar , He Huang , Shinji Watanabe , Boris Ginsburg

In this work, we propose a new automatic speech recognition (ASR) system based on feature learning and an end-to-end training procedure for air traffic control (ATC) systems. The proposed model integrates the feature learning block,…

声音 · 计算机科学 2021-11-05 Peng Fan , Dongyue Guo , Yi Lin , Bo Yang , Jianwei Zhang

This paper proposes a novel label-synchronous speech-to-text alignment technique for automatic speech recognition (ASR). The speech-to-text alignment is a problem of splitting long audio recordings with un-aligned transcripts into…

音频与语音处理 · 电气工程与系统科学 2021-04-22 Yusuke Kida , Tatsuya Komatsu , Masahito Togami

This paper presents a novel algorithm for building an automatic speech recognition (ASR) model with imperfect training data. Imperfectly transcribed speech is a prevalent issue in human-annotated speech corpora, which degrades the…

计算与语言 · 计算机科学 2023-06-05 Dongji Gao , Matthew Wiesner , Hainan Xu , Leibny Paola Garcia , Daniel Povey , Sanjeev Khudanpur

Convolutional Neural Networks (CNNs) are effective models for reducing spectral variations and modeling spectral correlations in acoustic features for automatic speech recognition (ASR). Hybrid speech recognition systems incorporating CNNs…

Adaption of end-to-end speech recognition systems to new tasks is known to be challenging. A number of solutions have been proposed which apply external language models with various fusion methods, possibly with a combination of two-pass…

计算与语言 · 计算机科学 2021-06-10 Janne Pylkkönen , Antti Ukkonen , Juho Kilpikoski , Samu Tamminen , Hannes Heikinheimo

Convolutional neural networks (CNNs) have achieved high performance in synthetic aperture radar (SAR) automatic target recognition (ATR). However, the performance of CNNs depends heavily on a large amount of training data. The insufficiency…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Chenwei Wang , Xiaoyu Liu , Yulin Huang , Siyi Luo , Jifang Pei , Jianyu Yang , Deqing Mao

Connectionist temporal classification (CTC) is a popular sequence prediction approach for automatic speech recognition that is typically used with models based on recurrent neural networks (RNNs). We explore whether deep convolutional…

计算与语言 · 计算机科学 2018-02-16 Kalpesh Krishna , Liang Lu , Kevin Gimpel , Karen Livescu

In the domain of air traffic control (ATC) systems, efforts to train a practical automatic speech recognition (ASR) model always faces the problem of small training samples since the collection and annotation of speech samples are expert-…

声音 · 计算机科学 2021-02-17 Yi Lin , Qin Li , Bo Yang , Zhen Yan , Huachun Tan , Zhengmao Chen

Neural Transducer and connectionist temporal classification (CTC) are popular end-to-end automatic speech recognition systems. Due to their frame-synchronous design, blank symbols are introduced to address the length mismatch between…

音频与语音处理 · 电气工程与系统科学 2023-05-22 Yifan Yang , Xiaoyu Yang , Liyong Guo , Zengwei Yao , Wei Kang , Fangjun Kuang , Long Lin , Xie Chen , Daniel Povey

Transducer-based models, such as RNN-Transducer and transformer-transducer, have achieved great success in speech recognition. A typical transducer model decodes the output sequence conditioned on the current acoustic state and previously…

音频与语音处理 · 电气工程与系统科学 2021-04-08 Zhengkun Tian , Jiangyan Yi , Ye Bai , Jianhua Tao , Shuai Zhang , Zhengqi Wen

Training automatic speech recognition (ASR) systems requires large amounts of data in the target language in order to achieve good performance. Whereas large training corpora are readily available for languages like English, there exists a…

音频与语音处理 · 电气工程与系统科学 2017-11-15 Markus Müller , Sebastian Stüker , Alex Waibel

We propose a novel approach for ASR N-best hypothesis rescoring with graph-based label propagation by leveraging cross-utterance acoustic similarity. In contrast to conventional neural language model (LM) based ASR rescoring/reranking…

音频与语音处理 · 电气工程与系统科学 2024-02-09 Srinath Tankasala , Long Chen , Andreas Stolcke , Anirudh Raju , Qianli Deng , Chander Chandak , Aparna Khare , Roland Maas , Venkatesh Ravichandran