中文
相关论文

相关论文: A CTC Triggered Siamese Network with Spatial-Tempo…

200 篇论文

We present a state-of-the-art end-to-end Automatic Speech Recognition (ASR) model. We learn to listen and write characters with a joint Connectionist Temporal Classification (CTC) and attention-based encoder-decoder network. The encoder is…

计算与语言 · 计算机科学 2017-06-12 Takaaki Hori , Shinji Watanabe , Yu Zhang , William Chan

In this work, we propose a streaming AV-ASR system based on a hybrid connectionist temporal classification (CTC)/attention neural network architecture. The audio and the visual encoder neural networks are both based on the conformer…

音频与语音处理 · 电气工程与系统科学 2023-07-04 Pingchuan Ma , Niko Moritz , Stavros Petridis , Christian Fuegen , Maja Pantic

Recently, there has been increasing progress in end-to-end automatic speech recognition (ASR) architecture, which transcribes speech to text without any pre-trained alignments. One popular end-to-end approach is the hybrid Connectionist…

音频与语音处理 · 电气工程与系统科学 2023-07-06 Haoran Miao , Gaofeng Cheng , Pengyuan Zhang , Yonghong Yan

Recently, there has been an increasing interest in end-to-end speech recognition that directly transcribes speech to text without any predefined alignments. One approach is the attention-based encoder-decoder framework that learns a mapping…

计算与语言 · 计算机科学 2017-02-02 Suyoun Kim , Takaaki Hori , Shinji Watanabe

Accents, as variations from standard pronunciation, pose significant challenges for speech recognition systems. Although joint automatic speech recognition (ASR) and accent recognition (AR) training has been proven effective in handling…

声音 · 计算机科学 2023-11-20 Qijie Shao , Pengcheng Guo , Jinghao Yan , Pengfei Hu , Lei Xie

Temporal connectionist temporal classification (CTC)-based automatic speech recognition (ASR) is one of the most successful end to end (E2E) ASR frameworks. However, due to the token independence assumption in decoding, an external language…

音频与语音处理 · 电气工程与系统科学 2023-09-26 Xugang Lu , Peng Shen , Yu Tsao , Hisashi Kawai

Attention-based methods and Connectionist Temporal Classification (CTC) network have been promising research directions for end-to-end Automatic Speech Recognition (ASR). The joint CTC/Attention model has achieved great success by utilizing…

计算与语言 · 计算机科学 2018-11-13 Ruizhi Li , Xiaofei Wang , Sri Harish Mallidi , Takaaki Hori , Shinji Watanabe , Hynek Hermansky

Aiming at the problem that the spatial-temporal hierarchical continuous sign language recognition model based on deep learning has a large amount of computation, which limits the real-time application of the model, this paper proposes a…

计算机视觉与模式识别 · 计算机科学 2022-07-05 Qidan Zhu , Jing Li , Fei Yuan , Quan Gan

In this work, we investigate two popular end-to-end automatic speech recognition (ASR) models, namely Connectionist Temporal Classification (CTC) and RNN-Transducer (RNN-T), for offline recognition of voice search queries, with up to 2B…

Confidence estimation of predictions from an End-to-End (E2E) Automatic Speech Recognition (ASR) model benefits ASR's downstream and upstream tasks. Class-probability-based confidence scores do not accurately represent the quality of…

音频与语音处理 · 电气工程与系统科学 2024-01-09 Nagarathna Ravi , Thishyan Raj T , Vipul Arora

We propose Citrinet - a new end-to-end convolutional Connectionist Temporal Classification (CTC) based automatic speech recognition (ASR) model. Citrinet is deep residual neural model which uses 1D time-channel separable convolutions…

音频与语音处理 · 电气工程与系统科学 2021-04-06 Somshubra Majumdar , Jagadeesh Balam , Oleksii Hrinchuk , Vitaly Lavrukhin , Vahid Noroozi , Boris Ginsburg

Connectionist Temporal Classification has recently attracted a lot of interest as it offers an elegant approach to building acoustic models (AMs) for speech recognition. The CTC loss function maps an input sequence of observable feature…

计算与语言 · 计算机科学 2017-08-16 Thomas Zenkel , Ramon Sanabria , Florian Metze , Jan Niehues , Matthias Sperber , Sebastian Stüker , Alex Waibel

Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder…

声音 · 计算机科学 2018-11-02 Zhe Yuan , Zhuoran Lyu , Jiwei Li , Xi Zhou

The Connectionist Temporal Classification (CTC) has achieved great success in sequence to sequence analysis tasks such as automatic speech recognition (ASR) and scene text recognition (STR). These applications can use the CTC objective…

信号处理 · 电气工程与系统科学 2019-09-09 Siyuan Lu , Jinming Lu , Jun Lin , Zhongfeng Wang

While deep learning based end-to-end automatic speech recognition (ASR) systems have greatly simplified modeling pipelines, they suffer from the data sparsity issue. In this work, we propose a self-training method with an end-to-end system…

音频与语音处理 · 电气工程与系统科学 2020-07-31 Yang Chen , Weiran Wang , Chao Wang

Long Short Term Memory Connectionist Temporal Classification (LSTM-CTC) based end-to-end models are widely used in speech recognition due to its simplicity in training and efficiency in decoding. In conventional LSTM-CTC based models, a…

计算与语言 · 计算机科学 2019-03-14 Yangyang Shi , Mei-Yuh Hwang , Xin Lei

We present a novel approach to end-to-end automatic speech recognition (ASR) that utilizes pre-trained masked language models (LMs) to facilitate the extraction of linguistic information. The proposed models, BERT-CTC and BECTRA, are…

音频与语音处理 · 电气工程与系统科学 2024-10-02 Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi , Shinji Watanabe

This paper presents a novel algorithm for building an automatic speech recognition (ASR) model with imperfect training data. Imperfectly transcribed speech is a prevalent issue in human-annotated speech corpora, which degrades the…

计算与语言 · 计算机科学 2023-06-05 Dongji Gao , Matthew Wiesner , Hainan Xu , Leibny Paola Garcia , Daniel Povey , Sanjeev Khudanpur

Connectionist temporal classification (CTC) is widely used for maximum likelihood learning in end-to-end speech recognition models. However, there is usually a disparity between the negative maximum likelihood and the performance metric…

计算与语言 · 计算机科学 2017-12-20 Yingbo Zhou , Caiming Xiong , Richard Socher

In this work, we present the first study addressing automatic speech recognition (ASR) for children in an online learning setting. This is particularly important for both child-centric applications and the privacy protection of minors,…

音频与语音处理 · 电气工程与系统科学 2025-10-07 Edem Ahadzi , Vishwanath Pratap Singh , Tomi Kinnunen , Ville Hautamaki