English
Related papers

Related papers: An improved hybrid CTC-Attention model for speech …

200 papers

In recent years, End-to-End speech recognition technology based on deep learning has developed rapidly. Due to the lack of Turkish speech data, the performance of Turkish speech recognition system is poor. Firstly, this paper studies a…

Sound · Computer Science 2023-03-23 Zeyu Ren , Nurmement Yolwas , Huiru Wang , Wushour Slamu

Recently, encoder-decoder neural networks have shown impressive performance on many sequence-related tasks. The architecture commonly uses an attentional mechanism which allows the model to learn alignments between the source and the target…

Computation and Language · Computer Science 2017-11-06 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Speech is one of the most effective ways of communication among humans. Even though audio is the most common way of transmitting speech, very important information can be found in other modalities, such as vision. Vision is particularly…

Computation and Language · Computer Science 2016-11-22 Ramon Sanabria , Florian Metze , Fernando De La Torre

Non-autoregressive (NAR) models for automatic speech recognition (ASR) aim to achieve high accuracy and fast inference by simplifying the autoregressive (AR) generation process of conventional models. Connectionist temporal classification…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-29 Yuya Fujita , Shinji Watanabe , Xuankai Chang , Takashi Maekaku

There has been an increasing interest in large speech models that can perform multiple tasks in a single model. Such models usually adopt an encoder-decoder or decoder-only architecture due to their popularity and good performance in many…

Computation and Language · Computer Science 2024-08-28 Yifan Peng , Yui Sudo , Muhammad Shakeel , Shinji Watanabe

End-to-end models have achieved impressive results on the task of automatic speech recognition (ASR). For low-resource ASR tasks, however, labeled data can hardly satisfy the demand of end-to-end models. Self-supervised acoustic…

Computation and Language · Computer Science 2021-05-12 Cheng Yi , Shiyu Zhou , Bo Xu

This paper proposes a novel automatic speech recognition (ASR) framework called Integrated Source-Channel and Attention (ISCA) that combines the advantages of traditional systems based on the noisy source-channel model (SC) and end-to-end…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-02 Qiujia Li , Chao Zhang , Philip C. Woodland

We propose a fully convolutional sequence-to-sequence encoder architecture with a simple and efficient decoder. Our model improves WER on LibriSpeech while being an order of magnitude more efficient than a strong RNN baseline. Key to our…

Computation and Language · Computer Science 2019-04-05 Awni Hannun , Ann Lee , Qiantong Xu , Ronan Collobert

Combination approaches for speech recognition (ASR) systems cover structured sentence-level or word-based merging techniques as well as combination of model scores during beam search. In this work, we compare model combination across…

Sound · Computer Science 2025-08-14 Noureldin Bayoumi , Robin Schmitt , Tina Raissi , Albert Zeyer , Ralf Schlüter , Hermann Ney

The Transformer has shown impressive performance in automatic speech recognition. It uses the encoder-decoder structure with self-attention to learn the relationship between the high-level representation of the source inputs and embedding…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-16 Xinyuan Zhou , Grandee Lee , Emre Yılmaz , Yanhua Long , Jiaen Liang , Haizhou Li

Deep neural network-based systems have significantly improved the performance of speaker diarization tasks. However, end-to-end neural diarization (EEND) systems often struggle to generalize to scenarios with an unseen number of speakers,…

Sound · Computer Science 2023-09-14 Zhengyang Chen , Bing Han , Shuai Wang , Yanmin Qian

We consider the design of two-pass voice trigger detection systems. We focus on the networks in the second pass that are used to re-score candidate segments obtained from the first-pass. Our baseline is an acoustic model(AM), with BiLSTM…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Saurabh Adya , Vineet Garg , Siddharth Sigtia , Pramod Simha , Chandra Dhir

Semi-supervised learning (SSL) is an active area of research which aims to utilize unlabelled data in order to improve the accuracy of speech recognition systems. The current study proposes a methodology for integration of two key ideas: 1)…

Computation and Language · Computer Science 2020-08-11 Prakhar Swarup , Debmalya Chakrabarty , Ashtosh Sapru , Hitesh Tulsiani , Harish Arsikere , Sri Garimella

Connectionist temporal classification (CTC) and attention-based encoder decoder (AED) joint training has been widely applied in automatic speech recognition (ASR). Unlike most hybrid models that separately calculate the CTC and AED losses,…

Computation and Language · Computer Science 2023-08-17 Daobin Zhu , Xiangdong Su , Hongbin Zhang

Attention-based encoder-decoder, e.g. transformer and its variants, generates the output sequence in an autoregressive (AR) manner. Despite its superior performance, AR model is computationally inefficient as its generation requires as many…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-27 Keyu An , Zerui Li , Zhifu Gao , Shiliang Zhang

This paper explores the use of Hybrid CTC/Attention encoder-decoder models trained with Intermediate CTC (InterCTC) for Irish (Gaelic) low-resource speech recognition (ASR) and dialect identification (DID). Results are compared to the…

Computation and Language · Computer Science 2024-05-03 Liam Lonergan , Mengjie Qian , Neasa Ní Chiaráin , Christer Gobl , Ailbhe Ní Chasaide

The Connectionist Temporal Classification (CTC) has achieved great success in sequence to sequence analysis tasks such as automatic speech recognition (ASR) and scene text recognition (STR). These applications can use the CTC objective…

Signal Processing · Electrical Eng. & Systems 2019-09-09 Siyuan Lu , Jinming Lu , Jun Lin , Zhongfeng Wang

Unified Speech Recognition (USR) has emerged as a semi-supervised framework for training a single model for audio, visual, and audiovisual speech recognition, achieving state-of-the-art results on in-distribution benchmarks. However, its…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Alexandros Haliassos , Rodrigo Mira , Stavros Petridis

In this paper, we propose an efficient and accurate streaming speech recognition model based on the FastConformer architecture. We adapted the FastConformer architecture for streaming applications through: (1) constraining both the…

Computation and Language · Computer Science 2024-05-06 Vahid Noroozi , Somshubra Majumdar , Ankur Kumar , Jagadeesh Balam , Boris Ginsburg

End-to-end automatic speech recognition (ASR) models, including both attention-based models and the recurrent neural network transducer (RNN-T), have shown superior performance compared to conventional systems. However, previous studies…