English
Related papers

Related papers: Parallel Rescoring with Transformer for Streaming …

200 papers

Recurrent transducer models have emerged as a promising solution for speech recognition on the current and next generation smart devices. The transducer models provide competitive accuracy within a reasonable memory footprint alleviating…

Attention-based models have been gaining popularity recently for their strong performance demonstrated in fields such as machine translation and automatic speech recognition. One major challenge of attention-based models is the need of…

Computation and Language · Computer Science 2020-11-17 Ching-Feng Yeh , Yongqiang Wang , Yangyang Shi , Chunyang Wu , Frank Zhang , Julian Chan , Michael L. Seltzer

In streaming automatic speech recognition (ASR), it is desirable to reduce latency as much as possible while having minimum impact on recognition accuracy. Although a few existing methods are able to achieve this goal, they are difficult to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Wei Kang , Zengwei Yao , Fangjun Kuang , Liyong Guo , Xiaoyu Yang , Long lin , Piotr Żelasko , Daniel Povey

In this paper we present an end-to-end speech recognition model with Transformer encoders that can be used in a streaming speech recognition system. Transformer computation blocks based on self-attention are used to encode both audio and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Qian Zhang , Han Lu , Hasim Sak , Anshuman Tripathi , Erik McDermott , Stephen Koo , Shankar Kumar

Recently, Transformer-based encoder-decoder models have demonstrated strong performance in multilingual speech recognition. However, the decoder's autoregressive nature and large size introduce significant bottlenecks during inference.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-28 Yunkyu Lim , Jihwan Park , Hyung Yong Kim , Hanbin Lee , Byeong-Yeol Kim

Transformer-based models excel in speech recognition. Existing efforts to optimize Transformer inference, typically for long-context applications, center on simplifying attention score calculations. However, streaming speech recognition…

Machine Learning · Computer Science 2024-01-22 Yang Li , Liangzhen Lai , Yuan Shangguan , Forrest N. Iandola , Zhaoheng Ni , Ernie Chang , Yangyang Shi , Vikas Chandra

This paper addresses end-to-end automatic speech recognition (ASR) for long audio recordings such as lecture and conversational speeches. Most end-to-end ASR models are designed to recognize independent utterances, but contextual…

Computation and Language · Computer Science 2021-04-20 Takaaki Hori , Niko Moritz , Chiori Hori , Jonathan Le Roux

LSTM based language models are an important part of modern LVCSR systems as they significantly improve performance over traditional backoff language models. Incorporating them efficiently into decoding has been notoriously difficult. In…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-03 Eugen Beck , Wei Zhou , Ralf Schlüter , Hermann Ney

Transformer-based acoustic modeling has achieved great suc-cess for both hybrid and sequence-to-sequence speech recogni-tion. However, it requires access to the full sequence, and thecomputational cost grows quadratically with respect to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Chunyang Wu , Yongqiang Wang , Yangyang Shi , Ching-Feng Yeh , Frank Zhang

We present a fully on-device streaming Speech2Speech conversion model that normalizes a given input speech directly to synthesized output speech. Deploying such a model on mobile devices pose significant challenges in terms of memory…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-26 Oleg Rybakov , Fadi Biadsy , Xia Zhang , Liyang Jiang , Phoenix Meadowlark , Shivani Agrawal

In interactive automatic speech recognition (ASR) systems, low-latency requirements limit the amount of search space that can be explored during decoding, particularly in end-to-end neural ASR. In this paper, we present a novel streaming…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-29 Denis Filimonov , Prabhat Pandey , Ariya Rastrow , Ankur Gandhe , Andreas Stolcke

In this paper, we present a novel two-pass approach to unify streaming and non-streaming end-to-end (E2E) speech recognition in a single model. Our model adopts the hybrid CTC/attention architecture, in which the conformer layers in the…

Sound · Computer Science 2021-12-30 Binbin Zhang , Di Wu , Zhuoyuan Yao , Xiong Wang , Fan Yu , Chao Yang , Liyong Guo , Yaguang Hu , Lei Xie , Xin Lei

Recent research shows end-to-end ASR systems can recognize overlapped speech from multiple speakers. However, all published works have assumed no latency constraints during inference, which does not hold for most voice assistant…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-22 Ilya Sklyar , Anna Piunova , Yulan Liu

This paper tackles several challenges that arise when integrating Automatic Speech Recognition (ASR) and Machine Translation (MT) for real-time, on-device streaming speech translation. Although state-of-the-art ASR systems based on…

Computation and Language · Computer Science 2025-08-20 Zeeshan Ahmed , Frank Seide , Niko Moritz , Ju Lin , Ruiming Xie , Simone Merello , Zhe Liu , Christian Fuegen

We propose a way to use a transformer-based language model in conversational speech recognition. Specifically, we focus on decoding efficiently in a weighted finite-state transducer framework. We showcase an approach to lattice re-scoring…

Computation and Language · Computer Science 2020-01-07 Kareem Nassar

We explore neural language modeling for speech recognition where the context spans multiple sentences. Rather than encode history beyond the current sentence using a cache of words or document-level features, we focus our study on the…

Computation and Language · Computer Science 2019-11-13 Sarangarajan Parthasarathy , William Gale , Xie Chen , George Polovets , Shuangyu Chang

This paper introduces a dual-signal transformation LSTM network (DTLN) for real-time speech enhancement as part of the Deep Noise Suppression Challenge (DNS-Challenge). This approach combines a short-time Fourier transform (STFT) and a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Nils L. Westhausen , Bernd T. Meyer

Multi-channel inputs offer several advantages over single-channel, to improve the robustness of on-device speech recognition systems. Recent work on multi-channel transformer, has proposed a way to incorporate such inputs into end-to-end…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-31 Feng-Ju Chang , Martin Radfar , Athanasios Mouchtaris , Maurizio Omologo

Simultaneous speech translation (SST) outputs translations in parallel with streaming speech input, balancing translation quality and latency. While large language models (LLMs) have been extended to handle the speech modality, streaming…

Computation and Language · Computer Science 2025-04-23 Keqi Deng , Wenxi Chen , Xie Chen , Philip C. Woodland

Modeling the parser state is key to good performance in transition-based parsing. Recurrent Neural Networks considerably improved the performance of transition-based systems by modelling the global state, e.g. stack-LSTM parsers, or local…

Computation and Language · Computer Science 2020-10-22 Ramon Fernandez Astudillo , Miguel Ballesteros , Tahira Naseem , Austin Blodgett , Radu Florian