English
Related papers

Related papers: Streaming Speech Recognition with Decoder-Only Lar…

200 papers

While integrating speech encoder with LLM requires substantial data and resources, use cases face limitations due to insufficient availability. To address this, we propose a solution with a parameter-efficient adapter that converts speech…

Computation and Language · Computer Science 2025-09-08 Jaekwon Yoo , Kunal Chandiramani , Divya Tadimeti , Abenezer Girma , Chandra Dhir

In the present paper, an attempt is made to combine Mask-CTC and the triggered attention mechanism to construct a streaming end-to-end automatic speech recognition (ASR) system that provides high performance with low latency. The triggered…

Sound · Computer Science 2021-10-22 Huaibo Zhao , Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi

Large language models have proven themselves highly flexible, able to solve a wide range of generative tasks, such as abstractive summarization and open-ended question answering. In this paper we extend the capabilities of LLMs by directly…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-25 Yassir Fathullah , Chunyang Wu , Egor Lakomkin , Junteng Jia , Yuan Shangguan , Ke Li , Jinxi Guo , Wenhan Xiong , Jay Mahadeokar , Ozlem Kalinli , Christian Fuegen , Mike Seltzer

While speech recognition Word Error Rate (WER) has reached human parity for English, continuous speech recognition scenarios such as voice typing and meeting transcriptions still suffer from segmentation and punctuation problems, resulting…

Computation and Language · Computer Science 2023-01-11 Piyush Behre , Sharman Tan , Padma Varadharajan , Shuangyu Chang

Deploying high-quality automatic speech recognition (ASR) on edge devices requires models that jointly optimize accuracy, latency, and memory footprint while operating entirely on CPU without GPU acceleration. We conduct a systematic…

Artificial Intelligence · Computer Science 2026-04-21 Nenad Banfic , David Fan , Kunal Vaishnavi , Sam Kemp , Sunghoon Choi , Rui Ren , Sayan Shaw , Meng Tang

We investigate a monotonic multihead attention (MMA) by extending hard monotonic attention to Transformer-based automatic speech recognition (ASR) for online streaming applications. For streaming inference, all monotonic attention (MA)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-01 Hirofumi Inaguma , Masato Mimura , Tatsuya Kawahara

This paper explores the integration of Large Language Models (LLMs) into Automatic Speech Recognition (ASR) systems to improve transcription accuracy. The increasing sophistication of LLMs, with their in-context learning capabilities and…

Computation and Language · Computer Science 2025-06-03 Zeping Min , Jinbo Wang

This paper introduces a fast-slow encoder based transducer with streaming deliberation for end-to-end automatic speech recognition. We aim to improve the recognition accuracy of the fast-slow encoder based transducer while keeping its…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-16 Ke Li , Jay Mahadeokar , Jinxi Guo , Yangyang Shi , Gil Keren , Ozlem Kalinli , Michael L. Seltzer , Duc Le

This paper works on streaming automatic speech recognition (ASR). Mamba, a recently proposed state space model, has demonstrated the ability to match or surpass Transformers in various tasks while benefiting from a linear complexity…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-30 Ying Fang , Xiaofei Li

As a robust and large-scale multilingual speech recognition model, Whisper has demonstrated impressive results in many low-resource and out-of-distribution scenarios. However, its encoder-decoder structure hinders its application to…

Sound · Computer Science 2025-05-06 Haoyu Wang , Guoqiang Hu , Guodong Lin , Wei-Qiang Zhang , Jian Li

Joint automatic speech recognition (ASR) and speaker diarization aim to answer the question "who spoke what" in multi-speaker scenarios. In this paper, we present an end-to-end speech large language model (Speech-LLM) for Joint strEamable…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-21 Mohan Shi , Xiong Xiao , Ruchao Fan , Shaoshi Ling , Jinyu Li

An inferior performance of the streaming automatic speech recognition models versus non-streaming model is frequently seen due to the absence of future context. In order to improve the performance of the streaming model and reduce the…

Sound · Computer Science 2022-03-30 Jingyu Sun , Guiping Zhong , Dinghao Zhou , Baoxiang Li

In this paper, we present a novel two-pass approach to unify streaming and non-streaming end-to-end (E2E) speech recognition in a single model. Our model adopts the hybrid CTC/attention architecture, in which the conformer layers in the…

Sound · Computer Science 2021-12-30 Binbin Zhang , Di Wu , Zhuoyuan Yao , Xiong Wang , Fan Yu , Chao Yang , Liyong Guo , Yaguang Hu , Lei Xie , Xin Lei

Transformer-based models have achieved state-of-the-art performance on speech translation tasks. However, the model architecture is not efficient enough for streaming scenarios since self-attention is computed over an entire input sequence…

Computation and Language · Computer Science 2020-11-03 Xutai Ma , Yongqiang Wang , Mohammad Javad Dousti , Philipp Koehn , Juan Pino

Automatic speech recognition (ASR) with an encoder equipped with self-attention, whether streaming or non-streaming, takes quadratic time in the length of the speech utterance. This slows down training and decoding, increase their cost, and…

Sound · Computer Science 2024-09-12 Titouan Parcollet , Rogier van Dalen , Shucong Zhang , Sourav Batthacharya

In real-world applications, automatic speech recognition (ASR) systems must handle overlapping speech from multiple speakers and recognize rare words like technical terms. Traditional methods address multi-talker ASR and contextual biasing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Jiajun He , Naoki Sawada , Koichi Miyazaki , Tomoki Toda

Recurrent neural networks (RNNs), especially long short-term memory (LSTM) RNNs, are effective network for sequential task like speech recognition. Deeper LSTM models perform well on large vocabulary continuous speech recognition, because…

Computation and Language · Computer Science 2017-03-22 Xu Tian , Jun Zhang , Zejun Ma , Yi He , Juan Wei , Peihao Wu , Wenchang Situ , Shuai Li , Yang Zhang

Automatic Speech Recognition (ASR) aims to convert human speech content into corresponding text. In conversational scenarios, effectively utilizing context can enhance its accuracy. Large Language Models' (LLMs) exceptional long-context…

Sound · Computer Science 2026-01-19 Bingshen Mu , Hexin Liu , Hongfei Xue , Kun Wei , Lei Xie

Attention-based sequence-to-sequence automatic speech recognition (ASR) requires a significant delay to recognize long utterances because the output is generated after receiving entire input sequences. Although several studies recently…

Computation and Language · Computer Science 2020-11-05 Sashi Novitasari , Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

This paper proposes an automatic speech recognition (ASR) model for hate speech using large language models (LLMs). The proposed method integrates the encoder of the ASR model with the decoder of the LLMs, enabling simultaneous…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-09 Ryutaro Oshima , Yuya Hosoda , Youji Iiguni