English
Related papers

Related papers: An Embarrassingly Simple Approach for LLM with Str…

200 papers

Large language model (LLM)-based automatic speech recognition (ASR) achieves strong performance but often incurs high computational costs. This work investigates how to obtain the best LLM-ASR performance efficiently. Through comprehensive…

Sound · Computer Science 2025-08-07 Bingshen Mu , Yiwen Shao , Kun Wei , Dong Yu , Lei Xie

Recognizing overlapping speech from multiple speakers in conversational scenarios is one of the most challenging problem for automatic speech recognition (ASR). Serialized output training (SOT) is a classic method to address multi-talker…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-02 Mohan Shi , Zengrui Jin , Yaoxun Xu , Yong Xu , Shi-Xiong Zhang , Kun Wei , Yiwen Shao , Chunlei Zhang , Dong Yu

While integrating speech encoder with LLM requires substantial data and resources, use cases face limitations due to insufficient availability. To address this, we propose a solution with a parameter-efficient adapter that converts speech…

Computation and Language · Computer Science 2025-09-08 Jaekwon Yoo , Kunal Chandiramani , Divya Tadimeti , Abenezer Girma , Chandra Dhir

LLM-based automatic speech recognition models demonstrate strong performance by connecting audio encoders and LLMs. However, data scarcity of paired speech and transcription often hinders their adaptation to new domains, making text-only…

Sound · Computer Science 2026-05-15 Ryo Magoshi , Takashi Maekaku , Yusuke Shinohara

The recent surge in open-source Multimodal Large Language Models (MLLM) frameworks, such as LLaVA, provides a convenient kickoff for artificial intelligence developers and researchers. However, most of the MLLM frameworks take vision as the…

While speech foundation models (SFMs) have demonstrated remarkable performance in audio-only tasks, their adaptation to multimodal scenarios remains underexplored. This work presents UASR-LLM, a novel framework that adapts frozen SFMs to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-03 Jing-Xuan Zhang , Genshun Wan , Jin Li , Jianqing Gao , Duo Zhao , Zhen-Hua Ling

Audio-Visual Speech Recognition (AVSR) integrates acoustic and visual information to enhance robustness in adverse acoustic conditions. Recent advances in Large Language Models (LLMs) have yielded competitive automatic speech recognition…

Sound · Computer Science 2026-03-05 Fei Su , Cancan Li , Juan Liu , Wei Ju , Hongbin Suo , Ming Li

The advent of Large Language Models (LLM) has reformed the Automatic Speech Recognition (ASR). Prompting LLM with audio embeddings to generate transcriptions becomes the new state-of-the-art ASR. Despite LLMs being trained with an extensive…

Computation and Language · Computer Science 2024-12-11 Yingyi Ma , Zhe Liu , Ozlem Kalinli

This paper explores the integration of Large Language Models (LLMs) into Automatic Speech Recognition (ASR) systems to improve transcription accuracy. The increasing sophistication of LLMs, with their in-context learning capabilities and…

Computation and Language · Computer Science 2025-06-03 Zeping Min , Jinbo Wang

Large language models (LLMs) have recently achieved impressive results in speech recognition across multiple modalities, including Auditory Speech Recognition (ASR), Visual Speech Recognition (VSR), and Audio-Visual Speech Recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-28 Umberto Cappellazzo , Xubo Liu , Pingchuan Ma , Stavros Petridis , Maja Pantic

Automatic Speech Recognition (ASR) aims to convert human speech content into corresponding text. In conversational scenarios, effectively utilizing context can enhance its accuracy. Large Language Models' (LLMs) exceptional long-context…

Sound · Computer Science 2026-01-19 Bingshen Mu , Hexin Liu , Hongfei Xue , Kun Wei , Lei Xie

Conventional end-to-end automatic speech recognition (ASR) systems rely on paired speech-text data for domain adaptation. Recent LLM-based ASR architectures connect a speech encoder to a large language model via a projection module,…

Automatic Speech Recognition (ASR) is an active field of research due to its large number of applications and the proliferation of interfaces or computing devices that can support speech processing. However, the bulk of applications are…

Artificial Intelligence · Computer Science 2022-03-03 Jean Louis K. E. Fendji , Diane C. M. Tala , Blaise O. Yenke , Marcellin Atemkeng

Automatic speech recognition (ASR) systems based on large language models (LLMs) achieve superior performance by leveraging pretrained LLMs as decoders, but their token-by-token generation mechanism leads to inference latency that grows…

Sound · Computer Science 2026-01-27 Wenjie Tian , Bingshen Mu , Guobin Ma , Xuelong Geng , Zhixian Zhao , Lei Xie

Large language models (LLMs) provide strong semantic priors that can improve multi-talker automatic speech recognition (MT-ASR), but using an LLM as an autoregressive decoder is computationally expensive and remains fragile under heavy…

Sound · Computer Science 2026-03-12 Hao Shi , Yusuke Fujita , Roman Koshkin , Mengjie Zhao , Yuan Gao , Lianbo Liu , Yui Sudo

Recent advancements in large language models (LLMs) have revolutionized various domains, bringing significant progress and new opportunities. Despite progress in speech-related tasks, LLMs have not been sufficiently explored in multi-talker…

Computation and Language · Computer Science 2025-04-03 Lingwei Meng , Shujie Hu , Jiawen Kang , Zhaoqing Li , Yuejiao Wang , Wenxuan Wu , Xixin Wu , Xunying Liu , Helen Meng

Integrating large language models (LLMs) into automatic speech recognition (ASR) has become a mainstream paradigm in recent years. Although existing LLM-based ASR models demonstrate impressive performance on public benchmarks, their…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Yuan Xie , Jiaqi Song , Guang Qiu , Xianliang Wang , Kai Qiao , Junfeng Yuan , Shengqing Liu , Yi Zhang , Bowen Chen , Ming Lei , Jie Gao , Jie Wu

The performance bottleneck of Automatic Speech Recognition (ASR) in stuttering speech scenarios has limited its applicability in domains such as speech rehabilitation. This paper proposed an LLM-driven ASR-SED multi-task learning framework…

Sound · Computer Science 2025-05-29 Shangkun Huang , Jing Deng , Jintao Kang , Rong Zheng

Multi-speaker automatic speech recognition (ASR) aims to transcribe conversational speech involving multiple speakers, requiring the model to capture not only what was said, but also who said it and sometimes when it was spoken. Recent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-27 Li Li , Ming Cheng , Weixin Zhu , Yannan Wang , Juan Liu , Ming Li

Speech Large Language Models (Speech LLMs) have emerged as a crucial paradigm in recent years, extending the capabilities of traditional LLMs to speech tasks such as automatic speech recognition (ASR) and spoken dialogue modeling. However,…

Computation and Language · Computer Science 2025-07-08 Phurich Saengthong , Boonnithi Jiaramaneepinit , Sheng Li , Manabu Okumura , Takahiro Shinozaki