English
Related papers

Related papers: NTU Speechlab LLM-Based Multilingual ASR System fo…

200 papers

This paper describes SHNU multilingual conversational speech recognition system (SHNU-mASR, team name-"maybe"), submitted to Track 1 of the INTERSPEECH 2025 MLC-SLM Challenge. Our system integrates a parallel-speech-encoder architecture…

Computation and Language · Computer Science 2025-07-09 Yuxiang Mei , Yuang Zheng , Dongxing Xu , Yanhua Long

The INTERSPEECH 2025 Challenge on Multilingual Conversational Speech Language Models (MLC-SLM) promotes multilingual conversational ASR with large language models (LLMs). Our previous SHNU-mASR system adopted a competitive…

Computation and Language · Computer Science 2026-02-03 Yuxiang Mei , Dongxing Xu , Jiaen Liang , Yanhua Long

This paper describes our Triple X speech recognition system submitted to Task 1 of the Multi-Lingual Conversational Speech Language Modeling (MLC-SLM) Challenge. Our work focuses on optimizing speech recognition accuracy in multilingual…

Computation and Language · Computer Science 2026-03-16 Miaomiao Gao , Xiaoxiao Xiang , Yiwen Guo

This paper presents the TEA-ASLP's system submitted to the MLC-SLM 2025 Challenge, addressing multilingual conversational automatic speech recognition (ASR) in Task I and speech diarization ASR in Task II. For Task I, we enhance Ideal-LLM…

Sound · Computer Science 2025-07-25 Hongfei Xue , Kaixun Huang , Zhikai Zhou , Shen Huang , Shidong Shang

This paper presents the architecture and performance of a novel Multilingual Automatic Speech Recognition (ASR) system developed by the Transsion Speech Team for Track 1 of the MLC-SLM 2025 Challenge. The proposed system comprises three key…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-22 Xiaoxiao Li , An Zhu , Youhai Jiang , Fengjie Zhu

Language understanding in speech-based systems have attracted much attention in recent years with the growing demand for voice interface applications. However, the robustness of natural language understanding (NLU) systems to errors…

Computation and Language · Computer Science 2022-03-17 Lingyun Feng , Jianwei Yu , Deng Cai , Songxiang Liu , Haitao Zheng , Yan Wang

Speech Large Language Models (Speech LLMs) have emerged as a crucial paradigm in recent years, extending the capabilities of traditional LLMs to speech tasks such as automatic speech recognition (ASR) and spoken dialogue modeling. However,…

Computation and Language · Computer Science 2025-07-08 Phurich Saengthong , Boonnithi Jiaramaneepinit , Sheng Li , Manabu Okumura , Takahiro Shinozaki

This paper describes the NTNU ASR system participating in the Interspeech 2020 Non-Native Children's Speech ASR Challenge supported by the SIG-CHILD group of ISCA. This ASR shared task is made much more challenging due to the coexisting…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-04 Tien-Hong Lo , Fu-An Chao , Shi-Yan Weng , Berlin Chen

While large language models excel in a variety of natural language processing (NLP) tasks, to perform well on spoken language understanding (SLU) tasks, they must either rely on off-the-shelf automatic speech recognition (ASR) systems for…

Computation and Language · Computer Science 2023-09-13 Pranay Dighe , Yi Su , Shangshang Zheng , Yunshu Liu , Vineet Garg , Xiaochuan Niu , Ahmed Tewfik

This paper describes our NPU-ASLP system submitted to the ISCSLP 2022 Magichub Code-Switching ASR Challenge. In this challenge, we first explore several popular end-to-end ASR architectures and training strategies, including bi-encoder,…

Sound · Computer Science 2022-10-27 Yuhao Liang , Peikun Chen , Fan Yu , Xinfa Zhu , Tianyi Xu , Lei Xie

This paper explores the integration of Large Language Models (LLMs) into Automatic Speech Recognition (ASR) systems to improve transcription accuracy. The increasing sophistication of LLMs, with their in-context learning capabilities and…

Computation and Language · Computer Science 2025-06-03 Zeping Min , Jinbo Wang

While integrating speech encoder with LLM requires substantial data and resources, use cases face limitations due to insufficient availability. To address this, we propose a solution with a parameter-efficient adapter that converts speech…

Computation and Language · Computer Science 2025-09-08 Jaekwon Yoo , Kunal Chandiramani , Divya Tadimeti , Abenezer Girma , Chandra Dhir

In this paper, we investigate the usage of large language models (LLMs) to improve the performance of competitive speech recognition systems. Different from previous LLM-based ASR error correction methods, we propose a novel multi-stage…

Computation and Language · Computer Science 2024-06-18 Jie Pu , Thai-Son Nguyen , Sebastian Stüker

Recent voice assistants are usually based on the cascade spoken language understanding (SLU) solution, which consists of an automatic speech recognition (ASR) engine and a natural language understanding (NLU) system. Because such approach…

Computation and Language · Computer Science 2023-06-14 Anderson R. Avila , Mehdi Rezagholizadeh , Chao Xing

Multilingual Large Language Models (LLMs) struggle with cross-lingual tasks due to data imbalances between high-resource and low-resource languages, as well as monolingual bias in pre-training. Existing methods, such as bilingual…

Computation and Language · Computer Science 2026-04-14 Weihua Zheng , Chang Liu , Zhengyuan Liu , Xin Huang , Kui Wu , Muhammad Huzaifah Md Shahrin , Aiti Aw , Roy Ka-Wei Lee

Despite recent progress in Natural Language Understanding (NLU), the creation of multilingual NLU systems remains a challenge. It is common to have NLU systems limited to a subset of languages due to lack of available data. They also often…

Computation and Language · Computer Science 2022-12-14 Christopher Hench , Charith Peris , Jack FitzGerald , Kay Rottmann

In real-world applications, automatic speech recognition (ASR) systems must handle overlapping speech from multiple speakers and recognize rare words like technical terms. Traditional methods address multi-talker ASR and contextual biasing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Jiajun He , Naoki Sawada , Koichi Miyazaki , Tomoki Toda

Multilingual end-to-end models have shown great improvement over monolingual systems. With the development of pre-training methods on speech, self-supervised multilingual speech representation learning like XLSR has shown success in…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Fenglin Ding , Genshun Wan , Pengcheng Li , Jia Pan , Cong Liu

Spoken language understanding (SLU) is a task aiming to extract high-level semantics from spoken utterances. Previous works have investigated the use of speech self-supervised models and textual pre-trained models, which have shown…

Computation and Language · Computer Science 2022-11-08 Jiatong Shi , Chan-Jan Hsu , Holam Chung , Dongji Gao , Paola Garcia , Shinji Watanabe , Ann Lee , Hung-yi Lee

In the realm of spoken language understanding (SLU), numerous natural language understanding (NLU) methodologies have been adapted by supplying large language models (LLMs) with transcribed speech instead of conventional written text. In…

‹ Prev 1 2 3 10 Next ›