English
Related papers

Related papers: Improving Code Switching with Supervised Fine Tuni…

200 papers

In a pipeline speech translation system, automatic speech recognition (ASR) system will transmit errors in recognition to the downstream machine translation (MT) system. A standard machine translation system is usually trained on parallel…

Computation and Language · Computer Science 2019-10-29 Qiao Cheng , Meiyuan Fang , Yaqian Han , Jin Huang , Yitao Duan

Code-switching (CS) is the alternating use of two or more languages within a conversation or utterance, often influenced by social context and speaker identity. This linguistic phenomenon poses challenges for Automatic Speech Recognition…

Computation and Language · Computer Science 2025-06-03 Peng Xie , Xingyuan Liu , Tsz Wai Chan , Yequan Bie , Yangqiu Song , Yang Wang , Hao Chen , Kani Chen

This paper presents the architecture and performance of a novel Multilingual Automatic Speech Recognition (ASR) system developed by the Transsion Speech Team for Track 1 of the MLC-SLM 2025 Challenge. The proposed system comprises three key…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-22 Xiaoxiao Li , An Zhu , Youhai Jiang , Fengjie Zhu

Code-switching (CS) refers to the phenomenon that languages switch within a speech signal and leads to language confusion for automatic speech recognition (ASR). This paper aims to address language confusion for improving CS-ASR from two…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-27 Hexin Liu , Haihua Xu , Leibny Paola Garcia , Andy W. H. Khong , Yi He , Sanjeev Khudanpur

Recently, there has been an increasing interest in two-pass streaming end-to-end speech recognition (ASR) that incorporates a 2nd-pass rescoring model on top of the conventional 1st-pass streaming ASR model to improve recognition accuracy…

Computation and Language · Computer Science 2022-11-17 Suyoun Kim , Ke Li , Lucas Kabela , Rongqing Huang , Jiedan Zhu , Ozlem Kalinli , Duc Le

Recent end-to-end automatic speech recognition (ASR) systems often utilize a Transformer-based acoustic encoder that generates embedding at a high frame rate. However, this design is inefficient, particularly for long speech signals due to…

Computation and Language · Computer Science 2023-06-29 Yuang Li , Yu Wu , Jinyu Li , Shujie Liu

Speaker-attributed automatic speech recognition (SA-ASR) aims to transcribe speech while assigning transcripts to the corresponding speakers accurately. Existing methods often rely on complex modular systems or require extensive fine-tuning…

Computation and Language · Computer Science 2025-01-16 Thai-Binh Nguyen , Alexander Waibel

Despite recent advancements in speech processing, zero-resource speech translation (ST) and automatic speech recognition (ASR) remain challenging problems. In this work, we propose to leverage a multilingual Large Language Model (LLM) to…

The development of resource-constrained approaches to automatic speech recognition (ASR) is of great interest due to its broad applicability to many low-resource languages for which there is scant usable data. Existing approaches to many…

Computation and Language · Computer Science 2026-03-17 Emma Rafkin , Dan DeGenaro , Xiulin Yang

This paper explores the use of ASR-pretrained Conformers for speaker verification, leveraging their strengths in modeling speech signals. We introduce three strategies: (1) Transfer learning to initialize the speaker embedding network,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-17 Danwei Cai , Ming Li

Automatic Speech Recognition (ASR) technology has made significant progress in recent years, providing accurate transcription across various domains. However, some challenges remain, especially in noisy environments and specialized jargon.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-06 Aviv Shamsian , Aviv Navon , Neta Glazer , Gill Hetz , Joseph Keshet

Modern automatic speech recognition (ASR) models, such as OpenAI's Whisper, rely on deep encoder-decoder architectures, and their encoders are a critical bottleneck for efficient deployment due to high computational intensity. We introduce…

Machine Learning · Computer Science 2025-08-26 Keisuke Kamahori , Jungo Kasai , Noriyuki Kojima , Baris Kasikci

Whisper, despite being trained on 680K hours of web-scaled audio data, faces difficulty in recognising rare words like domain-specific terms, with a solution being contextual biasing through prompting. To improve upon this method, in this…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-19 Yash Jogi , Vaibhav Aggarwal , Shabari S Nair , Yash Verma , Aayush Kubba

End-to-end training of automated speech recognition (ASR) systems requires massive data and compute resources. We explore transfer learning based on model adaptation as an approach for training ASR models under constrained GPU memory,…

Machine Learning · Computer Science 2017-06-02 Julius Kunze , Louis Kirsch , Ilia Kurenkov , Andreas Krug , Jens Johannsmeier , Sebastian Stober

Transcribing meetings containing overlapped speech with only a single distant microphone (SDM) has been one of the most challenging problems for automatic speech recognition (ASR). While various approaches have been proposed, all previous…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-14 Naoyuki Kanda , Guoli Ye , Yu Wu , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Takuya Yoshioka

With the advent of globalization, there is an increasing demand for multilingual automatic speech recognition (ASR), handling language and dialectal variation of spoken content. Recent studies show its efficacy over monolingual systems. In…

Computation and Language · Computer Science 2021-07-06 Shammur Absar Chowdhury , Amir Hussein , Ahmed Abdelali , Ahmed Ali

Speech enhancement methods are commonly believed to improve the performance of automatic speech recognition (ASR) in noisy environments. However, the effectiveness of these techniques cannot be taken for granted in the case of modern…

Unpaired text and audio injection have emerged as dominant methods for improving ASR performance in the absence of a large labeled corpus. However, little guidance exists on deploying these methods to improve production ASR systems that are…

Computation and Language · Computer Science 2023-04-24 Cal Peyser , Michael Picheny , Kyunghyun Cho , Rohit Prabhavalkar , Ronny Huang , Tara Sainath

State-of-the-art automatic speech recognition (ASR) systems are trained with tens of thousands of hours of labeled speech data. Human transcription is expensive and time consuming. Factors such as the quality and consistency of the…

Machine Learning · Computer Science 2022-07-05 Dongseong Hwang , Khe Chai Sim , Zhouyuan Huo , Trevor Strohman

Humans are capable of processing speech by making use of multiple sensory modalities. For example, the environment where a conversation takes place generally provides semantic and/or acoustic context that helps us to resolve ambiguities or…

Computation and Language · Computer Science 2019-02-21 Ozan Caglayan , Ramon Sanabria , Shruti Palaskar , Loïc Barrault , Florian Metze