English
Related papers

Related papers: Building Robust and Scalable Multilingual ASR for …

200 papers

Automatic speech recognition (ASR) is a key area in computational linguistics, focusing on developing technologies that enable computers to convert spoken language into text. This field combines linguistics and machine learning. ASR models,…

Computation and Language · Computer Science 2024-06-27 Anish Saha , A. G. Ramakrishnan

We study the effect of applying a language model (LM) on the output of Automatic Speech Recognition (ASR) systems for Indic languages. We fine-tune wav2vec $2.0$ models for $18$ Indic languages and adjust the results with language models…

Computation and Language · Computer Science 2022-06-16 Ankur Dhuriya , Harveen Singh Chadha , Anirudh Gupta , Priyanshi Shah , Neeraj Chhimwal , Rishabh Gaur , Vivek Raghavan

Multi-speaker speech recognition of unsegmented recordings has diverse applications such as meeting transcription and automatic subtitle generation. With technical advances in systems dealing with speech separation, speaker diarization, and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Desh Raj , Pavel Denisov , Zhuo Chen , Hakan Erdogan , Zili Huang , Maokui He , Shinji Watanabe , Jun Du , Takuya Yoshioka , Yi Luo , Naoyuki Kanda , Jinyu Li , Scott Wisdom , John R. Hershey

This paper introduces the sixth Oriental Language Recognition (OLR) 2021 Challenge, which intends to improve the performance of language recognition systems and speech recognition systems within multilingual scenarios. The data profile,…

Computation and Language · Computer Science 2021-07-26 Binling Wang , Wenxuan Hu , Jing Li , Yiming Zhi , Zheng Li , Qingyang Hong , Lin Li , Dong Wang , Liming Song , Cheng Yang

Multilingual Automatic Speech Recognition (ASR) aims to recognize and transcribe speech from multiple languages within a single system. Whisper, one of the most advanced ASR models, excels in this domain by handling 99 languages…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-24 Shao-Syuan Huang , Kuan-Po Huang , Andy T. Liu , Hung-yi Lee

Automatic speech recognition (ASR) has witnessed remarkable progress in recent years, largely driven by the emergence of LLM-based ASR paradigm. Despite their strong performance on a variety of open-source benchmarks, existing LLM-based ASR…

Sound · Computer Science 2026-01-06 Zheshu Song , Lu Wang , Wei Deng , Zhuo Yang , Yong Wu , Bin Xia

Code understanding is a foundational capability in software engineering tools and developer workflows. However, most existing systems are designed for English-speaking users interacting via keyboards, which limits accessibility in…

Software Engineering · Computer Science 2026-01-23 Jayant Havare , Ashish Mittal , Srikanth Tamilselvam , Ganesh Ramakrishnan

Training speech recognizers with unpaired speech and text -- known as unsupervised speech recognition (UASR) -- is a crucial step toward extending ASR to low-resource languages in the long-tail distribution and enabling multimodal learning…

Computation and Language · Computer Science 2025-10-07 Liming Wang , Junrui Ni , Kai-Wei Chang , Saurabhchand Bhati , David Harwath , Mark Hasegawa-Johnson , James R. Glass

The goal of multilingual speech technology is to facilitate seamless communication between individuals speaking different languages, creating the experience as though everyone were a multilingual speaker. To create this experience, speech…

Computation and Language · Computer Science 2026-05-19 Supriti Sinhamahapatra , Thai-Binh Nguyen , Yiğit Oğuz , Enes Ugan , Jan Niehues , Alexander Waibel

We present our first efforts towards building a single multilingual automatic speech recognition (ASR) system that can process code-switching (CS) speech in five languages spoken within the same population. This contrasts with related prior…

Computation and Language · Computer Science 2018-07-31 Emre Yılmaz , Astik Biswas , Ewald van der Westhuizen , Febe de Wet , Thomas Niesler

Running automatic speech recognition (ASR) on edge devices is non-trivial due to resource constraints, especially in scenarios that require supporting multiple languages. We propose a new approach to enable multilingual speech recognition…

Computation and Language · Computer Science 2021-08-05 Sangeeta Ghangam , Daniel Whitenack , Joshua Nemecek

Bengali, spoken by over 300 million people, is a morphologically rich and lowresource language, posing challenges for automatic speech recognition (ASR). This research presents an end-to-end framework for Bengali ASR, building on a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-16 Md. Nazmus Sakib , Golam Mahmud , Md. Maruf Bangabashi , Umme Ara Mahinur Istia , Md. Jahidul Islam , Partha Sarker , Afra Yeamini Prity

Languages usually switch within a multilingual speech signal, especially in a bilingual society. This phenomenon is referred to as code-switching (CS), making automatic speech recognition (ASR) challenging under a multilingual scenario. We…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-02 Hexin Liu , Leibny Paola Garcia , Xiangyu Zhang , Andy W. H. Khong , Sanjeev Khudanpur

Spoken Term Detection (STD) is the task of searching for words or phrases within audio, given either text or spoken input as a query. In this work, we use state-of-the-art Hindi, Tamil and Telugu ASR systems cross-lingually for lexical…

Computation and Language · Computer Science 2020-11-13 Sanket Shah , Satarupa Guha , Simran Khanuja , Sunayana Sitaram

This paper introduces the integration of language-specific bi-directional context into a speech large language model (SLLM) to improve multilingual continuous conversational automatic speech recognition (ASR). We propose a character-level…

Computation and Language · Computer Science 2025-07-08 Yizhou Peng , Hexin Liu , Eng Siong Chng

Humans are capable of processing speech by making use of multiple sensory modalities. For example, the environment where a conversation takes place generally provides semantic and/or acoustic context that helps us to resolve ambiguities or…

Computation and Language · Computer Science 2019-02-21 Ozan Caglayan , Ramon Sanabria , Shruti Palaskar , Loïc Barrault , Florian Metze

Training automatic speech recognition (ASR) systems requires large amounts of data in the target language in order to achieve good performance. Whereas large training corpora are readily available for languages like English, there exists a…

Audio and Speech Processing · Electrical Eng. & Systems 2017-11-15 Markus Müller , Sebastian Stüker , Alex Waibel

Retrieval-Augmented Generation (RAG) systems enable language models to access relevant information and generate accurate, well-grounded, and contextually informed responses. However, for Indian languages, the development of high-quality RAG…

Computation and Language · Computer Science 2025-06-04 Pasunuti Prasanjith , Prathmesh B More , Anoop Kunchukuttan , Raj Dabre

Building Automatic Speech Recognition (ASR) systems for code-switched speech has recently gained renewed attention due to the widespread use of speech technologies in multilingual communities worldwide. End-to-end ASR systems are a natural…

Computation and Language · Computer Science 2020-10-13 Yash Sharma , Basil Abraham , Karan Taneja , Preethi Jyothi

Code-switching (CS) is the alternating use of two or more languages within a conversation or utterance, often influenced by social context and speaker identity. This linguistic phenomenon poses challenges for Automatic Speech Recognition…

Computation and Language · Computer Science 2025-06-03 Peng Xie , Xingyuan Liu , Tsz Wai Chan , Yequan Bie , Yangqiu Song , Yang Wang , Hao Chen , Kani Chen