English
Related papers

Related papers: Learning to Recognize Code-switched Speech Without…

200 papers

Automatic speech recognition (ASR) systems have achieved strong performance on general transcription tasks. However, they continue to struggle with recognizing rare named entities and adapting to domain mismatches. In contrast, large…

Computation and Language · Computer Science 2025-08-21 Shaoshi Ling , Guoli Ye

Many existing works on voice conversion (VC) tasks use automatic speech recognition (ASR) models for ensuring linguistic consistency between source and converted samples. However, for the low-data resource domains, training a high-quality…

Sound · Computer Science 2023-05-25 Mayank Kumar Singh , Naoya Takahashi , Onoe Naoyuki

The success in designing Code-Switching (CS) ASR often depends on the availability of the transcribed CS resources. Such dependency harms the development of ASR in low-resourced languages such as Bengali and Hindi. In this paper, we exploit…

Computation and Language · Computer Science 2022-02-16 Amir Hussein , Shammur Chowdhury , Najim Dehak , Ahmed Ali

Automatic Speech Recognition (ASR) models have achieved remarkable accuracy in general settings, yet their performance often degrades in domain-specific applications due to data mismatch and linguistic variability. This challenge is…

Automatic Speech Recognition (ASR) performance for low-resource languages is still far behind that of higher-resource languages such as English, due to a lack of sufficient labeled data. State-of-the-art methods deploy self-supervised…

Computation and Language · Computer Science 2025-02-10 Reihaneh Amooie , Wietse de Vries , Yun Hao , Jelske Dijkstra , Matt Coler , Martijn Wieling

Code-switching, or alternating between languages within a single conversation, presents challenges for multilingual language models on NLP tasks. This research investigates if pre-training Multilingual BERT (mBERT) on code-switched datasets…

Computation and Language · Computer Science 2025-03-12 Katherine Xie , Nitya Babbar , Vicky Chen , Yoanna Turura

End-to-end automatic speech recognition (ASR) systems are increasingly popular due to their relative architectural simplicity and competitive performance. However, even though the average accuracy of these systems may be high, the…

Computation and Language · Computer Science 2021-09-14 Chao-Han Huck Yang , Linda Liu , Ankur Gandhe , Yile Gu , Anirudh Raju , Denis Filimonov , Ivan Bulyko

In recent years, automatic speech recognition (ASR) models greatly improved transcription performance both in clean, low noise, acoustic conditions and in reverberant environments. However, all these systems rely on the availability of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-18 Francesco Nespoli , Daniel Barreda , Patrick A. Naylor

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement (SE) algorithms. However, monaural SE has not been established as an effective frontend for automatic speech recognition (ASR) in noisy…

Sound · Computer Science 2024-03-12 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

Automatic Speech Recognition (ASR) traditionally assumes known domains, but adding data from a new domain raises concerns about computational inefficiencies linked to retraining models on both existing and new domains. Fine-tuning solely on…

Computation and Language · Computer Science 2024-09-25 Devang Kulshreshtha , Saket Dingliwal , Brady Houston , Nikolaos Pappas , Srikanth Ronanki

In the FAME! Project, a code-switching (CS) automatic speech recognition (ASR) system for Frisian-Dutch speech is developed that can accurately transcribe the local broadcaster's bilingual archives with CS speech. This archive contains…

Computation and Language · Computer Science 2019-07-01 Emre Yılmaz , Samuel Cohen , Xianghu Yue , David van Leeuwen , Haizhou Li

Continual Learning (CL) in Automatic Speech Recognition (ASR) suffers from catastrophic forgetting when adapting to new tasks, domains, or speakers. A common strategy to mitigate this is to store a subset of past data in memory for…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Steven Vander Eeckt , Hugo Van hamme

This paper presents Seewo's systems for both tracks of the Multilingual Conversational Speech Language Model Challenge (MLC-SLM), addressing automatic speech recognition (ASR) and speaker diarization with ASR (SD-ASR). We introduce a…

Computation and Language · Computer Science 2025-06-19 Bo Li , Chengben Xu , Wufeng Zhang

Thanks to the rise of self-supervised learning, automatic speech recognition (ASR) systems now achieve near-human performance on a wide variety of datasets. However, they still lack generalization capability and are not robust to domain…

Machine Learning · Computer Science 2023-03-15 Lucas Maison , Yannick Estève

End-to-end modeling (E2E) of automatic speech recognition (ASR) blends all the components of a traditional speech recognition system into a unified model. Although it simplifies training and decoding pipelines, the unified model is hard to…

Computation and Language · Computer Science 2018-12-06 Zhehuai Chen , Mahaveer Jain , Yongqiang Wang , Michael L. Seltzer , Christian Fuegen

Transferring information retrieval (IR) models from a high-resource language (typically English) to other languages in a zero-shot fashion has become a widely adopted approach. In this work, we show that the effectiveness of zero-shot…

Computation and Language · Computer Science 2023-05-29 Robert Litschko , Ekaterina Artemova , Barbara Plank

Although modern automatic speech recognition (ASR) systems can achieve high performance, they may produce errors that weaken readers' experience and do harm to downstream tasks. To improve the accuracy and reliability of ASR hypotheses, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-11 Jing Du , Shiliang Pu , Qinbo Dong , Chao Jin , Xin Qi , Dian Gu , Ru Wu , Hongwei Zhou

Recent advancement in deep learning encouraged developing large automatic speech recognition (ASR) models that achieve promising results while ignoring computational and memory constraints. However, deploying such models on low resource…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Abdul Hannan , Alessio Brutti , Shah Nawaz , Mubashir Noman

This paper proposes a novel, resource-efficient approach to Visual Speech Recognition (VSR) leveraging speech representations produced by any trained Automatic Speech Recognition (ASR) model. Moving away from the resource-intensive trends…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Hendrik Laux , Emil Mededovic , Ahmed Hallawa , Lukas Martin , Arne Peine , Anke Schmeink

Audio-visual automatic speech recognition (AV-ASR) models are very effective at reducing word error rates on noisy speech, but require large amounts of transcribed AV training data. Recently, audio-visual self-supervised learning (SSL)…

Sound · Computer Science 2023-12-18 Avner May , Dmitriy Serdyuk , Ankit Parag Shah , Otavio Braga , Olivier Siohan