中文
相关论文

相关论文: Improving Massively Multilingual ASR With Auxiliar…

200 篇论文

Multilingual automatic speech recognition (ASR) systems mostly benefit low resource languages but suffer degradation in performance across several languages relative to their monolingual counterparts. Limited studies have focused on…

计算与语言 · 计算机科学 2022-07-08 Muhammad Umar Farooq , Thomas Hain

Language development experts need tools that can automatically identify languages from fluent, conversational speech, and provide reliable estimates of usage rates at the level of an individual recording. However, language identification…

音频与语音处理 · 电气工程与系统科学 2023-05-31 Suzy J. Styles , Victoria Y. H. Chua , Fei Ting Woon , Hexin Liu , Leibny Paola Garcia Perera , Sanjeev Khudanpur , Andy W. H. Khong , Justin Dauwels

Building a high quality automatic speech recognition (ASR) system with limited training data has been a challenging task particularly for a narrow target population. Open-sourced ASR systems, trained on sufficient data from adults, are…

音频与语音处理 · 电气工程与系统科学 2020-11-18 Liu Chen , Meysam Asgari

Automatic Speech Recognition (ASR) aims to convert human speech content into corresponding text. In conversational scenarios, effectively utilizing context can enhance its accuracy. Large Language Models' (LLMs) exceptional long-context…

声音 · 计算机科学 2026-01-19 Bingshen Mu , Hexin Liu , Hongfei Xue , Kun Wei , Lei Xie

Automatic speech recognition systems have been largely improved in the past few decades and current systems are mainly hybrid-based and end-to-end-based. The recently proposed CTC-CRF framework inherits the data-efficiency of the hybrid…

音频与语音处理 · 电气工程与系统科学 2021-07-09 Huahuan Zheng , Wenjie Peng , Zhijian Ou , Jinsong Zhang

Running automatic speech recognition (ASR) on edge devices is non-trivial due to resource constraints, especially in scenarios that require supporting multiple languages. We propose a new approach to enable multilingual speech recognition…

计算与语言 · 计算机科学 2021-08-05 Sangeeta Ghangam , Daniel Whitenack , Joshua Nemecek

Automatic speech recognition (ASR) for African languages remains constrained by limited labeled data and the lack of systematic guidance on model selection, data scaling, and decoding strategies. Large pre-trained systems such as Whisper,…

End-to-end Automatic Speech Recognition (ASR) systems based on neural networks have seen large improvements in recent years. The availability of large scale hand-labeled datasets and sufficient computing resources made it possible to train…

计算机视觉与模式识别 · 计算机科学 2023-01-05 Maxime Burchi , Radu Timofte

Recently, Conformer based CTC/AED model has become a mainstream architecture for ASR. In this paper, based on our prior work, we identify and integrate several approaches to achieve further improvements for ASR tasks, which we denote as…

声音 · 计算机科学 2022-04-15 Zhao You , Shulin Feng , Dan Su , Dong Yu

Towards developing high-performing ASR for low-resource languages, approaches to address the lack of resources are to make use of data from multiple languages, and to augment the training data by creating acoustic variations. In this work…

音频与语音处理 · 电气工程与系统科学 2020-04-10 Chunxi Liu , Qiaochu Zhang , Xiaohui Zhang , Kritika Singh , Yatharth Saraf , Geoffrey Zweig

Connectionist Temporal Classification (CTC) is a widely used approach for automatic speech recognition (ASR) that performs conditionally independent monotonic alignment. However for translation, CTC exhibits clear limitations due to the…

计算与语言 · 计算机科学 2022-10-12 Brian Yan , Siddharth Dalmia , Yosuke Higuchi , Graham Neubig , Florian Metze , Alan W Black , Shinji Watanabe

Despite recent advancements in speech processing, zero-resource speech translation (ST) and automatic speech recognition (ASR) remain challenging problems. In this work, we propose to leverage a multilingual Large Language Model (LLM) to…

End-to-end automatic speech recognition (ASR) commonly transcribes audio signals into sequences of characters while its performance is evaluated by measuring the word-error rate (WER). This suggests that predicting sequences of words…

计算与语言 · 计算机科学 2018-12-07 Jan Kremer , Lasse Borgholt , Lars Maaløe

Automatic speech recognition (ASR) for conversational code-switching speech remains challenging due to the scarcity of realistic, high-quality labeled speech data. This paper explores multilingual text-to-speech (TTS) models as an effective…

音频与语音处理 · 电气工程与系统科学 2026-01-06 Yue Heng Yeo , Yuchen Hu , Shreyas Gopal , Yizhou Peng , Hexin Liu , Eng Siong Chng

Spoken language Identification (LID) systems are needed to identify the language(s) present in a given audio sample, and typically could be the first step in many speech processing related tasks such as automatic speech recognition (ASR).…

计算与语言 · 计算机科学 2020-10-15 Pradeep Rangan , Sundeep Teki , Hemant Misra

Pre-trained models, especially self-supervised learning (SSL) models, have demonstrated impressive results in automatic speech recognition (ASR) task. While most applications of SSL models focus on leveraging continuous representations as…

音频与语音处理 · 电气工程与系统科学 2025-09-03 Zehan Li , Yan Yang , Xueqing Li , Jian Kang , Xiao-Lei Zhang , Jie Li

While supervised quality predictors for synthesized speech have demonstrated strong correlations with human ratings, their requirement for in-domain labeled training data hinders their generalization ability to new domains. Unsupervised…

音频与语音处理 · 电气工程与系统科学 2025-09-08 Erica Cooper , Takuma Okamoto , Yamato Ohtani , Tomoki Toda , Hisashi Kawai

Language Identification (LID) is a core task in multilingual NLP, yet current systems often overfit to clean, monolingual data. This work introduces DIVERS-BENCH, a comprehensive evaluation of state-of-the-art LID models across diverse…

计算与语言 · 计算机科学 2025-09-23 Jessica Ojo , Zina Kamel , David Ifeoluwa Adelani

Recent years have witnessed significant progress in multilingual automatic speech recognition (ASR), driven by the emergence of end-to-end (E2E) models and the scaling of multilingual datasets. Despite that, two main challenges persist in…

音频与语音处理 · 电气工程与系统科学 2024-06-12 Zheshu Song , Jianheng Zhuo , Yifan Yang , Ziyang Ma , Shixiong Zhang , Xie Chen

Large language models (LLM) have demonstrated the ability to understand human language by leveraging large amount of text data. Automatic speech recognition (ASR) systems are often limited by available transcribed speech data and benefit…

音频与语音处理 · 电气工程与系统科学 2024-09-26 Prashanth Gurunath Shivakumar , Jari Kolehmainen , Aditya Gourav , Yi Gu , Ankur Gandhe , Ariya Rastrow , Ivan Bulyko