中文
相关论文

相关论文: Omnilingual ASR: Open-Source Multilingual Speech R…

200 篇论文

Recent advancements in multilingual automatic speech recognition (ASR) have been driven by large-scale end-to-end models like Whisper. However, challenges such as language interference and expanding to unseen languages (language expansion)…

计算与语言 · 计算机科学 2025-09-29 Hongli Yang , Sheng Li , Hao Huang , Ayiduosi Tuohan , Yizhou Peng

Automatic speech recognition (ASR) is a core component of human--computer interaction and an increasingly important front-end for LLM-based assistants and agents. However, most current ASR systems still follow a single-pass paradigm, which…

人工智能 · 计算机科学 2026-05-29 Zixuan Jiang , Yanqiao Zhu , Peng Wang , Qinyuan Chen , Xinjian Zhao , Xipeng Qiu , Wupeng Wang , Zhifu Gao , Xiangang Li , Kai Yu , Xie Chen

Automatic speech recognition (ASR) of overlapped speech remains a highly challenging task to date. To this end, multi-channel microphone array data are widely used in state-of-the-art ASR systems. Motivated by the invariance of visual…

音频与语音处理 · 电气工程与系统科学 2020-11-19 Jianwei Yu , Bo Wu , Rongzhi Gu , Shi-Xiong Zhang , Lianwu Chen , Yong Xu. Meng Yu , Dan Su , Dong Yu , Xunying Liu , Helen Meng

Low-resource automatic speech recognition (ASR) is challenging, as the low-resource target language data cannot well train an ASR model. To solve this issue, meta-learning formulates ASR for each source language into many small ASR tasks…

计算与语言 · 计算机科学 2021-04-13 Yubei Xiao , Ke Gong , Pan Zhou , Guolin Zheng , Xiaodan Liang , Liang Lin

The INTERSPEECH 2025 Challenge on Multilingual Conversational Speech Language Models (MLC-SLM) promotes multilingual conversational ASR with large language models (LLMs). Our previous SHNU-mASR system adopted a competitive…

计算与语言 · 计算机科学 2026-02-03 Yuxiang Mei , Dongxing Xu , Jiaen Liang , Yanhua Long

Although over 300M around the world speak Bangla, scant work has been done in improving Bangla voice-to-text transcription due to Bangla being a low-resource language. However, with the introduction of the Bengali Common Voice 9.0 speech…

计算与语言 · 计算机科学 2022-09-27 Mohammed Rakib , Md. Ismail Hossain , Nabeel Mohammed , Fuad Rahman

We present FireRedASR, a family of large-scale automatic speech recognition (ASR) models for Mandarin, designed to meet diverse requirements in superior performance and optimal efficiency across various applications. FireRedASR comprises…

音频与语音处理 · 电气工程与系统科学 2025-01-27 Kai-Tuo Xu , Feng-Long Xie , Xu Tang , Yao Hu

This paper presents a novel multistage fine-tuning strategy designed to enhance automatic speech recognition (ASR) performance in low-resource languages using OpenAI's Whisper model. In this approach we aim to build ASR model for languages…

计算与语言 · 计算机科学 2024-11-08 Leena G Pillai , Kavya Manohar , Basil K Raju , Elizabeth Sherly

This paper presents our latest investigation on end-to-end automatic speech recognition (ASR) for overlapped speech. We propose to train an end-to-end system conditioned on speaker embeddings and further improved by transfer learning from…

音频与语音处理 · 电气工程与系统科学 2019-08-14 Pavel Denisov , Ngoc Thang Vu

We present Speech-MASSIVE, a multilingual Spoken Language Understanding (SLU) dataset comprising the speech counterpart for a portion of the MASSIVE textual corpus. Speech-MASSIVE covers 12 languages from different families and inherits…

计算与语言 · 计算机科学 2024-08-08 Beomseok Lee , Ioan Calapodescu , Marco Gaido , Matteo Negri , Laurent Besacier

With the growing adoption of wearable devices such as smart glasses for AI assistants, wearer speech recognition (WSR) is becoming increasingly critical to next-generation human-computer interfaces. However, in real environments,…

音频与语音处理 · 电气工程与系统科学 2025-09-19 Yufeng Yang , Yiteng Huang , Yong Xu , Li Wan , Suwon Shon , Yang Liu , Yifeng Fan , Zhaojun Yang , Olivier Siohan , Yue Liu , Ming Sun , Florian Metze

We live in a world where 60% of the population can speak two or more languages fluently. Members of these communities constantly switch between languages when having a conversation. As automatic speech recognition (ASR) systems are being…

计算与语言 · 计算机科学 2021-02-16 Siddharth Dalmia , Yuzong Liu , Srikanth Ronanki , Katrin Kirchhoff

Recently, online end-to-end ASR has gained increasing attention. However, the performance of online systems still lags far behind that of offline systems, with a large gap in quality of recognition. For specific scenarios, we can trade-off…

声音 · 计算机科学 2020-10-28 Zhifu Gao , Shiliang Zhang , Ming Lei , Ian McLoughlin

Automatic speech recognition (ASR) for dysarthric speech remains challenging due to data scarcity, particularly in non-English languages. To address this, we fine-tune a voice conversion model on English dysarthric speech (UASpeech) to…

Automatic Speech Recognition (ASR) models demonstrate outstanding performance on high-resource languages but face significant challenges when applied to low-resource languages due to limited training data and insufficient cross-lingual…

音频与语音处理 · 电气工程与系统科学 2025-06-17 Ming-Hao Hsu , Hung-yi Lee

Text to speech (TTS) and automatic speech recognition (ASR) are two dual tasks in speech processing and both achieve impressive performance thanks to the recent advance in deep learning and large amount of aligned speech and text data.…

音频与语音处理 · 电气工程与系统科学 2020-07-28 Yi Ren , Xu Tan , Tao Qin , Sheng Zhao , Zhou Zhao , Tie-Yan Liu

Automatic Speech Recognition (ASR) technology has witnessed significant advancements in recent years, revolutionizing human-computer interactions. While major languages have benefited from these developments, lesser-resourced languages like…

计算与语言 · 计算机科学 2024-11-25 Muhammad Sharif , Zeeshan Abbas , Jiangyan Yi , Chenglin Liu

One of the central skills that language learners need to practice is speaking the language. Currently, students in school do not get enough speaking opportunities and lack conversational practice. Recent advances in speech technology and…

计算与语言 · 计算机科学 2024-06-06 Janick Michot , Manuela Hürlimann , Jan Deriu , Luzia Sauer , Katsiaryna Mlynchyk , Mark Cieliebak

Automatic speech recognition (ASR) systems have achieved near-human accuracy on curated benchmarks, yet still fail in real-world voice agents under conditions that current evaluations do not systematically cover. Without diagnostic tools…

人工智能 · 计算机科学 2026-03-27 Geeyang Tay , Wentao Ma , Jaewon Lee , Yuzhi Tang , Daniel Lee , Weisu Yin , Dongming Shen , Silin Meng , Yi Zhu , Mu Li , Alex Smola

The practical deployment of Audio-Visual Speech Recognition (AVSR) systems is fundamentally challenged by significant performance degradation in real-world environments, characterized by unpredictable acoustic noise and visual interference.…

音频与语音处理 · 电气工程与系统科学 2025-12-17 Sungnyun Kim