中文
相关论文

相关论文: Multilingual Graphemic Hybrid ASR with Massive Dat…

200 篇论文

Grapheme-to-phoneme (G2P) models are a key component in Automatic Speech Recognition (ASR) systems, such as the ASR system in Alexa, as they are used to generate pronunciations for out-of-vocabulary words that do not exist in the…

计算与语言 · 计算机科学 2020-06-30 Alex Sokolov , Tracy Rohlin , Ariya Rastrow

Multilingual automatic speech recognition (ASR) systems have garnered attention for their potential to extend language coverage globally. While self-supervised learning (SSL) models, like MMS, have demonstrated their effectiveness in…

计算与语言 · 计算机科学 2024-04-30 Hongfei Xue , Qijie Shao , Kaixun Huang , Peikun Chen , Jie Liu , Lei Xie

Automatic speech recognition (ASR) for low-resource languages remains a challenge due to the scarcity of labeled training data. Parameter-efficient fine-tuning and text-only adaptation are two popular methods that have been used to address…

计算与语言 · 计算机科学 2024-10-18 Abhishek Gupta , Amruta Parulekar , Sameep Chattopadhyay , Preethi Jyothi

The development of resource-constrained approaches to automatic speech recognition (ASR) is of great interest due to its broad applicability to many low-resource languages for which there is scant usable data. Existing approaches to many…

计算与语言 · 计算机科学 2026-03-17 Emma Rafkin , Dan DeGenaro , Xiulin Yang

Training automatic speech recognition (ASR) models increasingly relies on decentralized federated learning to ensure data privacy and accessibility, producing multiple local models that require effective merging. In hybrid ASR systems,…

计算与语言 · 计算机科学 2026-03-06 Mengze Hong , Yi Gu , Di Jiang , Hanlin Gu , Chen Jason Zhang , Lu Wang , Zhiyang Su

In this paper, we analyzed how audio-visual speech enhancement can help to perform the ASR task in a cocktail party scenario. Therefore we considered two simple end-to-end LSTM-based models that perform single-channel audio-visual speech…

音频与语音处理 · 电气工程与系统科学 2019-11-28 Luca Pasa , Giovanni Morrone , Leonardo Badino

In automatic speech recognition (ASR), phoneme-based multilingual pre-training and crosslingual fine-tuning is attractive for its high data efficiency and competitive results compared to subword-based models. However, Weighted Finite State…

声音 · 计算机科学 2025-06-06 Te Ma , Min Bi , Saierdaer Yusuyin , Hao Huang , Zhijian Ou

This research optimizes two-pass cross-lingual transfer learning in low-resource languages by enhancing phoneme recognition and phoneme-to-grapheme translation models. Our approach optimizes these two stages to improve speech recognition…

计算与语言 · 计算机科学 2023-12-07 Wonjun Lee , Gary Geunbae Lee , Yunsu Kim

While automatic speech recognition (ASR) systems have achieved remarkable performance with large-scale datasets, their efficacy remains inadequate in low-resource settings, encompassing dialects, accents, minority languages, and long-tail…

音频与语音处理 · 电气工程与系统科学 2024-10-23 Guanrou Yang , Fan Yu , Ziyang Ma , Zhihao Du , Zhifu Gao , Shiliang Zhang , Xie Chen

End-to-end multilingual ASR has become more appealing because of several reasons such as simplifying the training and deployment process and positive performance transfer from high-resource to low-resource languages. However, scaling up the…

计算与语言 · 计算机科学 2022-11-11 Andros Tjandra , Nayan Singhal , David Zhang , Ozlem Kalinli , Abdelrahman Mohamed , Duc Le , Michael L. Seltzer

This paper describes the systems developed by SPRING Lab, Indian Institute of Technology Madras, for the ASRU MADASR 2.0 challenge. The systems developed focuses on adapting ASR systems to improve in predicting the language and dialect of…

计算与语言 · 计算机科学 2025-11-20 Arjun Gangwar , Kaousheik Jayakumar , S. Umesh

Recent advancements in supervised automatic speech recognition (ASR) have achieved remarkable performance, largely due to the growing availability of large transcribed speech corpora. However, most languages lack sufficient paired speech…

计算与语言 · 计算机科学 2025-01-10 Junrui Ni , Liming Wang , Yang Zhang , Kaizhi Qian , Heting Gao , Mark Hasegawa-Johnson , Chang D. Yoo

In the FAME! Project, a code-switching (CS) automatic speech recognition (ASR) system for Frisian-Dutch speech is developed that can accurately transcribe the local broadcaster's bilingual archives with CS speech. This archive contains…

计算与语言 · 计算机科学 2019-07-01 Emre Yılmaz , Samuel Cohen , Xianghu Yue , David van Leeuwen , Haizhou Li

In this paper, we propose MixSpeech, a simple yet effective data augmentation method based on mixup for automatic speech recognition (ASR). MixSpeech trains an ASR model by taking a weighted combination of two different speech features…

计算与语言 · 计算机科学 2021-02-26 Linghui Meng , Jin Xu , Xu Tan , Jindong Wang , Tao Qin , Bo Xu

Multimodal speech recognition aims to improve the performance of automatic speech recognition (ASR) systems by leveraging additional visual information that is usually associated to the audio input. While previous approaches make crucial…

声音 · 计算机科学 2022-04-29 Dan Oneata , Horia Cucu

The performance of automatic speech recognition (ASR) systems has advanced substantially in recent years, particularly for languages for which a large amount of transcribed speech is available. Unfortunately, for low-resource languages,…

计算与语言 · 计算机科学 2023-05-22 Martijn Bartelds , Nay San , Bradley McDonnell , Dan Jurafsky , Martijn Wieling

Building ASR models across many languages is a challenging multi-task learning problem due to large variations and heavily unbalanced data. Existing work has shown positive transfer from high resource to low resource languages. However,…

计算与语言 · 计算机科学 2021-09-14 Bo Li , Ruoming Pang , Tara N. Sainath , Anmol Gulati , Yu Zhang , James Qin , Parisa Haghani , W. Ronny Huang , Min Ma , Junwen Bai

Human can recognize speech, as well as the peculiar accent of the speech simultaneously. However, present state-of-the-art ASR system can rarely do that. In this paper, we propose a multilingual approach to recognizing English speech, and…

音频与语音处理 · 电气工程与系统科学 2021-05-11 Yizhou Peng , Jicheng Zhang , Haobo Zhang , Haihua Xu , Hao Huang , Eng Siong Chng

Recent advances in text-to-speech (TTS) led to the development of flexible multi-speaker end-to-end TTS systems. We extend state-of-the-art attention-based automatic speech recognition (ASR) systems with synthetic audio generated by a TTS…

计算与语言 · 计算机科学 2020-02-18 Nick Rossenbach , Albert Zeyer , Ralf Schlüter , Hermann Ney

We introduce a bilingual solution to support English as secondary locale for most primary locales in hybrid automatic speech recognition (ASR) settings. Our key developments constitute: (a) pronunciation lexicon with grapheme units instead…

音频与语音处理 · 电气工程与系统科学 2023-08-15 Mohammad Soleymanpour , Mahmoud Al Ismail , Fahimeh Bahmaninezhad , Kshitiz Kumar , Jian Wu