中文
相关论文

相关论文: Attention-Guided Adaptation for Code-Switching Spe…

200 篇论文

Attention-based end-to-end models such as Listen, Attend and Spell (LAS), simplify the whole pipeline of traditional automatic speech recognition (ASR) systems and become popular in the field of speech recognition. In previous work,…

计算与语言 · 计算机科学 2019-04-26 Ruchao Fan , Pan Zhou , Wei Chen , Jia Jia , Gang Liu

Most spoken language understanding systems use a pipeline approach composed of an automatic speech recognition interface and a natural language understanding module. This approach forces hard decisions when converting continuous inputs into…

计算与语言 · 计算机科学 2023-10-18 Quentin Meeus , Marie-Francine Moens , Hugo Van hamme

Recent advancements in machine learning have significantly improved speech recognition, but recognizing speech from non-fluent or accented speakers remains a challenge. Previous efforts, relying on rule-based pronunciation patterns, have…

计算与语言 · 计算机科学 2025-06-04 Anna Seo Gyeong Choi , Jonghyeon Park , Myungwoo Oh

Mixture-of-experts based models, which use language experts to extract language-specific representations effectively, have been well applied in code-switching automatic speech recognition. However, there is still substantial space to…

声音 · 计算机科学 2023-10-10 Peikun Chen , Fan Yu , Yuhao Lian , Hongfei Xue , Xucheng Wan , Naijun Zheng , Huan Zhou , Lei Xie

The existing audio datasets are predominantly tailored towards single languages, overlooking the complex linguistic behaviors of multilingual communities that engage in code-switching. This practice, where individuals frequently mix two or…

声音 · 计算机科学 2025-03-04 Peng Xie , Kani Chen

The target speech extraction has attracted widespread attention in recent years. In this work, we focus on investigating the dynamic interaction between different mixtures and the target speaker to exploit the discriminative target speaker…

音频与语音处理 · 电气工程与系统科学 2021-10-20 Jiangyu Han , Wei Rao , Yanhua Long , Jiaen Liang

Motivated by a growing research interest into automatic speech recognition (ASR), and the growing body of work for languages in which code-switching (CS) often occurs, we present a systematic literature review of code-switching in…

计算与语言 · 计算机科学 2025-07-11 Maha Tufail Agro , Atharva Kulkarni , Karima Kadaoui , Zeerak Talat , Hanan Aldarmaki

Pre-trained transformer-based models have significantly advanced automatic speech recognition (ASR), yet they remain sensitive to accent and dialectal variations, resulting in elevated word error rates (WER) in linguistically diverse…

计算与语言 · 计算机科学 2025-10-13 Mohammad Hossein Sameti , Sepehr Harfi Moridani , Ali Zarean , Hossein Sameti

Recent advancements in multilingual automatic speech recognition (ASR) have been driven by large-scale end-to-end models like Whisper. However, challenges such as language interference and expanding to unseen languages (language expansion)…

计算与语言 · 计算机科学 2025-09-29 Hongli Yang , Sheng Li , Hao Huang , Ayiduosi Tuohan , Yizhou Peng

Automatic speech recognition (ASR) performance has improved drastically in recent years, mainly enabled by self-supervised learning (SSL) based acoustic models such as wav2vec2 and large-scale multi-lingual training like Whisper. A huge…

Recent research has shown that attention-based sequence-to-sequence models such as Listen, Attend, and Spell (LAS) yield comparable results to state-of-the-art ASR systems on various tasks. In this paper, we describe the development of such…

计算与语言 · 计算机科学 2018-11-07 Yan Yin , Ramon Prieto , Bin Wang , Jianwei Zhou , Yiwei Gu , Yang Liu , Hui Lin

Multilingual Automatic Speech Recognition (ASR) models are typically evaluated in a setting where the ground-truth language of the speech utterance is known, however, this is often not the case for most practical settings. Automatic Spoken…

计算与语言 · 计算机科学 2024-09-30 Brian Yan , Vineel Pratap , Shinji Watanabe , Michael Auli

With the massive developments of end-to-end (E2E) neural networks, recent years have witnessed unprecedented breakthroughs in automatic speech recognition (ASR). However, the codeswitching phenomenon remains a major obstacle that hinders…

计算与语言 · 计算机科学 2024-02-28 Tzu-Ting Yang , Hsin-Wei Wang , Yi-Cheng Wang , Chi-Han Lin , Berlin Chen

Contextual biasing improves automatic speech recognition (ASR) by integrating external knowledge, such as user-specific phrases or entities, during decoding. In this work, we use an attention-based biasing decoder to produce scores for…

音频与语音处理 · 电气工程与系统科学 2025-10-29 Wanting Huang , Weiran Wang

Multi-speaker automatic speech recognition (ASR) is crucial for many real-world applications, but it requires dedicated modeling techniques. Existing approaches can be divided into modular and end-to-end methods. Modular approaches separate…

计算与语言 · 计算机科学 2023-06-22 Simon Berger , Peter Vieting , Christoph Boeddeker , Ralf Schlüter , Reinhold Haeb-Umbach

The recent emergence of joint CTC-Attention model shows significant improvement in automatic speech recognition (ASR). The improvement largely lies in the modeling of linguistic information by decoder. The decoder joint-optimized with an…

计算与语言 · 计算机科学 2022-10-27 Xulong Zhang , Jianzong Wang , Ning Cheng , Mengyuan Zhao , Zhiyong Zhang , Jing Xiao

Multilingual end-to-end models have shown great improvement over monolingual systems. With the development of pre-training methods on speech, self-supervised multilingual speech representation learning like XLSR has shown success in…

音频与语音处理 · 电气工程与系统科学 2022-12-08 Fenglin Ding , Genshun Wan , Pengcheng Li , Jia Pan , Cong Liu

The recognition of rare named entities, such as personal names and terminologies, is challenging for automatic speech recognition (ASR) systems, especially when they are not frequently observed in the training data. In this paper, we…

人工智能 · 计算机科学 2024-06-07 Yuang Li , Min Zhang , Chang Su , Yinglu Li , Xiaosong Qiao , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Shimin Tao , Hao Yang

We study training a single acoustic model for multiple languages with the aim of improving automatic speech recognition (ASR) performance on low-resource languages, and over-all simplifying deployment of ASR systems that support diverse…

音频与语音处理 · 电气工程与系统科学 2020-07-09 Vineel Pratap , Anuroop Sriram , Paden Tomasello , Awni Hannun , Vitaliy Liptchinsky , Gabriel Synnaeve , Ronan Collobert

Domain mismatch between training and testing can lead to significant degradation in performance in many machine learning scenarios. Unfortunately, this is not a rare situation for automatic speech recognition deployments in real-world…

计算与语言 · 计算机科学 2017-09-25 Wei-Ning Hsu , Yu Zhang , James Glass