中文
相关论文

相关论文: Multilingual Bottleneck Features for Improving ASR…

200 篇论文

Code-switching in automatic speech recognition (ASR) is an important challenge due to globalization. Recent research in multilingual ASR shows potential improvement over monolingual systems. We study key issues related to multilingual…

计算与语言 · 计算机科学 2021-07-06 Ahmed Ali , Shammur Chowdhury , Amir Hussein , Yasser Hifny

In this paper, we propose a noise robust bottleneck feature representation which is generated by an adversarial network (AN). The AN includes two cascade connected networks, an encoding network (EN) and a discriminative network (DN).…

声音 · 计算机科学 2017-06-13 Hong Yu , Zheng-Hua Tan , Zhanyu Ma , Jun Guo

Training a conventional automatic speech recognition (ASR) system to support multiple languages is challenging because the sub-word unit, lexicon and word inventories are typically language specific. In contrast, sequence-to-sequence models…

音频与语音处理 · 电气工程与系统科学 2018-02-16 Shubham Toshniwal , Tara N. Sainath , Ron J. Weiss , Bo Li , Pedro Moreno , Eugene Weinstein , Kanishka Rao

Automatic speech recognition (ASR) for low-resource languages remains a challenge due to the scarcity of labeled training data. Parameter-efficient fine-tuning and text-only adaptation are two popular methods that have been used to address…

计算与语言 · 计算机科学 2024-10-18 Abhishek Gupta , Amruta Parulekar , Sameep Chattopadhyay , Preethi Jyothi

The kNN-CTC model has proven to be effective for monolingual automatic speech recognition (ASR). However, its direct application to multilingual scenarios like code-switching, presents challenges. Although there is potential for performance…

计算与语言 · 计算机科学 2025-01-20 Jiaming Zhou , Shiwan Zhao , Hui Wang , Tian-Hao Zhang , Haoqin Sun , Xuechen Wang , Yong Qin

State of the art solutions to query by example spoken term detection (QbE-STD) usually rely on bottleneck feature representation of the query and audio document to perform dynamic time warping (DTW) based template matching. Here, we present…

计算与语言 · 计算机科学 2019-07-02 Dhananjay Ram , Lesly Miculicich , Hervé Bourlard

We study training a single acoustic model for multiple languages with the aim of improving automatic speech recognition (ASR) performance on low-resource languages, and over-all simplifying deployment of ASR systems that support diverse…

音频与语音处理 · 电气工程与系统科学 2020-07-09 Vineel Pratap , Anuroop Sriram , Paden Tomasello , Awni Hannun , Vitaliy Liptchinsky , Gabriel Synnaeve , Ronan Collobert

We present improvements in automatic speech recognition (ASR) for Somali, a currently extremely under-resourced language. This forms part of a continuing United Nations (UN) effort to employ ASR-based keyword spotting systems to support…

计算与语言 · 计算机科学 2019-07-09 Astik Biswas , Raghav Menon , Ewald van der Westhuizen , Thomas Niesler

We propose a first step toward multilingual end-to-end automatic speech recognition (ASR) by integrating knowledge about speech articulators. The key idea is to leverage a rich set of fundamental units that can be defined "universally"…

音频与语音处理 · 电气工程与系统科学 2023-09-19 Hao Yen , Sabato Marco Siniscalchi , Chin-Hui Lee

In this work, we propose a new automatic speech recognition (ASR) system based on feature learning and an end-to-end training procedure for air traffic control (ATC) systems. The proposed model integrates the feature learning block,…

声音 · 计算机科学 2021-11-05 Peng Fan , Dongyue Guo , Yi Lin , Bo Yang , Jianwei Zhang

It is challenging to train and deploy Transformer LMs for hybrid speech recognition 2nd pass re-ranking in low-resource languages due to (1) data scarcity in low-resource languages, (2) expensive computing costs for training and refreshing…

计算与语言 · 计算机科学 2022-09-12 Li Miao , Jian Wu , Piyush Behre , Shuangyu Chang , Sarangarajan Parthasarathy

Automatic speech recognition (ASR) has benefited from advances in pretrained speech and language models, yet most systems remain constrained to monolingual settings and short, isolated utterances. While recent efforts in context-aware ASR…

计算与语言 · 计算机科学 2026-03-09 Yuchen Zhang , Haralambos Mouratidis , Ravi Shekhar

Multilingual Automatic Speech Recognition (ASR) models have extended the usability of speech technologies to a wide variety of languages. With how many languages these models have to handle, however, a key to understanding their imbalanced…

计算与语言 · 计算机科学 2023-02-28 William Chen , Brian Yan , Jiatong Shi , Yifan Peng , Soumi Maiti , Shinji Watanabe

Humans are adept at leveraging visual cues from lip movements for recognizing speech in adverse listening conditions. Audio-Visual Speech Recognition (AVSR) models follow similar approach to achieve robust speech recognition in noisy…

音频与语音处理 · 电气工程与系统科学 2024-05-24 Maxime Burchi , Krishna C. Puvvada , Jagadeesh Balam , Boris Ginsburg , Radu Timofte

Building automatic speech recognition (ASR) systems is a challenging task, especially for under-resourced languages that need to construct corpora nearly from scratch and lack sufficient training data. It has emerged that several African…

Modeling code-switched speech is an important problem in automatic speech recognition (ASR). Labeled code-switched data are rare, so monolingual data are often used to model code-switched speech. These monolingual data may be more closely…

计算与语言 · 计算机科学 2021-06-16 Andrew Slottje , Shannon Wotherspoon , William Hartmann , Matthew Snover , Owen Kimball

Speech enhancement improves speech quality and promotes the performance of various downstream tasks. However, most current speech enhancement work was mainly devoted to improving the performance of downstream automatic speech recognition…

声音 · 计算机科学 2022-09-16 Jianrong Wang , Xiaomin Li , Xuewei Li , Mei Yu , Qiang Fang , Li Liu

Acoustic word embedding models map variable duration speech segments to fixed dimensional vectors, enabling efficient speech search and discovery. Previous work explored how embeddings can be obtained in zero-resource settings where no…

计算与语言 · 计算机科学 2021-06-25 Christiaan Jacobs , Herman Kamper

Automatic speech recognition (ASR) systems have been shown to have large quality disparities between the language varieties they are intended or expected to recognize. One way to mitigate this is to train or fine-tune models with more…

In this work, we propose a new parameter-efficient learning framework based on neural model reprogramming for cross-lingual speech recognition, which can \textbf{re-purpose} well-trained English automatic speech recognition (ASR) models to…