中文
相关论文

相关论文: Layer-wise Fast Adaptation for End-to-End Multi-Ac…

200 篇论文

Bootstrapping speech recognition on limited data resources has been an area of active research for long. The recent transition to all-neural models and end-to-end (E2E) training brought along particular challenges as these models are known…

音频与语音处理 · 电气工程与系统科学 2021-06-21 Manuel Giollo , Deniz Gunceler , Yulan Liu , Daniel Willett

Self-supervised learning (SSL) methods which learn representations of data without explicit supervision have gained popularity in speech-processing tasks, particularly for single-talker applications. However, these models often have…

音频与语音处理 · 电气工程与系统科学 2022-11-02 Zili Huang , Desh Raj , Paola García , Sanjeev Khudanpur

Speech recognition models often obtain degraded performance when tested on speech with unseen accents. Domain-adversarial training (DAT) and multi-task learning (MTL) are two common approaches for building accent-robust ASR models. ASR…

音频与语音处理 · 电气工程与系统科学 2021-10-11 Jialu Li , Vimal Manohar , Pooja Chitkara , Andros Tjandra , Michael Picheny , Frank Zhang , Xiaohui Zhang , Yatharth Saraf

With rapid globalization, the need to build inclusive and representative speech technology cannot be overstated. Accent is an important aspect of speech that needs to be taken into consideration while building inclusive speech synthesizers.…

音频与语音处理 · 电气工程与系统科学 2024-10-01 Jan Melechovsky , Ambuj Mehrish , Berrak Sisman , Dorien Herremans

Code-switching (CS) automatic speech recognition (ASR) faces challenges due to the language confusion resulting from accents, auditory similarity, and seamless language switches. Adaptation on the pre-trained multi-lingual model has shown…

计算与语言 · 计算机科学 2025-01-07 Jiahui Zhao , Hao Shi , Chenrui Cui , Tianrui Wang , Hexin Liu , Zhaoheng Ni , Lingxuan Ye , Longbiao Wang

End-to-end (E2E) speech recognition architectures assemble all components of traditional speech recognition system into a single model. Although it simplifies ASR system, it introduces contextual ASR drawback: the E2E model has worse…

计算与语言 · 计算机科学 2022-02-21 Zhengyi Zhang , Pan Zhou

Automatic Speech Recognition(ASR) has been dominated by deep learning-based end-to-end speech recognition models. These approaches require large amounts of labeled data in the form of audio-text pairs. Moreover, these models are more…

音频与语音处理 · 电气工程与系统科学 2022-06-28 Raviraj Joshi , Anupam Singh

Training a conventional automatic speech recognition (ASR) system to support multiple languages is challenging because the sub-word unit, lexicon and word inventories are typically language specific. In contrast, sequence-to-sequence models…

音频与语音处理 · 电气工程与系统科学 2018-02-16 Shubham Toshniwal , Tara N. Sainath , Ron J. Weiss , Bo Li , Pedro Moreno , Eugene Weinstein , Kanishka Rao

Quantifying the confidence (or conversely the uncertainty) of a prediction is a highly desirable trait of an automatic system, as it improves the robustness and usefulness in downstream tasks. In this paper we investigate confidence…

音频与语音处理 · 电气工程与系统科学 2021-01-15 Dan Oneata , Alexandru Caranica , Adriana Stan , Horia Cucu

We present a structured overview of adaptation algorithms for neural network-based speech recognition, considering both hybrid hidden Markov model / neural network systems and end-to-end neural network systems, with a focus on speaker…

音频与语音处理 · 电气工程与系统科学 2021-03-02 Peter Bell , Joachim Fainberg , Ondrej Klejch , Jinyu Li , Steve Renals , Pawel Swietojanski

We propose a self-speaker adaptation method for streaming multi-talker automatic speech recognition (ASR) that eliminates the need for explicit speaker queries. Unlike conventional approaches requiring target speaker embeddings or…

音频与语音处理 · 电气工程与系统科学 2025-09-03 Weiqing Wang , Taejin Park , Ivan Medennikov , Jinhan Wang , Kunal Dhawan , He Huang , Nithin Rao Koluguri , Jagadeesh Balam , Boris Ginsburg

With increasingly more powerful compute capabilities and resources in today's devices, traditionally compute-intensive automatic speech recognition (ASR) has been moving from the cloud to devices to better protect user privacy. However, it…

Conversational automatic speech recognition (ASR) is a task to recognize conversational speech including multiple speakers. Unlike sentence-level ASR, conversational ASR can naturally take advantages from specific characteristics of…

声音 · 计算机科学 2022-02-18 Kun Wei , Yike Zhang , Sining Sun , Lei Xie , Long Ma

Code-switching-where multilingual speakers alternately switch between languages during conversations-still poses significant challenges to end-to-end (E2E) automatic speech recognition (ASR) systems due to phenomena of both acoustic and…

音频与语音处理 · 电气工程与系统科学 2024-12-13 Tzu-Ting Yang , Hsin-Wei Wang , Yi-Cheng Wang , Berlin Chen

Despite the success of deep learning in speech recognition, multi-dialect speech recognition remains a difficult problem. Although dialect-specific acoustic models are known to perform well in general, they are not easy to maintain when…

机器学习 · 计算机科学 2022-05-09 Sanghyun Yoo , Inchul Song , Yoshua Bengio

Despite the significant progress in end-to-end (E2E) automatic speech recognition (ASR), E2E ASR for low resourced code-switching (CS) speech has not been well studied. In this work, we describe an E2E ASR pipeline for the recognition of CS…

计算与语言 · 计算机科学 2019-10-01 Xianghu Yue , Grandee Lee , Emre Yılmaz , Fang Deng , Haizhou Li

End-to-end speech recognition models are improved by incorporating external text sources, typically by fusion with an external language model. Such language models have to be retrained whenever the corpus of interest changes. Furthermore,…

计算与语言 · 计算机科学 2023-03-21 Bolaji Yusuf , Aditya Gourav , Ankur Gandhe , Ivan Bulyko

Training a code-switching end-to-end automatic speech recognition (ASR) model normally requires a large amount of data, while code-switching data is often limited. In this paper, three novel approaches are proposed for code-switching data…

计算与语言 · 计算机科学 2024-11-05 Chenpeng Du , Hao Li , Yizhou Lu , Lan Wang , Yanmin Qian

ASR Error Detection (AED) models aim to post-process the output of Automatic Speech Recognition (ASR) systems, in order to detect transcription errors. Modern approaches usually use text-based input, comprised solely of the ASR…

计算与语言 · 计算机科学 2022-10-27 Zorik Gekhman , Dina Zverinski , Jonathan Mallinson , Genady Beryozkin

Low resource automatic speech recognition (ASR) is a useful but thorny task, since deep learning ASR models usually need huge amounts of training data. The existing models mostly established a bottleneck (BN) layer by pre-training on a…

计算与语言 · 计算机科学 2022-05-31 Jian Luo , Jianzong Wang , Ning Cheng , Zhenpeng Zheng , Jing Xiao