中文
相关论文

相关论文: Adaptive Data Augmentation with NaturalSpeech3 for…

200 篇论文

Speech synthesis might hold the key to low-resource speech recognition. Data augmentation techniques have become an essential part of modern speech recognition training. Yet, they are simple, naive, and rarely reflect real-world conditions.…

计算与语言 · 计算机科学 2020-12-25 Deblin Bagchi , Shannon Wotherspoon , Zhuolin Jiang , Prasanna Muthukumar

This paper describes speaker verification (SV) systems submitted by the SpeakIn team to the Task 1 and Task 2 of the Far-Field Speaker Verification Challenge 2022 (FFSVC2022). SV tasks of the challenge focus on the problem of fully…

声音 · 计算机科学 2022-09-26 Yu Zheng , Jinghan Peng , Yihao Chen , Yajun Zhang , Jialong Wang , Min Liu , Minqiang Xu

Data augmentation is one of the most effective ways to make end-to-end automatic speech recognition (ASR) perform close to the conventional hybrid approach, especially when dealing with low-resource tasks. Using recent advances in speech…

音频与语音处理 · 电气工程与系统科学 2020-12-21 Aleksandr Laptev , Roman Korostik , Aleksey Svischev , Andrei Andrusenko , Ivan Medennikov , Sergey Rybin

The goal of this work is to train robust speaker recognition models without speaker labels. Recent works on unsupervised speaker representations are based on contrastive learning in which they encourage within-utterance embeddings to be…

声音 · 计算机科学 2020-11-02 Jaesung Huh , Hee Soo Heo , Jingu Kang , Shinji Watanabe , Joon Son Chung

Voice conversion as the style transfer task applied to speech, refers to converting one person's speech into a new speech that sounds like another person's. Up to now, there has been a lot of research devoted to better implementation of VC…

声音 · 计算机科学 2023-08-23 Yimin Deng , Huaizhen Tang , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

We propose autoencoding speaker conversion for training data augmentation in automatic speech translation. This technique directly transforms an audio sequence, resulting in audio synthesized to resemble another speaker's voice. Our method…

音频与语音处理 · 电气工程与系统科学 2020-02-28 Arya D. McCarthy , Liezl Puzon , Juan Pino

Automatic recognition of dysarthric speech remains a highly challenging task to date. Neuro-motor conditions and co-occurring physical disabilities create difficulty in large-scale data collection for ASR system development. Adapting SSL…

声音 · 计算机科学 2024-01-02 Huimeng Wang , Zengrui Jin , Mengzhe Geng , Shujie Hu , Guinan Li , Tianzi Wang , Haoning Xu , Xunying Liu

Automatic speaker verification (ASV) systems use a playback detector to filter out playback attacks and ensure verification reliability. Since current playback detection models are almost always trained using genuine and played-back speech,…

声音 · 计算机科学 2018-09-14 Fuming Fang , Junichi Yamagishi , Isao Echizen , Md Sahidullah , Tomi Kinnunen

Recent success of the Tacotron speech synthesis architecture and its variants in producing natural sounding multi-speaker synthesized speech has raised the exciting possibility of replacing expensive, manually transcribed, domain-specific,…

计算与语言 · 计算机科学 2019-09-27 Andrew Rosenberg , Yu Zhang , Bhuvana Ramabhadran , Ye Jia , Pedro Moreno , Yonghui Wu , Zelin Wu

We investigated an enhancement and a domain adaptation approach to make speaker verification systems robust to perturbations of far-field speech. In the enhancement approach, using paired (parallel) reverberant-clean speech, we trained a…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Phani Sankar Nidadavolu , Saurabh Kataria , Paola García-Perera , Jesús Villalba , Najim Dehak

With excellent generalization ability, self-supervised speech models have shown impressive performance on various downstream speech tasks in the pre-training and fine-tuning paradigm. However, as the growing size of pre-trained models,…

音频与语音处理 · 电气工程与系统科学 2024-03-04 Mufan Sang , John H. L. Hansen

Cross-domain speech enhancement (SE) is often faced with severe challenges due to the scarcity of noise and background information in an unseen target domain, leading to a mismatch between training and test conditions. This study puts…

声音 · 计算机科学 2024-09-04 Chien-Chun Wang , Li-Wei Chen , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

Data augmentation (DA) has gained widespread popularity in deep speaker models due to its ease of implementation and significant effectiveness. It enriches training data by simulating real-life acoustic variations, enabling deep neural…

声音 · 计算机科学 2024-02-07 Zhenyu Zhou , Junhui Chen , Namin Wang , Lantian Li , Dong Wang

In this paper we investigate the use of adversarial domain adaptation for addressing the problem of language mismatch between speaker recognition corpora. In the context of speaker verification, adversarial domain adaptation methods aim at…

音频与语音处理 · 电气工程与系统科学 2018-11-07 Johan Rohdin , Themos Stafylakis , Anna Silnova , Hossein Zeinali , Lukas Burget , Oldrich Plchot

Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of…

音频与语音处理 · 电气工程与系统科学 2022-03-18 Mengzhe Geng , Xurong Xie , Zi Ye , Tianzi Wang , Guinan Li , Shujie Hu , Xunying Liu , Helen Meng

Most of the current speech data augmentation methods operate on either the raw waveform or the amplitude spectrum of speech. In this paper, we propose a novel speech data augmentation method called PhasePerturbation that operates…

声音 · 计算机科学 2023-12-15 Chengxi Lei , Satwinder Singh , Feng Hou , Xiaoyun Jia , Ruili Wang

Automatic speech recognition (ASR) needs to be robust to speaker differences. Voice Conversion (VC) modifies speaker characteristics of input speech. This is an attractive feature for ASR data augmentation. In this paper, we demonstrate…

Automatic Speech Recognition (ASR) systems suffer considerably when source speech is corrupted with noise or room impulse responses (RIR). Typically, speech enhancement is applied in both mismatched and matched scenario training and…

音频与语音处理 · 电气工程与系统科学 2022-04-26 Shashi Kumar , Shakti P. Rath , Abhishek Pandey

Speech-based virtual assistants, such as Amazon Alexa, Google assistant, and Apple Siri, typically convert users' audio signals to text data through automatic speech recognition (ASR) and feed the text to downstream dialog models for…

计算与语言 · 计算机科学 2020-06-11 Longshaokan Wang , Maryam Fazel-Zarandi , Aditya Tiwari , Spyros Matsoukas , Lazaros Polymenakos

Data augmentation is commonly used to help build a robust speaker verification system, especially in limited-resource case. However, conventional data augmentation methods usually focus on the diversity of acoustic environment, leaving the…

声音 · 计算机科学 2021-02-22 Houjun Huang , Xu Xiang , Fei Zhao , Shuai Wang , Yanmin Qian