中文
相关论文

相关论文: Towards Low-Resource StarGAN Voice Conversion usin…

200 篇论文

While recent neural text-to-speech (TTS) systems perform remarkably well, they typically require a substantial amount of recordings from the target speaker reading in the desired speaking style. In this work, we present a novel 3-step…

音频与语音处理 · 电气工程与系统科学 2021-06-03 Goeric Huybrechts , Thomas Merritt , Giulia Comini , Bartek Perz , Raahil Shah , Jaime Lorenzo-Trueba

Many existing works on voice conversion (VC) tasks use automatic speech recognition (ASR) models for ensuring linguistic consistency between source and converted samples. However, for the low-data resource domains, training a high-quality…

声音 · 计算机科学 2023-05-25 Mayank Kumar Singh , Naoya Takahashi , Onoe Naoyuki

We propose a new framework to improve automatic speech recognition (ASR) systems in resource-scarce environments using a generative adversarial network (GAN) operating on acoustic input features. The GAN is used to enhance the features of…

声音 · 计算机科学 2022-10-07 Walter Heymans , Marelie H. Davel , Charl van Heerden

Speaker adaptive training (SAT) of neural network acoustic models learns models in a way that makes them more suitable for adaptation to test conditions. Conventionally, model-based speaker adaptive training is performed by having a set of…

计算与语言 · 计算机科学 2019-10-24 Ondřej Klejch , Joachim Fainberg , Peter Bell , Steve Renals

This work presents a novel framework based on feed-forward neural network for text-independent speaker classification and verification, two related systems of speaker recognition. With optimized features and model training, it achieves 100%…

声音 · 计算机科学 2017-03-20 Zhenhao Ge , Ananth N. Iyer , Srinath Cheluvaraja , Ram Sundaram , Aravind Ganapathiraju

In general, the performance of automatic speech recognition (ASR) systems is significantly degraded due to the mismatch between training and test environments. Recently, a deep-learning-based image-to-image translation technique to…

音频与语音处理 · 电气工程与系统科学 2019-04-15 Jong-Hyeon Park , Myungwoo Oh , Hyung-Min Park

Whisper to normal speech conversion is an active area of research. Various architectures based on generative adversarial networks have been proposed in the recent past. Especially, recent study shows that MaskCycleGAN, which is a mask…

音频与语音处理 · 电气工程与系统科学 2024-08-28 K. Rohith Gupta , K. Ramnath , S. Johanan Joysingh , P. Vijayalakshmi , T. Nagarajan

Current state-of-the-art automatic speech recognition systems are trained to work in specific `domains', defined based on factors like application, sampling rate and codec. When such recognizers are used in conditions that do not match the…

Voice recognition and speaker identification are vital for applications in security and personal assistants. This paper presents a lightweight 1D-Convolutional Neural Network (1D-CNN) designed to perform speaker identification on minimal…

声音 · 计算机科学 2024-11-25 Irfan Nafiz Shahan , Pulok Ahmed Auvi

Voice conversion (VC) transforms an utterance to sound like another person without changing the linguistic content. A recently proposed generative adversarial network-based VC method, StarGANv2-VC is very successful in generating…

音频与语音处理 · 电气工程与系统科学 2023-09-15 Arnab Das , Suhita Ghosh , Tim Polzehl , Sebastian Stober

A key task for speech recognition systems is to reduce the mismatch between training and evaluation data that is often attributable to speaker differences. Speaker adaptation techniques play a vital role to reduce the mismatch. Model-based…

声音 · 计算机科学 2024-06-17 Xurong Xie , Xunying Liu , Tan Lee , Lan Wang

By representing speaker characteristic as a single fixed-length vector extracted solely from speech, we can train a neural multi-speaker speech synthesis model by conditioning the model on those vectors. This model can also be adapted to…

音频与语音处理 · 电气工程与系统科学 2019-10-09 Hieu-Thi Luong , Junichi Yamagishi

We propose a method for zero-resource domain adaptation of DNN acoustic models, for use in low-resource situations where the only in-language training data available may be poorly matched to the intended target domain. Our method uses a…

音频与语音处理 · 电气工程与系统科学 2019-10-31 Alberto Abad , Peter Bell , Andrea Carmantini , Steve Renals

This paper proposes an interesting voice and accent joint conversion approach, which can convert an arbitrary source speaker's voice to a target speaker with non-native accent. This problem is challenging as each target speaker only has…

声音 · 计算机科学 2020-11-18 Zhichao Wang , Wenshuo Ge , Xiong Wang , Shan Yang , Wendong Gan , Haitao Chen , Hai Li , Lei Xie , Xiulin Li

For deep learning-based speech enhancement (SE) systems, the training-test acoustic mismatch can cause notable performance degradation. To address the mismatch issue, numerous noise adaptation strategies have been derived. In this paper, we…

音频与语音处理 · 电气工程与系统科学 2022-06-22 Chi-Chang Lee , Cheng-Hung Hu , Yu-Chen Lin , Chu-Song Chen , Hsin-Min Wang , Yu Tsao

We propose a novel architecture and improved training objectives for non-parallel voice conversion. Our proposed CycleGAN-based model performs a shape-preserving transformation directly on a high frequency-resolution magnitude spectrogram,…

音频与语音处理 · 电气工程与系统科学 2021-08-25 Jaeseong You , Gyuhyeon Nam , Dalhyun Kim , Gyeongsu Chae

Speech enhancement is an essential task of improving speech quality in noise scenario. Several state-of-the-art approaches have introduced visual information for speech enhancement,since the visual aspect of speech is essentially unaffected…

音频与语音处理 · 电气工程与系统科学 2022-04-21 Xinmeng Xu , Yang Wang , Dongxiang Xu , Yiyuan Peng , Cong Zhang , Jie Jia , Binbin Chen

Unsupervised image-to-image translation has gained considerable attention due to the recent impressive progress based on generative adversarial networks (GANs). However, previous methods often fail in challenging cases, in particular, when…

机器学习 · 计算机科学 2019-01-03 Sangwoo Mo , Minsu Cho , Jinwoo Shin

This paper investigates the effectiveness of factorial speech processing models in noise-robust automatic speech recognition tasks. For this purpose, the paper proposes an idealistic approach for modeling state-conditional observation…

机器学习 · 计算机科学 2016-10-06 Mahdi Khademian , Mohammad Mehdi Homayounpour

This work adapts two recent architectures of generative models and evaluates their effectiveness for the conversion of whispered speech to normal speech. We incorporate the normal target speech into the training criterion of…