English
Related papers

Related papers: High-quality nonparallel voice conversion based on…

200 papers

In this paper, we integrate a simple non-parallel voice conversion (VC) system with a WaveNet (WN) vocoder and a proposed collapsed speech suppression technique. The effectiveness of WN as a vocoder for generating high-fidelity speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-08 Yi-Chiao Wu , Patrick Lumban Tobing , Kazuhiro Kobayashi , Tomoki Hayashi , Tomoki Toda

CycleGAN provides a framework to train image-to-image translation with unpaired datasets using cycle consistency loss [4]. While results are great in many applications, the pixel level cycle consistency can potentially be problematic and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Tongzhou Wang , Yihan Lin

The rise of automation and machine learning (ML) in electron microscopy has the potential to revolutionize materials research through autonomous data collection and processing. A significant challenge lies in developing ML models that…

Materials Science · Physics 2023-05-31 Abid Khan , Chia-Hao Lee , Pinshane Y. Huang , Bryan K. Clark

Current methods for image-to-image translation produce compelling results, however, the applied transformation is difficult to control, since existing mechanisms are often limited and non-intuitive. We propose ParGAN, a generalization of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Diego Martin Arroyo , Alessio Tonioni , Federico Tombari

This paper proposes SEFGAN, a Deep Neural Network (DNN) combining maximum likelihood training and Generative Adversarial Networks (GANs) for efficient speech enhancement (SE). For this, a DNN is trained to synthesize the enhanced speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-05 Martin Strauss , Nicola Pia , Nagashree K. S. Rao , Bernd Edler

This paper proposes voicing-aware conditional discriminators for Parallel WaveGAN-based waveform synthesis systems. In this framework, we adopt a projection-based conditioning method that can significantly improve the discriminator's…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Ryuichi Yamamoto , Eunwoo Song , Min-Jae Hwang , Jae-Min Kim

While generative adversarial networks (GANs) based neural text-to-speech (TTS) systems have shown significant improvement in neural speech synthesis, there is no TTS system to learn to synthesize speech from text sequences with only…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-15 Sang-Hoon Lee , Hyun-Wook Yoon , Hyeong-Rae Noh , Ji-Hoon Kim , Seong-Whan Lee

Generative adversarial networks (GANs) are capable of producing high quality image samples. However, unlike variational autoencoders (VAEs), GANs lack encoders that provide the inverse mapping for the generators, i.e., encode images back to…

Machine Learning · Statistics 2018-12-20 Paul K. Rubenstein , Yunpeng Li , Dominik Roblek

While pre-trained automatic speech recognition (ASR) systems demonstrate impressive performance on matched domains, their performance often degrades when confronted with channel mismatch stemming from unseen recording environments and…

Sound · Computer Science 2025-01-09 Chien-Chun Wang , Li-Wei Chen , Cheng-Kang Chou , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

Non-parallel many-to-many voice conversion, as well as zero-shot voice conversion, remain under-explored areas. Deep style transfer algorithms, such as generative adversarial networks (GAN) and conditional variational autoencoder (CVAE),…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-07 Kaizhi Qian , Yang Zhang , Shiyu Chang , Xuesong Yang , Mark Hasegawa-Johnson

Visual and audio modalities are two symbiotic modalities underlying videos, which contain both common and complementary information. If they can be mined and fused sufficiently, performances of related video tasks can be significantly…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Wangli Hao , Zhaoxiang Zhang , He Guan

We present a deep neural network based singing voice synthesizer, inspired by the Deep Convolutions Generative Adversarial Networks (DCGAN) architecture and optimized using the Wasserstein-GAN algorithm. We use vocoder parameters for…

Sound · Computer Science 2020-02-13 Pritish Chandna , Merlijn Blaauw , Jordi Bonada , Emilia Gomez

We propose a novel method that combines CycleGAN and inter-domain losses for semi-supervised end-to-end automatic speech recognition. Inter-domain loss targets the extraction of an intermediate shared representation of speech and text…

Computation and Language · Computer Science 2022-10-24 Chia-Yu Li , Ngoc Thang Vu

Recently, the effectiveness of text-to-speech (TTS) systems combined with neural vocoders to generate high-fidelity speech has been shown. However, collecting the required training data and building these advanced systems from scratch are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Yi-Chiao Wu , Patrick Lumban Tobing , Kazuki Yasuhara , Noriyuki Matsunaga , Yamato Ohtani , Tomoki Toda

Building cross-lingual voice conversion (VC) systems for multiple speakers and multiple languages has been a challenging task for a long time. This paper describes a parallel non-autoregressive network to achieve bilingual and code-switched…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-23 Yaogen Yang , Haozhe Zhang , Xiaoyi Qin , Shanshan Liang , Huahua Cui , Mingyang Xu , Ming Li

Current speech enhancement techniques operate on the spectral domain and/or exploit some higher-level feature. The majority of them tackle a limited number of noise conditions and rely on first-order statistics. To circumvent these issues,…

Machine Learning · Computer Science 2017-06-12 Santiago Pascual , Antonio Bonafonte , Joan Serrà

We propose a method to translate cartoon images to real world images using Generative Aderserial Network (GAN). Existing GAN-based image-to-image translation methods which are trained on paired datasets are impractical as the data is…

Computer Vision and Pattern Recognition · Computer Science 2019-03-25 K M Arefeen Sultan , Labiba Kanij Rupty , Nahidul Islam Pranto , Sayed Khan Shuvo , Mohammad Imrul Jubair

In this paper, we compare different audio signal representations, including the raw audio waveform and a variety of time-frequency representations, for the task of audio synthesis with Generative Adversarial Networks (GANs). We conduct the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 Javier Nistal , Stefan Lattner , Gaël Richard

Generative Adversarial Networks (GAN) is a model for data synthesis, which creates plausible data through the competition of generator and discriminator. Although GAN application to image synthesis is extensively studied, it has inherent…

Computation and Language · Computer Science 2025-01-07 Jun-Min Lee , Tae-Bin Ha

In this paper, we investigate algorithms for anomaly detection. Previous anomaly detection methods focus on modeling the distribution of non-anomalous data provided during training. However, this does not necessarily ensure the correct…

Machine Learning · Computer Science 2020-05-29 Ziyi Yang , Iman Soltani Bozchalooi , Eric Darve