English
Related papers

Related papers: Parallel-Data-Free Voice Conversion Using Cycle-Co…

200 papers

In this paper, we propose a model to perform style transfer of speech to singing voice. Contrary to the previous signal processing-based methods, which require high-quality singing templates or phoneme synchronization, we explore a…

Sound · Computer Science 2022-08-29 Shrutina Agarwal , Sriram Ganapathy , Naoya Takahashi

The primary motivation of Image-to-Image Transformation is to convert an image of one domain to another domain. Most of the research has been focused on the task of image transformation for a set of pre-defined domains. Very few works are…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Kishan Babu Kancharagunta , Shiv Ram Dubey

This paper presents an adversarial learning method for recognition-synthesis based non-parallel voice conversion. A recognizer is used to transform acoustic features into linguistic representations while a synthesizer recovers output…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Jing-Xuan Zhang , Zhen-Hua Ling , Li-Rong Dai

Medical image translation is an ill-posed problem. Unlike existing paired unbounded unidirectional translation networks, in this paper, we consider unpaired medical images and provide a strictly bounded network that yields a stable…

Image and Video Processing · Electrical Eng. & Systems 2023-11-07 Swati Rai , Jignesh S. Bhatt , Sarat Kumar Patra

This paper presents AC-VC (Almost Causal Voice Conversion), a phonetic posteriorgrams based voice conversion system that can perform any-to-many voice conversion while having only 57.5 ms future look-ahead. The complete system is composed…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-15 Damien Ronssin , Milos Cernak

Unsupervised domain mapping aims to learn a function to translate domain X to Y by a function GXY in the absence of paired examples. Finding the optimal GXY without paired data is an ill-posed problem, so appropriate constraints are…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Huan Fu , Mingming Gong , Chaohui Wang , Kayhan Batmanghelich , Kun Zhang , Dacheng Tao

We present a method for converting the voices between a set of speakers. Our method is based on training multiple autoencoder paths, where there is a single speaker-independent encoder and multiple speaker-dependent decoders. The…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-13 Orhan Ocal , Oguz H. Elibol , Gokce Keskin , Cory Stephenson , Anil Thomas , Kannan Ramchandran

We study CT image denoising in the unpaired and self-supervised regimes by evaluating two strong, training-data-efficient paradigms: a CycleGAN-based residual translator and a Noise2Score (N2S) score-matching denoiser. Under a common…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Abu Hanif Muhammad Syarubany

Human face synthesis and manipulation are increasingly important in entertainment and AI, with a growing demand for highly realistic, identity-preserving images even when only unpaired, unaligned datasets are available. We study unpaired…

Machine Learning · Computer Science 2026-01-05 Collin Guo , Yi Qian

Zero-shot voice conversion (VC) aims to transform source speech into arbitrary unseen target voice while keeping the linguistic content unchanged. Recent VC methods have made significant progress, but semantic losses in the decoupling…

Sound · Computer Science 2024-06-17 Linhan Ma , Xinfa Zhu , Yuanjun Lv , Zhichao Wang , Ziqian Wang , Wendi He , Hongbin Zhou , Lei Xie

In this paper, we integrate a simple non-parallel voice conversion (VC) system with a WaveNet (WN) vocoder and a proposed collapsed speech suppression technique. The effectiveness of WN as a vocoder for generating high-fidelity speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-08 Yi-Chiao Wu , Patrick Lumban Tobing , Kazuhiro Kobayashi , Tomoki Hayashi , Tomoki Toda

Large-scale synthetic datasets are beneficial to stereo matching but usually introduce known domain bias. Although unsupervised image-to-image translation networks represented by CycleGAN show great potential in dealing with domain gap, it…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Rui Liu , Chengxi Yang , Wenxiu Sun , Xiaogang Wang , Hongsheng Li

Recent techniques built on Generative Adversarial Networks (GANs), such as Cycle-Consistent GANs, are able to learn mappings among different domains built from unpaired datasets, through min-max optimization games between generators and…

Machine Learning · Computer Science 2020-08-18 Haoran You , Yu Cheng , Tianheng Cheng , Chunliang Li , Pan Zhou

Recently, deep learning approaches have been extensively studied for low-dose CT denoising thanks to its superior performance despite the fast computational time. In particular, cycleGAN has been demonstrated as a powerful unsupervised…

Image and Video Processing · Electrical Eng. & Systems 2020-08-14 Jawook Gu , Jong Chul Ye

Zero-shot voice conversion (VC) aims to transfer the timbre from the source speaker to an arbitrary unseen speaker while preserving the original linguistic content. Despite recent advancements in zero-shot VC using language model-based or…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-11 Jixun Yao , Yuguang Yang , Yu Pan , Ziqian Ning , Jiaohao Ye , Hongbin Zhou , Lei Xie

In this work, we propose a zero-shot voice conversion method using speech representations trained with self-supervised learning. First, we develop a multi-task model to decompose a speech utterance into features such as linguistic content,…

Sound · Computer Science 2023-02-17 Shehzeen Hussain , Paarth Neekhara , Jocelyn Huang , Jason Li , Boris Ginsburg

Face photo-sketch synthesis and recognition has many applications in digital entertainment and law enforcement. Recently, generative adversarial networks (GANs) based methods have significantly improved the quality of image synthesis, but…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yuke Fang , Jiani Hu , Weihong Deng

Recent works have demonstrated the superiority of supervised Convolutional Neural Networks (CNNs) in learning hierarchical representations from time series data for successful classification. These methods require sufficiently large labeled…

Machine Learning · Computer Science 2023-09-12 Fanling Huang , Yangdong Deng

As parallel training data is scarce for one-shot voice conversion (VC) tasks, waveform reconstruction is typically performed by various VC systems. A typical one-shot VC system comprises a content encoder and a speaker encoder. However, two…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Songjun Cao , Qinghua Wu , Jie Chen , Jin Li , Long Ma

Voice imitation aims to transform source speech to match a reference speaker's timbre and speaking style while preserving linguistic content. A straightforward approach is to train on triplets of (source, reference, target), where source…

Sound · Computer Science 2026-04-21 Tao Feng , Yuxiang Wang , Yuancheng Wang , Xueyao Zhang , Dekun Chen , Chaoren Wang , Xun Guan , Zhizheng Wu