English
Related papers

Related papers: Boosting Star-GANs for Voice Conversion with Contr…

200 papers

Recent work has shown that it is feasible to use generative adversarial networks (GANs) for speech enhancement, however, these approaches have not been compared to state-of-the-art (SOTA) non GAN-based approaches. Additionally, many loss…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-29 Zhuohuang Zhang , Chengyun Deng , Yi Shen , Donald S. Williamson , Yongtao Sha , Yi Zhang , Hui Song , Xiangang Li

Training a model to perform a task typically requires a large amount of data from the domains in which the task will be applied. However, it is often the case that data are abundant in some domains but scarce in others. Domain adaptation…

Machine Learning · Computer Science 2019-01-25 Ehsan Hosseini-Asl , Yingbo Zhou , Caiming Xiong , Richard Socher

Previously, we introduced VoiceGrad, a nonparallel voice conversion (VC) technique enabling mel-spectrogram conversion from source to target speakers using a score-based diffusion model. The concept involves training a score network to…

Sound · Computer Science 2025-09-11 Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Yuto Kondo

Transformer models have recently attracted much interest from computer vision researchers and have since been successfully employed for several problems traditionally addressed with convolutional neural networks. At the same time, image…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Ricard Durall , Stanislav Frolov , Jörn Hees , Federico Raue , Franz-Josef Pfreundt , Andreas Dengel , Janis Keupe

Singing technique conversion (STC) refers to the task of converting from one voice technique to another while leaving the original singer identity, melody, and linguistic components intact. Previous STC studies, as well as singing voice…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-22 Tung-Cheng Su , Yung-Chuan Chang , Yi-Wen Liu

Smartphone-based indoor localization has emerged as a cost-effective and accurate solution to localize mobile and IoT devices indoors. However, the challenges of device heterogeneity and temporal variations have hindered its widespread…

Machine Learning · Computer Science 2023-12-19 Danish Gufran , Saideep Tiku , Sudeep Pasricha

In this paper, we aim at solving the multi-domain image-to-image translation problem with a unified model in an unsupervised manner. The most successful work in this area refers to StarGAN, which works well in tasks like face attribute…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Xiao Liu , Shengchuan Zhang , Hong Liu , Xin Liu , Cheng Deng , Rongrong Ji

This paper presents a novel Dialect Identification (DID) system developed for the Fifth Edition of the Multi-Genre Broadcast challenge, the task of Fine-grained Arabic Dialect Identification (MGB-5 ADI Challenge). The system improves upon…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-20 Xiaoxiao Miao , Ian McLoughlin

We propose a distributed approach to train deep convolutional generative adversarial neural network (DC-CGANs) models. Our method reduces the imbalance between generator and discriminator by partitioning the training data according to data…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Massimiliano Lupo Pasini , Vittorio Gabbi , Junqi Yin , Simona Perotto , Nouamane Laanait

Despite the remarkable advances in deep learning technology, achieving satisfactory performance in lung sound classification remains a challenge due to the scarcity of available data. Moreover, the respiratory sound samples are collected…

Sound · Computer Science 2023-12-18 June-Woo Kim , Sangmin Bae , Won-Yang Cho , Byungjo Lee , Ho-Young Jung

Generative Adversarial Networks (GAN) have been employed for face super resolution but they bring distorted facial details easily and still have weakness on recovering realistic texture. To further improve the performance of GAN based…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Hao Dou , Chen Chen , Xiyuan Hu , Zuxing Xuan , Zhisen Hu , Silong Peng

Traditional voice conversion (VC) methods typically attempt to separate speaker identity and linguistic information into distinct representations, which are then combined to reconstruct the audio. However, effectively disentangling these…

Sound · Computer Science 2025-10-13 Huu Tuong Tu , Huan Vu , cuong tien nguyen , Dien Hy Ngo , Nguyen Thi Thu Trang

This paper introduces FastVC, an end-to-end model for fast Voice Conversion (VC). The proposed model can convert speech of arbitrary length from multiple source speakers to multiple target speakers. FastVC is based on a conditional…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-07 Oriol Barbany Mayor , Milos Cernak

Non-parallel voice conversion (VC) is a technique for learning mappings between source and target speeches without using a parallel corpus. Recently, cycle-consistent adversarial network (CycleGAN)-VC and CycleGAN-VC2 have shown promising…

Sound · Computer Science 2020-10-23 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka , Nobukatsu Hojo

In this paper, we investigate several existing and a new state-of-the-art generative adversarial network-based (GAN) voice conversion method for enhancing dysarthric speech for improved dysarthric speech recognition. We compare key…

Sound · Computer Science 2022-01-14 Luke Prananta , Bence Mark Halpern , Siyuan Feng , Odette Scharenborg

Integrated sensing and communication (ISAC) technology has been explored as a potential advancement for future wireless networks, striving to effectively use spectral resources for both communication and sensing. The integration of…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Alice Faisal , Ibrahim Al-Nahhal , Kyesan Lee , Octavia A. Dobre , Hyundong Shin

We propose noise-robust voice conversion (VC) which takes into account the recording quality and environment of noisy source speech. Conventional denoising training improves the noise robustness of a VC model by learning noisy-to-clean VC…

The goal of this work is to train robust speaker recognition models without speaker labels. Recent works on unsupervised speaker representations are based on contrastive learning in which they encourage within-utterance embeddings to be…

Sound · Computer Science 2020-11-02 Jaesung Huh , Hee Soo Heo , Jingu Kang , Shinji Watanabe , Joon Son Chung

Singing voice synthesis (SVS) is the computer production of a human-like singing voice from given musical scores. To accomplish end-to-end SVS effectively and efficiently, this work adopts the acoustic model-neural vocoder architecture…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-22 Yin-Ping Cho , Yu Tsao , Hsin-Min Wang , Yi-Wen Liu

A method for statistical parametric speech synthesis incorporating generative adversarial networks (GANs) is proposed. Although powerful deep neural networks (DNNs) techniques can be applied to artificially synthesize speech waveform, the…

Sound · Computer Science 2017-09-26 Yuki Saito , Shinnosuke Takamichi , Hiroshi Saruwatari