中文
相关论文

相关论文: Disentanglement in a GAN for Unconditional Speech …

200 篇论文

The impressive success of style-based GANs (StyleGANs) in high-fidelity image synthesis has motivated research to understand the semantic properties of their latent spaces. In this paper, we approach this problem through a geometric…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Jaewoong Choi , Geonho Hwang , Hyunsoo Cho , Myungjoo Kang

Generative adversarial models (GANs) continue to produce advances in terms of the visual quality of still images, as well as the learning of temporal correlations. However, few works manage to combine these two interesting capabilities for…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Gereon Fox , Ayush Tewari , Mohamed Elgharib , Christian Theobalt

Disentangled generative models map a latent code vector to a target space, while enforcing that a subset of the learned latent codes are interpretable and associated with distinct properties of the target distribution. Recent advances have…

机器学习 · 计算机科学 2020-08-10 Zinan Lin , Kiran Koshy Thekumparampil , Giulia Fanti , Sewoong Oh

We explore different design choices for injecting noise into generative adversarial networks (GANs) with the goal of disentangling the latent space. Instead of traditional approaches, we propose feeding multiple noise codes through separate…

计算机视觉与模式识别 · 计算机科学 2020-05-06 Yazeed Alharbi , Peter Wonka

Recent advancement in Generative Adversarial Networks in speech synthesis domain[3],[2] have shown, that it's possible to train GANs [8] in a reliable manner for high quality coherent waveform generation from mel-spectograms. We propose…

音频与语音处理 · 电气工程与系统科学 2020-06-16 Luka Chkhetiani , Levan Bejanidze

Speech synthesis is used in a wide variety of industries. Nonetheless, it always sounds flat or robotic. The state of the art methods that allow for prosody control are very cumbersome to use and do not allow easy tuning. To tackle some of…

声音 · 计算机科学 2021-10-08 Enrique Hortal , Rodrigo Brechard Alarcia

We propose Parallel WaveGAN, a distillation-free, fast, and small-footprint waveform generation method using a generative adversarial network. In the proposed method, a non-autoregressive WaveNet is trained by jointly optimizing…

音频与语音处理 · 电气工程与系统科学 2020-02-07 Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Generative adversarial networks have seen rapid development in recent years and have led to remarkable improvements in generative modelling of images. However, their application in the audio domain has received limited attention, and…

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel-wise style…

计算机视觉与模式识别 · 计算机科学 2020-12-04 Zongze Wu , Dani Lischinski , Eli Shechtman

Advanced Generative Adversarial Networks (GANs) are remarkable in generating intelligible audio from a random latent vector. In this paper, we examine the task of recovering the latent vector of both synthesized and real audio. Previous…

声音 · 计算机科学 2020-10-19 Andrew Keyes , Nicky Bayat , Vahid Reza Khazaie , Yalda Mohsenzadeh

Many existing conditional Generative Adversarial Networks (cGANs) are limited to conditioning on pre-defined and fixed class-level semantic labels or attributes. We propose an open set GAN architecture (OpenGAN) that is conditioned…

计算机视觉与模式识别 · 计算机科学 2020-03-19 Luke Ditria , Benjamin J. Meyer , Tom Drummond

Spatial target speaker extraction isolates a desired speaker's voice in multi-speaker environments using spatial information, such as the direction of arrival (DoA). Although recent deep neural network (DNN)-based discriminative methods…

音频与语音处理 · 电气工程与系统科学 2025-09-23 Shrishti Saha Shetu , Emanuël A. P. Habets , Andreas Brendel

We present an approach for unsupervised learning of speech representation disentangling contents and styles. Our model consists of: (1) a local encoder that captures per-frame information; (2) a global encoder that captures per-utterance…

计算与语言 · 计算机科学 2021-06-22 Andros Tjandra , Ruoming Pang , Yu Zhang , Shigeki Karita

In this paper, we propose a data privacy-preserving and communication efficient distributed GAN learning framework named Distributed Asynchronized Discriminator GAN (AsynDGAN). Our proposed framework aims to train a central generator learns…

图像与视频处理 · 电气工程与系统科学 2020-06-16 Qi Chang , Hui Qu , Yikai Zhang , Mert Sabuncu , Chao Chen , Tong Zhang , Dimitris Metaxas

Human motion synthesis conditioned on textual input has gained significant attention in recent years due to its potential applications in various domains such as gaming, film production, and virtual reality. Conditioned Motion synthesis…

计算机视觉与模式识别 · 计算机科学 2025-01-06 Avinash Amballa , Gayathri Akkinapalli , Vinitra Muralikrishnan

Improving speech system performance in noisy environments remains a challenging task, and speech enhancement (SE) is one of the effective techniques to solve the problem. Motivated by the promising results of generative adversarial networks…

音频与语音处理 · 电气工程与系统科学 2019-11-05 Daniel Michelsanti , Zheng-Hua Tan

Generative models have thrived in computer vision, enabling unprecedented image processes. Yet the results in audio remain less advanced. Our project targets real-time sound synthesis from a reduced set of high-level parameters, including…

声音 · 计算机科学 2019-06-25 Adrien Bitton , Philippe Esling , Antoine Caillon , Martin Fouilleul

Unsupervised foreground-background segmentation aims at extracting salient objects from cluttered backgrounds, where Generative Adversarial Network (GAN) approaches, especially layered GANs, show great promise. However, without human…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Qiran Zou , Yu Yang , Wing Yin Cheung , Chang Liu , Xiangyang Ji

In this work we present an adversarial training algorithm that exploits correlations in video to learn --without supervision-- an image generator model with a disentangled latent space. The proposed methodology requires only a few…

计算机视觉与模式识别 · 计算机科学 2019-10-25 Facundo Tuesca , Lucas C. Uzal

We propose using self-supervised discrete representations for the task of speech resynthesis. To generate disentangled representation, we separately extract low-bitrate representations for speech content, prosodic information, and speaker…