English
Related papers

Related papers: Variational Conditional GAN for Fine-grained Contr…

200 papers

Conditional sequence generation aims to instruct the generation procedure by conditioning the model with additional context information, which is a self-supervised learning issue (a form of unsupervised learning with supervision information…

Artificial Intelligence · Computer Science 2020-09-21 Yi Yu , Abhishek Srivastava , Rajiv Ratn Shah

Generative Adversarial Networks (GANs) have recently demonstrated to successfully approximate complex data distributions. A relevant extension of this model is conditional GANs (cGANs), where the introduction of external information allows…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Guim Perarnau , Joost van de Weijer , Bogdan Raducanu , Jose M. Álvarez

Generative Adversarial Networks (GANs) are powerful models able to synthesize data samples closely resembling the distribution of real data, yet the diversity of those generated samples is limited due to the so-called mode collapse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jan Dubiński , Kamil Deja , Sandro Wenzel , Przemysław Rokita , Tomasz Trzciński

In this paper, we propose a novel generative model named Stacked Generative Adversarial Networks (SGAN), which is trained to invert the hierarchical representations of a bottom-up discriminative network. Our model consists of a top-down…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Xun Huang , Yixuan Li , Omid Poursaeed , John Hopcroft , Serge Belongie

Conditional image generation is effective for diverse tasks including training data synthesis for learning-based computer vision. However, despite the recent advances in generative adversarial networks (GANs), it is still a challenging task…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yutaro Miyauchi , Yusuke Sugano , Yasuyuki Matsushita

Category text generation receives considerable attentions since it is beneficial for various natural language processing tasks. Recently, the generative adversarial network (GAN) has attained promising performance in text generation,…

Computation and Language · Computer Science 2023-08-03 Xinze Li , Kezhi Mao , Fanfan Lin , Zijian Feng

Generative adversarial networks are the state of the art approach towards learned synthetic image generation. Although early successes were mostly unsupervised, bit by bit, this trend has been superseded by approaches based on labelled…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Ricard Durall , Kalun Ho , Franz-Josef Pfreundt , Janis Keuper

One of the most interesting challenges in Artificial Intelligence is to train conditional generators which are able to provide labeled adversarial samples drawn from a specific distribution. In this work, a new framework is presented to…

Image and Video Processing · Electrical Eng. & Systems 2018-06-20 Shabab Bazrafkan , Hossein Javidnia , Peter Corcoran

This paper explores conditional image generation with a One-Vs-All classifier based on the Generative Adversarial Networks (GANs). Instead of the real/fake discriminator used in vanilla GANs, we propose to extend the discriminator to a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Xiangrui Xu , Yaqin Li , Cao Yuan

We develop a novel method for training of GANs for unsupervised and class conditional generation of images, called Linear Discriminant GAN (LD-GAN). The discriminator of an LD-GAN is trained to maximize the linear separability between…

Machine Learning · Statistics 2017-07-26 Zhun Sun , Mete Ozay , Takayuki Okatani

Auto-encoding generative adversarial networks (GANs) combine the standard GAN algorithm, which discriminates between real and model-generated data, with a reconstruction loss given by an auto-encoder. Such models aim to prevent mode…

Machine Learning · Statistics 2017-10-24 Mihaela Rosca , Balaji Lakshminarayanan , David Warde-Farley , Shakir Mohamed

This paper proposes two important contributions for conditional Generative Adversarial Networks (cGANs) to improve the wide variety of applications that exploit this architecture. The first main contribution is an analysis of cGANs to show…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Houssem eddine Boulahbal , Adrian Voicila , Andrew Comport

This paper proposes a hierarchical generative model with a multi-grained latent variable to synthesize expressive speech. In recent years, fine-grained latent variables are introduced into the text-to-speech synthesis that enable the fine…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-28 Yukiya Hono , Kazuna Tsuboi , Kei Sawada , Kei Hashimoto , Keiichiro Oura , Yoshihiko Nankaku , Keiichi Tokuda

Content creation and image editing can benefit from flexible user controls. A common intermediate representation for conditional image generation is a semantic map, that has information of objects present in the image. When compared to raw…

Artificial Intelligence · Computer Science 2024-01-25 Chandrakanth Gudavalli , Erik Rosten , Lakshmanan Nataraj , Shivkumar Chandrasekaran , B. S. Manjunath

Image generation abilities of text-to-image diffusion models have significantly advanced, yielding highly photo-realistic images from descriptive text and increasing the viability of leveraging synthetic images to train computer vision…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Jiahui Chen , Amy Zhang , Adriana Romero-Soriano

We present a conditional variational auto-encoder (VAE) which, to avoid the substantial cost of training from scratch, uses an architecture and training objective capable of leveraging a foundation model in the form of a pretrained…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 William Harvey , Saeid Naderiparizi , Frank Wood

Neural audio synthesis methods can achieve high-fidelity and realistic sound generation by utilizing deep generative models. Such models typically rely on external labels which are often discrete as conditioning information to achieve…

Sound · Computer Science 2024-06-12 Yunyi Liu , Craig Jin

Although deep learning has achieved appealing results on several machine learning tasks, most of the models are deterministic at inference, limiting their application to single-modal settings. We propose a novel general-purpose framework…

Machine Learning · Computer Science 2020-10-12 Sameera Ramasinghe , Kanchana Ranasinghe , Salman Khan , Nick Barnes , Stephen Gould

We introduce nested diffusion models, an efficient and powerful hierarchical generative framework that substantially enhances the generation quality of diffusion models, particularly for images of complex scenes. Our approach employs a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiao Zhang , Ruoxi Jiang , Rebecca Willett , Michael Maire

Generative image models have been extensively studied in recent years. In the unconditional setting, they model the marginal distribution from unlabelled images. To allow for more control, image synthesis can be conditioned on semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Marlène Careil , Stéphane Lathuilière , Camille Couprie , Jakob Verbeek