English
Related papers

Related papers: Discriminator Rejection Sampling

200 papers

Recent advances in powerful pre-trained diffusion models encourage the development of methods to improve the sampling performance under well-trained diffusion models. This paper introduces Diffusion Rejection Sampling (DiffRS), which uses a…

Machine Learning · Computer Science 2024-05-29 Byeonghu Na , Yeongmin Kim , Minsang Park , Donghyeok Shin , Wanmo Kang , Il-Chul Moon

The standard practice in Generative Adversarial Networks (GANs) discards the discriminator during sampling. However, this sampling method loses valuable information learned by the discriminator regarding the data distribution. In this work,…

Machine Learning · Computer Science 2019-11-25 Yuejiang Liu , Parth Kothari , Alexandre Alahi

Filtering out unrealistic images from trained generative adversarial networks (GANs) has attracted considerable attention recently. Two density ratio based subsampling methods---Discriminator Rejection Sampling (DRS) and Metropolis-Hastings…

Machine Learning · Computer Science 2020-04-22 Xin Ding , Z. Jane Wang , William J. Welch

The proposed method, Discriminator Guidance, aims to improve sample generation of pre-trained diffusion models. The approach introduces a discriminator that gives explicit supervision to a denoising sample path whether it is realistic or…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Dongjun Kim , Yeongmin Kim , Se Jung Kwon , Wanmo Kang , Il-Chul Moon

Deep generative models (DGMs) of images are now sufficiently mature that they produce nearly photorealistic samples and obtain scores similar to the data distribution on heuristics such as Frechet Inception Distance (FID). These results,…

Machine Learning · Computer Science 2019-10-29 Suman Ravuri , Oriol Vinyals

In adversarial learning, discriminator often fails to guide the generator successfully since it distinguishes between real and generated images using silly or non-robust features. To alleviate this problem, this brief presents a simple but…

Machine Learning · Computer Science 2021-01-20 Yong-Goo Shin , Yoon-Jae Yeo , Sung-Jea Ko

Rejection sampling methods have recently been proposed to improve the performance of discriminator-based generative models. However, these methods are only optimal under an unlimited sampling budget, and are usually applied to a generator…

Machine Learning · Computer Science 2024-03-04 Alexandre Verine , Muni Sreenivas Pydi , Benjamin Negrevergne , Yann Chevaleyre

Generative Adversarial Networks (GANs) in supervised settings can generate photo-realistic corresponding output from low-definition input (SRGAN). Using the architecture presented in the SRGAN original paper [2], we explore how selecting a…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Nao Takano , Gita Alaghband

Generative Adversarial Networks (GANs) have significantly advanced image synthesis, however, the synthesis quality drops significantly given a limited amount of training data. To improve the data efficiency of GAN training, prior work…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Ceyuan Yang , Yujun Shen , Yinghao Xu , Bolei Zhou

In this paper, we propose the Self-Attention Generative Adversarial Network (SAGAN) which allows attention-driven, long-range dependency modeling for image generation tasks. Traditional convolutional GANs generate high-resolution details as…

Machine Learning · Statistics 2019-06-18 Han Zhang , Ian Goodfellow , Dimitris Metaxas , Augustus Odena

Generative Adversarial Networks (GANs) have shown great promise in modeling high dimensional data. The learning objective of GANs usually minimizes some measure discrepancy, \textit{e.g.}, $f$-divergence~($f$-GANs) or Integral Probability…

Machine Learning · Computer Science 2020-04-07 Yuxuan Song , Qiwei Ye , Minkai Xu , Tie-Yan Liu

We introduce effective training algorithms for Generative Adversarial Networks (GAN) to alleviate mode collapse and gradient vanishing. In our system, we constrain the generator by an Autoencoder (AE). We propose a formulation to consider…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

Rejection sampling is a common tool for low dimensional problems ($d \leq 2$), often touted as an "easy" way to obtain valid samples from a distribution $f(\cdot)$ of interest. In practice it is non-trivial to apply, often requiring…

Computation · Statistics 2023-10-03 Edward Raff , Mark McLean , James Holt

Recent advances in generative modeling have led to an increased interest in the study of statistical divergences as means of model comparison. Commonly used evaluation methods, such as the Frechet Inception Distance (FID), correlate well…

Machine Learning · Statistics 2018-10-30 Mehdi S. M. Sajjadi , Olivier Bachem , Mario Lucic , Olivier Bousquet , Sylvain Gelly

In standard generative adversarial network (SGAN), the discriminator estimates the probability that the input data is real. The generator is trained to increase the probability that fake data is real. We argue that it should also…

Machine Learning · Computer Science 2018-09-11 Alexia Jolicoeur-Martineau

Recently, subsampling or refining images generated from unconditional GANs has been actively studied to improve the overall image quality. Unfortunately, these methods are often observed less effective or inefficient in handling conditional…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Xin Ding , Yongwei Wang , Z. Jane Wang , William J. Welch

We propose a Generative Adversarial Network (GAN) that introduces an evaluator module using pre-trained networks. The proposed model, called score-guided GAN (ScoreGAN), is trained with an evaluation metric for GANs, i.e., the Inception…

Machine Learning · Computer Science 2020-05-28 Minhyeok Lee , Junhee Seok

Recent successes in Generative Adversarial Networks (GAN) have affirmed the importance of using more data in GAN training. Yet it is expensive to collect data in many domains such as medical applications. Data Augmentation (DA) has been…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Ngoc-Trung Tran , Viet-Hung Tran , Ngoc-Bao Nguyen , Trung-Kien Nguyen , Ngai-Man Cheung

The generative adversarial network (GAN) is successfully applied to study the perceptual single image superresolution (SISR). However, the GAN often tends to generate images with high frequency details being inconsistent with the real ones.…

Image and Video Processing · Electrical Eng. & Systems 2021-12-28 Ziyang Liu , Zhengguo Li , Xingming Wu , Zhong Liu , Weihai Chen

We show that the sum of the implicit generator log-density $\log p_g$ of a GAN with the logit score of the discriminator defines an energy function which yields the true data density when the generator is imperfect but the discriminator is…

Machine Learning · Computer Science 2021-07-08 Tong Che , Ruixiang Zhang , Jascha Sohl-Dickstein , Hugo Larochelle , Liam Paull , Yuan Cao , Yoshua Bengio
‹ Prev 1 2 3 10 Next ›