中文
相关论文

相关论文: Minimax Optimality (Probably) Doesn't Imply Distri…

200 篇论文

Semi-supervised learning methods based on generative adversarial networks (GANs) obtained strong empirical results, but it is not clear 1) how the discriminator benefits from joint training with a generator, and 2) why good semi-supervised…

机器学习 · 计算机科学 2017-11-06 Zihang Dai , Zhilin Yang , Fan Yang , William W. Cohen , Ruslan Salakhutdinov

Though recent research has achieved remarkable progress in generating realistic images with generative adversarial networks (GANs), the lack of training stability is still a lingering concern of most GANs, especially on high-resolution…

计算机视觉与模式识别 · 计算机科学 2020-03-18 Runmin Wu , Kunyao Zhang , Lijun Wang , Yue Wang , Pingping Zhang , Huchuan Lu , Yizhou Yu

The Generative Adversarial Network (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. It has many applications in statistics such as nonparametric clustering and nonparametric…

机器学习 · 统计学 2023-06-26 Sehwan Kim , Qifan Song , Faming Liang

Computing optimal transport maps between high-dimensional and continuous distributions is a challenging problem in optimal transport (OT). Generative adversarial networks (GANs) are powerful generative models which have been successfully…

机器学习 · 计算机科学 2019-06-25 Jacob Leygonie , Jennifer She , Amjad Almahairi , Sai Rajeswar , Aaron Courville

Despite remarkable performance in producing realistic samples, Generative Adversarial Networks (GANs) often produce low-quality samples near low-density regions of the data manifold, e.g., samples of minor groups. Many techniques have been…

机器学习 · 计算机科学 2021-10-28 Jinhee Lee , Haeri Kim , Youngkyu Hong , Hye Won Chung

Unsupervised learning with generative adversarial networks (GANs) has proven to be hugely successful. Regular GANs hypothesize the discriminator as a classifier with the sigmoid cross entropy loss function. However, we found that this loss…

计算机视觉与模式识别 · 计算机科学 2018-09-24 Xudong Mao , Qing Li , Haoran Xie , Raymond Y. K. Lau , Zhen Wang , Stephen Paul Smolley

Pseudo-random number generators (PRNG) are a fundamental element of many security algorithms. We introduce a novel approach to their implementation, by proposing the use of generative adversarial networks (GAN) to train a neural network to…

机器学习 · 计算机科学 2018-10-02 Marcello De Bernardi , MHR Khouzani , Pasquale Malacaria

In this paper, we aim to understand the generalization properties of generative adversarial networks (GANs) from a new perspective of privacy protection. Theoretically, we prove that a differentially private learning algorithm used for…

机器学习 · 计算机科学 2019-09-26 Bingzhe Wu , Shiwan Zhao , ChaoChao Chen , Haoyang Xu , Li Wang , Xiaolu Zhang , Guangyu Sun , Jun Zhou

The success of neural networks over the past decade has established them as effective models for many relevant data generating processes. Statistical theory on neural networks indicates graceful scaling of sample complexity. For example,…

机器学习 · 计算机科学 2023-03-28 Yifan Zhu , Hong Jun Jeon , Benjamin Van Roy

We propose a stable method to train Wasserstein generative adversarial networks. In order to enhance stability, we consider two objective functions using the $c$-transform based on Kantorovich duality which arises in the theory of optimal…

机器学习 · 计算机科学 2021-10-28 Dohyun Kwon , Yeoneung Kim , Guido Montúfar , Insoon Yang

Generative adversarial networks (GANs) have been remarkably successful in learning complex high dimensional real word distributions and generating realistic samples. However, they provide limited control over the generation process.…

机器学习 · 计算机科学 2020-10-27 Arunava Chakraborty , Rahul Ragesh , Mahir Shah , Nipun Kwatra

We consider learning in an adversarial environment, where an $\varepsilon$-fraction of samples from a distribution $P$ are arbitrarily modified (global corruptions) and the remaining perturbations have average magnitude bounded by $\rho$…

机器学习 · 计算机科学 2024-06-26 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

Generative adversarial networks (GANs) are a class of generative models, known for producing accurate samples. The key feature of GANs is that there are two antagonistic neural networks: the generator and the discriminator. The main…

机器学习 · 计算机科学 2025-08-05 Barbara Franci , Sergio Grammatico

We present a framework to understand GAN training as alternating density ratio estimation and approximate divergence minimization. This provides an interpretation for the mismatched GAN generator and discriminator objectives often used in…

机器学习 · 计算机科学 2016-12-09 Ben Poole , Alexander A. Alemi , Jascha Sohl-Dickstein , Anelia Angelova

Neural networks are vulnerable to adversarial examples and researchers have proposed many heuristic attack and defense mechanisms. We address this problem through the principled lens of distributionally robust optimization, which guarantees…

机器学习 · 统计学 2020-05-04 Aman Sinha , Hongseok Namkoong , Riccardo Volpi , John Duchi

We consider the problem of estimating the parameters of a $d$-dimensional rectified Gaussian distribution from i.i.d. samples. A rectified Gaussian distribution is defined by passing a standard Gaussian distribution through a one-layer ReLU…

机器学习 · 计算机科学 2019-09-20 Shanshan Wu , Alexandros G. Dimakis , Sujay Sanghavi

Recent generative adversarial networks (GANs) are able to generate impressive photo-realistic images. However, controllable generation with GANs remains a challenging research problem. Achieving controllable generation requires semantically…

机器学习 · 计算机科学 2021-05-04 Grigorios G Chrysos , Jean Kossaifi , Zhiding Yu , Anima Anandkumar

When concept shifts and sample scarcity are present in the target domain of interest, nonparametric regression learners often struggle to generalize effectively. The technique of transfer learning remedies these issues by leveraging data or…

机器学习 · 统计学 2025-01-22 Haotian Lin , Matthew Reimherr

Generative adversarial networks (GANs) have been extremely effective in approximating complex distributions of high-dimensional, input data samples, and substantial progress has been made in understanding and improving GAN performance in…

机器学习 · 计算机科学 2018-05-01 Daniel Jiwoong Im , He Ma , Graham Taylor , Kristin Branson

Generative models based on latent variables, such as generative adversarial networks (GANs) and variational auto-encoders (VAEs), have gained lots of interests due to their impressive performance in many fields. However, many data such as…

机器学习 · 统计学 2024-09-30 Yixuan Qiu , Qingyi Gao , Xiao Wang