中文
相关论文

相关论文: Understanding Entropic Regularization in GANs

200 篇论文

We use adversarial network architectures together with the Wasserstein distance to generate or refine simulated detector data. The data reflect two-dimensional projections of spatially distributed signal patterns with a broad spectrum of…

天体物理仪器与方法 · 物理学 2018-02-12 Martin Erdmann , Lukas Geiger , Jonas Glombitza , David Schmidt

This brief note aims to introduce the recent paradigm of distributional robustness in the field of shape and topology optimization. Acknowledging that the probability law of uncertain physical data is rarely known beyond a rough…

最优化与控制 · 数学 2023-01-13 Charles Dapogny , Franck Iutzeler , Andrea Meda , Boris Thibert

In this paper, we introduce a new CT image denoising method based on the generative adversarial network (GAN) with Wasserstein distance and perceptual similarity. The Wasserstein distance is a key concept of the optimal transform theory,…

计算机视觉与模式识别 · 计算机科学 2018-07-17 Qingsong Yang , Pingkun Yan , Yanbo Zhang , Hengyong Yu , Yongyi Shi , Xuanqin Mou , Mannudeep K. Kalra , Ge Wang

This paper explains the math behind a generative adversarial network (GAN) model and why it is hard to be trained. Wasserstein GAN is intended to improve GANs' training by adopting a smooth metric for measuring the distance between two…

机器学习 · 计算机科学 2019-04-22 Lilian Weng

Robust estimation is an important problem in statistics which aims at providing a reasonable estimator when the data-generating distribution lies within an appropriately defined ball around an uncontaminated distribution. Although minimax…

统计理论 · 数学 2021-01-21 Zheng Liu , Po-Ling Loh

Sinkhorn divergence is a measure of dissimilarity between two probability measures. It is obtained through adding an entropic regularization term to Kantorovich's optimal transport problem and can hence be viewed as an entropically…

数值分析 · 数学 2020-05-01 Mohammad Motamed

This paper proposes a new theoretical lens to view Wasserstein generative adversarial networks (WGANs). To minimize the Wasserstein-1 distance between the true data distribution and our estimate of it, we derive a distribution-dependent…

机器学习 · 统计学 2025-02-05 Zachariah Malik , Yu-Jui Huang

Building on the success of deep learning, two modern approaches to learn a probability model from the data are Generative Adversarial Networks (GANs) and Variational AutoEncoders (VAEs). VAEs consider an explicit probability model for the…

机器学习 · 计算机科学 2019-06-06 Yogesh Balaji , Hamed Hassani , Rama Chellappa , Soheil Feizi

When researchers develop new econometric methods it is common practice to compare the performance of the new methods to those of existing methods in Monte Carlo studies. The credibility of such Monte Carlo studies is often limited because…

计量经济学 · 经济学 2020-07-23 Susan Athey , Guido Imbens , Jonas Metzger , Evan Munro

Arguably the most fundamental question in the theory of generative adversarial networks (GANs) is to understand to what extent GANs can actually learn the underlying distribution. Theoretical and empirical evidence suggests local optimality…

机器学习 · 计算机科学 2022-01-19 Sitan Chen , Jerry Li , Yuanzhi Li , Raghu Meka

Conditional Generative Adversarial Networks are known to be difficult to train, especially when the conditions are continuous and high-dimensional. To partially alleviate this difficulty, we propose a simple generator regularization term on…

机器学习 · 计算机科学 2021-03-30 Yufeng Zheng , Yunkai Zhang , Zeyu Zheng

Generative adversarial networks (GANs) have enjoyed much success in learning high-dimensional distributions. Learning objectives approximately minimize an $f$-divergence ($f$-GANs) or an integral probability metric (Wasserstein GANs)…

机器学习 · 计算机科学 2020-06-19 Jiaming Song , Stefano Ermon

The study of multidimensional discriminator (critic) output for Generative Adversarial Networks has been underexplored in the literature. In this paper, we generalize the Wasserstein GAN framework to take advantage of multidimensional…

机器学习 · 统计学 2022-07-15 Mengyu Dai , Haibin Hang , Anuj Srivastava

Comparing metric measure spaces (i.e. a metric space endowed with aprobability distribution) is at the heart of many machine learning problems. The most popular distance between such metric measure spaces is theGromov-Wasserstein (GW)…

最优化与控制 · 数学 2023-01-18 Thibault Séjourné , François-Xavier Vialard , Gabriel Peyré

We propose a stable method to train Wasserstein generative adversarial networks. In order to enhance stability, we consider two objective functions using the $c$-transform based on Kantorovich duality which arises in the theory of optimal…

机器学习 · 计算机科学 2021-10-28 Dohyun Kwon , Yeoneung Kim , Guido Montúfar , Insoon Yang

We propose a novel end-to-end non-minimax algorithm for training optimal transport mappings for the quadratic cost (Wasserstein-2 distance). The algorithm uses input convex neural networks and a cycle-consistency regularization to…

机器学习 · 计算机科学 2020-12-11 Alexander Korotin , Vage Egiazarian , Arip Asadulaev , Alexander Safin , Evgeny Burnaev

Generative Adversarial Networks (GANs) are one of the most popular tools for learning complex high dimensional distributions. However, generalization properties of GANs have not been well understood. In this paper, we analyze the…

机器学习 · 计算机科学 2019-02-12 Hoang Thanh-Tung , Truyen Tran , Svetha Venkatesh

As opposed to standard empirical risk minimization (ERM), distributionally robust optimization aims to minimize the worst-case risk over a larger ambiguity set containing the original empirical distribution of the training data. In this…

机器学习 · 计算机科学 2021-01-06 Jaeho Lee , Maxim Raginsky

In this paper, we introduce a robust market making framework based on Wasserstein distance, utilizing a stochastic policy approach enhanced by entropy regularization. We demonstrate that, under mild assumptions, the robust market making…

数理金融 · 定量金融 2025-03-07 Zhou Fang , Arie Israel

We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold…

计算机视觉与模式识别 · 计算机科学 2018-11-06 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung