中文
相关论文

相关论文: Wasserstein GANs Work Because They Fail (to Approx…

200 篇论文

In this paper, we investigate the underlying factor that leads to failure and success in the training of GANs. We study the property of the optimal discriminative function and show that in many GANs, the gradient from the optimal…

机器学习 · 计算机科学 2018-12-27 Zhiming Zhou , Yuxuan Song , Lantao Yu , Hongwei Wang , Jiadong Liang , Weinan Zhang , Zhihua Zhang , Yong Yu

Generative-adversarial networks (GANs) have been used to produce data closely resembling example data in a compressed, latent space that is close to sufficient for reconstruction in the original vector space. The Wasserstein metric has been…

机器学习 · 统计学 2022-10-10 Oliver Serang

We study the efficacy and efficiency of deep generative networks for approximating probability distributions. We prove that neural networks can transform a low-dimensional source distribution to a distribution that is arbitrarily close to a…

机器学习 · 计算机科学 2023-12-05 Yunfei Yang , Zhen Li , Yang Wang

Traditional generative adversarial networks (GAN) and many of its variants are trained by minimizing the KL or JS-divergence loss that measures how close the generated data distribution is from the true data distribution. A recent advance…

计算机视觉与模式识别 · 计算机科学 2017-04-18 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

The Wasserstein distance received a lot of attention recently in the community of machine learning, especially for its principled way of comparing distributions. It has found numerous applications in several hard problems, such as domain…

机器学习 · 统计学 2017-10-23 Nicolas Courty , Rémi Flamary , Mélanie Ducoffe

Wasserstein GANs (WGANs), built upon the Kantorovich-Rubinstein (KR) duality of Wasserstein distance, is one of the most theoretically sound GAN models. However, in practice it does not always outperform other variants of GANs. This is…

机器学习 · 计算机科学 2021-01-13 Minkai Xu , Zhiming Zhou , Guansong Lu , Jian Tang , Weinan Zhang , Yong Yu

We develop a general framework for statistical inference with the 1-Wasserstein distance. Recently, the Wasserstein distance has attracted considerable attention and has been widely applied to various machine learning tasks because of its…

统计理论 · 数学 2022-02-16 Masaaki Imaizumi , Hirofumi Ota , Takuo Hamaguchi

High-resolution (HR) precipitation prediction is essential for reducing damage from stationary and localized heavy rainfall; however, HR precipitation forecasts using process-driven numerical weather prediction models remains challenging.…

机器学习 · 计算机科学 2026-05-19 Kenta Shiraishi , Yuka Muto , Atsushi Okazaki , Shunji Kotsuki

In generative modeling, the Wasserstein distance (WD) has emerged as a useful metric to measure the discrepancy between generated and real data distributions. Unfortunately, it is challenging to approximate the WD of high-dimensional…

计算机视觉与模式识别 · 计算机科学 2019-04-16 Jiqing Wu , Zhiwu Huang , Dinesh Acharya , Wen Li , Janine Thoma , Danda Pani Paudel , Luc Van Gool

In generative modeling, the Wasserstein distance (WD) has emerged as a useful metric to measure the discrepancy between generated and real data distributions. Unfortunately, it is challenging to approximate the WD of high-dimensional…

计算机视觉与模式识别 · 计算机科学 2019-04-17 Jiqing Wu , Zhiwu Huang , Dinesh Acharya , Wen Li , Janine Thoma , Danda Pani Paudel , Luc Van Gool

Generative adversarial networks (GANs) are a widely used framework for learning generative models. Wasserstein GANs (WGANs), one of the most successful variants of GANs, require solving a minmax optimization problem to global optimality,…

机器学习 · 计算机科学 2020-07-03 Qi Lei , Jason D. Lee , Alexandros G. Dimakis , Constantinos Daskalakis

Wasserstein-GANs have been introduced to address the deficiencies of generative adversarial networks (GANs) regarding the problems of vanishing gradients and mode collapse during the training, leading to improved convergence behaviour and…

机器学习 · 计算机科学 2019-12-17 Jan Müller , Reinhard Klein , Michael Weinmann

This paper proposes a new theoretical lens to view Wasserstein generative adversarial networks (WGANs). To minimize the Wasserstein-1 distance between the true data distribution and our estimate of it, we derive a distribution-dependent…

机器学习 · 统计学 2025-02-05 Zachariah Malik , Yu-Jui Huang

Despite being impactful on a variety of problems and applications, the generative adversarial nets (GANs) are remarkably difficult to train. This issue is formally analyzed by \cite{arjovsky2017towards}, who also propose an alternative…

计算机视觉与模式识别 · 计算机科学 2018-03-06 Xiang Wei , Boqing Gong , Zixia Liu , Wei Lu , Liqiang Wang

The Wasserstein distance is a distance between two probability distributions and has recently gained increasing popularity in statistics and machine learning, owing to its attractive properties. One important approach to extending this…

统计方法学 · 统计学 2022-02-14 Ryo Okano , Masaaki Imaizumi

Wasserstein distances provide a powerful framework for comparing data distributions. They can be used to analyze processes over time or to detect inhomogeneities within data. However, simply calculating the Wasserstein distance or analyzing…

机器学习 · 计算机科学 2026-03-03 Philip Naumann , Jacob Kauffmann , Grégoire Montavon

Score-based generative models are shown to achieve remarkable empirical performances in various applications such as image generation and audio synthesis. However, a theoretical understanding of score-based diffusion models is still…

机器学习 · 计算机科学 2022-12-14 Dohyun Kwon , Ying Fan , Kangwook Lee

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

机器学习 · 计算机科学 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

We introduce a new algorithm named WGAN, an alternative to traditional GAN training. In this new model, we show that we can improve the stability of learning, get rid of problems like mode collapse, and provide meaningful learning curves…

机器学习 · 统计学 2017-12-08 Martin Arjovsky , Soumith Chintala , Léon Bottou

We introduce a new method for training generative adversarial networks by applying the Wasserstein-2 metric proximal on the generators. The approach is based on Wasserstein information geometry. It defines a parametrization invariant…

机器学习 · 计算机科学 2021-02-16 Alex Tong Lin , Wuchen Li , Stanley Osher , Guido Montufar