English
Related papers

Related papers: Projected Wasserstein gradient descent for high-di…

200 papers

Generative adversarial nets (GANs) and variational auto-encoders have significantly improved our distribution modeling capabilities, showing promise for dataset augmentation, image-to-image translation and feature learning. However, to…

An algorithm for approximating the p-Wasserstein distance between histograms defined on unstructured discrete grids is presented. It is based on the computation of a barycenter constrained to be supported on a low dimensional subspace,…

Numerical Analysis · Mathematics 2020-09-24 Nicolas Papadakis

Wasserstein Gradient Flows (WGF) with respect to specific functionals have been widely used in the machine learning literature. Recently, neural networks have been adopted to approximate certain intractable parts of the underlying…

Machine Learning · Computer Science 2024-01-26 Huminhao Zhu , Fangyikang Wang , Chao Zhang , Hanbin Zhao , Hui Qian

We introduce a new method for training generative adversarial networks by applying the Wasserstein-2 metric proximal on the generators. The approach is based on Wasserstein information geometry. It defines a parametrization invariant…

Machine Learning · Computer Science 2021-02-16 Alex Tong Lin , Wuchen Li , Stanley Osher , Guido Montufar

Gradient flow in the 2-Wasserstein space is widely used to optimize functionals over probability distributions and is typically implemented using an interacting particle system with $n$ particles. Analyzing these algorithms requires showing…

Machine Learning · Computer Science 2026-03-27 Chandan Tankala , Dheeraj M. Nagaraj , Anant Raj

A common feature of methods for analyzing samples of probability density functions is that they respect the geometry inherent to the space of densities. Once a metric is specified for this space, the Fr\'echet mean is typically used to…

Methodology · Statistics 2018-12-20 Alexander Petersen , Hans-Georg Müller

Wasserstein Gradient Flow (WGF) describes the gradient dynamics of probability density within the Wasserstein space. WGF provides a promising approach for conducting optimization over the probability distributions. Numerically approximating…

Machine Learning · Computer Science 2024-06-04 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

Estimating spatially distributed properties such as hydraulic conductivity (K) from available sparse measurements is a great challenge in subsurface characterization. However, the use of inverse modeling is limited for ill-posed,…

Machine Learning · Computer Science 2023-10-11 Jichao Bao , Hongkyu Yoon , Jonghyun Lee

This paper presents an efficient discontinuous Galerkin method to simulate wave propagation in heterogeneous media with sub-cell variations. This method is based on a weight-adjusted discontinuous Galerkin method (WADG), which achieves high…

Numerical Analysis · Mathematics 2019-03-12 Kaihang Guo , Jesse Chan

Minimum distance estimation (MDE) gained recent attention as a formulation of (implicit) generative modeling. It considers minimizing, over model parameters, a statistical distance between the empirical data distribution and the model. This…

Statistics Theory · Mathematics 2020-10-21 Ziv Goldfeld , Kristjan Greenewald , Kengo Kato

As a counterpoint to recent numerical methods for crystal surface evolution, which agree well with microscopic dynamics but suffer from significant stiffness that prevents simulation on fine spatial grids, we develop a new numerical method…

Numerical Analysis · Mathematics 2020-06-24 Katy Craig , Jian-Guo Liu , Jianfeng Lu , Jeremy L. Marzuola , Li Wang

We derive finite-particle rates for the regularized Stein variational gradient descent (R-SVGD) algorithm introduced by He et al. (2024) that corrects the constant-order bias of the SVGD by applying a resolvent-type preconditioner to the…

Machine Learning · Statistics 2026-05-19 Ye He , Krishnakumar Balasubramanian , Sayan Banerjee , Promit Ghosal

Generative adversarial networks (GANs) are a widely used framework for learning generative models. Wasserstein GANs (WGANs), one of the most successful variants of GANs, require solving a minmax optimization problem to global optimality,…

Machine Learning · Computer Science 2020-07-03 Qi Lei , Jason D. Lee , Alexandros G. Dimakis , Constantinos Daskalakis

This paper proposes a novel parameter selection strategy for kernel-based gradient descent (KGD) algorithms, integrating bias-variance analysis with the splitting method. We introduce the concept of empirical effective dimension to quantify…

Machine Learning · Statistics 2026-03-05 Xiaotong Liu , Yunwen Lei , Xiangyu Chang , Shao-Bo Lin

Stein Variational Gradient Descent (SVGD) is a nonparametric particle-based deterministic sampling algorithm. Despite its wide usage, understanding the theoretical properties of SVGD has remained a challenging problem. For sampling from a…

Statistics Theory · Mathematics 2023-10-31 Tianle Liu , Promit Ghosal , Krishnakumar Balasubramanian , Natesh S. Pillai

The analysis of samples of random objects that do not lie in a vector space is gaining increasing attention in statistics. An important class of such object data is univariate probability measures defined on the real line. Adopting the…

Methodology · Statistics 2021-07-07 Yaqing Chen , Zhenhua Lin , Hans-Georg Müller

Projection-based embedding provides a simple, robust, and accurate approach for describing a small part of a chemical system at the level of a correlated wavefunction method while the remainder of the system is described at the level of…

Chemical Physics · Physics 2019-08-21 Sebastian J. R. Lee , Feizhi Ding , Frederick R. Manby , Thomas F. Miller

The mean field variational inference (MFVI) formulation restricts the general Bayesian inference problem to the subspace of product measures. We present a framework to analyze MFVI algorithms, which is inspired by a similar development for…

Machine Learning · Statistics 2022-10-21 Soumyadip Ghosh , Yingdong Lu , Tomasz Nowicki , Edith Zhang

We present a novel multiscale framework for analyzing sequences of probability measures in Wasserstein spaces over Euclidean domains. Exploiting the intrinsic geometry of optimal transport, we construct a multiscale transform applicable to…

Numerical Analysis · Mathematics 2026-04-13 Wael Mattar , Nir Sharon

This paper presents a theoretical framework for the design and analysis of gradient descent-based algorithms for coverage control tasks involving robot swarms. We adopt a multiscale approach to analysis and design to ensure consistency of…

Optimization and Control · Mathematics 2022-06-08 Vishaal Krishnan , Sonia Martínez
‹ Prev 1 8 9 10 Next ›