English
Related papers

Related papers: Properties and limitations of geometric tempering …

200 papers

Approximating a probability distribution using a set of particles is a fundamental problem in machine learning and statistics, with applications including clustering and quantization. Formally, we seek a weighted mixture of Dirac measures…

Machine Learning · Statistics 2026-04-24 Ayoub Belhadji , Daniel Sharp , Youssef Marzouk

There has been recently a lot of interest in the analysis of the Stein gradient descent method, a deterministic sampling algorithm. It is based on a particle system moving along the gradient flow of the Kullback-Leibler divergence towards…

Analysis of PDEs · Mathematics 2023-12-29 José A. Carrillo , Jakub Skrzeczkowski

Parallel tempering is popular method for allowing MCMC algorithms to properly explore a $d$-dimensional multimodal target density. One problem with traditional power-based parallel tempering for multimodal targets is that the proportion of…

Computation · Statistics 2018-10-16 Nicholas G. Tawn , Gareth O. Roberts

We construct optimal low-rank approximations for the Gaussian posterior distribution in linear Gaussian inverse problems with possibly infinite-dimensional separable Hilbert parameter spaces and finite-dimensional data spaces. We first…

Statistics Theory · Mathematics 2026-04-09 Giuseppe Carere , Han Cheng Lie

We study evolution equations on metric graphs with reservoirs, that is graphs where a one-dimensional interval is associated to each edge and, in addition, the vertices are able to store and exchange mass with these intervals. Focusing on…

Analysis of PDEs · Mathematics 2024-12-24 Georg Heinze , Jan-Frederik Pietschmann , André Schlichting

Policy gradients methods often achieve better performance when the change in policy is limited to a small Kullback-Leibler divergence. We derive policy gradients where the change in policy is limited to a small Wasserstein distance (or…

Machine Learning · Computer Science 2017-12-21 Pierre H. Richemond , Brendan Maginnis

We present a discretization-free scalable framework for solving a large class of mass-conserving partial differential equations (PDEs), including the time-dependent Fokker-Planck equation and the Wasserstein gradient flow. The main…

Machine Learning · Computer Science 2023-11-15 Lingxiao Li , Samuel Hurault , Justin Solomon

We propose a fully discrete variational scheme for nonlinear evolution equations with gradient flow structure on the space of finite Radon measures on an interval with respect to a generalized version of the Wasserstein distance with…

Numerical Analysis · Mathematics 2016-09-29 Jonathan Zinsl , Daniel Matthes

Wasserstein-Fisher-Rao (WFR) gradient flows have been recently proposed as a powerful sampling tool that combines the advantages of pure Wasserstein (W) and pure Fisher-Rao (FR) gradient flows. Existing algorithmic developments implicitly…

Machine Learning · Statistics 2026-03-02 Francesca Romana Crucinio , Sahani Pathiraja

A $\phi$-exponential distribution is a generalization of an exponential distribution associated to functions $\phi$ in an appropriate class, and the space of $\phi$-exponential distributions has a dually flat structure. We study features of…

Metric Geometry · Mathematics 2011-10-03 Asuka Takatsu

We study the particle method to approximate the gradient flow on the $L^p$-Wasserstein space. This method relies on the discretization of the energy introduced by [3] via nonoverlapping balls centered at the particles and preserves the…

Numerical Analysis · Mathematics 2025-01-08 Rong Lei

In this article, we formulate topology optimization problems concerning the mass distribution as minimization problems for functionals on the Wasserstein space. We relax optimization problems regarding non-convex objective functions on the…

Optimization and Control · Mathematics 2026-01-22 Fumiya Okazaki , Takayuki Yamada

In this paper, we study efficient approximate sampling for probability distributions known up to normalization constants. We specifically focus on a problem class arising in Bayesian inference for large-scale inverse problems in science and…

Machine Learning · Computer Science 2024-10-14 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

We study the convergence of stochastic time-discretization schemes for evolution equations driven by random velocity fields, including examples like stochastic gradient descent and interacting particle systems. Using a unified framework…

Functional Analysis · Mathematics 2025-05-28 Giulia Cavagnari , Giuseppe Savaré , Giacomo Enrico Sodini

Sparse inversion and classification problems are ubiquitous in modern data science and imaging. They are often formulated as non-smooth minimisation problems. In sparse inversion, we minimise, e.g., the sum of a data fidelity term and an…

Numerical Analysis · Mathematics 2022-11-23 Jonas Latz

Fitting a function by using linear combinations of a large number $N$ of `simple' components is one of the most fruitful ideas in statistical learning. This idea lies at the core of a variety of methods, from two-layer neural networks to…

Statistics Theory · Mathematics 2019-08-20 Adel Javanmard , Marco Mondelli , Andrea Montanari

Flow Matching has recently emerged as a popular class of generative models for simulating a target distribution $\mu_1$ from samples drawn from a source distribution $\mu_0$. This framework relies on a fixed coupling between $\mu_0$ and…

Machine Learning · Computer Science 2026-05-12 Le-Tuyet-Nhi Pham , Giovanni Conforti , Zhenjie Ren , Alain Durmus

We introduce adaptive, tuning-free step size schedules for gradient-based sampling algorithms obtained as time-discretizations of Wasserstein gradient flows. The result is a suite of tuning-free sampling algorithms, including tuning-free…

Methodology · Statistics 2025-10-30 Louis Sharrock , Christopher Nemeth

Wasserstein distributionally robust optimization (DRO) has recently achieved empirical success for various applications in operations research and machine learning, owing partly to its regularization effect. Although connection between…

Machine Learning · Computer Science 2020-11-02 Rui Gao , Xi Chen , Anton J. Kleywegt

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov