English
Related papers

Related papers: Weighted quantization using MMD: From mean field t…

200 papers

Deterministic mathematical models, such as those specified via differential equations, are a powerful tool to communicate scientific insight. However, such models are necessarily simplified descriptions of the real world. Generalised…

Methodology · Statistics 2025-03-24 Zheyang Shen , Jeremias Knoblauch , Sam Power , Chris. J. Oates

We study multi-objective optimization over probability distributions in Wasserstein space. Recently, Nguyen et al. (2025) introduced Multiple Wasserstein Gradient Descent (MWGraD) algorithm, which exploits the geometric structure of…

Machine Learning · Computer Science 2026-01-28 Dai Hai Nguyen , Duc Dung Nguyen , Atsuyoshi Nakamura , Hiroshi Mamitsuka

One of the most well-known and simplest models for diversity maximization is the Max-Min Diversification (MMD) model, which has been extensively studied in the data mining and database literature. In this paper, we initiate the study of the…

Data Structures and Algorithms · Computer Science 2025-02-05 Iiro Kumpulainen , Florian Adriaens , Nikolaj Tatti

Accounting for the uncertainty of value functions boosts exploration in Reinforcement Learning (RL). Our work introduces Maximum Mean Discrepancy Q-Learning (MMD-QL) to improve Wasserstein Q-Learning (WQL) for uncertainty propagation during…

Machine Learning · Computer Science 2024-04-04 Srinjoy Roy , Swagatam Das

Stochastic Gradient Langevin Dynamics (SGLD) has emerged as a key MCMC algorithm for Bayesian learning from large scale datasets. While SGLD with decreasing step sizes converges weakly to the posterior distribution, the algorithm is often…

Machine Learning · Statistics 2018-11-27 Nicolas Brosse , Alain Durmus , Eric Moulines

Likelihood-free inference methods typically make use of a distance between simulated and real data. A common example is the maximum mean discrepancy (MMD), which has previously been used for approximate Bayesian computation, minimum…

Methodology · Statistics 2023-05-11 Ayush Bharti , Masha Naslidnyk , Oscar Key , Samuel Kaski , François-Xavier Briol

Mean-Field is an efficient way to approximate a posterior distribution in complex graphical models and constitutes the most popular class of Bayesian variational approximation methods. In most applications, the mean field distribution…

Machine Learning · Computer Science 2015-02-23 Pierre Baqué , Jean-Hubert Hours , François Fleuret , Pascal Fua

We present a novel approach to approximate Gaussian and mixture-of-Gaussians filtering. Our method relies on a variational approximation via a gradient-flow representation. The gradient flow is derived from a Kullback--Leibler discrepancy…

Computation · Statistics 2023-06-21 Adrien Corenflos , Hany Abdulsamad

We study the particle method to approximate the gradient flow on the $L^p$-Wasserstein space. This method relies on the discretization of the energy introduced by [3] via nonoverlapping balls centered at the particles and preserves the…

Numerical Analysis · Mathematics 2025-01-08 Rong Lei

The Wasserstein distance received a lot of attention recently in the community of machine learning, especially for its principled way of comparing distributions. It has found numerous applications in several hard problems, such as domain…

Machine Learning · Statistics 2017-10-23 Nicolas Courty , Rémi Flamary , Mélanie Ducoffe

Mixed Precision Quantization (MPQ) has become an essential technique for optimizing neural network by determining the optimal bitwidth per layer. Existing MPQ methods, however, face a major hurdle: they require a computationally expensive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Lianbo Ma , Jianlun Ma , Yuee Zhou , Guoyang Xie , Qiang He , Zhichao Lu

Flow Matching has recently gained attention in generative modeling as a simple and flexible alternative to diffusion models. While existing statistical guarantees adapt tools from the analysis of diffusion models, we take a different…

Machine Learning · Statistics 2026-03-18 Lea Kunkel , Mathias Trabs

The discrete distribution is often used to describe complex instances in machine learning, such as images, sequences, and documents. Traditionally, clustering of discrete distributions (D2C) has been approached using Wasserstein barycenter…

Machine Learning · Computer Science 2024-08-19 Zixiao Wang , Dong Qiao , Jicong Fan

Robustness to adversarial attacks is an important concern due to the fragility of deep neural networks to small perturbations and has received an abundance of attention in recent years. Distributionally Robust Optimization (DRO), a…

Machine Learning · Statistics 2020-06-09 Hisham Husain

We address the estimation problem for general finite mixture models, with a particular focus on the elliptical mixture models (EMMs). Compared to the widely adopted Kullback-Leibler divergence, we show that the Wasserstein distance provides…

Machine Learning · Computer Science 2020-10-09 Shengxi Li , Zeyang Yu , Min Xiang , Danilo Mandic

In this paper, we investigate gradient estimate of the Poisson equation and the exponential convergence in the Wasserstein metric $W_{1,d_{l^1}}$, uniform in the number of particles, and uniform-in-time propagation of chaos for the…

Probability · Mathematics 2021-09-15 Wei Liu , Liming Wu , Chaoen Zhang

This paper is concerned with the optimal approximation of a given multivariate Dirac mixture, i.e., a density comprising weighted Dirac distributions on a continuous domain, by an equally weighted Dirac mixture with a reduced number of…

Systems and Control · Computer Science 2014-11-18 Uwe D. Hanebeck

Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and…

Optimization and Control · Mathematics 2017-10-31 Abhishek Halder , Tryphon T. Georgiou

Stochastic Gradient Descent (SGD) is an important algorithm in machine learning. With constant learning rates, it is a stochastic process that, after an initial phase of convergence, generates samples from a stationary distribution. We show…

Machine Learning · Statistics 2017-09-12 Stephan Mandt , Matthew D. Hoffman , David M. Blei

Optimization over the space of probability measures endowed with the Wasserstein-2 geometry is central to modern machine learning and mean-field modeling. However, traditional methods relying on full Wasserstein gradients often suffer from…

Machine Learning · Statistics 2026-04-03 Yewei Xu , Qin Li