English
Related papers

Related papers: Interior-Point Methods Strike Back: Solving the Wa…

200 papers

We show that the problem of finding the barycenter in the Hellinger-Kantorovich setting admits a least-cost soft multi-marginal formulation, provided that a one-sided hard marginal constraint is introduced. The constrained approach is then…

Optimization and Control · Mathematics 2025-01-22 Maciej Buze

We consider stochastic programs where the distribution of the uncertain parameters is only observable through a finite training dataset. Using the Wasserstein metric, we construct a ball in the space of (multivariate and non-discrete)…

Optimization and Control · Mathematics 2017-06-14 Peyman Mohajerin Esfahani , Daniel Kuhn

This paper discusses the efficiency of Hybrid Primal-Dual (HPD) type algorithms to approximate solve discrete Optimal Transport (OT) and Wasserstein Barycenter (WB) problems, with and without entropic regularization. Our first contribution…

Optimization and Control · Mathematics 2022-09-01 Antonin Chambolle , Juan Pablo Contreras

Obtaining solutions to Optimal Transportation (OT) problems is typically intractable when the marginal spaces are continuous. Recent research has focused on approximating continuous solutions with discretization methods based on i.i.d.…

Optimization and Control · Mathematics 2021-02-17 Junqi Wang , Pei Wang , Patrick Shafto

We propose a multi-class point optimization formulation based on continuous Wasserstein barycenters. Our formulation is designed to handle hundreds to thousands of optimization objectives and comes with a practical optimization scheme. We…

Graphics · Computer Science 2022-11-09 Corentin Salaün , Iliyan Georgiev , Hans-Peter Seidel , Gurprit Singh

We study two fundamental optimization problems: (1) scaling a symmetric positive definite matrix by a positive diagonal matrix so that the resulting matrix has row and column sums equal to 1; and (2) minimizing a quadratic function subject…

Data Structures and Algorithms · Computer Science 2025-04-30 Adrian Vladu

Computing Wasserstein barycenters is a fundamental geometric problem with widespread applications in machine learning, statistics, and computer graphics. However, it is unknown whether Wasserstein barycenters can be computed in polynomial…

Optimization and Control · Mathematics 2021-11-16 Jason M. Altschuler , Enric Boix-Adsera

In [Q. Liao et al., Commun. Math. Sci., 20(2022)], a linear-time Sinkhorn algorithm is developed based on dynamic programming, which significantly reduces the computational complexity involved in solving optimal transport problems. However,…

Optimization and Control · Mathematics 2025-03-25 Ziyuan Lyu , Zihao Wang , Hao Wu , Shuai Yang

In this paper, we propose and analyze an efficient Halpern-Peaceman-Rachford (HPR) algorithm for solving the Wasserstein barycenter problem (WBP) with fixed supports. While the Peaceman-Rachford (PR) splitting method itself may not be…

Optimization and Control · Mathematics 2022-11-29 Guojun Zhang , Yancheng Yuan , Defeng Sun

Many machine learning problems can be expressed as the optimization of some cost functional over a parametric family of probability distributions. It is often beneficial to solve such optimization problems using natural gradient methods.…

Machine Learning · Statistics 2020-02-14 Michael Arbel , Arthur Gretton , Wuchen Li , Guido Montufar

Most metrics between finite point measures currently used in the literature have the flaw that they do not treat differing total masses in an adequate manner for applications. This paper introduces a new metric $\bar{d}_1$ that combines…

Probability · Mathematics 2007-08-22 Dominic Schuhmacher , Aihua Xia

We study nonparametric density estimation problems where error is measured in the Wasserstein distance, a metric on probability distributions popular in many areas of statistics and machine learning. We give the first minimax-optimal rates…

Statistics Theory · Mathematics 2020-04-30 Jonathan Niles-Weed , Quentin Berthet

In this paper, we develop an interior-point method for solving a class of convex optimization problems with time-varying objective and constraint functions. Using log-barrier penalty functions, we propose a continuous-time dynamical system…

Optimization and Control · Mathematics 2016-08-29 Mahyar Fazlyab , Santiago Paternain , Victor M. Preciado , Alejandro Ribeiro

In a variety of research areas, the weighted bag of vectors and the histogram are widely used descriptors for complex objects. Both can be expressed as discrete distributions. D2-clustering pursues the minimum total within-cluster variation…

Computation · Statistics 2017-01-10 Jianbo Ye , Panruo Wu , James Z. Wang , Jia Li

In this paper, we propose a local squared Wasserstein-2 (W_2) method to solve the inverse problem of reconstructing models with uncertain latent variables or parameters. A key advantage of our approach is that it does not require prior…

Machine Learning · Statistics 2024-06-12 Mingtao Xia , Qijing Shen

We introduce the so called DeepParticle method to learn and generate invariant measures of stochastic dynamical systems with physical parameters based on data computed from an interacting particle method (IPM). We utilize the expressiveness…

Machine Learning · Computer Science 2022-06-22 Zhongjian Wang , Jack Xin , Zhiwen Zhang

We provide theoretical complexity analysis for new algorithms to compute the optimal transport (OT) distance between two discrete probability distributions, and demonstrate their favorable practical performance over state-of-art primal-dual…

Data Structures and Algorithms · Computer Science 2020-06-16 Wenshuo Guo , Nhat Ho , Michael I. Jordan

We extend the classical primal-dual interior point method from the Euclidean setting to the Riemannian one. Our method, named the Riemannian interior point method, is for solving Riemannian constrained optimization problems. We establish…

Optimization and Control · Mathematics 2024-03-06 Zhijian Lai , Akiko Yoshise

The proliferation of large data sets and Bayesian inference techniques motivates demand for better data sparsification. Coresets provide a principled way of summarizing a large dataset via a smaller one that is guaranteed to match the…

Machine Learning · Statistics 2020-03-04 Sebastian Claici , Aude Genevay , Justin Solomon

Illumination estimation remains a pivotal challenge in image processing, particularly for robotics, where robust environmental perception is essential under varying lighting conditions. Traditional approaches, such as RGB histograms and…

Image and Video Processing · Electrical Eng. & Systems 2025-07-04 Selcuk Yazar