English
Related papers

Related papers: Least-Squares Problem Over Probability Measure Spa…

200 papers

In variational inference (VI), the practitioner approximates a high-dimensional distribution $\pi$ with a simple surrogate one, often a (product) Gaussian distribution. However, in many cases of practical interest, Gaussian distributions…

Machine Learning · Computer Science 2026-04-01 Luca Ghafourpour , Sinho Chewi , Alessio Figalli , Aram-Alexandre Pooladian

We estimate contrasts $\int_0 ^1 \rho(F^{-1}(u)-G^{-1}(u))du$ between two continuous distributions $F$ and $G$ on $\mathbb R$ such that the set $\{F=G\}$ is a finite union of intervals, possibly empty or $\mathbb{R}$. The non-negative…

Probability · Mathematics 2019-11-07 Philippe Berthet , Jean-Claude Fort

We show that the variance of a probability measure $\mu$ on a compact subset $X$ of a complete metric space $M$ is bounded by the square of the circumradius $R$ of the canonical embedding of $X$ into the space $P(M)$ of probability measures…

Probability · Mathematics 2020-06-05 Brendan Pass

For a probability measure on a real separable Hilbert space, we are interested in "volume-based" approximations of the d-dimensional least squares error of it, i.e., least squares error with respect to a best fit d-dimensional affine…

Functional Analysis · Mathematics 2012-10-08 Gilad Lerman , J. Tyler Whitehouse

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

Machine Learning · Computer Science 2023-11-27 Clément Bonet

The aim of this paper is to address optimality of stochastic control strategies via dynamic programming subject to total variation distance ambiguity on the conditional distribution of the controlled process. We formulate the stochastic…

Optimization and Control · Mathematics 2014-02-06 Ioannis Tzortzis , Charalambos D. Charalambous , Themistoklis Charalambous

The problem of least squares regression of a $d$-dimensional unknown parameter is considered. A stochastic gradient descent based algorithm with weighted iterate-averaging that uses a single pass over the data is studied and its convergence…

Information Theory · Computer Science 2016-06-10 Kobi Cohen , Angelia Nedic , R. Srikant

We consider the problem of finding the infimum, over probability measures being in a ball defined by Wasserstein distance, of the expected value of a bounded Lipschitz random variable on $\mathbf{R}^d$. We show that if the $\sigma-$algebra…

Probability · Mathematics 2019-12-30 Gusti van Zyl

We analyze the effect of small changes in the underlying probabilistic model on the value of multi-period stochastic optimization problems and optimal stopping problems. We work in finite discrete time and measure these changes with the…

Optimization and Control · Mathematics 2023-06-19 Daniel Bartl , Johannes Wiesel

This paper presents a framework for computing the Gromov-Wasserstein problem between two sets of points in low dimensional spaces, where the discrepancy is the squared Euclidean norm. The Gromov-Wasserstein problem is a generalization of…

Optimization and Control · Mathematics 2023-07-19 Martin Ryner , Jan Kronqvist , Johan Karlsson

Wasserstein barycenter, built on the theory of optimal transport, provides a powerful framework to aggregate probability distributions, and it has increasingly attracted great attention within the machine learning community. However, it…

Machine Learning · Computer Science 2022-12-20 Jinjin Chi , Zhiyao Yang , Jihong Ouyang , Ximing Li

We prove the existence of global minimizers to the double minimization problem \[ \inf\Big\{ P(E) + \lambda W_p(\mathcal{L}^n \lfloor \, E,\mathcal{L}^n \lfloor\, F) \colon |E \cap F| = 0, \, |E| = |F| = 1\Big\}, \] where $P(E)$ denotes the…

Analysis of PDEs · Mathematics 2022-10-06 Michael Novack , Ihsan Topaloglu , Raghavendra Venkatraman

The Poisson model is frequently employed to describe count data, but in a Bayesian context it leads to an analytically intractable posterior probability distribution. In this work, we analyze a variational Gaussian approximation to the…

Numerical Analysis · Mathematics 2018-02-14 Simon Arridge , Kazufumi Ito , Bangti Jin , Chen Zhang

In this work, we consider the deterministic optimization using random projections as a statistical estimation problem, where the squared distance between the predictions from the estimator and the true solution is the error metric. In…

Optimization and Control · Mathematics 2020-06-16 Srivatsan Sridhar , Mert Pilanci , Ayfer Özgür

Gromov--Wasserstein (GW) distances compare graphs, shapes, and point clouds through internal distances, without requiring a common coordinate system. This invariance is powerful, but discrete GW is a nonconvex quadratic optimal transport…

Machine Learning · Computer Science 2026-05-15 Ao Xu , Tieru Wu

In this paper, we introduce a generalization of the Wasserstein barycenter, to a case where the initial probability measures live on different subspaces of R^d. We study the existence and uniqueness of this barycenter, we show how it is…

Probability · Mathematics 2021-05-21 Julie Delon , Nathaël Gozlan , Alexandre Saint-Dizier

We consider multiperiod stochastic control problems with non-parametric uncertainty on the underlying probabilistic model. We derive a new metric on the space of probability measures, called the adapted $(p, \infty)$--Wasserstein distance…

Optimization and Control · Mathematics 2024-11-01 Ruslan Mirmominov , Johannes Wiesel

In the study of dynamical and physical systems, the input parameters are often uncertain or randomly distributed according to a measure $\varrho$. The system's response $f$ pushes forward $\varrho$ to a new measure $f\circ \varrho$ which we…

Classical Analysis and ODEs · Mathematics 2019-11-15 Amir Sagiv

We investigate a stochastic program with expected value constraints, addressing the problem in a general context through Distributionally Robust Optimization (DRO) approach using Wasserstein distances, where the ambiguity set depends on the…

Optimization and Control · Mathematics 2023-04-18 Diego Fonseca , Mauricio Junca

Multi-marginal optimal transport enables one to compare multiple probability measures, which increasingly finds application in multi-task learning problems. One practical limitation of multi-marginal transport is computational scalability…