English
Related papers

Related papers: Stochastic Saddle-Point Optimization for Wasserste…

200 papers

Stochastic convex optimization, where the objective is the expectation of a random convex function, is an important and widely used method with numerous applications in machine learning, statistics, operations research and other areas. We…

Machine Learning · Computer Science 2016-11-23 Vitaly Feldman , Cristobal Guzman , Santosh Vempala

Let $\mathcal{P}_{2,ac}$ be the set of Borel probabilities on $\mathbb{R}^d$ with finite second moment and absolutely continuous with respect to Lebesgue measure. We consider the problem of finding the barycenter (or Fr\'echet mean) of a…

Computation · Statistics 2016-04-25 Pedro C. Álvarez-Esteban , E. del Barrio , J. A. Cuesta-Albertos , C. Matrán

We present a novel algorithm to estimate the barycenter of arbitrary probability distributions with respect to the Sinkhorn divergence. Based on a Frank-Wolfe optimization strategy, our approach proceeds by populating the support of the…

Machine Learning · Statistics 2019-06-04 Giulia Luise , Saverio Salzo , Massimiliano Pontil , Carlo Ciliberto

We present a novel $Q$-learning algorithm tailored to solve distributionally robust Markov decision problems where the corresponding ambiguity set of transition probabilities for the underlying Markov decision process is a Wasserstein ball…

Machine Learning · Computer Science 2024-06-21 Ariel Neufeld , Julian Sester

In this work we introduce a novel approach, based on sampling, for finding assignments that are likely to be solutions to stochastic constraint satisfaction problems and constraint optimisation problems. Our approach reduces the size of the…

Optimization and Control · Mathematics 2015-09-22 Roberto Rossi , Brahim Hnich , S. Armagan Tarim , Steven Prestwich

Stochastic localization is a pathwise analysis technique originating from convex geometry. This paper explores certain algorithmic aspects of stochastic localization as a computational tool. First, we unify various existing stochastic…

Statistics Theory · Mathematics 2025-05-20 Tom Alberts , Yiming Xu , Qiang Ye

This paper is focused on the statistical analysis of probability measures $\nu_{1},\ldots,\nu_{n}$ on $\mathbb{R}$ that can be viewed as independent realizations of an underlying stochastic process. We consider the situation of practical…

Statistics Theory · Mathematics 2017-03-30 Jérémie Bigot , Raúl Gouet , Thierry Klein , Alfredo López

In this paper, we introduce a generalization of the Wasserstein barycenter, to a case where the initial probability measures live on different subspaces of R^d. We study the existence and uniqueness of this barycenter, we show how it is…

Probability · Mathematics 2021-05-21 Julie Delon , Nathaël Gozlan , Alexandre Saint-Dizier

Many modern machine learning applications - from online principal component analysis to covariance matrix identification and dictionary learning - can be formulated as minimization problems on Riemannian manifolds, and are typically solved…

Optimization and Control · Mathematics 2023-11-07 Ya-Ping Hsieh , Mohammad Reza Karimi , Andreas Krause , Panayotis Mertikopoulos

One key challenge for solving a general stochastic optimization problem with expectations in the objective and constraint functions using ordinary stochastic iterative methods lies in the infeasibility issue caused by the randomness over…

Information Theory · Computer Science 2019-08-30 Chencheng Ye , Ying Cui

Semi-discrete optimal transport problems, which evaluate the Wasserstein distance between a discrete and a generic (possibly non-discrete) probability measure, are believed to be computationally hard. Even though such problems are…

Machine Learning · Computer Science 2022-05-02 Bahar Taskesen , Soroosh Shafieezadeh-Abadeh , Daniel Kuhn

Variational problems that involve Wasserstein distances and more generally optimal transport (OT) theory are playing an increasingly important role in data sciences. Such problems can be used to form an examplar measure out of various…

Machine Learning · Computer Science 2018-11-15 Marco Cuturi , Gabriel Peyré

Saddle-point problems have recently gained increased attention from the machine learning community, mainly due to applications in training Generative Adversarial Networks using stochastic gradients. At the same time, in some applications…

Optimization and Control · Mathematics 2021-09-07 Abdurakhmon Sadiev , Aleksandr Beznosikov , Pavel Dvurechensky , Alexander Gasnikov

Inverse problems in physical or biological sciences often involve recovering an unknown parameter that is random. The sought-after quantity is a probability distribution of the unknown parameter, that produces data that aligns with…

Machine Learning · Statistics 2024-10-02 Qin Li , Maria Oprea , Li Wang , Yunan Yang

Gaussian Process based Bayesian Optimization is a widely applied algorithm to learn and optimize under uncertainty, well-known for its sample efficiency. However, recently -- and more frequently -- research studies have empirically…

Machine Learning · Statistics 2025-05-20 Antonio Candelieri , Andrea Ponti , Francesco Archetti

We present a novel method for efficiently computing optimal transport maps and Wasserstein barycenters in high-dimensional spaces. Our approach uses conditional normalizing flows to approximate the input distributions as invertible…

Machine Learning · Statistics 2025-05-29 Gabriele Visentin , Patrick Cheridito

Distributed nonconvex optimization underpins key functionalities of numerous distributed systems, ranging from power systems, smart buildings, cooperative robots, vehicle networks to sensor networks. Recently, it has also merged as a…

Optimization and Control · Mathematics 2024-03-18 Yanan Bo , Yongqiang Wang

Variational problems that involve Wasserstein distances have been recently proposed to summarize and learn from probability measures. Despite being conceptually simple, such problems are computationally challenging because they involve…

Machine Learning · Statistics 2015-08-26 Marco Cuturi , Gabriel Peyré

Discrete Wasserstein barycenters correspond to optimal solutions of transportation problems for a set of probability measures with finite support. Discrete barycenters are measures with finite support themselves and exhibit two favorable…

Optimization and Control · Mathematics 2020-04-24 Steffen Borgwardt

Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimization in these…

Machine Learning · Statistics 2020-06-05 Peter D. Tonner , Daniel V. Samarov , A. Gilad Kusne