中文
相关论文

相关论文: Averaging on the Bures-Wasserstein manifold: dimen…

200 篇论文

Wasserstein Barycenter is a principled approach to represent the weighted mean of a given set of probability distributions, utilizing the geometry induced by optimal transport. In this work, we present a novel scalable algorithm to…

机器学习 · 计算机科学 2021-11-30 Jiaojiao Fan , Amirhossein Taghvaei , Yongxin Chen

Efficiently aggregating data from different sources is a challenging problem, particularly when samples from each source are distributed differently. These differences can be inherent to the inference task or present for other reasons:…

机器学习 · 计算机科学 2017-11-15 Matthew Staib , Sebastian Claici , Justin Solomon , Stefanie Jegelka

Inspired by recent advances in distributed algorithms for approximating Wasserstein barycenters, we propose a novel distributed algorithm for this problem. The main novelty is that we consider time-varying computational networks, which are…

最优化与控制 · 数学 2023-07-26 Olga Yufereva , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kovalev

Optimal transport is a notoriously difficult problem to solve numerically, with current approaches often remaining intractable for very large scale applications such as those encountered in machine learning. Wasserstein barycenters -- the…

机器学习 · 计算机科学 2021-02-25 Julien Lacombe , Julie Digne , Nicolas Courty , Nicolas Bonneel

This paper provides rates of convergence for empirical (generalised) barycenters on compact geodesic metric spaces under general conditions using empirical processes techniques. Our main assumption is termed a variance inequality and…

统计理论 · 数学 2019-06-03 Adil Ahidar-Coutrix , Thibaut Le Gouic , Quentin Paris

We study the convergence properties of Riemannian gradient method for solving the consensus problem (for an undirected connected graph) over the Stiefel manifold. The Stiefel manifold is a non-convex set and the standard notion of averaging…

最优化与控制 · 数学 2021-01-26 Shixiang Chen , Alfredo Garcia , Mingyi Hong , Shahin Shahrampour

Let $M$ be a simply-connected compact Riemannian symmetric space, and $U$ a twice-differentiable function on $M$, with unique global minimum at $x^* \in M$. The idea of the present work is to replace the problem of searching for the global…

统计理论 · 数学 2019-02-12 Salem Said , Jonathan H. Manton

As interest in graph data has grown in recent years, the computation of various geometric tools has become essential. In some area such as mesh processing, they often rely on the computation of geodesics and shortest paths in discretized…

计算几何 · 计算机科学 2023-03-28 Marc Theveneau , Nicolas Keriven

We present a stochastic descent algorithm for unconstrained optimization that is particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained optimization and…

最优化与控制 · 数学 2024-07-08 David Kozak , Stephen Becker , Alireza Doostan , Luis Tenorio

This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set…

统计计算 · 统计学 2016-04-20 Olivier Féron , François Orieux , Jean-François Giovannelli

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

最优化与控制 · 数学 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

Motivated by energy based analyses for descent methods in the Euclidean setting, we investigate a generalisation of such analyses for descent methods over Riemannian manifolds. In doing so, we find that it is possible to derive…

最优化与控制 · 数学 2022-12-13 Vishwak Srinivasan , Ashia Wilson

We propose a hybrid resampling method to approximate finitely supported Wasserstein barycenters on large-scale datasets, which can be combined with any exact solver. Nonasymptotic bounds on the expected error of the objective value as well…

统计计算 · 统计学 2021-05-28 Florian Heinemann , Axel Munk , Yoav Zemel

We study the Wasserstein natural gradient in parametric statistical models with continuous sample spaces. Our approach is to pull back the $L^2$-Wasserstein metric tensor in the probability density space to a parameter space, equipping the…

最优化与控制 · 数学 2024-08-20 Yifan Chen , Wuchen Li

The Wasserstein distance has become increasingly important in machine learning and deep learning. Despite its popularity, the Wasserstein distance is hard to approximate because of the curse of dimensionality. A recently proposed approach…

机器学习 · 计算机科学 2021-09-29 Minhui Huang , Shiqian Ma , Lifeng Lai

We study the decentralized distributed computation of discrete approximations for the regularized Wasserstein barycenter of a finite set of continuous probability measures distributedly stored over a network. We assume there is a network of…

最优化与控制 · 数学 2020-02-21 Pavel Dvurechensky , Darina Dvinskikh , Alexander Gasnikov , César A. Uribe , Angelia Nedić

Distributed systems require fusing heterogeneous local probability distributions into a global summary over sparse and unreliable communication networks. Traditional consensus algorithms, which average distributions in Euclidean space,…

系统与控制 · 电气工程与系统科学 2026-05-26 Ali Baheri , Alireza Vahid

This paper considers the analysis of continuous time gradient-based optimization algorithms through the lens of nonlinear contraction theory. It demonstrates that in the case of a time-invariant objective, most elementary results on…

最优化与控制 · 数学 2022-12-23 Patrick M. Wensing , Jean-Jacques E. Slotine

Divide-and-conquer based methods for Bayesian inference provide a general approach for tractable posterior inference when the sample size is large. These methods divide the data into smaller subsets, sample from the posterior distribution…

统计方法学 · 统计学 2018-06-21 Sanvesh Srivastava , Cheng Li , David B. Dunson

Computing the unregularized Wasserstein barycenter for measure-valued data is a challenging optimization task. Recent algorithms have been tailored to either discrete measures as point clouds or continuous measures discretized on regular…

最优化与控制 · 数学 2026-05-13 Peng Xu , Changbo Zhu , Xiaohui Chen