中文
相关论文

相关论文: Sinkhorn Barycenters with Free Support via Frank-W…

200 篇论文

The Frank-Wolfe algorithm has seen a resurgence in popularity due to its ability to efficiently solve constrained optimization problems in machine learning and high-dimensional statistics. As such, there is much interest in establishing…

机器学习 · 统计学 2022-05-19 Suhas Vijaykumar

We consider the problem of minimizing the sum of two convex functions. One of those functions has Lipschitz-continuous gradients, and can be accessed via stochastic oracles, whereas the other is "simple". We provide a Bregman-type algorithm…

最优化与控制 · 数学 2024-11-26 Benjamin Dubois-Taine , Francis Bach , Quentin Berthet , Adrien Taylor

Sinkhorn divergence is a measure of dissimilarity between two probability measures. It is obtained through adding an entropic regularization term to Kantorovich's optimal transport problem and can hence be viewed as an entropically…

数值分析 · 数学 2020-05-01 Mohammad Motamed

The purpose of this work is to develop a framework to calibrate signed datasets so as to be consistent with specified marginals by suitably extending the Schr\"odinger-Fortet-Sinkhorn paradigm. Specifically, we seek to revise…

机器学习 · 统计学 2023-08-24 Anqi Dong , Tryphon T. Georgiou , Allen Tannenbaum

In the paper, we propose a class of accelerated stochastic gradient-free and projection-free (a.k.a., zeroth-order Frank-Wolfe) methods to solve the constrained stochastic and finite-sum nonconvex optimization. Specifically, we propose an…

最优化与控制 · 数学 2020-08-11 Feihu Huang , Lue Tao , Songcan Chen

The Frank-Wolfe (FW) method is a popular approach for solving optimization problems with structured constraints that arise in machine learning applications. In recent years, stochastic versions of FW have gained popularity, motivated by…

最优化与控制 · 数学 2024-09-17 Aleksandr Beznosikov , David Dobre , Gauthier Gidel

In this work, we investigate the convergence properties of the backward regularized Wasserstein proximal (BRWP) method for sampling a target distribution. The BRWP approach can be shown as a semi-implicit time discretization for a…

数值分析 · 数学 2025-12-18 Fuqun Han , Stanley Osher , Wuchen Li

We propose an accelerated algorithm with a Frank-Wolfe method as an oracle for solving strongly monotone variational inequality problems. While standard solution approaches, such as projected gradient descent (aka value iteration), involve…

最优化与控制 · 数学 2025-10-07 Reza Rahimi Baghbadorani , Peyman Mohajerin Esfahani , Sergio Grammatico

We propose Frank--Wolfe (FW) algorithms with an adaptive Bregman step-size strategy for smooth adaptable (also called: relatively smooth) (weakly-) convex functions. This means that the gradient of the objective function is not necessarily…

最优化与控制 · 数学 2026-02-19 Shota Takahashi , Sebastian Pokutta , Akiko Takeda

We prove that the block-coordinate Frank-Wolfe (BCFW) algorithm converges with state-of-the-art rates in both convex and nonconvex settings under a very mild "block-iterative" assumption. This appears to be the first result on BCFW…

最优化与控制 · 数学 2025-12-17 Gábor Braun , Jannis Halbey , Sebastian Pokutta , Zev Woodstock

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

最优化与控制 · 数学 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

We propose a simple, projection-based algorithm for clustering mixtures of discrete (Bernoulli) distributions. Unlike previous approaches that rely on coordinate-specific ``combinatorial projections,'' our algorithm is rotationally…

数据结构与算法 · 计算机科学 2026-04-28 Pradipta Mitra

Motivated by applications in emergency response and experimental design, we consider smooth stochastic optimization problems over probability measures supported on compact subsets of the Euclidean space. With the influence function as the…

最优化与控制 · 数学 2025-10-06 Di Yu , Shane G. Henderson , Raghu Pasupathy

Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the…

机器学习 · 计算机科学 2018-06-27 Han Zhao , Geoff Gordon

We present a framework to simultaneously align and smooth data in the form of multiple point clouds sampled from unknown densities with support in a d-dimensional Euclidean space. This work is motivated by applications in bioinformatics…

统计方法学 · 统计学 2019-08-28 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

We study stochastic projection-free methods for constrained optimization of smooth functions on Riemannian manifolds, i.e., with additional constraints beyond the parameter domain being a manifold. Specifically, we introduce stochastic…

最优化与控制 · 数学 2021-04-06 Melanie Weber , Suvrit Sra

This paper is concerned by the study of barycenters for random probability measures in the Wasserstein space. Using a duality argument, we give a precise characterization of the population barycenter for various parametric classes of random…

统计理论 · 数学 2017-11-30 Jérémie Bigot , Thierry Klein

We study the fixed-support Wasserstein barycenter problem (FS-WBP), which consists in computing the Wasserstein barycenter of $m$ discrete probability measures supported on a finite metric space of size $n$. We show first that the…

计算复杂性 · 计算机科学 2022-06-07 Tianyi Lin , Nhat Ho , Xi Chen , Marco Cuturi , Michael I. Jordan

Recently the away-step Frank-Wolfe algoritm for constrained multiobjective optimization has been shown linear convergence rate over a polytope which is generated by finite points set. In this paper we design a decomposition-invariant…

最优化与控制 · 数学 2024-09-10 Zhuoxin Fan , Liping Tang

We present a blended conditional gradient approach for minimizing a smooth convex function over a polytope P, combining the Frank--Wolfe algorithm (also called conditional gradient) with gradient-based steps, different from away steps and…

最优化与控制 · 数学 2025-03-24 Gábor Braun , Sebastian Pokutta , Dan Tu , Stephen Wright