中文
相关论文

相关论文: A Randomized Linearly Convergent Frank-Wolfe-type …

200 篇论文

We introduce a new class of Frank-Wolfe algorithms for minimizing differentiable functionals over probability measures. This framework can be shown to encompass a diverse range of tasks in areas such as artificial intelligence,…

统计计算 · 统计学 2021-05-13 Carson Kent , Jose Blanchet , Peter Glynn

We propose a simple variant of the generalized Frank-Wolfe method for solving strongly convex composite optimization problems, by introducing an additional averaging step on the dual variables. We show that in this variant, one can choose a…

最优化与控制 · 数学 2022-10-27 Renbo Zhao , Qiuyun Zhu

The Frank-Wolfe algorithm is a popular method in structurally constrained machine learning applications, due to its fast per-iteration complexity. However, one major limitation of the method is a slow rate of convergence that is difficult…

最优化与控制 · 数学 2023-04-14 Zhaoyue Chen , Yifan Sun

The Frank-Wolfe (FW) algorithm has been widely used in solving nuclear norm constrained problems, since it does not require projections. However, FW often yields high rank intermediate iterates, which can be very expensive in time and space…

机器学习 · 统计学 2017-10-17 Edward Cheung , Yuying Li

This paper presents a subgradient-based algorithm for constrained nonsmooth convex optimization that does not require projections onto the feasible set. While the well-established Frank-Wolfe algorithm and its variants already avoid…

最优化与控制 · 数学 2024-09-04 Kamiar Asgari , Michael J. Neely

We study the Frank-Wolfe algorithm for minimizing a differentiable function with Lipschitz continuous gradient over a compact convex set. To extend classical complexity bounds to certain non-convex functions, we focus on the class of…

最优化与控制 · 数学 2025-07-24 R. Diaz Millan , Orizon Pereira Ferreira , Julien Ugon

In the present paper, we formulate two versions of Frank--Wolfe algorithm or conditional gradient method to solve the DC optimization problem with an adaptive step size. The DC objective function consists of two components; the first is…

最优化与控制 · 数学 2026-02-02 R. Díaz Millán , O. P. Ferreira , J. Ugon

Frank-Wolfe methods are projection-free algorithms for constrained optimization whose practical performance often depends critically on the choice of step size. Classical closed-loop step-size rules typically require prior knowledge of a…

最优化与控制 · 数学 2026-05-29 Khanh-Hung Giang-Tran , Soroosh Shafiee , Nam Ho-Nguyen

In this paper, we consider Frank-Wolfe-based algorithms for composite convex optimization problems with objective involving a logarithmically-homogeneous, self-concordant functions. Recent Frank-Wolfe-based methods for this class of…

最优化与控制 · 数学 2023-10-24 Nimita Shinde , Vishnu Narayanan , James Saunderson

The Frank-Wolfe algorithm is a method for constrained optimization that relies on linear minimizations, as opposed to projections. Therefore, a motivation put forward in a large body of work on the Frank-Wolfe algorithm is the computational…

最优化与控制 · 数学 2021-06-15 Cyrille W. Combettes , Sebastian Pokutta

We demonstrate how to scalably solve a class of constrained self-concordant minimization problems using linear minimization oracles (LMO) over the constraint set. We prove that the number of LMO calls of our method is nearly the same as…

最优化与控制 · 数学 2020-02-18 Deyi Liu , Volkan Cevher , Quoc Tran-Dinh

We revisit the Frank-Wolfe (FW) optimization under strongly convex constraint sets. We provide a faster convergence rate for FW without line search, showing that a previously overlooked variant of FW is indeed faster than the standard…

机器学习 · 计算机科学 2019-02-01 Jarrid Rector-Brooks , Jun-Kun Wang , Barzan Mozafari

We study a class of convex-concave saddle-point problems of the form $\min_x\max_y \langle Kx,y\rangle+f_{\cal{P}}(x)-h^\ast(y)$ where $K$ is a linear operator, $f_{\cal{P}}$ is the sum of a convex function $f$ with a Lipschitz-continuous…

最优化与控制 · 数学 2021-06-07 Vladimir Kolmogorov , Thomas Pock

We consider the Frank-Wolfe algorithm for solving variational inequalities over compact, convex sets under a monotone $C^1$ operator and vanishing, nonsummable step sizes. We introduce a continuous-time interpolation of the discrete…

最优化与控制 · 数学 2026-04-10 Matthew Hough

We study the convergence properties of the 'greedy' Frank-Wolfe algorithm with a unit step size, for a convex maximization problem over a compact set. We assume the function satisfies smoothness and strong convexity. These assumptions…

最优化与控制 · 数学 2025-05-02 Fatih Selim Aktas , Christian Kroer

We study constrained stochastic programs where the decision vector at each time slot cannot be chosen freely but is tied to the realization of an underlying random state vector. The goal is to minimize a general objective function subject…

最优化与控制 · 数学 2018-06-05 Xiaohan Wei , Michael J. Neely

We consider the oracle complexity of constrained convex optimization given access to a Linear Minimization Oracle (LMO) for the constraint set and a gradient oracle for the $L$-smooth, strongly convex objective. This model includes…

最优化与控制 · 数学 2026-02-27 Benjamin Grimmer , Ning Liu

Decentralized optimization algorithms have received much attention due to the recent advances in network information processing. However, conventional decentralized algorithms based on projected gradient descent are incapable of handling…

最优化与控制 · 数学 2018-08-29 Hoi-To Wai , Jean Lafond , Anna Scaglione , Eric Moulines

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe…

最优化与控制 · 数学 2019-06-11 Paul Grigas , Alfonso Lobos , Nathan Vermeersch

We propose a variant of the Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The proposed Primal-Dual Block…

机器学习 · 计算机科学 2019-06-07 Qi Lei , Jiacheng Zhuo , Constantine Caramanis , Inderjit S. Dhillon , Alexandros G. Dimakis