中文
相关论文

相关论文: Minding the Gaps for Block Frank-Wolfe Optimizatio…

200 篇论文

We study the Frank-Wolfe algorithm for constrained optimization problems with relatively smooth objectives. Building upon our previous work, we propose a fully adaptive variant of the Frank-Wolfe method that dynamically adjusts the step…

最优化与控制 · 数学 2025-08-27 A. A. Vyguzov , F. S. Stonyakin

This work proposes a new algorithm for training a re-weighted L2 Support Vector Machine (SVM), inspired on the re-weighted Lasso algorithm of Cand\`es et al. and on the equivalence between Lasso and SVM shown recently by Jaggi. In…

机器学习 · 计算机科学 2018-04-16 Carlos M. Alaíz , Johan A. K. Suykens

We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained smooth convex-concave saddle point (SP) problems. Remarkably, the method only requires access to linear minimization oracles. Leveraging recent advances in FW…

最优化与控制 · 数学 2017-03-07 Gauthier Gidel , Tony Jebara , Simon Lacoste-Julien

The Frank-Wolfe (FW) method is a popular approach for solving optimization problems with structured constraints that arise in machine learning applications. In recent years, stochastic versions of FW have gained popularity, motivated by…

最优化与控制 · 数学 2024-09-17 Aleksandr Beznosikov , David Dobre , Gauthier Gidel

The Frank-Wolfe (FW) method is a popular algorithm for solving large-scale convex optimization problems appearing in structured statistical learning. However, the traditional Frank-Wolfe method can only be applied when the feasible region…

最优化与控制 · 数学 2021-10-11 Haoyue Wang , Haihao Lu , Rahul Mazumder

The purpose of this survey is to serve both as a gentle introduction and a coherent overview of state-of-the-art Frank--Wolfe algorithms, also called conditional gradient algorithms, for function minimization. These algorithms are…

The Frank-Wolfe (FW) optimization algorithm has lately re-gained popularity thanks in particular to its ability to nicely handle the structured constraints appearing in machine learning applications. However, its convergence rate is known…

最优化与控制 · 数学 2015-11-19 Simon Lacoste-Julien , Martin Jaggi

The paper presents various modifications of the Frank-Wolfe algorithm in the equilibrium traffic assignment problem. The Beckman model is used as a model for experiments. In this article, first of all, attention is paid to the choice of the…

最优化与控制 · 数学 2024-03-11 Igor N. Ignashin , Demyan V. Yarmoshik

We study Frank-Wolfe methods for nonconvex stochastic and finite-sum optimization problems. Frank-Wolfe methods (in the convex case) have gained tremendous recent interest in machine learning and optimization communities due to their…

最优化与控制 · 数学 2016-08-01 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

As a projection-free algorithm, Frank-Wolfe (FW) method, also known as conditional gradient, has recently received considerable attention in the machine learning community. In this dissertation, we study several topics on the FW variants…

最优化与控制 · 数学 2021-05-11 Mingrui Zhang

We present a new proximal bundle method for Maximum-A-Posteriori (MAP) inference in structured energy minimization problems. The method optimizes a Lagrangean relaxation of the original energy minimization problem using a multi plane…

机器学习 · 计算机科学 2019-04-08 Paul Swoboda , Vladimir Kolmogorov

Projection-free optimization via different variants of the Frank-Wolfe (FW), a.k.a. Conditional Gradient method has become one of the cornerstones in optimization for machine learning since in many cases the linear minimization oracle is…

最优化与控制 · 数学 2020-06-30 Pavel Dvurechensky , Petr Ostroukhov , Kamil Safin , Shimrit Shtern , Mathias Staudigl

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

最优化与控制 · 数学 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

Decentralized optimization algorithms have received much attention due to the recent advances in network information processing. However, conventional decentralized algorithms based on projected gradient descent are incapable of handling…

最优化与控制 · 数学 2018-08-29 Hoi-To Wai , Jean Lafond , Anna Scaglione , Eric Moulines

Frank-Wolfe methods (FW) have gained significant interest in the machine learning community due to its ability to efficiently solve large problems that admit a sparse structure (e.g. sparse vectors and low-rank matrices). However the…

机器学习 · 统计学 2018-03-22 Edward Cheung , Yuying Li

The Frank-Wolfe optimization algorithm has recently regained popularity for machine learning applications due to its projection-free property and its ability to handle structured constraints. However, in the stochastic learning setting, it…

机器学习 · 计算机科学 2017-09-15 Elad Hazan , Haipeng Luo

In this paper, we consider approximate Frank-Wolfe (FW) algorithms to solve convex optimization problems over graph-structured support sets where the linear minimization oracle (LMO) cannot be efficiently obtained in general. We first…

最优化与控制 · 数学 2022-06-20 Baojian Zhou , Yifan Sun

The boosted Frank-Wolfe algorithm accelerates the classical Frank-Wolfe algorithm by better aligning the update direction with the negative gradient. Its analysis, however, has been limited to deterministic convex problems, with step sizes…

最优化与控制 · 数学 2026-05-26 Navil Nandhan , Abbas Khademi , Antonio Silveti-Falls

A broad class of convex optimization problems can be formulated as a semidefinite program (SDP), minimization of a convex function over the positive-semidefinite cone subject to some affine constraints. The majority of classical SDP solvers…

最优化与控制 · 数学 2019-10-30 Francesco Locatello , Alp Yurtsever , Olivier Fercoq , Volkan Cevher

We investigate variants of the Frank-Wolfe (FW) algorithm for smoothing and strongly convex optimization over polyhedral sets, with the goal of designing algorithms that achieve linear convergence while minimizing per-iteration complexity…

最优化与控制 · 数学 2025-09-30 Haoning Wang , Houduo Qi , Liping Zhang