English
Related papers

Related papers: Minding the Gaps for Block Frank-Wolfe Optimizatio…

200 papers

We study the Frank-Wolfe algorithm for constrained optimization problems with relatively smooth objectives. Building upon our previous work, we propose a fully adaptive variant of the Frank-Wolfe method that dynamically adjusts the step…

Optimization and Control · Mathematics 2025-08-27 A. A. Vyguzov , F. S. Stonyakin

This work proposes a new algorithm for training a re-weighted L2 Support Vector Machine (SVM), inspired on the re-weighted Lasso algorithm of Cand\`es et al. and on the equivalence between Lasso and SVM shown recently by Jaggi. In…

Machine Learning · Computer Science 2018-04-16 Carlos M. Alaíz , Johan A. K. Suykens

We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained smooth convex-concave saddle point (SP) problems. Remarkably, the method only requires access to linear minimization oracles. Leveraging recent advances in FW…

Optimization and Control · Mathematics 2017-03-07 Gauthier Gidel , Tony Jebara , Simon Lacoste-Julien

The Frank-Wolfe (FW) method is a popular approach for solving optimization problems with structured constraints that arise in machine learning applications. In recent years, stochastic versions of FW have gained popularity, motivated by…

Optimization and Control · Mathematics 2024-09-17 Aleksandr Beznosikov , David Dobre , Gauthier Gidel

The Frank-Wolfe (FW) method is a popular algorithm for solving large-scale convex optimization problems appearing in structured statistical learning. However, the traditional Frank-Wolfe method can only be applied when the feasible region…

Optimization and Control · Mathematics 2021-10-11 Haoyue Wang , Haihao Lu , Rahul Mazumder

The purpose of this survey is to serve both as a gentle introduction and a coherent overview of state-of-the-art Frank--Wolfe algorithms, also called conditional gradient algorithms, for function minimization. These algorithms are…

The Frank-Wolfe (FW) optimization algorithm has lately re-gained popularity thanks in particular to its ability to nicely handle the structured constraints appearing in machine learning applications. However, its convergence rate is known…

Optimization and Control · Mathematics 2015-11-19 Simon Lacoste-Julien , Martin Jaggi

The paper presents various modifications of the Frank-Wolfe algorithm in the equilibrium traffic assignment problem. The Beckman model is used as a model for experiments. In this article, first of all, attention is paid to the choice of the…

Optimization and Control · Mathematics 2024-03-11 Igor N. Ignashin , Demyan V. Yarmoshik

We study Frank-Wolfe methods for nonconvex stochastic and finite-sum optimization problems. Frank-Wolfe methods (in the convex case) have gained tremendous recent interest in machine learning and optimization communities due to their…

Optimization and Control · Mathematics 2016-08-01 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

As a projection-free algorithm, Frank-Wolfe (FW) method, also known as conditional gradient, has recently received considerable attention in the machine learning community. In this dissertation, we study several topics on the FW variants…

Optimization and Control · Mathematics 2021-05-11 Mingrui Zhang

We present a new proximal bundle method for Maximum-A-Posteriori (MAP) inference in structured energy minimization problems. The method optimizes a Lagrangean relaxation of the original energy minimization problem using a multi plane…

Machine Learning · Computer Science 2019-04-08 Paul Swoboda , Vladimir Kolmogorov

Projection-free optimization via different variants of the Frank-Wolfe (FW), a.k.a. Conditional Gradient method has become one of the cornerstones in optimization for machine learning since in many cases the linear minimization oracle is…

Optimization and Control · Mathematics 2020-06-30 Pavel Dvurechensky , Petr Ostroukhov , Kamil Safin , Shimrit Shtern , Mathias Staudigl

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

Optimization and Control · Mathematics 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

Decentralized optimization algorithms have received much attention due to the recent advances in network information processing. However, conventional decentralized algorithms based on projected gradient descent are incapable of handling…

Optimization and Control · Mathematics 2018-08-29 Hoi-To Wai , Jean Lafond , Anna Scaglione , Eric Moulines

Frank-Wolfe methods (FW) have gained significant interest in the machine learning community due to its ability to efficiently solve large problems that admit a sparse structure (e.g. sparse vectors and low-rank matrices). However the…

Machine Learning · Statistics 2018-03-22 Edward Cheung , Yuying Li

The Frank-Wolfe optimization algorithm has recently regained popularity for machine learning applications due to its projection-free property and its ability to handle structured constraints. However, in the stochastic learning setting, it…

Machine Learning · Computer Science 2017-09-15 Elad Hazan , Haipeng Luo

In this paper, we consider approximate Frank-Wolfe (FW) algorithms to solve convex optimization problems over graph-structured support sets where the linear minimization oracle (LMO) cannot be efficiently obtained in general. We first…

Optimization and Control · Mathematics 2022-06-20 Baojian Zhou , Yifan Sun

The boosted Frank-Wolfe algorithm accelerates the classical Frank-Wolfe algorithm by better aligning the update direction with the negative gradient. Its analysis, however, has been limited to deterministic convex problems, with step sizes…

Optimization and Control · Mathematics 2026-05-26 Navil Nandhan , Abbas Khademi , Antonio Silveti-Falls

A broad class of convex optimization problems can be formulated as a semidefinite program (SDP), minimization of a convex function over the positive-semidefinite cone subject to some affine constraints. The majority of classical SDP solvers…

Optimization and Control · Mathematics 2019-10-30 Francesco Locatello , Alp Yurtsever , Olivier Fercoq , Volkan Cevher

We investigate variants of the Frank-Wolfe (FW) algorithm for smoothing and strongly convex optimization over polyhedral sets, with the goal of designing algorithms that achieve linear convergence while minimizing per-iteration complexity…

Optimization and Control · Mathematics 2025-09-30 Haoning Wang , Houduo Qi , Liping Zhang