English
Related papers

Related papers: Linear Convergence of the Frank-Wolfe Algorithm ov…

200 papers

It is known that the gradient descent algorithm converges linearly when applied to a strongly convex function with Lipschitz gradient. In this case the algorithm's rate of convergence is determined by the condition number of the function.…

Optimization and Control · Mathematics 2016-12-28 Javier Pena , Daniel Rodriguez

We provide a template to derive convergence rates for the following popular versions of the Frank-Wolfe algorithm on polytopes: vanilla Frank-Wolfe, Frank-Wolfe with away steps, Frank-Wolfe with blended pairwise steps, and Frank-Wolfe with…

Optimization and Control · Mathematics 2025-05-21 Elias Wirth , Javier Pena , Sebastian Pokutta

In recent years it was proved that simple modifications of the classical Frank-Wolfe algorithm (aka conditional gradient algorithm) for smooth convex minimization over convex and compact polytopes, converge with linear rate, assuming the…

Optimization and Control · Mathematics 2021-01-08 Dan Garber

Recently the away-step Frank-Wolfe algoritm for constrained multiobjective optimization has been shown linear convergence rate over a polytope which is generated by finite points set. In this paper we design a decomposition-invariant…

Optimization and Control · Mathematics 2024-09-10 Zhuoxin Fan , Liping Tang

This paper analyzes the convergence rates of the {\it Frank-Wolfe } method for solving convex constrained multiobjective optimization. We establish improved convergence rates under different assumptions on the objective function, the…

Optimization and Control · Mathematics 2024-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

Frank-Wolfe methods are popular for optimization over a polytope. One of the reasons is because they do not need projection onto the polytope but only linear optimization over it. To understand its complexity, Lacoste-Julien and Jaggi…

Data Structures and Algorithms · Computer Science 2020-11-26 Luis Rademacher , Chang Shu

We develop a Frank-Wolfe algorithm with corrective steps, generalizing previous algorithms including blended conditional gradients, blended pairwise conditional gradients, and fully-corrective Frank-Wolfe. For this, we prove tight…

Optimization and Control · Mathematics 2026-05-21 Jannis Halbey , Seta Rakotomandimby , Mathieu Besançon , Sébastien Designolle , Sebastian Pokutta

We study the convergence properties of the original and away-step Frank-Wolfe algorithms for linearly constrained stochastic optimization assuming the availability of unbiased objective function gradient estimates. The objective function is…

Optimization and Control · Mathematics 2025-04-08 Natthawut Boonsiriphatthanajaroen , Shane G. Henderson

We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained smooth convex-concave saddle point (SP) problems. Remarkably, the method only requires access to linear minimization oracles. Leveraging recent advances in FW…

Optimization and Control · Mathematics 2017-03-07 Gauthier Gidel , Tony Jebara , Simon Lacoste-Julien

We study the convergence properties of the 'greedy' Frank-Wolfe algorithm with a unit step size, for a convex maximization problem over a compact set. We assume the function satisfies smoothness and strong convexity. These assumptions…

Optimization and Control · Mathematics 2025-05-02 Fatih Selim Aktas , Christian Kroer

We consider variants of the classical Frank-Wolfe algorithm for constrained smooth convex minimization, that instead of access to the standard oracle for minimizing a linear function over the feasible set, have access to an oracle that can…

Optimization and Control · Mathematics 2022-02-10 Dan Garber , Noam Wolf

Conditional Gradient algorithms (aka Frank-Wolfe algorithms) form a classical set of methods for constrained smooth convex minimization due to their simplicity, the absence of projection steps, and competitive numerical performance. While…

Optimization and Control · Mathematics 2021-10-20 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

Recently, several works have shown that natural modifications of the classical conditional gradient method (aka Frank-Wolfe algorithm) for constrained convex optimization, provably converge with a linear rate when: i) the feasible set is a…

Optimization and Control · Mathematics 2016-05-23 Dan Garber , Ofer Meshi

The Frank-Wolfe algorithm is a popular method for minimizing a smooth convex function $f$ over a compact convex set $\mathcal{C}$. While many convergence results have been derived in terms of function values, hardly nothing is known about…

Optimization and Control · Mathematics 2022-02-18 Jérôme Bolte , Cyrille W. Combettes , Édouard Pauwels

We investigate variants of the Frank-Wolfe (FW) algorithm for smoothing and strongly convex optimization over polyhedral sets, with the goal of designing algorithms that achieve linear convergence while minimizing per-iteration complexity…

Optimization and Control · Mathematics 2025-09-30 Haoning Wang , Houduo Qi , Liping Zhang

The Frank-Wolfe (FW) optimization algorithm has lately re-gained popularity thanks in particular to its ability to nicely handle the structured constraints appearing in machine learning applications. However, its convergence rate is known…

Optimization and Control · Mathematics 2015-11-19 Simon Lacoste-Julien , Martin Jaggi

We study the linear convergence of variants of the Frank-Wolfe algorithms for some classes of strongly convex problems, using only affine-invariant quantities. As in Guelat & Marcotte (1986), we show the linear convergence of the standard…

Optimization and Control · Mathematics 2014-01-06 Simon Lacoste-Julien , Martin Jaggi

The Frank-Wolfe method solves smooth constrained convex optimization problems at a generic sublinear rate of $\mathcal{O}(1/T)$, and it (or its variants) enjoys accelerated convergence rates for two fundamental classes of constraints:…

Optimization and Control · Mathematics 2020-06-17 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

We consider the Frank-Wolfe algorithm for solving variational inequalities over compact, convex sets under a monotone $C^1$ operator and vanishing, nonsummable step sizes. We introduce a continuous-time interpolation of the discrete…

Optimization and Control · Mathematics 2026-04-10 Matthew Hough

We present a blended conditional gradient approach for minimizing a smooth convex function over a polytope P, combining the Frank--Wolfe algorithm (also called conditional gradient) with gradient-based steps, different from away steps and…

Optimization and Control · Mathematics 2025-03-24 Gábor Braun , Sebastian Pokutta , Dan Tu , Stephen Wright
‹ Prev 1 2 3 10 Next ›