English
Related papers

Related papers: A Newton Frank-Wolfe Method for Constrained Self-C…

200 papers

We develop new accelerated first-order algorithms in the Frank-Wolfe (FW) family for minimizing smooth convex functions over compact convex sets, with a focus on two prominent constraint classes: (1) polytopes and (2) matrix domains given…

Optimization and Control · Mathematics 2025-11-05 Dan Garber

We consider the Frank-Wolfe algorithm for solving variational inequalities over compact, convex sets under a monotone $C^1$ operator and vanishing, nonsummable step sizes. We introduce a continuous-time interpolation of the discrete…

Optimization and Control · Mathematics 2026-04-10 Matthew Hough

Conditional Gradient algorithms (aka Frank-Wolfe algorithms) form a classical set of methods for constrained smooth convex minimization due to their simplicity, the absence of projection steps, and competitive numerical performance. While…

Optimization and Control · Mathematics 2021-10-20 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

Some variant of the Frank-Wolfe method for convex optimization problems with adaptive selection of the step parameter corresponding to information about the smoothness of the objective function (the Lipschitz constant of the gradient).…

Optimization and Control · Mathematics 2023-08-01 G. V. Aivazian , F. S. Stonyakin , D. A. Pasechnyuk , M. S. Alkousa , A. M. Raigorodskii

This paper analyzes the convergence rates of the {\it Frank-Wolfe } method for solving convex constrained multiobjective optimization. We establish improved convergence rates under different assumptions on the objective function, the…

Optimization and Control · Mathematics 2024-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

Frank-Wolfe algorithms for convex minimization have recently gained considerable attention from the Optimization and Machine Learning communities, as their properties make them a suitable choice in a variety of applications. However, as…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Johan Suykens

Minimizing a function over an intersection of convex sets is an important task in optimization that is often much more challenging than minimizing it over each individual constraint set. While traditional methods such as Frank-Wolfe (FW) or…

Optimization and Control · Mathematics 2018-04-11 Gauthier Gidel , Fabian Pedregosa , Simon Lacoste-Julien

Mixed-integer nonlinear optimization encompasses a broad class of problems that present both theoretical and computational challenges. We propose a new type of method to solve these problems based on a branch-and-bound algorithm with convex…

Optimization and Control · Mathematics 2024-07-19 Deborah Hendrych , Hannah Troppens , Mathieu Besançon , Sebastian Pokutta

The Frank-Wolfe method has become increasingly useful in statistical and machine learning applications, due to the structure-inducing properties of the iterates, and especially in settings where linear minimization over the feasible set is…

Machine Learning · Computer Science 2024-12-16 Zikai Xiong , Robert M. Freund

We propose a novel Stochastic Frank-Wolfe (a.k.a. conditional gradient) algorithm for constrained smooth finite-sum minimization with a generalized linear prediction/structure. This class of problems includes empirical risk minimization…

Recently, there has been a renewed interest in the machine learning community for variants of a sparse greedy approximation procedure for concave optimization known as {the Frank-Wolfe (FW) method}. In particular, this procedure has been…

Computer Vision and Pattern Recognition · Computer Science 2015-10-27 Hector Allende , Emanuele Frandi , Ricardo Nanculef , Claudio Sartori

We introduce a few variants on Frank-Wolfe style algorithms suitable for large scale optimization. We show how to modify the standard Frank-Wolfe algorithm using stochastic gradients, approximate subproblem solutions, and sketched decision…

Optimization and Control · Mathematics 2018-08-17 Lijun Ding , Madeleine Udell

We give a simple and natural method for computing approximately optimal solutions for minimizing a convex function $f$ over a convex set $K$ given by a separation oracle. Our method utilizes the Frank--Wolfe algorithm over the cone of valid…

Optimization and Control · Mathematics 2022-03-14 Daniel Dadush , Christopher Hojny , Sophie Huiberts , Stefan Weltge

We address the problem of minimizing a convex smooth function $f(x)$ over a compact polyhedral set $D$ given a stochastic zeroth-order constraint feedback model. This problem arises in safety-critical machine learning applications, such as…

Optimization and Control · Mathematics 2019-12-10 Ilnura Usmanova , Andreas Krause , Maryam Kamgarpour

Error bound condition has recently gained revived interest in optimization. It has been leveraged to derive faster convergence for many popular algorithms, including subgradient methods, proximal gradient method and accelerated proximal…

Optimization and Control · Mathematics 2018-10-12 Yi Xu , Tianbao Yang

The Frank-Wolfe algorithm has seen a resurgence in popularity due to its ability to efficiently solve constrained optimization problems in machine learning and high-dimensional statistics. As such, there is much interest in establishing…

Machine Learning · Statistics 2022-05-19 Suhas Vijaykumar

We introduce a new projection-free (Frank-Wolfe) method for optimizing structured nonconvex functions that are expressed as a difference of two convex functions. This problem class subsumes smooth nonconvex minimization, positioning our…

Optimization and Control · Mathematics 2025-12-01 Hoomaan Maskan , Yikun Hou , Suvrit Sra , Alp Yurtsever

We tackle robust optimization problems under objective uncertainty in the oracle model, i.e., when the deterministic problem is solved by an oracle. The oracle-based setup is favorable in many situations, e.g., when a compact formulation of…

Optimization and Control · Mathematics 2024-12-06 Mathieu Besançon , Jannis Kurtz

In recent years it was proved that simple modifications of the classical Frank-Wolfe algorithm (aka conditional gradient algorithm) for smooth convex minimization over convex and compact polytopes, converge with linear rate, assuming the…

Optimization and Control · Mathematics 2021-01-08 Dan Garber

The Frank-Wolfe method solves smooth constrained convex optimization problems at a generic sublinear rate of $\mathcal{O}(1/T)$, and it (or its variants) enjoys accelerated convergence rates for two fundamental classes of constraints:…

Optimization and Control · Mathematics 2020-06-17 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta