English
Related papers

Related papers: The Sliding Frank-Wolfe Algorithm and its Applicat…

200 papers

We propose a novel Stochastic Frank-Wolfe (a.k.a. conditional gradient) algorithm for constrained smooth finite-sum minimization with a generalized linear prediction/structure. This class of problems includes empirical risk minimization…

The Frank-Wolfe algorithm, a very first optimization method and also known as the conditional gradient method, was introduced by Frank and Wolfe in 1956. Due to its simple linear subproblems, the Frank-Wolfe algorithm has recently been…

Optimization and Control · Mathematics 2017-10-23 Hong-Kun Xu

This article analyzes the recovery performance of two popular finite dimensional approximations of the sparse spikes deconvolution problem over Radon measures. We examine in a unified framework both the L1 regularization (often referred to…

Information Theory · Computer Science 2015-03-31 Vincent Duval , Gabriel Peyré

We develop a Frank-Wolfe algorithm with corrective steps, generalizing previous algorithms including blended conditional gradients, blended pairwise conditional gradients, and fully-corrective Frank-Wolfe. For this, we prove tight…

Optimization and Control · Mathematics 2026-05-21 Jannis Halbey , Seta Rakotomandimby , Mathieu Besançon , Sébastien Designolle , Sebastian Pokutta

We study a phase retrieval problem in the Poisson noise model. Motivated by the PhaseLift approach, we approximate the maximum-likelihood estimator by solving a convex program with a nuclear norm constraint. While the Frank-Wolfe algorithm,…

Optimization and Control · Mathematics 2016-02-03 Gergely Odor , Yen-Huan Li , Alp Yurtsever , Ya-Ping Hsieh , Quoc Tran-Dinh , Marwa El Halabi , Volkan Cevher

This paper presents a subgradient-based algorithm for constrained nonsmooth convex optimization that does not require projections onto the feasible set. While the well-established Frank-Wolfe algorithm and its variants already avoid…

Optimization and Control · Mathematics 2024-09-04 Kamiar Asgari , Michael J. Neely

Some variant of the Frank-Wolfe method for convex optimization problems with adaptive selection of the step parameter corresponding to information about the smoothness of the objective function (the Lipschitz constant of the gradient).…

Optimization and Control · Mathematics 2023-08-01 G. V. Aivazian , F. S. Stonyakin , D. A. Pasechnyuk , M. S. Alkousa , A. M. Raigorodskii

We present a new approach leveraging the Sliding Frank--Wolfe algorithm to address the challenge of line recovery in degraded images. Building upon advances in conditional gradient methods for sparse inverse problems with differentiable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Kévin Polisano , Basile Dubois-Bonnaire , Sylvain Meignen

We propose an algorithm which appears to be the first bridge between the fields of conditional gradient methods and abs-smooth optimization. Our problem setting is motivated by various applications that lead to nonsmoothness, such as…

Optimization and Control · Mathematics 2023-07-20 Timo Kreimeier , Sebastian Pokutta , Andrea Walther , Zev Woodstock

Sparse regularization is a central technique for both machine learning (to achieve supervised features selection or unsupervised mixture learning) and imaging sciences (to achieve super-resolution). Existing performance guaranties assume a…

Information Theory · Computer Science 2018-10-09 Clarice Poon , Nicolas Keriven , Gabriel Peyré

We propose an enhanced zeroth-order stochastic Frank-Wolfe framework to address constrained finite-sum optimization problems, a structure prevalent in large-scale machine-learning applications. Our method introduces a novel double variance…

Machine Learning · Computer Science 2025-01-24 Haishan Ye , Yinghui Huang , Hao Di , Xiangyu Chang

In the present paper, we formulate two versions of Frank--Wolfe algorithm or conditional gradient method to solve the DC optimization problem with an adaptive step size. The DC objective function consists of two components; the first is…

Optimization and Control · Mathematics 2026-02-02 R. Díaz Millán , O. P. Ferreira , J. Ugon

The Conditional Gradient (or Frank-Wolfe) method is one of the most well-known methods for solving constrained optimization problems appearing in various machine learning tasks. The simplicity of iteration and applicability to many…

Optimization and Control · Mathematics 2024-09-17 Ruslan Nazykov , Aleksandr Shestakov , Vladimir Solodkin , Aleksandr Beznosikov , Gauthier Gidel , Alexander Gasnikov

We investigate variants of the Frank-Wolfe (FW) algorithm for smoothing and strongly convex optimization over polyhedral sets, with the goal of designing algorithms that achieve linear convergence while minimizing per-iteration complexity…

Optimization and Control · Mathematics 2025-09-30 Haoning Wang , Houduo Qi , Liping Zhang

We study the Frank-Wolfe algorithm for constrained optimization problems with relatively smooth objectives. Building upon our previous work, we propose a fully adaptive variant of the Frank-Wolfe method that dynamically adjusts the step…

Optimization and Control · Mathematics 2025-08-27 A. A. Vyguzov , F. S. Stonyakin

The Frank-Wolfe (FW) method, which implements efficient linear oracles that minimize linear approximations of the objective function over a fixed compact convex set, has recently received much attention in the optimization and machine…

Optimization and Control · Mathematics 2024-01-19 Liaoyuan Zeng , Yongle Zhang , Guoyin Li , Ting Kei Pong , Xiaozhou Wang

The boosted Frank-Wolfe algorithm accelerates the classical Frank-Wolfe algorithm by better aligning the update direction with the negative gradient. Its analysis, however, has been limited to deterministic convex problems, with step sizes…

Optimization and Control · Mathematics 2026-05-26 Navil Nandhan , Abbas Khademi , Antonio Silveti-Falls

We propose a new version of the Frank-Wolfe method, called the (L0, L1)-Frank-Wolfe algorithm, developed for optimization problems with (L0, L1)-smooth objectives. We establish that this algorithm achieves superior theoretical convergence…

Optimization and Control · Mathematics 2026-05-21 A. A. Vyguzov , F. S. Stonyakin

We study the properties of the Frank-Wolfe algorithm to solve the m-EXACT-SPARSE reconstruction problem, where a signal y must be expressed as a sparse linear combination of a predefined set of atoms, called dictionary. We prove that when…

Optimization and Control · Mathematics 2019-05-28 Farah Cherfaoui , Valentin Emiya , Liva Ralaivola , Sandrine Anthoine

The Frank-Wolfe algorithm is a popular method in structurally constrained machine learning applications, due to its fast per-iteration complexity. However, one major limitation of the method is a slow rate of convergence that is difficult…

Optimization and Control · Mathematics 2023-04-14 Zhaoyue Chen , Yifan Sun