English
Related papers

Related papers: A Deterministic Nonsmooth Frank Wolfe Algorithm wi…

200 papers

Frank-Wolfe algorithm (FW) and its variants have gained a surge of interests in machine learning community due to its projection-free property. Recently people have reduced the gradient evaluation complexity of FW algorithm to…

Machine Learning · Statistics 2018-05-22 Yan Li , Chao Qu , Huan Xu

We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained smooth convex-concave saddle point (SP) problems. Remarkably, the method only requires access to linear minimization oracles. Leveraging recent advances in FW…

Optimization and Control · Mathematics 2017-03-07 Gauthier Gidel , Tony Jebara , Simon Lacoste-Julien

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe…

Optimization and Control · Mathematics 2019-06-11 Paul Grigas , Alfonso Lobos , Nathan Vermeersch

In this paper, we consider Frank-Wolfe-based algorithms for composite convex optimization problems with objective involving a logarithmically-homogeneous, self-concordant functions. Recent Frank-Wolfe-based methods for this class of…

Optimization and Control · Mathematics 2023-10-24 Nimita Shinde , Vishnu Narayanan , James Saunderson

Conditional Gradient algorithms (aka Frank-Wolfe algorithms) form a classical set of methods for constrained smooth convex minimization due to their simplicity, the absence of projection steps, and competitive numerical performance. While…

Optimization and Control · Mathematics 2021-10-20 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

This paper is concerned with the Frank--Wolfe algorithm for a special class of {\it non-compact} constrained optimization problems. The notion of asymptotic cone is used to introduce this class of problems as well as to establish that the…

Optimization and Control · Mathematics 2021-09-29 O. P. Ferreira , W. S. Sosa

We address a large-scale and nonconvex optimization problem, involving an aggregative term. This term can be interpreted as the sum of the contributions of N agents to some common good, with N large. We investigate a relaxation of this…

Optimization and Control · Mathematics 2023-06-19 J. Frédéric Bonnans , Kang Liu , Nadia Oudjane , Laurent Pfeiffer , Cheng Wan

In this paper, we provide a sub-gradient based algorithm to solve general constrained convex optimization without taking projections onto the domain set. The well studied Frank-Wolfe type algorithms also avoid projections. However, they are…

Optimization and Control · Mathematics 2023-06-16 Kamiar Asgari , Michael J. Neely

We investigate a class of nonconvex optimization problems characterized by a feasible set consisting of level-bounded nonconvex regularizers, with a continuously differentiable objective. We propose a novel hybrid approach to tackle such…

Optimization and Control · Mathematics 2024-10-28 Xiangyu Yang , Hao Wang , Yichen Zhu , Xiao Wang

In this paper, we consider approximate Frank-Wolfe (FW) algorithms to solve convex optimization problems over graph-structured support sets where the linear minimization oracle (LMO) cannot be efficiently obtained in general. We first…

Optimization and Control · Mathematics 2022-06-20 Baojian Zhou , Yifan Sun

We revisit the Frank-Wolfe (FW) optimization under strongly convex constraint sets. We provide a faster convergence rate for FW without line search, showing that a previously overlooked variant of FW is indeed faster than the standard…

Machine Learning · Computer Science 2019-02-01 Jarrid Rector-Brooks , Jun-Kun Wang , Barzan Mozafari

Frank-Wolfe algorithms for convex minimization have recently gained considerable attention from the Optimization and Machine Learning communities, as their properties make them a suitable choice in a variety of applications. However, as…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Johan Suykens

It is known that the Frank-Wolfe (FW) algorithm, which is affine-covariant, enjoys accelerated convergence rates when the constraint set is strongly convex. However, these results rely on norm-dependent assumptions, usually incurring…

Optimization and Control · Mathematics 2020-11-09 Thomas Kerdreux , Lewis Liu , Simon Lacoste-Julien , Damien Scieur

The Frank-Wolfe (FW) optimization algorithm has lately re-gained popularity thanks in particular to its ability to nicely handle the structured constraints appearing in machine learning applications. However, its convergence rate is known…

Optimization and Control · Mathematics 2015-11-19 Simon Lacoste-Julien , Martin Jaggi

We propose an algorithm which appears to be the first bridge between the fields of conditional gradient methods and abs-smooth optimization. Our problem setting is motivated by various applications that lead to nonsmoothness, such as…

Optimization and Control · Mathematics 2023-07-20 Timo Kreimeier , Sebastian Pokutta , Andrea Walther , Zev Woodstock

We analyze two novel randomized variants of the Frank-Wolfe (FW) or conditional gradient algorithm. While classical FW algorithms require solving a linear minimization problem over the domain at each iteration, the proposed method only…

Optimization and Control · Mathematics 2018-03-21 Thomas Kerdreux , Fabian Pedregosa , Alexandre d'Aspremont

Frank-Wolfe algorithms (FW) are popular first-order methods for solving constrained convex optimization problems that rely on a linear minimization oracle instead of potentially expensive projection-like oracles. Many works have identified…

Optimization and Control · Mathematics 2023-09-18 Elias Wirth , Thomas Kerdreux , Sebastian Pokutta

We study constrained stochastic programs where the decision vector at each time slot cannot be chosen freely but is tied to the realization of an underlying random state vector. The goal is to minimize a general objective function subject…

Optimization and Control · Mathematics 2018-06-05 Xiaohan Wei , Michael J. Neely

The Frank-Wolfe method solves smooth constrained convex optimization problems at a generic sublinear rate of $\mathcal{O}(1/T)$, and it (or its variants) enjoys accelerated convergence rates for two fundamental classes of constraints:…

Optimization and Control · Mathematics 2020-06-17 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

We consider the Frank-Wolfe algorithm for solving variational inequalities over compact, convex sets under a monotone $C^1$ operator and vanishing, nonsummable step sizes. We introduce a continuous-time interpolation of the discrete…

Optimization and Control · Mathematics 2026-04-10 Matthew Hough