English
Related papers

Related papers: Reducing Discretization Error in the Frank-Wolfe M…

200 papers

We present an exact algorithm for mean-risk optimization subject to a budget constraint, where decision variables may be continuous or integer. The risk is measured by the covariance matrix and weighted by an arbitrary monotone function,…

Optimization and Control · Mathematics 2017-05-08 Christoph Buchheim , Marianna De Santis , Francesco Rinaldi , Long Trieu

Recently the away-step Frank-Wolfe algoritm for constrained multiobjective optimization has been shown linear convergence rate over a polytope which is generated by finite points set. In this paper we design a decomposition-invariant…

Optimization and Control · Mathematics 2024-09-10 Zhuoxin Fan , Liping Tang

We consider smooth convex minimization over compact convex sets, i.e., $\min_{x \in C} f(x)$ with the (vanilla) Frank-Wolfe algorithm. Well-known lower bounds establish a worst-case $\Omega(1/t)$ primal-gap barrier in the general smooth…

Optimization and Control · Mathematics 2026-05-05 Sebastian Pokutta

This paper focuses on convex constrained optimization problems, where the solution is subject to a convex inequality constraint. In particular, we aim at challenging problems for which both projection into the constrained domain and a…

Optimization and Control · Mathematics 2017-06-13 Tianbao Yang , Qihang Lin , Lijun Zhang

We study the convergence properties of the original and away-step Frank-Wolfe algorithms for linearly constrained stochastic optimization assuming the availability of unbiased objective function gradient estimates. The objective function is…

Optimization and Control · Mathematics 2025-04-08 Natthawut Boonsiriphatthanajaroen , Shane G. Henderson

We develop new accelerated first-order algorithms in the Frank-Wolfe (FW) family for minimizing smooth convex functions over compact convex sets, with a focus on two prominent constraint classes: (1) polytopes and (2) matrix domains given…

Optimization and Control · Mathematics 2025-11-05 Dan Garber

We develop parallel and distributed Frank-Wolfe algorithms; the former on shared memory machines with mini-batching, and the latter in a delayed update framework. Whenever possible, we perform computations asynchronously, which helps attain…

Machine Learning · Statistics 2016-02-16 Yu-Xiang Wang , Veeranjaneyulu Sadhanala , Wei Dai , Willie Neiswanger , Suvrit Sra , Eric P. Xing

We give a simple proof that the Frank-Wolfe algorithm obtains a stationary point at a rate of $O(1/\sqrt{t})$ on non-convex objectives with a Lipschitz continuous gradient. Our analysis is affine invariant and is the first, to the best of…

Optimization and Control · Mathematics 2016-07-07 Simon Lacoste-Julien

We study the linear convergence of variants of the Frank-Wolfe algorithms for some classes of strongly convex problems, using only affine-invariant quantities. As in Guelat & Marcotte (1986), we show the linear convergence of the standard…

Optimization and Control · Mathematics 2014-01-06 Simon Lacoste-Julien , Martin Jaggi

Multi-category support vector machine (MC-SVM) is one of the most popular machine learning algorithms. There are lots of variants of MC-SVM, although different optimization algorithms were developed for different learning machines. In this…

Machine Learning · Computer Science 2021-11-10 Kenya Tajima , Yoshihiro Hirohashi , Esmeraldo Ronnie Rey Zara , Tsuyoshi Kato

We study a phase retrieval problem in the Poisson noise model. Motivated by the PhaseLift approach, we approximate the maximum-likelihood estimator by solving a convex program with a nuclear norm constraint. While the Frank-Wolfe algorithm,…

Optimization and Control · Mathematics 2016-02-03 Gergely Odor , Yen-Huan Li , Alp Yurtsever , Ya-Ping Hsieh , Quoc Tran-Dinh , Marwa El Halabi , Volkan Cevher

In constrained convex optimization, existing methods based on the ellipsoid or cutting plane method do not scale well with the dimension of the ambient space. Alternative approaches such as Projected Gradient Descent only provide a…

Optimization and Control · Mathematics 2021-11-11 Zakaria Mhammedi

In this paper, we consider Frank-Wolfe-based algorithms for composite convex optimization problems with objective involving a logarithmically-homogeneous, self-concordant functions. Recent Frank-Wolfe-based methods for this class of…

Optimization and Control · Mathematics 2023-10-24 Nimita Shinde , Vishnu Narayanan , James Saunderson

We study a class of convex-concave saddle-point problems of the form $\min_x\max_y \langle Kx,y\rangle+f_{\cal{P}}(x)-h^\ast(y)$ where $K$ is a linear operator, $f_{\cal{P}}$ is the sum of a convex function $f$ with a Lipschitz-continuous…

Optimization and Control · Mathematics 2021-06-07 Vladimir Kolmogorov , Thomas Pock

In this paper, we consider a distributed online convex optimization problem over a time-varying multi-agent network. The goal of this network is to minimize a global loss function through local computation and communication with neighbors.…

Optimization and Control · Mathematics 2024-06-17 Wentao Zhang , Yang Shi , Baoyong Zhang , Deming Yuan

We design Local LMO - a new projection-free gradient-type method for constrained optimization. The key algorithmic idea is to replace the global linear minimization oracle over the constraint set used by Frank-Wolfe (FW) with a local linear…

Optimization and Control · Mathematics 2026-05-12 Peter Richtárik , Kaja Gruntkowska , Hanmin Li

In recent years it was proved that simple modifications of the classical Frank-Wolfe algorithm (aka conditional gradient algorithm) for smooth convex minimization over convex and compact polytopes, converge with linear rate, assuming the…

Optimization and Control · Mathematics 2021-01-08 Dan Garber

We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained smooth convex-concave saddle point (SP) problems. Remarkably, the method only requires access to linear minimization oracles. Leveraging recent advances in FW…

Optimization and Control · Mathematics 2017-03-07 Gauthier Gidel , Tony Jebara , Simon Lacoste-Julien

In the paper, we propose a class of accelerated stochastic gradient-free and projection-free (a.k.a., zeroth-order Frank-Wolfe) methods to solve the constrained stochastic and finite-sum nonconvex optimization. Specifically, we propose an…

Optimization and Control · Mathematics 2020-08-11 Feihu Huang , Lue Tao , Songcan Chen

This paper showcases the theoretical and numerical performance of the Sliding Frank-Wolfe, which is a novel optimization algorithm to solve the BLASSO sparse spikes super-resolution problem. The BLASSO is a continuous (i.e. off-the-grid or…

Numerical Analysis · Mathematics 2018-11-16 Quentin Denoyelle , Vincent Duval , Gabriel Peyré , Emmanuel Soubies