English
Related papers

Related papers: Frank-Wolfe Algorithm for the Exact Sparse Problem

200 papers

Nous nous int\'eressons \`a la reconstruction parcimonieuse d'images \`a l'aide du probl\`eme d'optimisation r\'egularis\'e LASSO. Dans de nombreuses applications pratiques, les grandes dimensions des objets \`a reconstruire limitent, voire…

Signal Processing · Electrical Eng. & Systems 2022-04-29 Adrian Jarret , Matthieu Simeoni , Julien Fageot

We study the linear convergence of variants of the Frank-Wolfe algorithms for some classes of strongly convex problems, using only affine-invariant quantities. As in Guelat & Marcotte (1986), we show the linear convergence of the standard…

Optimization and Control · Mathematics 2014-01-06 Simon Lacoste-Julien , Martin Jaggi

This paper showcases the theoretical and numerical performance of the Sliding Frank-Wolfe, which is a novel optimization algorithm to solve the BLASSO sparse spikes super-resolution problem. The BLASSO is a continuous (i.e. off-the-grid or…

Numerical Analysis · Mathematics 2018-11-16 Quentin Denoyelle , Vincent Duval , Gabriel Peyré , Emmanuel Soubies

In this paper we provide an introduction to the Frank-Wolfe algorithm, a method for smooth convex optimization in the presence of (relatively) complicated constraints. We will present the algorithm, introduce key concepts, and establish…

Optimization and Control · Mathematics 2023-11-30 Sebastian Pokutta

We propose a fast and scalable Polyatomic Frank-Wolfe (P-FW) algorithm for the resolution of high-dimensional LASSO regression problems. The latter improves upon traditional Frank-Wolfe methods by considering generalized greedy steps with…

Signal Processing · Electrical Eng. & Systems 2022-03-03 Adrian Jarret , Julien Fageot , Matthieu Simeoni

It is known that the Frank-Wolfe (FW) algorithm, which is affine-covariant, enjoys accelerated convergence rates when the constraint set is strongly convex. However, these results rely on norm-dependent assumptions, usually incurring…

Optimization and Control · Mathematics 2020-11-09 Thomas Kerdreux , Lewis Liu , Simon Lacoste-Julien , Damien Scieur

Maximizing a DR-submodular function subject to a general convex set is an NP-hard problem arising from many applications in combinatorial optimization and machine learning. While it is highly desirable to design efficient approximation…

Data Structures and Algorithms · Computer Science 2022-03-29 Donglei Du , Zhicheng Liu , Chenchen Wu , Dachuan Xu , Yang Zhou

Recently, the Frank-Wolfe optimization algorithm was suggested as a procedure to obtain adaptive quadrature rules for integrals of functions in a reproducing kernel Hilbert space (RKHS) with a potentially faster rate of convergence than…

Machine Learning · Statistics 2015-02-11 Simon Lacoste-Julien , Fredrik Lindsten , Francis Bach

We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained smooth convex-concave saddle point (SP) problems. Remarkably, the method only requires access to linear minimization oracles. Leveraging recent advances in FW…

Optimization and Control · Mathematics 2017-03-07 Gauthier Gidel , Tony Jebara , Simon Lacoste-Julien

Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the…

Machine Learning · Computer Science 2018-06-27 Han Zhao , Geoff Gordon

We study a phase retrieval problem in the Poisson noise model. Motivated by the PhaseLift approach, we approximate the maximum-likelihood estimator by solving a convex program with a nuclear norm constraint. While the Frank-Wolfe algorithm,…

Optimization and Control · Mathematics 2016-02-03 Gergely Odor , Yen-Huan Li , Alp Yurtsever , Ya-Ping Hsieh , Quoc Tran-Dinh , Marwa El Halabi , Volkan Cevher

We propose a variant of the Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The proposed Primal-Dual Block…

Machine Learning · Computer Science 2019-06-07 Qi Lei , Jiacheng Zhuo , Constantine Caramanis , Inderjit S. Dhillon , Alexandros G. Dimakis

We derive a memory-efficient first-order variable splitting algorithm for convex image reconstruction problems with non-smooth regularization terms. The algorithm is based on a primal-dual approach, where one of the dual variables is…

Optimization and Control · Mathematics 2019-04-02 Greg Ongie , Naveen Murthy , Laura Balzano , Jeffrey A. Fessler

We consider variants of the classical Frank-Wolfe algorithm for constrained smooth convex minimization, that instead of access to the standard oracle for minimizing a linear function over the feasible set, have access to an oracle that can…

Optimization and Control · Mathematics 2022-02-10 Dan Garber , Noam Wolf

Frank-Wolfe algorithms have recently regained the attention of the Machine Learning community. Their solid theoretical properties and sparsity guarantees make them a suitable choice for a wide range of problems in this field. In addition,…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Johan A. K. Suykens

We propose Frank--Wolfe (FW) algorithms with an adaptive Bregman step-size strategy for smooth adaptable (also called: relatively smooth) (weakly-) convex functions. This means that the gradient of the objective function is not necessarily…

Optimization and Control · Mathematics 2026-02-19 Shota Takahashi , Sebastian Pokutta , Akiko Takeda

We propose an accelerated algorithm with a Frank-Wolfe method as an oracle for solving strongly monotone variational inequality problems. While standard solution approaches, such as projected gradient descent (aka value iteration), involve…

Optimization and Control · Mathematics 2025-10-07 Reza Rahimi Baghbadorani , Peyman Mohajerin Esfahani , Sergio Grammatico

Some variant of the Frank-Wolfe method for convex optimization problems with adaptive selection of the step parameter corresponding to information about the smoothness of the objective function (the Lipschitz constant of the gradient).…

Optimization and Control · Mathematics 2023-08-01 G. V. Aivazian , F. S. Stonyakin , D. A. Pasechnyuk , M. S. Alkousa , A. M. Raigorodskii

Sparse inverse covariance selection is a fundamental problem for analyzing dependencies in high dimensional data. However, such a problem is difficult to solve since it is NP-hard. Existing solutions are primarily based on convex…

Numerical Analysis · Computer Science 2018-04-05 Ganzhao Yuan , Haoxian Tan , Wei-Shi Zheng

This paper studies the problem of sampling vector and tensor signals, which is the process of choosing sites in vectors and tensors to place sensors for better recovery. A small core tensor and multiple factor matrices can be used to…

Optimization and Control · Mathematics 2024-07-03 Hao Li , Dong Liang , Zixi Zhou , Zheng Xie