English
Related papers

Related papers: Approximate FW Algorithm with a novel DMO method o…

200 papers

We propose a randomized block-coordinate variant of the classic Frank-Wolfe algorithm for convex optimization with block-separable constraints. Despite its lower iteration cost, we show that it achieves a similar convergence rate in duality…

Machine Learning · Computer Science 2013-01-15 Simon Lacoste-Julien , Martin Jaggi , Mark Schmidt , Patrick Pletscher

In this paper, we use composite optimization algorithms to solve sigmoid networks. We equivalently transfer the sigmoid networks to a convex composite optimization and propose the composite optimization algorithms based on the linearized…

Optimization and Control · Mathematics 2023-07-10 Huixiong Chen , Qi Ye

In this paper, the online variants of the classical Frank-Wolfe algorithm are considered. We consider minimizing the regret with a stochastic cost. The online algorithms only require simple iterative updates and a non-adaptive step size…

Machine Learning · Statistics 2016-08-16 Jean Lafond , Hoi-To Wai , Eric Moulines

Frank-Wolfe methods are projection-free algorithms for constrained optimization whose practical performance often depends critically on the choice of step size. Classical closed-loop step-size rules typically require prior knowledge of a…

Optimization and Control · Mathematics 2026-05-29 Khanh-Hung Giang-Tran , Soroosh Shafiee , Nam Ho-Nguyen

The Frank-Wolfe method solves smooth constrained convex optimization problems at a generic sublinear rate of $\mathcal{O}(1/T)$, and it (or its variants) enjoys accelerated convergence rates for two fundamental classes of constraints:…

Optimization and Control · Mathematics 2020-06-17 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

Many problems in real life can be converted to combinatorial optimization problems (COPs) on graphs, that is to find a best node state configuration or a network structure such that the designed objective function is optimized under some…

Machine Learning · Computer Science 2019-09-17 Jing Liu , Fei Gao , Jiang Zhang

The Frank-Wolfe algorithm has seen a resurgence in popularity due to its ability to efficiently solve constrained optimization problems in machine learning and high-dimensional statistics. As such, there is much interest in establishing…

Machine Learning · Statistics 2022-05-19 Suhas Vijaykumar

Greedy optimization methods such as Matching Pursuit (MP) and Frank-Wolfe (FW) algorithms regained popularity in recent years due to their simplicity, effectiveness and theoretical guarantees. MP and FW address optimization over the linear…

Machine Learning · Computer Science 2017-11-21 Francesco Locatello , Michael Tschannen , Gunnar Rätsch , Martin Jaggi

The Frank-Wolfe algorithm has regained much interest in its use in structurally constrained machine learning applications. However, one major limitation of the Frank-Wolfe algorithm is the slow local convergence property due to the…

Optimization and Control · Mathematics 2022-10-18 Zhaoyue Chen , Yifan Sun

We consider the problem of minimizing a continuous function that may be nonsmooth and nonconvex, subject to bound constraints. We propose an algorithm that uses the L-BFGS quasi-Newton approximation of the problem's curvature together with…

Optimization and Control · Mathematics 2016-12-23 Nitish Shirish Keskar , Andreas Waechter

The Densest $k$-Subgraph (D$k$S) is a fundamental combinatorial problem known for its theoretical hardness and breadth of applications. Recently, Lu et al. (AAAI 2025) introduced a penalty-based non-convex relaxation that achieves promising…

Social and Information Networks · Computer Science 2026-02-03 Qiheng Lu , Nicholas D. Sidiropoulos , Aritra Konar

In the Upper Degree-Constrained Partial Orientation problem we are given an undirected graph $G=(V,E)$, together with two degree constraint functions $d^-,d^+ : V \to \mathbb{N}$. The goal is to orient as many edges as possible, in such a…

Data Structures and Algorithms · Computer Science 2014-10-13 Marek Cygan , Tomasz Kociumaka

In this paper, we propose several improvements on the block-coordinate Frank-Wolfe (BCFW) algorithm from Lacoste-Julien et al. (2013) recently used to optimize the structured support vector machine (SSVM) objective in the context of…

Machine Learning · Computer Science 2016-06-01 Anton Osokin , Jean-Baptiste Alayrac , Isabella Lukasewitz , Puneet K. Dokania , Simon Lacoste-Julien

Derivative-free optimization (DFO) is vital in solving complex optimization problems where only noisy function evaluations are available through an oracle. Within this domain, DFO via finite difference (FD) approximation has emerged as a…

Machine Learning · Computer Science 2025-02-19 Wang Du-Yi , Liang Guo , Liu Guangwu , Zhang Kun

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe…

Optimization and Control · Mathematics 2019-06-11 Paul Grigas , Alfonso Lobos , Nathan Vermeersch

We consider variants of the classical Frank-Wolfe algorithm for constrained smooth convex minimization, that instead of access to the standard oracle for minimizing a linear function over the feasible set, have access to an oracle that can…

Optimization and Control · Mathematics 2022-02-10 Dan Garber , Noam Wolf

This paper focuses on convex constrained optimization problems, where the solution is subject to a convex inequality constraint. In particular, we aim at challenging problems for which both projection into the constrained domain and a…

Optimization and Control · Mathematics 2017-06-13 Tianbao Yang , Qihang Lin , Lijun Zhang

The Frank-Wolfe method (a.k.a. conditional gradient algorithm) for smooth optimization has regained much interest in recent years in the context of large scale optimization and machine learning. A key advantage of the method is that it…

Optimization and Control · Mathematics 2015-08-17 Dan Garber , Elad Hazan

This work studies the linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). Searching this approximation in a data-driven approach is formalised as attempting to solve a low-rank…

Machine Learning · Statistics 2021-08-23 Patrick Héas , Cédric Herzet

In this paper, we show that the Away-step Stochastic Frank-Wolfe Algorithm (ASFW) and Pairwise Stochastic Frank-Wolfe algorithm (PSFW) converge linearly in expectation. We also show that if an algorithm convergences linearly in expectation…

Optimization and Control · Mathematics 2017-03-22 Donald Goldfarb , Garud Iyengar , Chaoxu Zhou