中文
相关论文

相关论文: Frank-Wolfe Algorithm for the Exact Sparse Problem

200 篇论文

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe…

最优化与控制 · 数学 2019-06-11 Paul Grigas , Alfonso Lobos , Nathan Vermeersch

Recently, there has been a renewed interest in the machine learning community for variants of a sparse greedy approximation procedure for concave optimization known as {the Frank-Wolfe (FW) method}. In particular, this procedure has been…

计算机视觉与模式识别 · 计算机科学 2015-10-27 Hector Allende , Emanuele Frandi , Ricardo Nanculef , Claudio Sartori

Conditional Gradient algorithms (aka Frank-Wolfe algorithms) form a classical set of methods for constrained smooth convex minimization due to their simplicity, the absence of projection steps, and competitive numerical performance. While…

最优化与控制 · 数学 2021-10-20 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

We study Frank-Wolfe algorithms - standard, pairwise, and away-steps - for efficient optimization of Dominant Set Clustering. We present a unified and computationally efficient framework to employ the different variants of Frank-Wolfe…

机器学习 · 计算机科学 2022-12-06 Carl Johnell , Morteza Haghir Chehreghani

Sparse representation-based classifiers have shown outstanding accuracy and robustness in image classification tasks even with the presence of intense noise and occlusion. However, it has been discovered that the performance degrades…

计算机视觉与模式识别 · 计算机科学 2015-12-22 Xiaoxia Sun , Nasser M. Nasrabadi , Trac D. Tran

We develop new accelerated first-order algorithms in the Frank-Wolfe (FW) family for minimizing smooth convex functions over compact convex sets, with a focus on two prominent constraint classes: (1) polytopes and (2) matrix domains given…

最优化与控制 · 数学 2025-11-05 Dan Garber

This work proposes a new algorithm for training a re-weighted L2 Support Vector Machine (SVM), inspired on the re-weighted Lasso algorithm of Cand\`es et al. and on the equivalence between Lasso and SVM shown recently by Jaggi. In…

机器学习 · 计算机科学 2018-04-16 Carlos M. Alaíz , Johan A. K. Suykens

Frank-Wolfe algorithms (FW) are popular first-order methods for solving constrained convex optimization problems that rely on a linear minimization oracle instead of potentially expensive projection-like oracles. Many works have identified…

最优化与控制 · 数学 2023-09-18 Elias Wirth , Thomas Kerdreux , Sebastian Pokutta

The Frank-Wolfe (FW) optimization algorithm has lately re-gained popularity thanks in particular to its ability to nicely handle the structured constraints appearing in machine learning applications. However, its convergence rate is known…

最优化与控制 · 数学 2015-11-19 Simon Lacoste-Julien , Martin Jaggi

In the present paper, we formulate two versions of Frank--Wolfe algorithm or conditional gradient method to solve the DC optimization problem with an adaptive step size. The DC objective function consists of two components; the first is…

最优化与控制 · 数学 2026-02-02 R. Díaz Millán , O. P. Ferreira , J. Ugon

In this paper, we consider the problem of selecting representatives from a data set for arbitrary supervised/unsupervised learning tasks. We identify a subset $S$ of a data set $A$ such that 1) the size of $S$ is much smaller than $A$ and…

机器学习 · 计算机科学 2020-02-25 Gary Cheng , Armin Askari , Kannan Ramchandran , Laurent El Ghaoui

The optimal transport (OT) problem has been used widely for machine learning. It is necessary for computation of an OT problem to solve linear programming with tight mass-conservation constraints. These constraints prevent its application…

机器学习 · 计算机科学 2022-05-30 Takumi Fukunaga , Hiroyuki Kasai

The Frank-Wolfe (FW) method is a popular approach for solving optimization problems with structured constraints that arise in machine learning applications. In recent years, stochastic versions of FW have gained popularity, motivated by…

最优化与控制 · 数学 2024-09-17 Aleksandr Beznosikov , David Dobre , Gauthier Gidel

Frank-Wolfe algorithms for convex minimization have recently gained considerable attention from the Optimization and Machine Learning communities, as their properties make them a suitable choice in a variety of applications. However, as…

机器学习 · 统计学 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Johan Suykens

This paper analyzes the convergence rates of the {\it Frank-Wolfe } method for solving convex constrained multiobjective optimization. We establish improved convergence rates under different assumptions on the objective function, the…

最优化与控制 · 数学 2024-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

We propose an algorithm which appears to be the first bridge between the fields of conditional gradient methods and abs-smooth optimization. Our problem setting is motivated by various applications that lead to nonsmoothness, such as…

最优化与控制 · 数学 2023-07-20 Timo Kreimeier , Sebastian Pokutta , Andrea Walther , Zev Woodstock

We study the convergence properties of the 'greedy' Frank-Wolfe algorithm with a unit step size, for a convex maximization problem over a compact set. We assume the function satisfies smoothness and strong convexity. These assumptions…

最优化与控制 · 数学 2025-05-02 Fatih Selim Aktas , Christian Kroer

Aiming at convex optimization under structural constraints, this work introduces and analyzes a variant of the Frank Wolfe (FW) algorithm termed ExtraFW. The distinct feature of ExtraFW is the pair of gradients leveraged per iteration,…

最优化与控制 · 数学 2020-12-11 Bingcong Li , Lingda Wang , Georgios B. Giannakis , Zhizhen Zhao

We propose a semi-stochastic Frank-Wolfe algorithm with away-steps for regularized empirical risk minimization and extend it to problems with block-coordinate structure. Our algorithms use adaptive step-size and we show that they converge…

最优化与控制 · 数学 2016-02-16 Donald Goldfarb , Garud Iyengar , Chaoxu Zhou

We provide a template to derive convergence rates for the following popular versions of the Frank-Wolfe algorithm on polytopes: vanilla Frank-Wolfe, Frank-Wolfe with away steps, Frank-Wolfe with blended pairwise steps, and Frank-Wolfe with…

最优化与控制 · 数学 2025-05-21 Elias Wirth , Javier Pena , Sebastian Pokutta