中文
相关论文

相关论文: Frank-Wolfe algorithm for learning SVM-type multi-…

200 篇论文

We propose several variants of the Frank-Wolfe algorithm to minimize a sum of functions. The main proposed algorithm is inspired from the dual averaging scheme of Nesterov adapted for Frank Wolfe in a stochastic setting. A distributed…

最优化与控制 · 数学 2023-01-12 Suhail M Shah

The Conditional Gradient (or Frank-Wolfe) method is one of the most well-known methods for solving constrained optimization problems appearing in various machine learning tasks. The simplicity of iteration and applicability to many…

Domain knowledge is useful to improve the generalization performance of learning machines. Sign constraints are a handy representation to combine domain knowledge with learning machine. In this paper, we consider constraining the signs of…

机器学习 · 计算机科学 2022-10-12 Kenya Tajima , Takahiko Henmi , Kohei Tsuchida , Esmeraldo Ronnie R. Zara , Tsuyoshi Kato

We introduce a new class of Frank-Wolfe algorithms for minimizing differentiable functionals over probability measures. This framework can be shown to encompass a diverse range of tasks in areas such as artificial intelligence,…

统计计算 · 统计学 2021-05-13 Carson Kent , Jose Blanchet , Peter Glynn

The Frank-Wolfe (FW) method is a popular algorithm for solving large-scale convex optimization problems appearing in structured statistical learning. However, the traditional Frank-Wolfe method can only be applied when the feasible region…

最优化与控制 · 数学 2021-10-11 Haoyue Wang , Haihao Lu , Rahul Mazumder

We investigate variants of the Frank-Wolfe (FW) algorithm for smoothing and strongly convex optimization over polyhedral sets, with the goal of designing algorithms that achieve linear convergence while minimizing per-iteration complexity…

最优化与控制 · 数学 2025-09-30 Haoning Wang , Houduo Qi , Liping Zhang

In recent years, feature selection has become a challenging problem in several machine learning fields, such as classification problems. Support Vector Machine (SVM) is a well-known technique applied in classification tasks. Various…

机器学习 · 计算机科学 2021-01-18 Asunción Jiménez-Cordero , Juan Miguel Morales , Salvador Pineda

We introduce a few variants on Frank-Wolfe style algorithms suitable for large scale optimization. We show how to modify the standard Frank-Wolfe algorithm using stochastic gradients, approximate subproblem solutions, and sketched decision…

最优化与控制 · 数学 2018-08-17 Lijun Ding , Madeleine Udell

The Frank-Wolfe algorithm is a popular method for minimizing a smooth convex function $f$ over a compact convex set $\mathcal{C}$. While many convergence results have been derived in terms of function values, hardly nothing is known about…

最优化与控制 · 数学 2022-02-18 Jérôme Bolte , Cyrille W. Combettes , Édouard Pauwels

We develop a Frank-Wolfe algorithm with corrective steps, generalizing previous algorithms including blended conditional gradients, blended pairwise conditional gradients, and fully-corrective Frank-Wolfe. For this, we prove tight…

The Frank-Wolfe algorithm is a popular method in structurally constrained machine learning applications, due to its fast per-iteration complexity. However, one major limitation of the method is a slow rate of convergence that is difficult…

最优化与控制 · 数学 2023-04-14 Zhaoyue Chen , Yifan Sun

Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the…

机器学习 · 计算机科学 2018-06-27 Han Zhao , Geoff Gordon

The Frank-Wolfe optimization algorithm has recently regained popularity for machine learning applications due to its projection-free property and its ability to handle structured constraints. However, in the stochastic learning setting, it…

机器学习 · 计算机科学 2017-09-15 Elad Hazan , Haipeng Luo

We develop a novel variant of the classical Frank-Wolfe algorithm, which we call spectral Frank-Wolfe, for convex optimization over a spectrahedron. The spectral Frank-Wolfe algorithm has a novel ingredient: it computes a few eigenvectors…

最优化与控制 · 数学 2020-08-18 Lijun Ding , Yingjie Fei , Qiantong Xu , Chengrun Yang

A broad class of convex optimization problems can be formulated as a semidefinite program (SDP), minimization of a convex function over the positive-semidefinite cone subject to some affine constraints. The majority of classical SDP solvers…

最优化与控制 · 数学 2019-10-30 Francesco Locatello , Alp Yurtsever , Olivier Fercoq , Volkan Cevher

Mixed-integer nonlinear optimization encompasses a broad class of problems that present both theoretical and computational challenges. We propose a new type of method to solve these problems based on a branch-and-bound algorithm with convex…

最优化与控制 · 数学 2024-07-19 Deborah Hendrych , Hannah Troppens , Mathieu Besançon , Sebastian Pokutta

Recently the away-step Frank-Wolfe algoritm for constrained multiobjective optimization has been shown linear convergence rate over a polytope which is generated by finite points set. In this paper we design a decomposition-invariant…

最优化与控制 · 数学 2024-09-10 Zhuoxin Fan , Liping Tang

We study Frank-Wolfe algorithms - standard, pairwise, and away-steps - for efficient optimization of Dominant Set Clustering. We present a unified and computationally efficient framework to employ the different variants of Frank-Wolfe…

机器学习 · 计算机科学 2022-12-06 Carl Johnell , Morteza Haghir Chehreghani

Nonnegative matrix factorization (NMF) often relies on the separability condition for tractable algorithm design. Separability-based NMF is mainly handled by two types of approaches, namely, greedy pursuit and convex programming. A notable…

信号处理 · 电气工程与系统科学 2022-07-20 Tri Nguyen , Xiao Fu , Ruiyuan Wu

We introduce a new projection-free (Frank-Wolfe) method for optimizing structured nonconvex functions that are expressed as a difference of two convex functions. This problem class subsumes smooth nonconvex minimization, positioning our…

最优化与控制 · 数学 2025-12-01 Hoomaan Maskan , Yikun Hou , Suvrit Sra , Alp Yurtsever