中文
相关论文

相关论文: A nonsmooth Frank-Wolfe algorithm through a dual c…

200 篇论文

We propose an algorithm which appears to be the first bridge between the fields of conditional gradient methods and abs-smooth optimization. Our problem setting is motivated by various applications that lead to nonsmoothness, such as…

最优化与控制 · 数学 2023-07-20 Timo Kreimeier , Sebastian Pokutta , Andrea Walther , Zev Woodstock

We propose an enhanced zeroth-order stochastic Frank-Wolfe framework to address constrained finite-sum optimization problems, a structure prevalent in large-scale machine-learning applications. Our method introduces a novel double variance…

机器学习 · 计算机科学 2025-01-24 Haishan Ye , Yinghui Huang , Hao Di , Xiangyu Chang

We propose a variant of the Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The proposed Primal-Dual Block…

机器学习 · 计算机科学 2019-06-07 Qi Lei , Jiacheng Zhuo , Constantine Caramanis , Inderjit S. Dhillon , Alexandros G. Dimakis

We analyze two novel randomized variants of the Frank-Wolfe (FW) or conditional gradient algorithm. While classical FW algorithms require solving a linear minimization problem over the domain at each iteration, the proposed method only…

最优化与控制 · 数学 2018-03-21 Thomas Kerdreux , Fabian Pedregosa , Alexandre d'Aspremont

This paper presents a subgradient-based algorithm for constrained nonsmooth convex optimization that does not require projections onto the feasible set. While the well-established Frank-Wolfe algorithm and its variants already avoid…

最优化与控制 · 数学 2024-09-04 Kamiar Asgari , Michael J. Neely

Differentiable optimization has received a significant amount of attention due to its foundational role in the domain of machine learning based on neural networks. This paper proposes a differentiable layer, named Differentiable Frank-Wolfe…

机器学习 · 计算机科学 2024-04-01 Zixuan Liu , Liu Liu , Xueqian Wang , Peilin Zhao

We propose a novel Stochastic Frank-Wolfe (a.k.a. conditional gradient) algorithm for constrained smooth finite-sum minimization with a generalized linear prediction/structure. This class of problems includes empirical risk minimization…

In this paper, we consider approximate Frank-Wolfe (FW) algorithms to solve convex optimization problems over graph-structured support sets where the linear minimization oracle (LMO) cannot be efficiently obtained in general. We first…

最优化与控制 · 数学 2022-06-20 Baojian Zhou , Yifan Sun

We present a new Frank-Wolfe (FW) type algorithm that is applicable to minimization problems with a nonsmooth convex objective. We provide convergence bounds and show that the scheme yields so-called coreset results for various Machine…

最优化与控制 · 数学 2017-08-23 Sathya N. Ravi , Maxwell D. Collins , Vikas Singh

The Frank-Wolfe (FW) method is a popular approach for solving optimization problems with structured constraints that arise in machine learning applications. In recent years, stochastic versions of FW have gained popularity, motivated by…

最优化与控制 · 数学 2024-09-17 Aleksandr Beznosikov , David Dobre , Gauthier Gidel

We propose a randomized block-coordinate variant of the classic Frank-Wolfe algorithm for convex optimization with block-separable constraints. Despite its lower iteration cost, we show that it achieves a similar convergence rate in duality…

机器学习 · 计算机科学 2013-01-15 Simon Lacoste-Julien , Martin Jaggi , Mark Schmidt , Patrick Pletscher

Frank-Wolfe methods (FW) have gained significant interest in the machine learning community due to its ability to efficiently solve large problems that admit a sparse structure (e.g. sparse vectors and low-rank matrices). However the…

机器学习 · 统计学 2018-03-22 Edward Cheung , Yuying Li

Conditional Gradient algorithms (aka Frank-Wolfe algorithms) form a classical set of methods for constrained smooth convex minimization due to their simplicity, the absence of projection steps, and competitive numerical performance. While…

最优化与控制 · 数学 2021-10-20 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

最优化与控制 · 数学 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

The Frank-Wolfe (FW) method, which implements efficient linear oracles that minimize linear approximations of the objective function over a fixed compact convex set, has recently received much attention in the optimization and machine…

最优化与控制 · 数学 2024-01-19 Liaoyuan Zeng , Yongle Zhang , Guoyin Li , Ting Kei Pong , Xiaozhou Wang

Decentralized optimization algorithms have received much attention due to the recent advances in network information processing. However, conventional decentralized algorithms based on projected gradient descent are incapable of handling…

最优化与控制 · 数学 2018-08-29 Hoi-To Wai , Jean Lafond , Anna Scaglione , Eric Moulines

Distributed optimization has gained a surge of interest in recent years. In this paper we propose a distributed projection free algorithm named Distributed Conditional Gradient Sliding(DCGS). Compared to the state-of-the-art distributed…

最优化与控制 · 数学 2018-05-22 Yan Li , Chao Qu , Huan Xu

We propose a novel generalization of the conditional gradient (CG / Frank-Wolfe) algorithm for minimizing a smooth function $f$ under an intersection of compact convex sets, using a first-order oracle for $\nabla f$ and linear minimization…

最优化与控制 · 数学 2024-10-11 Zev Woodstock , Sebastian Pokutta

We introduce a new projection-free (Frank-Wolfe) method for optimizing structured nonconvex functions that are expressed as a difference of two convex functions. This problem class subsumes smooth nonconvex minimization, positioning our…

最优化与控制 · 数学 2025-12-01 Hoomaan Maskan , Yikun Hou , Suvrit Sra , Alp Yurtsever

In the present paper, we formulate two versions of Frank--Wolfe algorithm or conditional gradient method to solve the DC optimization problem with an adaptive step size. The DC objective function consists of two components; the first is…

最优化与控制 · 数学 2026-02-02 R. Díaz Millán , O. P. Ferreira , J. Ugon
‹ 上一页 1 2 3 10 下一页 ›