中文
相关论文

相关论文: Continuous Time Frank-Wolfe Does Not Zig-Zag, But …

200 篇论文

In the present paper, we formulate two versions of Frank--Wolfe algorithm or conditional gradient method to solve the DC optimization problem with an adaptive step size. The DC objective function consists of two components; the first is…

最优化与控制 · 数学 2026-02-02 R. Díaz Millán , O. P. Ferreira , J. Ugon

Conditional Gradient algorithms (aka Frank-Wolfe algorithms) form a classical set of methods for constrained smooth convex minimization due to their simplicity, the absence of projection steps, and competitive numerical performance. While…

最优化与控制 · 数学 2021-10-20 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

The stochastic Frank-Wolfe method has recently attracted much general interest in the context of optimization for statistical and machine learning due to its ability to work with a more general feasible region. However, there has been a…

最优化与控制 · 数学 2019-11-06 Haihao Lu , Robert M. Freund

The paper introduces a new adaptive version of the Frank-Wolfe algorithm for relatively smooth convex functions. It is proposed to use the Bregman divergence other than half the square of the Euclidean norm in the formula for step-size.…

最优化与控制 · 数学 2024-07-23 Alexander Vyguzov , Fedor Stonyakin

We analyze two novel randomized variants of the Frank-Wolfe (FW) or conditional gradient algorithm. While classical FW algorithms require solving a linear minimization problem over the domain at each iteration, the proposed method only…

最优化与控制 · 数学 2018-03-21 Thomas Kerdreux , Fabian Pedregosa , Alexandre d'Aspremont

We introduce regularized Frank-Wolfe, a general and effective algorithm for inference and learning of dense conditional random fields (CRFs). The algorithm optimizes a nonconvex continuous relaxation of the CRF inference problem using…

机器学习 · 计算机科学 2022-09-09 Đ. Khuê Lê-Huu , Karteek Alahari

It is known that the Frank-Wolfe (FW) algorithm, which is affine-covariant, enjoys accelerated convergence rates when the constraint set is strongly convex. However, these results rely on norm-dependent assumptions, usually incurring…

最优化与控制 · 数学 2020-11-09 Thomas Kerdreux , Lewis Liu , Simon Lacoste-Julien , Damien Scieur

Recent papers have shown that the Frank-Wolfe algorithm (FW) with open-loop step-sizes exhibits rates of convergence faster than the iconic $\mathcal{O}(t^{-1})$ rate. In particular, when the minimizer of a strongly convex function over a…

最优化与控制 · 数学 2025-01-22 Elias Wirth , Javier Pena , Sebastian Pokutta

This paper considers distributed stochastic optimization, in which a number of agents cooperate to optimize a global objective function through local computations and information exchanges with neighbors over a network. Stochastic…

最优化与控制 · 数学 2022-08-09 Jie Hou , Xianlin Zeng , Gang Wang , Jian Sun , Jie Chen

We propose an accelerated algorithm with a Frank-Wolfe method as an oracle for solving strongly monotone variational inequality problems. While standard solution approaches, such as projected gradient descent (aka value iteration), involve…

最优化与控制 · 数学 2025-10-07 Reza Rahimi Baghbadorani , Peyman Mohajerin Esfahani , Sergio Grammatico

To deal with non-stationary online problems with complex constraints, we investigate the dynamic regret of online Frank-Wolfe (OFW), which is an efficient projection-free algorithm for online convex optimization. It is well-known that in…

机器学习 · 计算机科学 2024-06-25 Yuanyu Wan , Lijun Zhang , Mingli Song

Wasserstein gradient flows have become a central tool for optimization problems over probability measures. A natural numerical approach is forward-Euler time discretization. We show, however, that even in the simple case where the energy…

数值分析 · 数学 2025-10-16 Yewei Xu , Qin Li

We propose an algorithm which appears to be the first bridge between the fields of conditional gradient methods and abs-smooth optimization. Our problem setting is motivated by various applications that lead to nonsmoothness, such as…

最优化与控制 · 数学 2023-07-20 Timo Kreimeier , Sebastian Pokutta , Andrea Walther , Zev Woodstock

We propose several variants of the Frank-Wolfe algorithm to minimize a sum of functions. The main proposed algorithm is inspired from the dual averaging scheme of Nesterov adapted for Frank Wolfe in a stochastic setting. A distributed…

最优化与控制 · 数学 2023-01-12 Suhail M Shah

Generalized self-concordance is a key property present in the objective function of many important learning problems. We establish the convergence rate of a simple Frank-Wolfe variant that uses the open-loop step size strategy $\gamma_t =…

最优化与控制 · 数学 2024-04-09 Alejandro Carderera , Mathieu Besançon , Sebastian Pokutta

The Frank-Wolfe algorithm is a method for constrained optimization that relies on linear minimizations, as opposed to projections. Therefore, a motivation put forward in a large body of work on the Frank-Wolfe algorithm is the computational…

最优化与控制 · 数学 2021-06-15 Cyrille W. Combettes , Sebastian Pokutta

We study constrained stochastic programs where the decision vector at each time slot cannot be chosen freely but is tied to the realization of an underlying random state vector. The goal is to minimize a general objective function subject…

最优化与控制 · 数学 2018-06-05 Xiaohan Wei , Michael J. Neely

The Frank-Wolfe algorithm has seen a resurgence in popularity due to its ability to efficiently solve constrained optimization problems in machine learning and high-dimensional statistics. As such, there is much interest in establishing…

机器学习 · 统计学 2022-05-19 Suhas Vijaykumar

We propose a novel Stochastic Frank-Wolfe (a.k.a. conditional gradient) algorithm for constrained smooth finite-sum minimization with a generalized linear prediction/structure. This class of problems includes empirical risk minimization…

The purpose of this survey is to serve both as a gentle introduction and a coherent overview of state-of-the-art Frank--Wolfe algorithms, also called conditional gradient algorithms, for function minimization. These algorithms are…