English
Related papers

Related papers: Linear Convergence of the Frank-Wolfe Algorithm ov…

200 papers

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe…

Optimization and Control · Mathematics 2019-06-11 Paul Grigas , Alfonso Lobos , Nathan Vermeersch

Frank-Wolfe (FW) algorithms have been often proposed over the last few years as efficient solvers for a variety of optimization problems arising in the field of Machine Learning. The ability to work with cheap projection-free iterations and…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Stefano Lodi , Claudio Sartori , Johan A. K. Suykens

We study Frank-Wolfe algorithms - standard, pairwise, and away-steps - for efficient optimization of Dominant Set Clustering. We present a unified and computationally efficient framework to employ the different variants of Frank-Wolfe…

Machine Learning · Computer Science 2022-12-06 Carl Johnell , Morteza Haghir Chehreghani

Approximation problems involving a single convex body in $d$-dimensional space have received a great deal of attention in the computational geometry community. In contrast, works involving multiple convex bodies are generally limited to…

Computational Geometry · Computer Science 2018-07-03 Sunil Arya , Guilherme D. da Fonseca , David M. Mount

We investigate the robustness of the Frank-Wolfe method when gradients are computed inexactly and examine the relative computational cost of the linear minimization oracle (LMO) versus projection. For smooth nonconvex functions, we…

Optimization and Control · Mathematics 2026-01-27 Tao Hu

We present an exact algorithm for mean-risk optimization subject to a budget constraint, where decision variables may be continuous or integer. The risk is measured by the covariance matrix and weighted by an arbitrary monotone function,…

Optimization and Control · Mathematics 2017-05-08 Christoph Buchheim , Marianna De Santis , Francesco Rinaldi , Long Trieu

Optimal transport (OT), which provides a distance between two probability distributions by considering their spatial locations, has been applied to widely diverse applications. Computing an OT problem requires solution of linear programming…

Machine Learning · Computer Science 2021-03-11 Takumi Fukunaga , Hiroyuki Kasai

We propose an accelerated algorithm with a Frank-Wolfe method as an oracle for solving strongly monotone variational inequality problems. While standard solution approaches, such as projected gradient descent (aka value iteration), involve…

Optimization and Control · Mathematics 2025-10-07 Reza Rahimi Baghbadorani , Peyman Mohajerin Esfahani , Sergio Grammatico

In the rank-constrained optimization problem (RCOP), it minimizes a linear objective function over a prespecified closed rank-constrained domain set and $m$ generic two-sided linear matrix inequalities. Motivated by the Dantzig-Wolfe (DW)…

Optimization and Control · Mathematics 2023-06-16 Yongchun Li , Weijun Xie

Frequent itemsets form a polytope and can be found and analyzed with Linear Programming.

Databases · Computer Science 2020-08-03 Natalia Vanetik

We consider the problem of minimizing the sum of two convex functions. One of those functions has Lipschitz-continuous gradients, and can be accessed via stochastic oracles, whereas the other is "simple". We provide a Bregman-type algorithm…

Optimization and Control · Mathematics 2024-11-26 Benjamin Dubois-Taine , Francis Bach , Quentin Berthet , Adrien Taylor

We propose a primal heuristic for quadratic mixed-integer problems. Our method extends the Boscia framework -- originally a mixed-integer convex solver leveraging a Frank-Wolfe-based branch-and-bound approach -- to address nonconvex…

Optimization and Control · Mathematics 2025-10-21 Gioni Mexi , Deborah Hendrych , Sébastien Designolle , Mathieu Besançon , Sebastian Pokutta

We consider the continuous Fermat-Weber problem, where the customers are continuously (uniformly) distributed along the boundary of a convex polygon. We derive the closed-form expression for finding the average distance from a given point…

Computational Geometry · Computer Science 2014-03-18 Thomas T. C. K. Zhang , John Gunnar Carlsson

We present a constructive lower bound of $\Omega(1/\sqrt{\varepsilon})$ for Frank-Wolfe (FW) when both the objective and the constraint set are smooth and strongly convex, showing that the known uniform $\mathcal{O}(1/\sqrt{\varepsilon})$…

Optimization and Control · Mathematics 2026-04-14 Jannis Halbey , Daniel Deza , Max Zimmer , Christophe Roux , Bartolomeo Stellato , Sebastian Pokutta

We consider the problem of minimizing a difference of (smooth) convex functions over a compact convex feasible region $P$, i.e., $\min_{x \in P} f(x) - g(x)$, with smooth $f$ and Lipschitz continuous $g$. This computational study builds…

Optimization and Control · Mathematics 2025-08-05 Sebastian Pokutta

In this paper we consider the solvability of a non-convex regular polynomial vector optimization problem on a nonempty closed set. We introduce regularity conditions for the polynomial vector optimization problem and study properties and…

Optimization and Control · Mathematics 2021-01-12 Danyang Liu , Rong Hu , Yaping Fang

We show that for multivariate Freud-type weights $W_\alpha(x)=\exp(-|x|^\alpha)$, $\alpha>1$, any convex function $f$ on $R^d$ satisfying $fW_\alpha\in L_p(R^d)$ if $1\le p<\infty$, or $\lim_{|x|\to\infty}f(x)W_\alpha(x)=0$ if $p=\infty$,…

Classical Analysis and ODEs · Mathematics 2014-11-14 Oleksandr Maizlish , Andriy Prymak

This study develops a fixed-time convergent saddle point dynamical system for solving min-max problems under a relaxation of standard convexity-concavity assumption. In particular, it is shown that by leveraging the dynamical systems…

Optimization and Control · Mathematics 2022-07-28 Kunal Garg , Mayank Baranwal

In this paper, we study the properties of the Frank-Wolfe algorithm to solve the \ExactSparse reconstruction problem. We prove that when the dictionary is quasi-incoherent, at each iteration, the Frank-Wolfe algorithm picks up an atom…

Machine Learning · Computer Science 2018-12-19 Farah Cherfaoui , Valentin Emiya , Liva Ralaivola , Sandrine Anthoine

The Frank-Wolfe algorithm is a popular method in structurally constrained machine learning applications, due to its fast per-iteration complexity. However, one major limitation of the method is a slow rate of convergence that is difficult…

Optimization and Control · Mathematics 2023-04-14 Zhaoyue Chen , Yifan Sun