English
Related papers

Related papers: Frank-Wolfe algorithm for learning SVM-type multi-…

200 papers

The purpose of this survey is to serve both as a gentle introduction and a coherent overview of state-of-the-art Frank--Wolfe algorithms, also called conditional gradient algorithms, for function minimization. These algorithms are…

We study the Frank-Wolfe algorithm for constrained optimization problems with relatively smooth objectives. Building upon our previous work, we propose a fully adaptive variant of the Frank-Wolfe method that dynamically adjusts the step…

Optimization and Control · Mathematics 2025-08-27 A. A. Vyguzov , F. S. Stonyakin

Differentiable optimization has received a significant amount of attention due to its foundational role in the domain of machine learning based on neural networks. This paper proposes a differentiable layer, named Differentiable Frank-Wolfe…

Machine Learning · Computer Science 2024-04-01 Zixuan Liu , Liu Liu , Xueqian Wang , Peilin Zhao

One Class Slab Support Vector Machines (OCSSVM) have turned out to be better in terms of accuracy in certain classes of classification problems than the traditional SVMs and One Class SVMs or even other One class classifiers. This paper…

Machine Learning · Computer Science 2024-09-05 Bagesh Kumar , Ayush Sinha , Sourin Chakrabarti , O. P. Vyas

The Frank-Wolfe algorithm has become a popular first-order optimization algorithm for it is simple and projection-free, and it has been successfully applied to a variety of real-world problems. Its main drawback however lies in its…

Optimization and Control · Mathematics 2020-06-25 Cyrille W. Combettes , Sebastian Pokutta

We propose a semi-stochastic Frank-Wolfe algorithm with away-steps for regularized empirical risk minimization and extend it to problems with block-coordinate structure. Our algorithms use adaptive step-size and we show that they converge…

Optimization and Control · Mathematics 2016-02-16 Donald Goldfarb , Garud Iyengar , Chaoxu Zhou

In this paper, we study the problem of speeding up a type of optimization algorithms called Frank-Wolfe, a conditional gradient method. We develop and employ two novel inner product search data structures, improving the prior fastest…

Data Structures and Algorithms · Computer Science 2022-07-20 Zhao Song , Zhaozhuo Xu , Yuanyuan Yang , Lichen Zhang

We present an exact algorithm for mean-risk optimization subject to a budget constraint, where decision variables may be continuous or integer. The risk is measured by the covariance matrix and weighted by an arbitrary monotone function,…

Optimization and Control · Mathematics 2017-05-08 Christoph Buchheim , Marianna De Santis , Francesco Rinaldi , Long Trieu

In the present paper, we formulate two versions of Frank--Wolfe algorithm or conditional gradient method to solve the DC optimization problem with an adaptive step size. The DC objective function consists of two components; the first is…

Optimization and Control · Mathematics 2026-02-02 R. Díaz Millán , O. P. Ferreira , J. Ugon

The Frank-Wolfe (FW) method, which implements efficient linear oracles that minimize linear approximations of the objective function over a fixed compact convex set, has recently received much attention in the optimization and machine…

Optimization and Control · Mathematics 2024-01-19 Liaoyuan Zeng , Yongle Zhang , Guoyin Li , Ting Kei Pong , Xiaozhou Wang

We study Frank-Wolfe methods for nonconvex stochastic and finite-sum optimization problems. Frank-Wolfe methods (in the convex case) have gained tremendous recent interest in machine learning and optimization communities due to their…

Optimization and Control · Mathematics 2016-08-01 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

The stochastic Frank-Wolfe method has recently attracted much general interest in the context of optimization for statistical and machine learning due to its ability to work with a more general feasible region. However, there has been a…

Optimization and Control · Mathematics 2019-11-06 Haihao Lu , Robert M. Freund

We propose a novel Stochastic Frank-Wolfe (a.k.a. conditional gradient) algorithm for constrained smooth finite-sum minimization with a generalized linear prediction/structure. This class of problems includes empirical risk minimization…

We address the problem of minimizing a convex smooth function $f(x)$ over a compact polyhedral set $D$ given a stochastic zeroth-order constraint feedback model. This problem arises in safety-critical machine learning applications, such as…

Optimization and Control · Mathematics 2019-12-10 Ilnura Usmanova , Andreas Krause , Maryam Kamgarpour

The Frank-Wolfe algorithm has regained much interest in its use in structurally constrained machine learning applications. However, one major limitation of the Frank-Wolfe algorithm is the slow local convergence property due to the…

Optimization and Control · Mathematics 2022-10-18 Zhaoyue Chen , Yifan Sun

Support vector machine (SVM) is a powerful machine learning algorithm to handle classification tasks. However, the classical SVM is developed for binary problems with the assumption of balanced datasets. Obviously, the multi-class…

Machine Learning · Computer Science 2025-02-21 Zhong-Liang Zhang , Jie Yang , Jian-Ming Ru , Xiao-Xi Zhao , Xing-Gang Luo

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe…

Optimization and Control · Mathematics 2019-06-11 Paul Grigas , Alfonso Lobos , Nathan Vermeersch

The optimal transport (OT) problem has been used widely for machine learning. It is necessary for computation of an OT problem to solve linear programming with tight mass-conservation constraints. These constraints prevent its application…

Machine Learning · Computer Science 2022-05-30 Takumi Fukunaga , Hiroyuki Kasai

The Frank-Wolfe algorithm is a method for constrained optimization that relies on linear minimizations, as opposed to projections. Therefore, a motivation put forward in a large body of work on the Frank-Wolfe algorithm is the computational…

Optimization and Control · Mathematics 2021-06-15 Cyrille W. Combettes , Sebastian Pokutta

Optimal transport (OT), which provides a distance between two probability distributions by considering their spatial locations, has been applied to widely diverse applications. Computing an OT problem requires solution of linear programming…

Machine Learning · Computer Science 2021-03-11 Takumi Fukunaga , Hiroyuki Kasai