English
Related papers

Related papers: A Multi-Plane Block-Coordinate Frank-Wolfe Algorit…

200 papers

One Class Slab Support Vector Machines (OCSSVM) have turned out to be better in terms of accuracy in certain classes of classification problems than the traditional SVMs and One Class SVMs or even other One class classifiers. This paper…

Machine Learning · Computer Science 2024-09-05 Bagesh Kumar , Ayush Sinha , Sourin Chakrabarti , O. P. Vyas

Support Vector Machine (SVM) is a powerful tool in binary classification, known to attain excellent misclassification rates. On the other hand, many realworld classification problems, such as those found in medical diagnosis, churn or fraud…

Machine Learning · Statistics 2023-12-25 Sandra Benítez-Peña , Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo

The optimal transport (OT) problem has been used widely for machine learning. It is necessary for computation of an OT problem to solve linear programming with tight mass-conservation constraints. These constraints prevent its application…

Machine Learning · Computer Science 2022-05-30 Takumi Fukunaga , Hiroyuki Kasai

This work studies and develop projection-free algorithms for online learning with linear optimization oracles (a.k.a. Frank-Wolfe) for handling the constraint set. More precisely, this work (i) provides an improved (optimized) variant of an…

Optimization and Control · Mathematics 2026-05-20 Julien Weibel , Pierre Gaillard , Wouter M. Koolen , Adrien Taylor

Optimal transport (OT), which provides a distance between two probability distributions by considering their spatial locations, has been applied to widely diverse applications. Computing an OT problem requires solution of linear programming…

Machine Learning · Computer Science 2021-03-11 Takumi Fukunaga , Hiroyuki Kasai

This paper considers convex quadratic programs associated with the training of support vector machines (SVM). Exploiting the special structure of the SVM problem a new type of active set method with long cycles and stable rank-one-updates…

Optimization and Control · Mathematics 2025-04-09 Florian Jarre

Support Vector Machine (SVM) algorithm requires a high computational cost (both in memory and time) to solve a complex quadratic programming (QP) optimization problem during the training process. Consequently, SVM necessitates high…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-28 Islam Elgarhy

We propose a rank-$k$ variant of the classical Frank-Wolfe algorithm to solve convex optimization over a trace-norm ball. Our algorithm replaces the top singular-vector computation ($1$-SVD) in Frank-Wolfe with a top-$k$ singular-vector…

Machine Learning · Computer Science 2017-11-10 Zeyuan Allen-Zhu , Elad Hazan , Wei Hu , Yuanzhi Li

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

Optimization and Control · Mathematics 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

In this paper, we consider Frank-Wolfe-based algorithms for composite convex optimization problems with objective involving a logarithmically-homogeneous, self-concordant functions. Recent Frank-Wolfe-based methods for this class of…

Optimization and Control · Mathematics 2023-10-24 Nimita Shinde , Vishnu Narayanan , James Saunderson

We investigate the robustness of the Frank-Wolfe method when gradients are computed inexactly and examine the relative computational cost of the linear minimization oracle (LMO) versus projection. For smooth nonconvex functions, we…

Optimization and Control · Mathematics 2026-01-27 Tao Hu

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe…

Optimization and Control · Mathematics 2019-06-11 Paul Grigas , Alfonso Lobos , Nathan Vermeersch

Support Vector Machine (SVM) is an efficient classification approach, which finds a hyperplane to separate data from different classes. This hyperplane is determined by support vectors. In existing SVM formulations, the objective function…

Machine Learning · Computer Science 2018-04-09 Shuai Zheng , Chris Ding

One of the limiting factors of using support vector machines (SVMs) in large scale applications are their super-linear computational requirements in terms of the number of training samples. To address this issue, several approaches that…

Machine Learning · Statistics 2015-07-24 Mona Eberts , Ingo Steinwart

Twin support vector machine~(TSVM) is a powerful learning algorithm by solving a pair of smaller SVM-type problems. However, there are still some specific issues such as low efficiency and weak robustness when it is faced with some real…

Machine Learning · Computer Science 2019-07-30 Bin-Bin Gao , Jian-Jun Wang

In this paper, we present the Stochastic Origin Frank-Wolfe (SOFW) method, which is a special case of the block-coordinate Frank-Wolfe algorithm, applied to the problem of finding equilibrium flow distributions. By significantly reducing…

Optimization and Control · Mathematics 2025-10-03 Igor Ignashin , Demyan Yarmoshik , Andrei Raigorodskii

The Frank-Wolfe algorithm is a classic method for constrained optimization problems. It has recently been popular in many machine learning applications because its projection-free property leads to more efficient iterations. In this paper,…

Optimization and Control · Mathematics 2020-10-23 Cheng Chen , Luo Luo , Weinan Zhang , Yong Yu

Sampling and budgeting training examples are two essential factors in tracking algorithms based on support vector machines (SVMs) as a trade-off between accuracy and efficiency. Recently, the circulant matrix formed by dense sampling of…

Computer Vision and Pattern Recognition · Computer Science 2016-01-25 Wangmeng Zuo , Xiaohe Wu , Liang Lin , Lei Zhang , Ming-Hsuan Yang

Projection-free optimization via different variants of the Frank-Wolfe (FW), a.k.a. Conditional Gradient method has become one of the cornerstones in optimization for machine learning since in many cases the linear minimization oracle is…

Optimization and Control · Mathematics 2020-06-30 Pavel Dvurechensky , Petr Ostroukhov , Kamil Safin , Shimrit Shtern , Mathias Staudigl

This paper aims at improving the classification accuracy of a Support Vector Machine (SVM) classifier with Sequential Minimal Optimization (SMO) training algorithm in order to properly classify failure and normal instances from oil and gas…

Machine Learning · Computer Science 2021-01-01 Zhiyuan Chen , Isa Dino , Nik Ahmad Akram