English
Related papers

Related papers: Training Support Vector Machines Using Frank-Wolfe…

200 papers

Objective: Brain networks have gained increasing recognition as potential biomarkers in mental health studies, but there are limited approaches that can leverage complex brain networks for accurate classification. Our goal is to develop a…

Methodology · Statistics 2022-05-25 Jin Ming , Suprateek Kundu

We propose a novel and efficient training method for RNNs by iteratively seeking a local minima on the loss surface within a small region, and leverage this directional vector for the update, in an outer-loop. We propose to utilize the…

Machine Learning · Computer Science 2020-10-16 Yun Yue , Ming Li , Venkatesh Saligrama , Ziming Zhang

Memory is a key computational bottleneck when solving large-scale convex optimization problems such as semidefinite programs (SDPs). In this paper, we focus on the regime in which storing an $n\times n$ matrix decision variable is…

Optimization and Control · Mathematics 2021-08-25 Nimita Shinde , Vishnu Narayanan , James Saunderson

In recent years, supervised and semi-supervised machine learning methods such as neural networks, support vector machines (SVM), and semi-supervised support vector machines (S4VM) have been widely used in quantum entanglement and quantum…

Quantum Physics · Physics 2023-11-30 Yi-Jun Luo , Jin-Ming Liu , Chengjie Zhang

Adversarial attacks by generating examples which are almost indistinguishable from natural examples, pose a serious threat to learning models. Defending against adversarial attacks is a critical element for a reliable learning system.…

Machine Learning · Computer Science 2021-07-22 Huimin Wu , Zhengmian Hu , Bin Gu

Machine learning and quantum computing are being progressively explored to shed light on possible computational approaches to deal with hitherto unsolvable problems. Classical methods for machine learning are ubiquitous in pattern…

Quantum Physics · Physics 2024-07-10 Papri Saha

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe…

Optimization and Control · Mathematics 2019-06-11 Paul Grigas , Alfonso Lobos , Nathan Vermeersch

We propose an accelerated algorithm with a Frank-Wolfe method as an oracle for solving strongly monotone variational inequality problems. While standard solution approaches, such as projected gradient descent (aka value iteration), involve…

Optimization and Control · Mathematics 2025-10-07 Reza Rahimi Baghbadorani , Peyman Mohajerin Esfahani , Sergio Grammatico

The Frank-Wolfe algorithm is a method for constrained optimization that relies on linear minimizations, as opposed to projections. Therefore, a motivation put forward in a large body of work on the Frank-Wolfe algorithm is the computational…

Optimization and Control · Mathematics 2021-06-15 Cyrille W. Combettes , Sebastian Pokutta

We introduce a new nearest-prototype classifier, the prototype vector machine (PVM). It arises from a combinatorial optimization problem which we cast as a variant of the set cover problem. We propose two algorithms for approximating its…

Machine Learning · Statistics 2009-08-18 Jacob Bien , Robert Tibshirani

We develop a Frank-Wolfe algorithm with corrective steps, generalizing previous algorithms including blended conditional gradients, blended pairwise conditional gradients, and fully-corrective Frank-Wolfe. For this, we prove tight…

Optimization and Control · Mathematics 2026-05-21 Jannis Halbey , Seta Rakotomandimby , Mathieu Besançon , Sébastien Designolle , Sebastian Pokutta

The Support Vector Machine (SVM) of Vapnik (1998) has become widely established as one of the leading approaches to pattern recognition and machine learning. It expresses predictions in terms of a linear combination of kernel functions…

Machine Learning · Computer Science 2013-01-18 Christopher M. Bishop , Michael Tipping

This work presents a machine learning approach based on support vector machines (SVMs) for quantum entanglement detection. Particularly, we focus in bipartite systems of dimensions 3x3, 4x4, and 5x5, where the positive partial transpose…

We introduce an efficient method for training the linear ranking support vector machine. The method combines cutting plane optimization with red-black tree based approach to subgradient calculations, and has O(m*s+m*log(m)) time complexity,…

Machine Learning · Statistics 2022-02-07 Antti Airola , Tapio Pahikkala , Tapio Salakoski

We consider a suboptimal solution path algorithm for the Support Vector Machine. The solution path algorithm is an effective tool for solving a sequence of a parametrized optimization problems in machine learning. The path of the solutions…

Machine Learning · Computer Science 2011-05-04 Masayuki Karasuyama , Ichiro Takeuchi

This work endeavors to juxtapose the efficacy of machine learning algorithms within classical and quantum computational paradigms. Particularly, by emphasizing on Support Vector Machines (SVM), we scrutinize the classification prowess of…

Machine Learning · Computer Science 2023-10-18 Davut Emre Tasar , Kutan Koruyan , Ceren Ocal Tasar

We study the Frank-Wolfe algorithm for constrained optimization problems with relatively smooth objectives. Building upon our previous work, we propose a fully adaptive variant of the Frank-Wolfe method that dynamically adjusts the step…

Optimization and Control · Mathematics 2025-08-27 A. A. Vyguzov , F. S. Stonyakin

We review the concept of support vector machines (SVMs) and discuss examples of their use. One of the benefits of SVM algorithms, compared with neural networks and decision trees is that they can be less susceptible to over fitting than…

Data Analysis, Statistics and Probability · Physics 2016-12-21 A. Bethani , A. J. Bevan , J. Hays , T. J. Stevenson

The parameters of support vector machines (SVMs) such as the penalty parameter and the kernel parameters have a great impact on the classification accuracy and the complexity of the SVM model. Therefore, the model selection in SVM involves…

Machine Learning · Computer Science 2020-07-13 Alaa Tharwat

This paper presents the impact of using quantization on the efficiency of multi-class text classification in the training process of a support vector machine (SVM). This work is focused on comparing the efficiency of SVM model trained using…

Machine Learning · Computer Science 2020-07-20 Dominik Żurek , Marcin Pietroń