English
Related papers

Related papers: Training Support Vector Machines Using Frank-Wolfe…

200 papers

Quantum computing leverages quantum effects to build algorithms that are faster then their classical variants. In machine learning, for a given model architecture, the speed of training the model is typically determined by the size of the…

Machine Learning · Computer Science 2022-04-25 Seyran Saeedi , Aliakbar Panahi , Tom Arodz

In many applications, input data are sampled functions taking their values in infinite dimensional spaces rather than standard vectors. This fact has complex consequences on data analysis algorithms that motivate modifications of them. In…

Statistics Theory · Mathematics 2007-05-23 Fabrice Rossi , Nathalie Villa

Quantum machine learning (QML) has witnessed immense progress recently, with quantum support vector machines (QSVMs) emerging as a promising model. This paper focuses on the two existing QSVM methods: quantum kernel SVM (QK-SVM) and quantum…

Quantum Physics · Physics 2024-02-02 Nouhaila Innan , Muhammad Al-Zafar Khan , Biswaranjan Panda , Mohamed Bennai

In this paper, we propose several improvements on the block-coordinate Frank-Wolfe (BCFW) algorithm from Lacoste-Julien et al. (2013) recently used to optimize the structured support vector machine (SSVM) objective in the context of…

Machine Learning · Computer Science 2016-06-01 Anton Osokin , Jean-Baptiste Alayrac , Isabella Lukasewitz , Puneet K. Dokania , Simon Lacoste-Julien

Classifiers and rating scores are prone to implicitly codifying biases, which may be present in the training data, against protected classes (i.e., age, gender, or race). So it is important to understand how to design classifiers and scores…

Machine Learning · Computer Science 2017-10-17 Matt Olfat , Anil Aswani

In \cite{simon2023algorithms} we introduced four algorithms for the training of neural support vector machines (NSVMs) and demonstrated their feasibility. In this note we introduce neural quantum support vector machines, that is, NSVMs with…

Quantum Physics · Physics 2023-11-27 Lars Simon , Manuel Radons

Learning a deep neural network requires solving a challenging optimization problem: it is a high-dimensional, non-convex and non-smooth minimization problem with a large number of terms. The current practice in neural network optimization…

Machine Learning · Computer Science 2021-02-23 Leonard Berrada , Andrew Zisserman , M. Pawan Kumar

Domain knowledge is useful to improve the generalization performance of learning machines. Sign constraints are a handy representation to combine domain knowledge with learning machine. In this paper, we consider constraining the signs of…

Machine Learning · Computer Science 2022-10-12 Kenya Tajima , Takahiko Henmi , Kohei Tsuchida , Esmeraldo Ronnie R. Zara , Tsuyoshi Kato

Supervised machine learning is the classification of new data based on already classified training examples. In this work, we show that the support vector machine, an optimized binary classifier, can be implemented on a quantum computer,…

Quantum Physics · Physics 2014-10-01 Patrick Rebentrost , Masoud Mohseni , Seth Lloyd

Support vector machine (SVM) has achieved many successes in machine learning, especially for a small sample problem. As a famous extension of the traditional SVM, the $\nu$ support vector machine ($\nu$-SVM) has shown outstanding…

Machine Learning · Computer Science 2024-03-05 Zhiji Yang , Wanyi Chen , Huan Zhang , Yitian Xu , Lei Shi , Jianhua Zhao

Support vector machines (SVMs) are special kernel based methods and belong to the most successful learning methods since more than a decade. SVMs can informally be described as a kind of regularized M-estimators for functions and have…

Machine Learning · Statistics 2010-07-26 Andreas Christmann , Robert Hable

Support vector machines (SVMs) are a standard method in the machine learning toolbox, in particular for tabular data. Non-linear kernel SVMs often deliver highly accurate predictors, however, at the cost of long training times. That problem…

Machine Learning · Computer Science 2022-07-05 Tobias Glasmachers

While quantum machine learning (ML) has been proposed to be one of the most promising applications of quantum computing, how to build quantum ML models that outperform classical ML remains a major open question. Here, we demonstrate a…

Quantum Physics · Physics 2023-03-10 Elham Torabian , Roman V. Krems

Support vector machines (SVMs) have been successful in solving many computer vision tasks including image and video category recognition especially for small and mid-scale training problems. The principle of these non-parametric models is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Hichem Sahbi

Subgradient algorithms for training support vector machines have been quite successful for solving large-scale and online learning problems. However, they have been restricted to linear kernels and strongly convex formulations. This paper…

Machine Learning · Computer Science 2011-11-04 Sangkyun Lee , Stephen J. Wright

Support vector machine (SVM) is one of the most popular classification algorithms in the machine learning literature. We demonstrate that SVM can be used to balance covariates and estimate average causal effects under the unconfoundedness…

Methodology · Statistics 2021-07-02 Alexander Tarr , Kosuke Imai

The support vector machines (SVM) is one of the most widely used and practical optimization based classification models in machine learning because of its interpretability and flexibility to produce high quality results. However, the big…

Machine Learning · Computer Science 2020-11-06 Ehsan Sadrfaridpour , Korey Palmer , Ilya Safro

We analyze the computational complexity of Quantum Sparse Support Vector Machine, a linear classifier that minimizes the hinge loss and the $L_1$ norm of the feature weights vector and relies on a quantum linear programming solver instead…

Machine Learning · Computer Science 2022-04-26 Seyran Saeedi , Tom Arodz

Frank-Wolfe algorithms have recently regained the attention of the Machine Learning community. Their solid theoretical properties and sparsity guarantees make them a suitable choice for a wide range of problems in this field. In addition,…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Johan A. K. Suykens

Sparse support vector machine (SVM) is a popular classification technique that can simultaneously learn a small set of the most interpretable features and identify the support vectors. It has achieved great successes in many real-world…

Machine Learning · Statistics 2019-07-19 Weizhong Zhang , Bin Hong , Wei Liu , Jieping Ye , Deng Cai , Xiaofei He , Jie Wang