English
Related papers

Related papers: Regularization approaches for support vector machi…

200 papers

In this paper, we consider the binary classification problem via distributed Support-Vector-Machines (SVM), where the idea is to train a network of agents, with limited share of data, to cooperatively learn the SVM classifier for the global…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Mohammadreza Doostmohammadian , Alireza Aghasi , Themistoklis Charalambous , Usman A. Khan

In support vector machine (SVM) applications with unreliable data that contains a portion of outliers, non-robustness of SVMs often causes considerable performance deterioration. Although many approaches for improving the robustness of SVMs…

Machine Learning · Statistics 2015-07-14 Shinya Suzumura , Kohei Ogawa , Masashi Sugiyama , Masayuki Karasuyama , Ichiro Takeuchi

Supervised machine learning is the classification of new data based on already classified training examples. In this work, we show that the support vector machine, an optimized binary classifier, can be implemented on a quantum computer,…

Quantum Physics · Physics 2014-10-01 Patrick Rebentrost , Masoud Mohseni , Seth Lloyd

Anomaly detection algorithms find extensive use in various fields. This area of research has recently made great advances thanks to deep learning. A recent method, the deep Support Vector Data Description (deep SVDD), which is inspired by…

Machine Learning · Computer Science 2021-01-20 Penny Chong , Lukas Ruff , Marius Kloft , Alexander Binder

We present improved methods of using structured SVMs in a large-scale hierarchical classification problem, that is when labels are leaves, or sets of leaves, in a tree or a DAG. We examine the need to normalize both the regularization and…

Machine Learning · Computer Science 2016-03-07 Heejin Choi , Yutaka Sasaki , Nathan Srebro

The support vector machines (SVM) is a powerful classifier used for binary classification to improve the prediction accuracy. However, the non-differentiability of the SVM hinge loss function can lead to computational difficulties in high…

Machine Learning · Statistics 2023-03-17 Rachid Kharoubi , Abdallah Mkhadri , Karim Oualkacha

Data augmentation has been proven to be an effective technique for developing machine learning models that are robust to known classes of distributional shifts (e.g., rotations of images), and alignment regularization is a technique often…

Machine Learning · Computer Science 2022-06-07 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

Twin support vector machine (TWSVM) and twin support vector regression (TSVR) are newly emerging efficient machine learning techniques which offer promising solutions for classification and regression challenges respectively. TWSVM is based…

Machine Learning · Computer Science 2022-03-21 M. Tanveer , T. Rajani , R. Rastogi , Y. H. Shao , M. A. Ganaie

Tackling pattern recognition problems in areas such as computer vision, bioinformatics, speech or text recognition is often done best by taking into account task-specific statistical relations between output variables. In structured…

Machine Learning · Statistics 2016-03-14 Rein Houthooft , Filip De Turck

Regularization methods are a key tool in the solution of inverse problems. They are used to introduce prior knowledge and make the approximation of ill-posed (pseudo-)inverses feasible. In the last two decades interest has shifted from…

Numerical Analysis · Mathematics 2018-01-31 Martin Benning , Martin Burger

Typically, nonlinear Support Vector Machines (SVMs) produce significantly higher classification quality when compared to linear ones but, at the same time, their computational complexity is prohibitive for large-scale datasets: this…

Machine Learning · Computer Science 2021-11-11 S. Cipolla , J. Gondzio

Variational regularization is commonly used to solve linear inverse problems, and involves augmenting a data fidelity by a regularizer. The regularizer is used to promote a priori information and is weighted by a regularization parameter.…

Optimization and Control · Mathematics 2024-01-23 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

An importance sampling and bagging approach to solving the support vector machine (SVM) problem in the context of large databases is presented and evaluated. Our algorithm builds on the nearest neighbors ideas presented in Camelo at al.…

Machine Learning · Statistics 2018-08-20 R. Bárcenas , M. D. Gónzalez--Lima , A. J. Quiroz

Localized support vector machines solve SVMs on many spatially defined small chunks and one of their main characteristics besides the computational benefit compared to global SVMs is the freedom of choosing arbitrary kernel and…

Statistics Theory · Mathematics 2019-09-27 Ingrid Blaschzyk , Ingo Steinwart

Relevance Vector Machine (RVM) is a supervised learning algorithm extended from Support Vector Machine (SVM) based on the Bayesian sparsity model. Compared with the regression problem, RVM classification is difficult to be conducted because…

Machine Learning · Statistics 2022-10-28 Wenyang Wang , Dongchu Sun , Zhuoqiong He

Support vector machines (SVM) is one of the well known supervised classes of learning algorithms. Furthermore, the conic-segmentation SVM (CS-SVM) is a natural multiclass analogue of the standard binary SVM, as CS-SVM models are dealing…

Machine Learning · Computer Science 2022-09-23 Shen Peng , Gianpiero Canessa , Zhihua Allen-Zhao

Support vector machine (SVM) has proved to be a successful approach for machine learning. Two typical SVM models are the L1-loss model for support vector classification (SVC) and $\epsilon$-L1-loss model for support vector regression (SVR).…

Optimization and Control · Mathematics 2020-03-09 Yinqiao Yan , Qingna Li

Objective: Classifier transfers usually come with dataset shifts. To overcome them, online strategies have to be applied. For practical applications, limitations in the computational resources for the adaptation of batch learning…

Machine Learning · Computer Science 2022-08-11 Mario Michael Krell , Nils Wilshusen , Anett Seeland , Su Kyoung Kim

This paper presents a kernel-based discriminative learning framework on probability measures. Rather than relying on large collections of vectorial training examples, our framework learns using a collection of probability distributions that…

Machine Learning · Statistics 2013-01-15 Krikamol Muandet , Kenji Fukumizu , Francesco Dinuzzo , Bernhard Schölkopf

Kernel-based methods for support vector machines (SVM) have shown highly advantageous performance in various applications. However, they may incur prohibitive computational costs for large-scale sample datasets. Therefore, data reduction…

Optimization and Control · Mathematics 2021-04-27 Shenglong Zhou