English
Related papers

Related papers: Span error bound for weighted SVM with application…

200 papers

The support vector machines (SVM) is one of the most widely used and practical optimization based classification models in machine learning because of its interpretability and flexibility to produce high quality results. However, the big…

Machine Learning · Computer Science 2020-11-06 Ehsan Sadrfaridpour , Korey Palmer , Ilya Safro

A mean field variational Bayes approach to support vector machines (SVMs) using the latent variable representation on Polson & Scott (2012) is presented. This representation allows circumvention of many of the shortcomings associated with…

Methodology · Statistics 2013-05-14 Jan Luts , John T. Ormerod

In this paper, we present new optimization models for Support Vector Machine (SVM), with the aim of separating data points in two or more classes. The classification task is handled by means of nonlinear classifiers induced by kernel…

Optimization and Control · Mathematics 2025-07-15 Francesca Maggioni , Andrea Spinelli

Support vector machines (SVMs) are powerful supervised learning tools developed to solve classification problems. However, SVMs are likely to perform poorly in the classification of imbalanced data. The rough set theory presents a…

Machine Learning · Computer Science 2021-05-25 Maysam Behmanesh , Peyman Adibi , Hossein Karshenas

The support vector machine (SVM) is a widely used method for classification. Although many efforts have been devoted to develop efficient solvers, it remains challenging to apply SVM to large-scale problems. A nice property of SVM is that…

Machine Learning · Computer Science 2013-10-29 Jie Wang , Peter Wonka , Jieping Ye

The Support Vector Machine (SVM) is one of the most widely used classification methods. In this paper, we consider the soft-margin SVM used on data points with independent features, where the sample size $n$ and the feature dimension $p$…

Machine Learning · Statistics 2019-08-02 Haoyang Liu

Support Vector Machines (SVMs) based on hinge loss have been extensively discussed and applied to various binary classification tasks. These SVMs achieve a balance between margin maximization and the minimization of slack due to outliers.…

Machine Learning · Computer Science 2024-08-21 Haoxiang Sun

The k-fold cross-validation is commonly used to evaluate the effectiveness of SVMs with the selected hyper-parameters. It is known that the SVM k-fold cross-validation is expensive, since it requires training k SVMs. However, little work…

Machine Learning · Computer Science 2017-02-07 Zeyi Wen , Bin Li , Rao Kotagiri , Jian Chen , Yawen Chen , Rui Zhang

This paper addresses feature subset selection for Support Vector Machines (SVMs) based on the cross-validation criterion. Unlike statistical criteria such as the Akaike information criterion (AIC) and the Bayesian information criterion…

Optimization and Control · Mathematics 2026-05-11 Masaharu Mori , Shunnosuke Ikeda , Ryuta Tamura , Yuichi Takano , Ryuhei Miyashiro

Tackling pattern recognition problems in areas such as computer vision, bioinformatics, speech or text recognition is often done best by taking into account task-specific statistical relations between output variables. In structured…

Machine Learning · Statistics 2016-03-14 Rein Houthooft , Filip De Turck

A widely-used tool for binary classification is the Support Vector Machine (SVM), a supervised learning technique that finds the "maximum margin" linear separator between the two classes. While SVMs have been well studied in the batch…

Machine Learning · Computer Science 2014-12-09 Vikram Nathan , Sharath Raghvendra

Research in machine learning has successfully developed algorithms to build accurate classification models. However, in many real-world applications, such as healthcare, customer satisfaction, and environment protection, we want to be able…

Machine Learning · Computer Science 2020-12-08 Samuel Marc Denton , Ansaf Salleb-Aouissi

The support vector machine (SVM) is a well-established classification method whose name refers to the particular training examples, called support vectors, that determine the maximum margin separating hyperplane. The SVM classifier is known…

Statistics Theory · Mathematics 2022-06-15 Daniel Hsu , Vidya Muthukumar , Ji Xu

As a technique that can compactly represent complex patterns, machine learning has significant potential for predictive inference. K-fold cross-validation (CV) is the most common approach to ascertaining the likelihood that a machine…

Machine Learning · Statistics 2026-04-24 Juan M Gorriz , R. Martin Clemente , F Segovia , J Ramirez , A Ortiz , J. Suckling

The Support Vector Machine (SVM) of Vapnik (1998) has become widely established as one of the leading approaches to pattern recognition and machine learning. It expresses predictions in terms of a linear combination of kernel functions…

Machine Learning · Computer Science 2013-01-18 Christopher M. Bishop , Michael Tipping

Prior knowledge can be used to improve predictive performance of learning algorithms or reduce the amount of data required for training. The same goal is pursued within the learning using privileged information paradigm which was recently…

Machine Learning · Statistics 2014-03-04 Maksim Lapin , Matthias Hein , Bernt Schiele

The support vector machine (SVM) algorithm is well known to the computer learning community for its very good practical results. The goal of the present paper is to study this algorithm from a statistical perspective, using tools of…

Statistics Theory · Mathematics 2008-12-18 Gilles Blanchard , Olivier Bousquet , Pascal Massart

When evaluating the performance of a model for individualised risk prediction, the sample size needs to be large enough to precisely estimate the performance measures of interest. Current sample size guidance is based on precisely…

Cross-validation is a common method for estimating the predictive performance of machine learning models. In a data-scarce regime, where one typically wishes to maximize the number of instances used for training the model, an approach…

Methodology · Statistics 2025-03-25 George I. Austin , Itsik Pe'er , Tal Korem

We investigate leave-one-out cross validation (CV) as a determinator of the weight of the penalty term in the least absolute shrinkage and selection operator (LASSO). First, on the basis of the message passing algorithm and a perturbative…

Information Theory · Computer Science 2016-06-22 Tomoyuki Obuchi , Yoshiyuki Kabashima