English
Related papers

Related papers: Support vector machines and linear regression coin…

200 papers

Support vector machines (SVMs) are an extremely successful type of classification and regression algorithms. Building an SVM entails solving a constrained convex quadratic programming problem, which is quadratic in the number of training…

Machine Learning · Computer Science 2008-11-15 Danny Bickson , Elad Yom-Tov , Danny Dolev

This paper studies the addition of linear constraints to the Support Vector Regression (SVR) when the kernel is linear. Adding those constraints into the problem allows to add prior knowledge on the estimator obtained, such as finding…

Optimization and Control · Mathematics 2019-11-07 Quentin Klopfenstein , Samuel Vaiter

Support Vector Machines (SVMs) are popular tools for data mining tasks such as classification, regression, and density estimation. However, original SVM (C-SVM) only considers local information of data points on or over the margin.…

Artificial Intelligence · Computer Science 2010-09-28 Xin Liu , Ying Ding , Forrest Sheng Bao

Support vector machine (SVM) has been one of the most popular learning algorithms, with the central idea of maximizing the minimum margin, i.e., the smallest distance from the instances to the classification boundary. Recent theoretical…

Machine Learning · Computer Science 2014-05-26 Teng Zhang , Zhi-Hua Zhou

Subgradient algorithms for training support vector machines have been quite successful for solving large-scale and online learning problems. However, they have been restricted to linear kernels and strongly convex formulations. This paper…

Machine Learning · Computer Science 2011-11-04 Sangkyun Lee , Stephen J. Wright

Support vector machines (SVMs) rely on the inherent geometry of a data set to classify training data. Because of this, we believe SVMs are an excellent candidate to guide the development of an analytic feature selection algorithm, as…

Machine Learning · Computer Science 2013-04-23 Carly Stambaugh , Hui Yang , Felix Breuer

The support vector machine (SVM) is a popular machine learning classification method which produces a nonlinear decision boundary in a feature space by constructing linear boundaries in a transformed Hilbert space. It is well known that…

Quantum Physics · Physics 2017-10-31 Rupak Chatterjee , Ting Yu

In nonparametric classification and regression problems, regularized kernel methods, in particular support vector machines, attract much attention in theoretical and in applied statistics. In an abstract sense, regularized kernel methods…

Machine Learning · Statistics 2011-04-13 Robert Hable

In this paper, we consider asymptotic properties of the support vector machine (SVM) in high-dimension, low-sample-size (HDLSS) settings. We show that the hard-margin linear SVM holds a consistency property in which misclassification rates…

Machine Learning · Statistics 2017-02-28 Yugo Nakayama , Kazuyoshi Yata , Makoto Aoshima

Let X be a data matrix of rank \rho, whose rows represent n points in d-dimensional space. The linear support vector machine constructs a hyperplane separator that maximizes the 1-norm soft margin. We develop a new oblivious dimension…

Machine Learning · Computer Science 2014-04-18 Saurabh Paul , Christos Boutsidis , Malik Magdon-Ismail , Petros Drineas

We propose a new approach, multi-view Laplacian support vector machines (SVMs), for semi-supervised learning under the multi-view scenario. It integrates manifold regularization and multi-view regularization into the usual formulation of…

Machine Learning · Computer Science 2013-07-29 Shiliang Sun

Using a support vector machine requires to set two types of hyperparameters: the soft margin parameter C and the parameters of the kernel. To perform this model selection task, the method of choice is cross-validation. Its leave-one-out…

Machine Learning · Computer Science 2008-12-18 Emmanuel Monfrini , Yann Guermeur

This paper proposes a frequent pattern data mining algorithm based on support vector machine (SVM), aiming to solve the performance bottleneck of traditional frequent pattern mining algorithms in high-dimensional and sparse data…

Machine Learning · Computer Science 2024-12-23 Pochun Li

Tackling pattern recognition problems in areas such as computer vision, bioinformatics, speech or text recognition is often done best by taking into account task-specific statistical relations between output variables. In structured…

Machine Learning · Statistics 2016-03-14 Rein Houthooft , Filip De Turck

Twin support vector machine (TWSVM) and twin support vector regression (TSVR) are newly emerging efficient machine learning techniques which offer promising solutions for classification and regression challenges respectively. TWSVM is based…

Machine Learning · Computer Science 2022-03-21 M. Tanveer , T. Rajani , R. Rastogi , Y. H. Shao , M. A. Ganaie

The time complexity of support vector machines (SVMs) prohibits training on huge data sets with millions of data points. Recently, multilevel approaches to train SVMs have been developed to allow for time-efficient training on huge data…

Machine Learning · Computer Science 2020-01-29 Sebastian Schlag , Matthias Schmitt , Christian Schulz

This paper addresses feature subset selection for Support Vector Machines (SVMs) based on the cross-validation criterion. Unlike statistical criteria such as the Akaike information criterion (AIC) and the Bayesian information criterion…

Optimization and Control · Mathematics 2026-05-11 Masaharu Mori , Shunnosuke Ikeda , Ryuta Tamura , Yuichi Takano , Ryuhei Miyashiro

Support Vector Data Description (SVDD) is a machine-learning technique used for single class classification and outlier detection. SVDD formulation with kernel function provides a flexible boundary around data. The value of kernel function…

Machine Learning · Computer Science 2017-09-06 Deovrat Kakde , Arin Chaudhuri , Seunghyun Kong , Maria Jahja , Hansi Jiang , Jorge Silva

Support vector machine (SVM) has proved to be a successful approach for machine learning. Two typical SVM models are the L1-loss model for support vector classification (SVC) and $\epsilon$-L1-loss model for support vector regression (SVR).…

Optimization and Control · Mathematics 2020-03-09 Yinqiao Yan , Qingna Li

Support vector data description (SVDD) is a machine learning technique that is used for single-class classification and outlier detection. The idea of SVDD is to find a set of support vectors that defines a boundary around data. When…

Machine Learning · Statistics 2018-11-05 Hansi Jiang , Haoyu Wang , Wenhao Hu , Deovrat Kakde , Arin Chaudhuri