English
Related papers

Related papers: Near-Tight Margin-Based Generalization Bounds for …

200 papers

Support Vector Machine (SVM) is a robust machine learning algorithm with broad applications in classification, regression, and outlier detection. SVM requires tuning the regularization parameter (RP) which controls the model capacity and…

Machine Learning · Statistics 2023-05-18 Mahdi Shamsi , Soosan Beheshti

Support vector machines (SVMs) are widely used machine learning models (e.g., in remote sensing), with formulations for both classification and regression tasks. In the last years, with the advent of working quantum annealers, hybrid SVM…

Emerging Technologies · Computer Science 2024-11-05 Enrico Zardini , Amer Delilbasic , Enrico Blanzieri , Gabriele Cavallaro , Davide Pastorello

Twin support vector machine (TWSVM) and twin support vector regression (TSVR) are newly emerging efficient machine learning techniques which offer promising solutions for classification and regression challenges respectively. TWSVM is based…

Machine Learning · Computer Science 2022-03-21 M. Tanveer , T. Rajani , R. Rastogi , Y. H. Shao , M. A. Ganaie

We give two provably accurate feature-selection techniques for the linear SVM. The algorithms run in deterministic and randomized time respectively. Our algorithms can be used in an unsupervised or supervised setting. The supervised…

Machine Learning · Statistics 2015-02-09 Saurabh Paul , Malik Magdon-Ismail , Petros Drineas

Support vector machine algorithms are considered essential for the implementation of automation in a radio access network. Specifically, they are critical in the prediction of the quality of user experience for video streaming based on…

Emerging Technologies · Computer Science 2019-09-27 Jiaying Yang , Ahsan Javed Awan , Gemma Vall-Llosera

We study the typical learning properties of the recently proposed Support Vectors Machines. The generalization error on linearly separable tasks, the capacity, the typical number of Support Vectors, the margin, and the robustness or noise…

Disordered Systems and Neural Networks · Physics 2007-05-23 A. Buhot , Mirta B. Gordon

Deep neural networks generalize well despite being exceedingly overparameterized and being trained without explicit regularization. This curious phenomenon has inspired extensive research activity in establishing its statistical principles:…

Machine Learning · Statistics 2021-09-16 Ke Wang , Christos Thrampoulidis

We give sublinear-time approximation algorithms for some optimization problems arising in machine learning, such as training linear classifiers and finding minimum enclosing balls. Our algorithms can be extended to some kernelized versions…

Machine Learning · Computer Science 2010-10-22 Kenneth L. Clarkson , Elad Hazan , David P. Woodruff

Kernel-based machine learning algorithms are based on mapping data from the original input feature space to a kernel feature space of higher dimensionality to solve a linear problem in that space. Over the last decade, kernel based…

Computer Vision and Pattern Recognition · Computer Science 2011-01-18 Mahesh Pal

Support vector machines (SVMs) are an important tool in modern data analysis. Traditionally, support vector machines have been fitted via quadratic programming, either using purpose-built or off-the-shelf algorithms. We present an…

Computation · Statistics 2017-05-15 Hien D. Nguyen , Geoffrey J. McLachlan

One of the limiting factors of using support vector machines (SVMs) in large scale applications are their super-linear computational requirements in terms of the number of training samples. To address this issue, several approaches that…

Machine Learning · Statistics 2015-07-24 Mona Eberts , Ingo Steinwart

Explaining the unreasonable effectiveness of deep learning has eluded researchers around the globe. Various authors have described multiple metrics to evaluate the capacity of deep architectures. In this paper, we allude to the radius…

Machine Learning · Computer Science 2018-11-06 Mayank Sharma , Jayadeva , Sumit Soman

This paper presents a review on methods for class-imbalanced learning with the Support Vector Machine (SVM) and its variants. We first explain the structure of SVM and its variants and discuss their inefficiency in learning with…

Machine Learning · Computer Science 2024-07-23 Salim Rezvani , Farhad Pourpanah , Chee Peng Lim , Q. M. Jonathan Wu

The linear Support Vector Machine (SVM) is a classic classification technique in machine learning. Motivated by applications in modern high dimensional statistics, we consider penalized SVM problems involving the minimization of a…

Machine Learning · Statistics 2021-08-31 Antoine Dedieu , Rahul Mazumder , Haoyue Wang

Support vector machines (SVM) and other kernel techniques represent a family of powerful statistical classification methods with high accuracy and broad applicability. Because they use all or a significant portion of the training data,…

Machine Learning · Statistics 2023-01-31 Peter Mills

In most papers establishing consistency for learning algorithms it is assumed that the observations used for training are realizations of an i.i.d. process. In this paper we go far beyond this classical framework by showing that support…

Machine Learning · Statistics 2007-07-04 Ingo Steinwart , Don Hush , Clint Scovel

The support vector machine (SVM) is a powerful and widely used classification algorithm. This paper uses the Karush-Kuhn-Tucker conditions to provide rigorous mathematical proof for new insights into the behavior of SVM. These insights…

Machine Learning · Statistics 2018-10-11 Iain Carmichael , J. S. Marron

This Note proposes a new methodology for function classification with Support Vector Machine (SVM). Rather than relying on projection on a truncated Hilbert basis as in our previous work, we use an implicit spline interpolation that allows…

Statistics Theory · Mathematics 2007-05-23 Nathalie Villa , Fabrice Rossi

Largest theoretical contribution to Neural Networks comes from VC Dimension which characterizes the sample complexity of classification model in a probabilistic view and are widely used to study the generalization error. So far in the…

Machine Learning · Computer Science 2024-09-05 Linu Pinto , Sasi Gopalan

Support Vector Machines (SVMs) are an important tool for performing classification on scattered data, where one usually has to deal with many data points in high-dimensional spaces. We propose solving SVMs in primal form using feature maps…

Machine Learning · Computer Science 2024-09-05 Kseniya Akhalaya , Franziska Nestler , Daniel Potts