English
Related papers

Related papers: Statistical performance of support vector machines

200 papers

We investigate the issue of model selection and the use of the nonconformity (strangeness) measure in batch learning. Using the nonconformity measure we propose a new training algorithm that helps avoid the need for Cross-Validation or…

Machine Learning · Statistics 2009-09-15 David R. Hardoon , Zakria Hussain , John Shawe-Taylor

We consider gradient descent like algorithms for Support Vector Machine (SVM) training when the data is in relational form. The gradient of the SVM objective can not be efficiently computed by known techniques as it suffers from the…

Data Structures and Algorithms · Computer Science 2020-05-13 Mahmoud Abo-Khamis , Sungjin Im , Benjamin Moseley , Kirk Pruhs , Alireza Samadian

We consider convex-concave saddle-point problems where the objective functions may be split in many components, and extend recent stochastic variance reduction methods (such as SVRG or SAGA) to provide the first large-scale linearly…

Machine Learning · Computer Science 2016-11-04 P Balamurugan , Francis Bach

This paper addresses the problem of efficiently classifying high-dimensional data over decentralized networks. Penalized support vector machines (SVMs) are widely used for high-dimensional classification tasks. However, the double…

Machine Learning · Statistics 2025-03-11 Canyi Chen , Nan Qiao , Liping Zhu

The time complexity of support vector machines (SVMs) prohibits training on huge data sets with millions of data points. Recently, multilevel approaches to train SVMs have been developed to allow for time-efficient training on huge data…

Machine Learning · Computer Science 2020-01-29 Sebastian Schlag , Matthias Schmitt , Christian Schulz

The Support Vector Machine (SVM) is one of the most widely used classification methods. In this paper, we consider the soft-margin SVM used on data points with independent features, where the sample size $n$ and the feature dimension $p$…

Machine Learning · Statistics 2019-08-02 Haoyang Liu

Structural support vector machines (SSVMs) are amongst the best performing models for structured computer vision tasks, such as semantic image segmentation or human pose estimation. Training SSVMs, however, is computationally costly,…

Machine Learning · Computer Science 2014-11-19 Neel Shah , Vladimir Kolmogorov , Christoph H. Lampert

Support vector machine is an important and fundamental technique in machine learning. Soft-margin SVM models have stronger generalization performance compared with the hard-margin SVM. Most existing works use the hinge-loss function which…

Optimization and Control · Mathematics 2021-05-18 Lu Sitong , Li Qinana

In this paper, support vector machine (SVM) performance was assessed utilizing a quantum-inspired complementary metal-oxide semiconductor (CMOS) annealer. The primary focus during performance evaluation was the accuracy rate in binary…

Performance · Computer Science 2025-01-07 Ryoga Fukuhara , Makoto Morishita , Takahiro Katagiri , Masatoshi Kawai , Toru Nagai , Tetsuya Hoshino

The support vector machine (SVM) is a widely used method for classification. Although many efforts have been devoted to develop efficient solvers, it remains challenging to apply SVM to large-scale problems. A nice property of SVM is that…

Machine Learning · Computer Science 2013-10-29 Jie Wang , Peter Wonka , Jieping Ye

We introduce a novel application of Support Vector Machines (SVM), an important Machine Learning algorithm, to determine the beginning and end of recessions in real time. Nowcasting, "forecasting" a condition about the present time because…

General Finance · Quantitative Finance 2019-06-28 Alexander James , Yaser S. Abu-Mostafa , Xiao Qiao

We prove that, under low noise assumptions, the support vector machine with $N\ll m$ random features (RFSVM) can achieve the learning rate faster than $O(1/\sqrt{m})$ on a training set with $m$ samples when an optimized feature map is used.…

Machine Learning · Computer Science 2019-01-09 Yitong Sun , Anna Gilbert , Ambuj Tewari

In ranking problems, the goal is to learn a ranking function from labeled pairs of input points. In this paper, we consider the related comparison problem, where the label indicates which element of the pair is better, or if there is no…

Machine Learning · Statistics 2020-07-27 David Venuto , Toby Dylan Hocking , Lakjaree Sphanurattana , Masashi Sugiyama

We introduce a principal support vector machine (PSVM) approach that can be used for both linear and nonlinear sufficient dimension reduction. The basic idea is to divide the response variables into slices and use a modified form of support…

Statistics Theory · Mathematics 2012-03-14 Bing Li , Andreas Artemiou , Lexin Li

Support Vector Machines (SVMs) are powerful learners that have led to state-of-the-art results in various computer vision problems. SVMs suffer from various drawbacks in terms of selecting the right kernel, which depends on the image…

Computer Vision and Pattern Recognition · Computer Science 2014-03-31 Gemma Roig , Xavier Boix , Luc Van Gool

The support vector machine (SVM) is one of the most successful learning methods for solving classification problems. Despite its popularity, SVM has a serious drawback, that is sensitivity to outliers in training samples. The penalty on…

Machine Learning · Statistics 2014-09-04 Takafumi Kanamori , Shuhei Fujiwara , Akiko Takeda

One of the most challenging problems in kernel online learning is to bound the model size and to promote the model sparsity. Sparse models not only improve computation and memory usage, but also enhance the generalization capacity, a…

Machine Learning · Computer Science 2017-05-30 Trung Le , Tu Dinh Nguyen , Vu Nguyen , Dinh Phung

Support vector machine is an important and fundamental technique in machine learning. In this paper, we apply a semismooth Newton method to solve two typical SVM models: the L2-loss SVC model and the \epsilon-L2-loss SVR model. The…

Optimization and Control · Mathematics 2019-03-04 Juan Yin , Qingna Li

Sparsity-inducing penalties are useful tools to design multiclass support vector machines (SVMs). In this paper, we propose a convex optimization approach for efficiently and exactly solving the multiclass SVM learning problem involving a…

Machine Learning · Computer Science 2015-12-15 G. Chierchia , Nelly Pustelnik , Jean-Christophe Pesquet , B. Pesquet-Popescu

Sampling and budgeting training examples are two essential factors in tracking algorithms based on support vector machines (SVMs) as a trade-off between accuracy and efficiency. Recently, the circulant matrix formed by dense sampling of…

Computer Vision and Pattern Recognition · Computer Science 2016-01-25 Wangmeng Zuo , Xiaohe Wu , Liang Lin , Lei Zhang , Ming-Hsuan Yang