English
Related papers

Related papers: Majorization-Minimization for sparse SVMs

200 papers

We prove that, under low noise assumptions, the support vector machine with $N\ll m$ random features (RFSVM) can achieve the learning rate faster than $O(1/\sqrt{m})$ on a training set with $m$ samples when an optimized feature map is used.…

Machine Learning · Computer Science 2019-01-09 Yitong Sun , Anna Gilbert , Ambuj Tewari

Support vector machine (SVM) has been one of the most popular learning algorithms, with the central idea of maximizing the minimum margin, i.e., the smallest distance from the instances to the classification boundary. Recent theoretical…

Machine Learning · Computer Science 2014-05-26 Teng Zhang , Zhi-Hua Zhou

This paper studies $\ell_1$ regularization with high-dimensional features for support vector machines with a built-in reject option (meaning that the decision of classifying an observation can be withheld at a cost lower than that of…

Statistics Theory · Mathematics 2012-01-06 Marten Wegkamp , Ming Yuan

This study introduces a novel formulation to enhance Support Vector Machines (SVMs) in handling class imbalance and noise. Unlike the conventional Soft Margin SVM, which penalizes the magnitude of constraint violations, the proposed model…

Machine Learning · Computer Science 2025-03-20 Seyed Mojtaba Mohasel , Hamidreza Koosha

We propose a new convex loss for Support Vector Machines, both for the binary classification and for the regression models. Therefore, we show the mathematical derivation of the dual problems and we experiment with them on several small…

Machine Learning · Computer Science 2026-03-02 Filippo Portera

Localized support vector machines solve SVMs on many spatially defined small chunks and one of their main characteristics besides the computational benefit compared to global SVMs is the freedom of choosing arbitrary kernel and…

Statistics Theory · Mathematics 2019-09-27 Ingrid Blaschzyk , Ingo Steinwart

Support Vector Machine (SVM) is an efficient classification approach, which finds a hyperplane to separate data from different classes. This hyperplane is determined by support vectors. In existing SVM formulations, the objective function…

Machine Learning · Computer Science 2018-04-09 Shuai Zheng , Chris Ding

As enjoying the closed form solution, least squares support vector machine (LSSVM) has been widely used for classification and regression problems having the comparable performance with other types of SVMs. However, LSSVM has two drawbacks:…

Machine Learning · Computer Science 2017-02-08 Li Chen , Shuisheng Zhou

The soft-margin support vector machine (SVM) is a ubiquitous tool for prediction of binary-response data. However, the SVM is characterized entirely via a numerical optimization problem, rather than a probability model, and thus does not…

Methodology · Statistics 2020-07-24 Hien D Nguyen , Daniel V Fryer

Support Vector Machine (SVM) has been one of the most successful machine learning techniques for binary classification problems. The key idea is to maximize the margin from the data to the hyperplane subject to correct classification on…

Machine Learning · Computer Science 2023-06-27 Rongrong Lin , Yingjia Yao , Yulan Liu

In recent years, feature selection has become a challenging problem in several machine learning fields, such as classification problems. Support Vector Machine (SVM) is a well-known technique applied in classification tasks. Various…

Machine Learning · Computer Science 2021-01-18 Asunción Jiménez-Cordero , Juan Miguel Morales , Salvador Pineda

The Support Vector Machine (SVM) is a popular classification paradigm in machine learning and has achieved great success in real applications. However, the standard SVM can not select variables automatically and therefore its solution…

Methodology · Statistics 2008-12-18 Hao Helen Zhang , Yufeng Liu , Yichao Wu , Ji Zhu

Support vector machines (SVM) can classify data sets along highly non-linear decision boundaries because of the kernel-trick. This expressiveness comes at a price: During test-time, the SVM classifier needs to compute the kernel…

Machine Learning · Computer Science 2015-02-03 Zhixiang Xu , Jacob R. Gardner , Stephen Tyree , Kilian Q. Weinberger

Support Vector Machines (SVMs) are among the most popular and the best performing classification algorithms. Various approaches have been proposed to reduce the high computation and memory cost when training and predicting based on…

Machine Learning · Computer Science 2020-07-24 Chen Jiang , Qingna Li

In this paper, we present new optimization models for Support Vector Machine (SVM), with the aim of separating data points in two or more classes. The classification task is handled by means of nonlinear classifiers induced by kernel…

Optimization and Control · Mathematics 2025-07-15 Francesca Maggioni , Andrea Spinelli

A new procedure for learning cost-sensitive SVM(CS-SVM) classifiers is proposed. The SVM hinge loss is extended to the cost sensitive setting, and the CS-SVM is derived as the minimizer of the associated risk. The extension of the hinge…

Machine Learning · Computer Science 2015-02-17 Hamed Masnadi-Shirazi , Nuno Vasconcelos , Arya Iranmehr

Support vector machine (SVM) is one of the most popular classification algorithms in the machine learning literature. We demonstrate that SVM can be used to balance covariates and estimate average causal effects under the unconfoundedness…

Methodology · Statistics 2021-07-02 Alexander Tarr , Kosuke Imai

Support vector machines (SVMs) are widely used and constitute one of the best examined and used machine learning models for two-class classification. Classification in SVM is based on a score procedure, yielding a deterministic…

Machine Learning · Statistics 2023-10-11 Sandra Benítez-Peña , Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo

Sparse classifiers such as the support vector machines (SVM) are efficient in test-phases because the classifier is characterized only by a subset of the samples called support vectors (SVs), and the rest of the samples (non SVs) have no…

Machine Learning · Statistics 2014-01-28 Kohei Ogawa , Yoshiki Suzuki , Shinya Suzumura , Ichiro Takeuchi

Kernelized Support Vector Machines (SVMs) are among the best performing supervised learning methods. But for optimal predictive performance, time-consuming parameter tuning is crucial, which impedes application. To tackle this problem, the…

Machine Learning · Statistics 2016-02-11 Aydin Demircioglu , Daniel Horn , Tobias Glasmachers , Bernd Bischl , Claus Weihs