English
Related papers

Related papers: Structured variable selection in support vector ma…

200 papers

Kernel-based methods for support vector machines (SVM) have shown highly advantageous performance in various applications. However, they may incur prohibitive computational costs for large-scale sample datasets. Therefore, data reduction…

Optimization and Control · Mathematics 2021-04-27 Shenglong Zhou

We analyze the computational complexity of Quantum Sparse Support Vector Machine, a linear classifier that minimizes the hinge loss and the $L_1$ norm of the feature weights vector and relies on a quantum linear programming solver instead…

Machine Learning · Computer Science 2022-04-26 Seyran Saeedi , Tom Arodz

The support vector machines (SVM) is a powerful classifier used for binary classification to improve the prediction accuracy. However, the non-differentiability of the SVM hinge loss function can lead to computational difficulties in high…

Machine Learning · Statistics 2023-03-17 Rachid Kharoubi , Abdallah Mkhadri , Karim Oualkacha

The support vector machines (SVM) algorithm is a popular classification technique in data mining and machine learning. In this paper, we propose a distributed SVM algorithm and demonstrate its use in a number of applications. The algorithm…

Machine Learning · Computer Science 2019-05-02 Taiping He , Tao Wang , Ralph Abbey , Joshua Griffin

The support vector machine (SVM) is a supervised learning algorithm that finds a maximum-margin linear classifier, often after mapping the data to a high-dimensional feature space via the kernel trick. Recent work has demonstrated that in…

Machine Learning · Statistics 2026-04-16 Chiraag Kaushik , Andrew D. McRae , Mark A. Davenport , Vidya Muthukumar

As enjoying the closed form solution, least squares support vector machine (LSSVM) has been widely used for classification and regression problems having the comparable performance with other types of SVMs. However, LSSVM has two drawbacks:…

Machine Learning · Computer Science 2017-02-08 Li Chen , Shuisheng Zhou

In high-dimensions, many variable selection methods, such as the lasso, are often limited by excessive variability and rank deficiency of the sample covariance matrix. Covariance sparsity is a natural phenomenon in high-dimensional…

Methodology · Statistics 2010-06-08 X. Jessie Jeng And Z. John Daye

Classification is one of the main areas of pattern recognition research, and within it, Support Vector Machine (SVM) is one of the most popular methods outside of field of deep learning -- and a de-facto reference for many Machine Learning…

Machine Learning · Computer Science 2024-02-23 Michał Cholewa , Michał Romaszewski , Przemysław Głomb

A structured variable selection problem is considered in which the covariates, divided into predefined groups, activate according to sparse patterns with few nonzero entries per group. Capitalizing on the concept of atomic norm, a composite…

Machine Learning · Computer Science 2023-11-03 David Gregoratti , Xavier Mestre , Carlos Buelga

Support vector machines (SVMs) rely on the inherent geometry of a data set to classify training data. Because of this, we believe SVMs are an excellent candidate to guide the development of an analytic feature selection algorithm, as…

Machine Learning · Computer Science 2013-04-23 Carly Stambaugh , Hui Yang , Felix Breuer

Few Bayesian methods for analyzing high-dimensional sparse survival data provide scalable variable selection, effect estimation and uncertainty quantification. Such methods often either sacrifice uncertainty quantification by computing…

Methodology · Statistics 2022-07-06 Michael Komodromos , Eric Aboagye , Marina Evangelou , Sarah Filippi , Kolyan Ray

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. While naturally cast as a combinatorial optimization problem, variable or feature selection admits a convex relaxation through the…

Machine Learning · Computer Science 2012-04-23 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

We investigate the relation of two fundamental tools in machine learning and signal processing, that is the support vector machine (SVM) for classification, and the Lasso technique used in regression. We show that the resulting optimization…

Machine Learning · Computer Science 2014-04-28 Martin Jaggi

In this paper, we present new optimization models for Support Vector Machine (SVM), with the aim of separating data points in two or more classes. The classification task is handled by means of nonlinear classifiers induced by kernel…

Optimization and Control · Mathematics 2025-07-15 Francesca Maggioni , Andrea Spinelli

Support vector machine (SVM) is a particularly powerful and flexible supervised learning model that analyzes data for both classification and regression, whose usual algorithm complexity scales polynomially with the dimension of data space…

Machine Learning · Computer Science 2023-03-08 Chen Ding , Tian-Yi Bao , He-Liang Huang

Several decades ago, Support Vector Machines (SVMs) were introduced for performing binary classification tasks, under a supervised framework. Nowadays, they often outperform other supervised methods and remain one of the most popular…

Support vector machines (SVMs) are special kernel based methods and belong to the most successful learning methods since more than a decade. SVMs can informally be described as a kind of regularized M-estimators for functions and have…

Machine Learning · Statistics 2010-07-26 Andreas Christmann , Robert Hable

Support vector machine (SVM) is one of the most studied paradigms in the realm of machine learning for classification and regression problems. It relies on vectorized input data. However, a significant portion of the real-world data exists…

Machine Learning · Computer Science 2023-10-31 Anuradha Kumari , Mushir Akhtar , Rupal Shah , M. Tanveer

Support Vector Machine (SVM) is a powerful tool in binary classification, known to attain excellent misclassification rates. On the other hand, many realworld classification problems, such as those found in medical diagnosis, churn or fraud…

Machine Learning · Statistics 2023-12-25 Sandra Benítez-Peña , Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo

Due to the rise of cardinality minimization in optimization, sparse support vector machines (SSVMs) have attracted much attention lately and show certain empirical advantages over convex SVMs. A common way to derive an SSVM is to add a…

Machine Learning · Computer Science 2026-01-29 Penghe Zhang , Naihua Xiu , Houduo Qi