English
Related papers

Related papers: Local Duality for Sparse Support Vector Machines

200 papers

Support Vector Machines (SVM) with $\ell_1$ penalty became a standard tool in analysis of highdimensional classification problems with sparsity constraints in many applications including bioinformatics and signal processing. Although SVM…

Information Theory · Computer Science 2015-09-29 Anton Kolleck , Jan Vybíral

Mathematical modelling, particularly through approaches such as structured sparse support vector machines (SS-SVM), plays a crucial role in processing data with complex feature structures, yet efficient algorithms for distributed…

Machine Learning · Computer Science 2026-01-13 Rongmei Liang , Zizheng Liu , Xiaofei Wu , Jingwen Tu

Kernel-based methods for support vector machines (SVM) have shown highly advantageous performance in various applications. However, they may incur prohibitive computational costs for large-scale sample datasets. Therefore, data reduction…

Optimization and Control · Mathematics 2021-04-27 Shenglong Zhou

We provide a formulation for Local Support Vector Machines (LSVMs) that generalizes previous formulations, and brings out the explicit connections to local polynomial learning used in nonparametric estimation literature. We investigate the…

Machine Learning · Statistics 2018-05-23 Ravi Ganti , Alexander Gray

Support Vector Machines (SVM), a popular machine learning technique, has been applied to a wide range of domains such as science, finance, and social networks for supervised learning. Whether it is identifying high-risk patients by…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-06-20 Jeyanthi Narasimhan , Abhinav Vishnu , Lawrence Holder , Adolfy Hoisie

Over the past two decades, support vector machine (SVM) has become a popular supervised machine learning model, and plenty of distinct algorithms are designed separately based on different KKT conditions of the SVM model for…

Machine Learning · Computer Science 2022-04-04 Zhou Shuisheng , Zhou Wendi

Kernel-free quadratic surface support vector machines (QSVM) have recently gained traction due to their flexibility in modeling nonlinear decision boundaries without relying on kernel functions. However, the introduction of a full quadratic…

Machine Learning · Computer Science 2026-03-09 Ahmad Mousavi , Ramin Zandvakili , Zheming Gao

In this paper, we study the embedded feature selection problem in linear Support Vector Machines (SVMs), in which a cardinality constraint is employed, leading to an interpretable classification model. The problem is NP-hard due to the…

Optimization and Control · Mathematics 2024-12-20 Immanuel Bomze , Federico D'Onofrio , Laura Palagi , Bo Peng

Support vector machines (SVMs) are well-studied supervised learning models for binary classification. In many applications, large amounts of samples can be cheaply and easily obtained. What is often a costly and error-prone process is to…

Optimization and Control · Mathematics 2024-12-20 Veronica Piccialli , Jan Schwiddessen , Antonio M. Sudoso

The linear Support Vector Machine (SVM) is a classic classification technique in machine learning. Motivated by applications in modern high dimensional statistics, we consider penalized SVM problems involving the minimization of a…

Machine Learning · Statistics 2021-08-31 Antoine Dedieu , Rahul Mazumder , Haoyue Wang

Support vector machines (SVMs) are invaluable tools for many practical applications in artificial intelligence, e.g., classification and event recognition. However, popular SVM solvers are not sufficiently efficient for applications with a…

Machine Learning · Computer Science 2011-10-02 Tianyi Zhou , Dacheng Tao , Xindong Wu

Support matrix machine (SMM) is an emerging classification framework that directly handles matrix-structured observations, thereby avoiding the spatial correlations destroyed by vectorization. However, most existing SMM variants rely on…

Machine Learning · Computer Science 2026-03-03 Xianchao Xiu , Shenghao Sun , Xinrong Li , Jiyuan Tao

The support vector machine (SVM) algorithm is well known to the computer learning community for its very good practical results. The goal of the present paper is to study this algorithm from a statistical perspective, using tools of…

Statistics Theory · Mathematics 2008-12-18 Gilles Blanchard , Olivier Bousquet , Pascal Massart

Least Squares Twin Support Vector Machine (LST-SVM) has been shown to be an efficient and fast algorithm for binary classification. It combines the operating principles of Least Squares SVM (LS-SVM) and Twin SVM (T-SVM); it constructs two…

Artificial Intelligence · Computer Science 2018-11-26 Javad Salimi Sartakhti , Homayun Afrabandpey , Nasser Ghadiri

Recent advance on linear support vector machine with the 0-1 soft margin loss ($L_{0/1}$-SVM) shows that the 0-1 loss problem can be solved directly. However, its theoretical and algorithmic requirements restrict us extending the linear…

Machine Learning · Computer Science 2022-12-02 Ju Liu , Ling-Wei Huang , Yuan-Hai Shao , Wei-Jie Chen , Chun-Na Li

Support vector machines (SVMs) are special kernel based methods and belong to the most successful learning methods since more than a decade. SVMs can informally be described as a kind of regularized M-estimators for functions and have…

Machine Learning · Statistics 2010-07-26 Andreas Christmann , Robert Hable

High-dimensional classification problems often rely on the Lasso-penalized linear Support Vector Machines (SVMs). However, the double non-smoothness induced by the hinge loss and Lasso penalty in this model makes statistical inference…

Methodology · Statistics 2026-05-18 Shuya Zhou , Junwen Xia , Jingxiao Zhang

In this article, a large dimensional performance analysis of kernel least squares support vector machines (LS-SVMs) is provided under the assumption of a two-class Gaussian mixture model for the input data. Building upon recent advances in…

Machine Learning · Statistics 2021-03-18 Zhenyu Liao , Romain Couillet

Support vector machine (SVM), is a popular kernel method for data classification that demonstrated its efficiency for a large range of practical applications. The method suffers, however, from some weaknesses including; time processing,…

Machine Learning · Computer Science 2023-08-23 Lakhdar Remaki

This paper presents approaches to compute sparse solutions of Generalized Singular Value Problem (GSVP). The GSVP is regularized by $\ell_1$-norm and $\ell_q$-penalty for $0<q<1$, resulting in the $\ell_1$-GSVP and $\ell_q$-GSVP…

Machine Learning · Computer Science 2024-10-08 Ugochukwu O. Ugwu , Michael Kirby