English
Related papers

Related papers: Local Duality for Sparse Support Vector Machines

200 papers

Support vector machine (SVM) is a particularly powerful and flexible supervised learning model that analyzes data for both classification and regression, whose usual algorithm complexity scales polynomially with the dimension of data space…

Machine Learning · Computer Science 2023-03-08 Chen Ding , Tian-Yi Bao , He-Liang Huang

The support vector machine (SVM) is a supervised learning algorithm that finds a maximum-margin linear classifier, often after mapping the data to a high-dimensional feature space via the kernel trick. Recent work has demonstrated that in…

Machine Learning · Statistics 2026-04-16 Chiraag Kaushik , Andrew D. McRae , Mark A. Davenport , Vidya Muthukumar

Support vector machines are widely used in machine learning classification tasks, but traditional SVM models suffer from sensitivity to outliers and instability in resampling, which limits their performance in practical applications. To…

Machine Learning · Statistics 2025-12-01 Shibo Diao

In support vector machine (SVM) applications with unreliable data that contains a portion of outliers, non-robustness of SVMs often causes considerable performance deterioration. Although many approaches for improving the robustness of SVMs…

Machine Learning · Statistics 2015-07-14 Shinya Suzumura , Kohei Ogawa , Masashi Sugiyama , Masayuki Karasuyama , Ichiro Takeuchi

Support Vector Machines (SVMs) are popular tools for data mining tasks such as classification, regression, and density estimation. However, original SVM (C-SVM) only considers local information of data points on or over the margin.…

Artificial Intelligence · Computer Science 2010-09-28 Xin Liu , Ying Ding , Forrest Sheng Bao

Support vector machines (SVMs) appeared in the early nineties as optimal margin classifiers in the context of Vapnik's statistical learning theory. Since then SVMs have been successfully applied to real-world data analysis problems, often…

Statistics Theory · Mathematics 2016-08-16 Javier M. Moguerza , Alberto Muñoz

In recent years, feature selection has become a challenging problem in several machine learning fields, such as classification problems. Support Vector Machine (SVM) is a well-known technique applied in classification tasks. Various…

Machine Learning · Computer Science 2021-01-18 Asunción Jiménez-Cordero , Juan Miguel Morales , Salvador Pineda

The binomial deviance and the SVM hinge loss functions are two of the most widely used loss functions in machine learning. While there are many similarities between them, they also have their own strengths when dealing with different types…

Machine Learning · Statistics 2022-05-25 Man Huang , Luis Carvalho

Due to the non-smoothness of the Hinge loss in SVM, it is difficult to obtain a faster convergence rate with modern optimization algorithms. In this paper, we introduce two smooth Hinge losses $\psi_G(\alpha;\sigma)$ and…

Machine Learning · Computer Science 2021-03-16 JunRu Luo , Hong Qiao , Bo Zhang

In recent years, considerable attention has been devoted to the regularization models due to the presence of high-dimensional data in scientific research. Sparse support vector machine (SVM) are useful tools in high-dimensional data…

Computation · Statistics 2023-12-27 Jiawei Wen

A support vector machine (SVM) is an algorithm that finds a hyperplane which optimally separates labeled data points in $\mathbb{R}^n$ into positive and negative classes. The data points on the margin of this separating hyperplane are…

Machine Learning · Computer Science 2022-09-19 Henry Adams , Elin Farnell , Brittany Story

We give two provably accurate feature-selection techniques for the linear SVM. The algorithms run in deterministic and randomized time respectively. Our algorithms can be used in an unsupervised or supervised setting. The supervised…

Machine Learning · Statistics 2015-02-09 Saurabh Paul , Malik Magdon-Ismail , Petros Drineas

The Support Vector Machine (SVM) of Vapnik (1998) has become widely established as one of the leading approaches to pattern recognition and machine learning. It expresses predictions in terms of a linear combination of kernel functions…

Machine Learning · Computer Science 2013-01-18 Christopher M. Bishop , Michael Tipping

Twin support vector machine (TSVM), a variant of support vector machine (SVM), has garnered significant attention due to its $3/4$ times lower computational complexity compared to SVM. However, due to the utilization of the hinge loss…

Machine Learning · Computer Science 2024-10-01 Mushir Akhtar , M. Tanveer , Mohd. Arshad

Although Support Vector Machine (SVM) algorithm has a high generalization property to classify for unseen examples after training phase and it has small loss value, the algorithm is not suitable for real-life classification and regression…

Machine Learning · Computer Science 2013-12-17 Ferhat Özgür Çatak , Mehmet Erdal Balaban

An unsolved issue in widely used methods such as Support Vector Data Description (SVDD) and Small Sphere and Large Margin SVM (SSLM) for anomaly detection is their nonconvexity, which hampers the analysis of optimal solutions in a manner…

Machine Learning · Computer Science 2025-10-01 Hongying Liu , Hao Wang , Haoran Chu , Yibo Wu

Transductive SVM (TSVM) is a well known semi-supervised large margin learning method for binary text classification. In this paper we extend this method to multi-class and hierarchical classification problems. We point out that the…

Machine Learning · Computer Science 2012-11-02 Sathiya Keerthi Selvaraj , Sundararajan Sellamanickam , Shirish Shevade

This chapter describes componentwise Least Squares Support Vector Machines (LS-SVMs) for the estimation of additive models consisting of a sum of nonlinear components. The primal-dual derivations characterizing LS-SVMs for the estimation of…

Machine Learning · Computer Science 2007-05-23 Kristiaan Pelckmans , Ivan Goethals , Jos De Brabanter , Johan A. K. Suykens , Bart De Moor

Support Vector Machine (SVM) stands out as a prominent machine learning technique widely applied in practical pattern recognition tasks. It achieves binary classification by maximizing the "margin", which represents the minimum distance…

Machine Learning · Computer Science 2026-01-21 Zhezheng Hao , Feiping Nie , Rong Wang

Support vector machine is an important and fundamental technique in machine learning. Soft-margin SVM models have stronger generalization performance compared with the hard-margin SVM. Most existing works use the hinge-loss function which…

Optimization and Control · Mathematics 2021-05-18 Lu Sitong , Li Qinana