English
Related papers

Related papers: Principal support vector machines for linear and n…

200 papers

Existing support vector machines(SVM) models are sensitive to noise and lack sparsity, which limits their performance. To address these issues, we combine the elastic net loss with a robust loss framework to construct a sparse…

Machine Learning · Statistics 2026-04-10 Haiyan Du , Hu Yang

Support Vector Machine (SVM) has been one of the most successful machine learning techniques for binary classification problems. The key idea is to maximize the margin from the data to the hyperplane subject to correct classification on…

Machine Learning · Computer Science 2023-06-27 Rongrong Lin , Yingjia Yao , Yulan Liu

This paper proposes a novel, node-splitting support vector machine (SVM) for creating survival trees. This approach is capable of non-linearly partitioning survival data which includes continuous, right-censored outcomes. Our method…

Methodology · Statistics 2025-11-11 Aye Aye Maung , Drew Lazar , Qi Zheng

The support vector machine (SVM) is a powerful and widely used classification algorithm. This paper uses the Karush-Kuhn-Tucker conditions to provide rigorous mathematical proof for new insights into the behavior of SVM. These insights…

Machine Learning · Statistics 2018-10-11 Iain Carmichael , J. S. Marron

In the last few years, various types of machine learning algorithms, such as Support Vector Machine (SVM), Support Vector Regression (SVR), and Non-negative Matrix Factorization (NMF) have been introduced. The kernel approach is an…

Machine Learning · Computer Science 2022-12-16 Sajad Fathi Hafshejani , Zahra Moberfard

This work focuses on support vector machine (SVM) with feature selection. A MILP formulation is proposed for the problem. The choice of suitable features to construct the separating hyperplanes has been modelled in this formulation by…

Optimization and Control · Mathematics 2018-08-08 Martine Labbé , Luisa I. Martínez-Merino , Antonio M. Rodríguez-Chía

Support vector machines (SVMs) are an extremely successful type of classification and regression algorithms. Building an SVM entails solving a constrained convex quadratic programming problem, which is quadratic in the number of training…

Machine Learning · Computer Science 2008-11-15 Danny Bickson , Elad Yom-Tov , Danny Dolev

Support vector machine (SVM) is a powerful machine learning algorithm to handle classification tasks. However, the classical SVM is developed for binary problems with the assumption of balanced datasets. Obviously, the multi-class…

Machine Learning · Computer Science 2025-02-21 Zhong-Liang Zhang , Jie Yang , Jian-Ming Ru , Xiao-Xi Zhao , Xing-Gang Luo

We give two provably accurate feature-selection techniques for the linear SVM. The algorithms run in deterministic and randomized time respectively. Our algorithms can be used in an unsupervised or supervised setting. The supervised…

Machine Learning · Statistics 2015-02-09 Saurabh Paul , Malik Magdon-Ismail , Petros Drineas

We introduce a new approach to nonlinear sufficient dimension reduction in cases where both the predictor and the response are distributional data, modeled as members of a metric space. Our key step is to build universal kernels…

Methodology · Statistics 2023-04-26 Qi Zhang , Bing Li , Lingzhou Xue

The aim of this paper is to study the convergence of the primal-dual dynamics pertaining to Support Vector Machines (SVM). The optimization routine, used for determining an SVM for classification, is first formulated as a dynamical system.…

Systems and Control · Computer Science 2018-05-03 Krishna Chaitanya Kosaraju , Shravan Mohan , Ramkrishna Pasumarthy

In traditional boosting algorithms, the focus on misclassified training samples emphasizes their importance based on difficulty during the learning process. While using a standard Support Vector Machine (SVM) as a weak learner in an…

Machine Learning · Computer Science 2024-10-10 Junbo Jacob Lian

Classification is one of the main areas of pattern recognition research, and within it, Support Vector Machine (SVM) is one of the most popular methods outside of field of deep learning -- and a de-facto reference for many Machine Learning…

Machine Learning · Computer Science 2024-02-23 Michał Cholewa , Michał Romaszewski , Przemysław Głomb

We review the concept of support vector machines (SVMs) and discuss examples of their use. One of the benefits of SVM algorithms, compared with neural networks and decision trees is that they can be less susceptible to over fitting than…

Data Analysis, Statistics and Probability · Physics 2016-12-21 A. Bethani , A. J. Bevan , J. Hays , T. J. Stevenson

Neural support vector machines (NSVMs) allow for the incorporation of domain knowledge in the design of the model architecture. In this article we introduce a set of training algorithms for NSVMs that leverage the Pegasos algorithm and…

Machine Learning · Computer Science 2023-08-15 Lars Simon , Manuel Radons

We study non-linear data-dimension reduction. We are motivated by the classical linear framework of Principal Component Analysis. In nonlinear case, we introduce instead a new kernel-Principal Component Analysis, manifold and feature space…

Functional Analysis · Mathematics 2022-09-09 Palle E. T. Jorgensen , Sooran Kang , Myung-Sin Song , Feng Tian

Support vector machines represent a promising development in machine learning research that is not widely used within the remote sensing community. This paper reports the results of Multispectral(Landsat-7 ETM+) and Hyperspectral DAIS)data…

Neural and Evolutionary Computing · Computer Science 2009-11-13 Mahesh Pal , Paul M. Mather

Support vector regression (SVR) is one of the most popular machine learning algorithms aiming to generate the optimal regression curve through maximizing the minimal margin of selected training samples, i.e., support vectors. Recent…

Machine Learning · Computer Science 2019-05-07 Gaoyang Li , Jinyu Yang , Chunguo Wu , Qin Ma

We address the problem of model selection for Support Vector Machine (SVM) classification. For fixed functional form of the kernel, model selection amounts to tuning kernel parameters and the slack penalty coefficient $C$. We begin by…

Disordered Systems and Neural Networks · Physics 2007-05-23 Carl Gold , Peter Sollich

In this paper, we consider the binary classification problem via distributed Support-Vector-Machines (SVM), where the idea is to train a network of agents, with limited share of data, to cooperatively learn the SVM classifier for the global…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Mohammadreza Doostmohammadian , Alireza Aghasi , Themistoklis Charalambous , Usman A. Khan