English
Related papers

Related papers: Optimal Learning Rates for Localized SVMs

200 papers

The support vector machine (SVM) and minimum Euclidean norm least squares regression are two fundamentally different approaches to fitting linear models, but they have recently been connected in models for very high-dimensional data through…

Machine Learning · Computer Science 2021-10-28 Navid Ardeshir , Clayton Sanford , Daniel Hsu

In this paper we measured the stability of stochastic gradient method (SGM) for learning an approximated Fourier primal support vector machine. The stability of an algorithm is considered by measuring the generalization error in terms of…

Signal Processing · Electrical Eng. & Systems 2018-04-24 Aven Samareh , Mahshid Salemi Parizi

This paper investigates the asymptotic behavior of the soft-margin and hard-margin support vector machine (SVM) classifiers for simultaneously high-dimensional and numerous data (large $n$ and large $p$ with $n/p\to\delta$) drawn from a…

Information Theory · Computer Science 2020-03-31 Abla Kammoun , Mohamed-Slim Alouini

Support vector machines (SVMs) rely on the inherent geometry of a data set to classify training data. Because of this, we believe SVMs are an excellent candidate to guide the development of an analytic feature selection algorithm, as…

Machine Learning · Computer Science 2013-04-23 Carly Stambaugh , Hui Yang , Felix Breuer

Data mining algorithms are originally designed by assuming the data is available at one centralized site.These algorithms also assume that the whole data is fit into main memory while running the algorithm. But in today's scenario the data…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-03 Aruna Govada , Bhavul Gauri , S. K. Sahay

Quantum computing, with its potential to enhance various machine learning tasks, allows significant advancements in kernel calculation and model precision. Utilizing the one-class Support Vector Machine alongside a quantum kernel, known for…

This paper addresses feature subset selection for Support Vector Machines (SVMs) based on the cross-validation criterion. Unlike statistical criteria such as the Akaike information criterion (AIC) and the Bayesian information criterion…

Optimization and Control · Mathematics 2026-05-11 Masaharu Mori , Shunnosuke Ikeda , Ryuta Tamura , Yuichi Takano , Ryuhei Miyashiro

We develop and analyze a set of new sequential simulation-optimization algorithms for large-scale multi-dimensional discrete optimization via simulation problems with a convexity structure. The "large-scale" notion refers to that the…

Optimization and Control · Mathematics 2022-01-20 Haixiang Zhang , Zeyu Zheng , Javad Lavaei

We apply information-based complexity analysis to support vector machine (SVM) algorithms, with the goal of a comprehensive continuous algorithmic analysis of such algorithms. This involves complexity measures in which some higher order…

Machine Learning · Statistics 2012-12-20 Mark A. Kon

Objective: Classifier transfers usually come with dataset shifts. To overcome them, online strategies have to be applied. For practical applications, limitations in the computational resources for the adaptation of batch learning…

Machine Learning · Computer Science 2022-08-11 Mario Michael Krell , Nils Wilshusen , Anett Seeland , Su Kyoung Kim

Any applied mathematical model contains parameters. The paper proposes to use kernel learning for the parametric analysis of the model. The approach consists in setting a distribution on the parameter space, obtaining a finite training…

Optimization and Control · Mathematics 2025-01-27 Vladimir Norkin , Alois Pichler

Support vector machines (SVMs) are invaluable tools for many practical applications in artificial intelligence, e.g., classification and event recognition. However, popular SVM solvers are not sufficiently efficient for applications with a…

Machine Learning · Computer Science 2011-10-02 Tianyi Zhou , Dacheng Tao , Xindong Wu

We analyze the computational complexity of Quantum Sparse Support Vector Machine, a linear classifier that minimizes the hinge loss and the $L_1$ norm of the feature weights vector and relies on a quantum linear programming solver instead…

Machine Learning · Computer Science 2022-04-26 Seyran Saeedi , Tom Arodz

Conventional SVM-based image coding methods are founded on independently restricting the distortion in every image coefficient at some particular image representation. Geometrically, this implies allowing arbitrary signal distortions in an…

Computer Vision and Pattern Recognition · Computer Science 2013-10-21 Gustavo Camps-Valls , Juan Gutiérrez , Gabriel Gómez-Pérez , Jesús Malo

The Support Vector Machine (SVM) is one of the most widely used classification methods. In this paper, we consider the soft-margin SVM used on data points with independent features, where the sample size $n$ and the feature dimension $p$…

Machine Learning · Statistics 2019-08-02 Haoyang Liu

The support vector machine (SVM) is a well-established classification method whose name refers to the particular training examples, called support vectors, that determine the maximum margin separating hyperplane. The SVM classifier is known…

Statistics Theory · Mathematics 2022-06-15 Daniel Hsu , Vidya Muthukumar , Ji Xu

Support vector machine algorithms are considered essential for the implementation of automation in a radio access network. Specifically, they are critical in the prediction of the quality of user experience for video streaming based on…

Emerging Technologies · Computer Science 2019-09-27 Jiaying Yang , Ahsan Javed Awan , Gemma Vall-Llosera

Variance reduction (VR) methods employ stochastic gradients with decreasing variance, and they have been widely applied to solve large-scale optimization problems in machine learning because of their efficiency. Existing theoretical studies…

Machine Learning · Computer Science 2026-05-28 Yunwen Lei , Zimeng Wang , Xiaoming Yuan

Support Vector Machine (SVM) has been one of the most successful machine learning techniques for binary classification problems. The key idea is to maximize the margin from the data to the hyperplane subject to correct classification on…

Machine Learning · Computer Science 2023-06-27 Rongrong Lin , Yingjia Yao , Yulan Liu

This paper investigates the nonparametric regression problem using SVMs with anisotropic Gaussian RBF kernels. Under the assumption that the target functions are resided in certain anisotropic Besov spaces, we establish the almost optimal…

Machine Learning · Statistics 2018-10-05 Hanyuan Hang , Ingo Steinwart