English
Related papers

Related papers: Optimal $\gamma$ and $C$ for $\epsilon$-Support Ve…

200 papers

Support Vector Regression (SVR) and its variants are widely used to handle regression tasks, however, since their solution involves solving an expensive quadratic programming problem, it limits its application, especially when dealing with…

Machine Learning · Computer Science 2025-03-14 Reshma Rastogi , Ankush Bisht , Sanjay Kumar , Suresh Chandra

This paper aims at refined error analysis for binary classification using support vector machine (SVM) with Gaussian kernel and convex loss. Our first result shows that for some loss functions such as the truncated quadratic loss and…

Machine Learning · Computer Science 2017-10-06 Shao-Bo Lin , Jinshan Zeng , Xiangyu Chang

Kernel-based modal statistical methods include mode estimation, regression, and clustering. Estimation accuracy of these methods depends on the kernel used as well as the bandwidth. We study effect of the selection of the kernel function to…

Machine Learning · Statistics 2023-04-21 Ryoya Yamasaki , Toshiyuki Tanaka

It is well known that our motion with respect to the cosmic microwave background (CMB) rest frame introduces a large dipolar CMB anisotropy, with an amplitude ~beta=v/c~10^{-3}. In addition it should lead to a small breaking of statistical…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-27 J. Chluba

This paper investigates the nonparametric regression problem using SVMs with anisotropic Gaussian RBF kernels. Under the assumption that the target functions are resided in certain anisotropic Besov spaces, we establish the almost optimal…

Machine Learning · Statistics 2018-10-05 Hanyuan Hang , Ingo Steinwart

The support vector machine (SVM) is a popular machine learning classification method which produces a nonlinear decision boundary in a feature space by constructing linear boundaries in a transformed Hilbert space. It is well known that…

Quantum Physics · Physics 2017-10-31 Rupak Chatterjee , Ting Yu

The paper presents a new framework for complex Support Vector Regression as well as Support Vector Machines for quaternary classification. The method exploits the notion of widely linear estimation to model the input-out relation for…

Machine Learning · Computer Science 2016-11-15 Pantelis Bouboulis , Sergios Theodoridis , Charalampos Mavroforakis , Leoni Dalla

We present a new approach, kernel regression, to determine photometric redshifts for 399,929 galaxies in the Fifth Data Release of the Sloan Digital Sky Survey (SDSS). In our case, kernel regression is a weighted average of spectral…

Astrophysics · Physics 2009-11-13 D. Wang , Y. X. Zhang , C. Liu , Y. H. Zhao

Robust Support Vector Machines (R-SVMs) address feature noise by adopting a worst-case robust formulation that explicitly incorporates uncertainty sets into training. While this robustness improves reliability, it also leads to increased…

Machine Learning · Computer Science 2026-03-27 Tan-Hau Nguyen , Thu-Le Tran , Kien Trung Nguyen

Approximate Bayesian computation (ABC) is a likelihood-free inference method that has been employed in various applications. However, ABC can be sensitive to outliers if a data discrepancy measure is chosen inappropriately. In this paper,…

Machine Learning · Statistics 2021-03-08 Masahiro Fujisawa , Takeshi Teshima , Issei Sato , Masashi Sugiyama

Random Fourier Features (RFF) demonstrate wellappreciated performance in kernel approximation for largescale situations but restrict kernels to be stationary and positive definite. And for non-stationary kernels, the corresponding RFF could…

Machine Learning · Statistics 2021-04-15 Qin Luo , Kun Fang , Jie Yang , Xiaolin Huang

The selection of Gaussian kernel parameters plays an important role in the applications of support vector classification (SVC). A commonly used method is the k-fold cross validation with grid search (CV), which is extremely time-consuming…

Machine Learning · Computer Science 2025-01-22 Linkai Luo , Qiaoling Yang , Hong Peng , Yiding Wang , Ziyang Chen

Support vector machines (SVM) is one of the well known supervised classes of learning algorithms. Furthermore, the conic-segmentation SVM (CS-SVM) is a natural multiclass analogue of the standard binary SVM, as CS-SVM models are dealing…

Machine Learning · Computer Science 2022-09-23 Shen Peng , Gianpiero Canessa , Zhihua Allen-Zhao

The purpose of this report is in examining the generalization performance of Support Vector Machines (SVM) as a tool for pattern recognition and object classification. The work is motivated by the growing popularity of the method that is…

Machine Learning · Computer Science 2014-12-16 Eugene Borovikov

Robust estimators for linear regression require non-convex objective functions to shield against adverse affects of outliers. This non-convexity brings challenges, particularly when combined with penalization in high-dimensional settings.…

Computation · Statistics 2025-08-08 David Kepplinger , Siqi Wei

In the regression model $Y = b(X) +\sigma(X)\varepsilon$, where $X$ has a density $f$, this paper deals with an oracle inequality for an estimator of $bf$, involving a kernel in the sense of Lerasle et al. (2016), selected via the PCO…

Statistics Theory · Mathematics 2021-06-07 Hélène Halconruy , Nicolas Marie

The massive amount of available data potentially used to discover patters in machine learning is a challenge for kernel based algorithms with respect to runtime and storage capacities. Local approaches might help to relieve these issues.…

Machine Learning · Statistics 2017-03-21 Florian Dumpert

Kernel-based methods for support vector machines (SVM) have shown highly advantageous performance in various applications. However, they may incur prohibitive computational costs for large-scale sample datasets. Therefore, data reduction…

Optimization and Control · Mathematics 2021-04-27 Shenglong Zhou

Accurate and efficient environment representation is crucial for robotic applications such as motion planning, manipulation, and navigation. Signed distance functions (SDFs) have emerged as a powerful representation for encoding distance to…

Robotics · Computer Science 2026-04-01 Zhirui Dai , Tianxing Fan , Mani Amani , Jaemin Seo , Ki Myung Brian Lee , Hyondong Oh , Nikolay Atanasov

This lecture will introduce the Support Vector algorithms for classification and regression. They are an application of the so called kernel trick, which allows the extension of a certain class of linear algorithms to the non linear case.…

Data Analysis, Statistics and Probability · Physics 2008-03-18 Anselm Vossen