English
Related papers

Related papers: The Entire Quantile Path of a Risk-Agnostic SVM Cl…

200 papers

The previous support vector machine(SVM) including $0/1$ loss SVM, hinge loss SVM, ramp loss SVM, truncated pinball loss SVM, and others, overlooked the degree of penalty for the correctly classified samples within the margin. This…

Machine Learning · Computer Science 2024-03-26 Yan Li , Liping Zhang

In this paper we present a supervised machine learning quantum classifier. It consists of a quantum data re-uploading classifier with binary trainable parameters, the optimal values of which are found by a quantum search algorithm. We show…

Quantum Physics · Physics 2023-07-10 Wojciech Roga , Baptiste Chevalier , Masahiro Takeoka

Support Vector Machine (SVM) is powerful classification technique based on the idea of structural risk minimization. Use of kernel function enables curse of dimensionality to be addressed. However, proper kernel function for certain problem…

Machine Learning · Computer Science 2014-03-04 Arindam Chaudhuri

Sample complexity bounds are a common performance metric in the Reinforcement Learning literature. In the discounted cost, infinite horizon setting, all of the known bounds have a factor that is a polynomial in $1/(1-\gamma)$, where $\gamma…

Machine Learning · Computer Science 2020-07-09 Adithya M. Devraj , Sean P. Meyn

The support vector machine (SVM) was originally designed for binary classifications. A lot of effort has been put to generalize the binary SVM to multiclass SVM (MSVM) which are more complex problems. Initially, MSVMs were solved by…

Machine Learning · Statistics 2015-12-01 Yangyang Xu , Ioannis Akrotirianakis , Amit Chakraborty

Mainstream approximate action-value iteration reinforcement learning (RL) algorithms suffer from overestimation bias, leading to suboptimal policies in high-variance stochastic environments. Quantile-based action-value iteration methods…

Machine Learning · Computer Science 2025-12-09 Clinton Enwerem , Aniruddh G. Puranic , John S. Baras , Calin Belta

This study investigates the misclassification excess risk bound in the context of 1-bit matrix completion, a significant problem in machine learning involving the recovery of an unknown matrix from a limited subset of its entries. Matrix…

Machine Learning · Computer Science 2024-10-02 The Tien Mai

Cross validation is widely used for selecting tuning parameters in regularization methods, but it is computationally intensive in general. To lessen its computational burden, approximation schemes such as generalized approximate cross…

Methodology · Statistics 2024-12-02 Shanshan Tu , Yunzhang Zhu , Yoonkyung Lee , Qiuyu Gu , Haozhen Yu

We study quantile trend filtering, a recently proposed method for nonparametric quantile regression with the goal of generalizing existing risk bounds known for the usual trend filtering estimators which perform mean regression. We study…

Statistics Theory · Mathematics 2021-08-31 Oscar Hernan Madrid Padilla , Sabyasachi Chatterjee

In this paper, we investigate the problem of classifying feature vectors with mutually independent but non-identically distributed elements. First, we show the importance of this problem. Next, we propose a classifier and derive an…

Machine Learning · Computer Science 2021-09-01 Farzad Shahrivari , Nikola Zlatanov

The parameters of support vector machines (SVMs) such as the penalty parameter and the kernel parameters have a great impact on the classification accuracy and the complexity of the SVM model. Therefore, the model selection in SVM involves…

Machine Learning · Computer Science 2020-07-13 Alaa Tharwat

In this paper, we consider asymptotic properties of the support vector machine (SVM) in high-dimension, low-sample-size (HDLSS) settings. We show that the hard-margin linear SVM holds a consistency property in which misclassification rates…

Machine Learning · Statistics 2017-02-28 Yugo Nakayama , Kazuyoshi Yata , Makoto Aoshima

This paper studies $\ell_1$ regularization with high-dimensional features for support vector machines with a built-in reject option (meaning that the decision of classifying an observation can be withheld at a cost lower than that of…

Statistics Theory · Mathematics 2012-01-06 Marten Wegkamp , Ming Yuan

We address the problem of model selection for Support Vector Machine (SVM) classification. For fixed functional form of the kernel, model selection amounts to tuning kernel parameters and the slack penalty coefficient $C$. We begin by…

Disordered Systems and Neural Networks · Physics 2007-05-23 Carl Gold , Peter Sollich

Unlike its intercept, a linear classifier's weight vector cannot be tuned by a simple grid search. Hence, this paper proposes weight vector tuning of a generic binary linear classifier through the parameterization of a decomposition of the…

Machine Learning · Statistics 2021-10-04 Lama B. Niyazi , Abla Kammoun , Hayssam Dahrouj , Mohamed-Slim Alouini , Tareq Al-Naffouri

We present and compare two methods of generating quantum feature maps for quantum-enhanced support vector machine, a classifier based on kernel method, by which we can access high dimensional Hilbert space efficiently. The first method is a…

Quantum Physics · Physics 2022-09-27 Bang-Shien Chen , Jann-Long Chern

The explosive availability of remote sensing images has challenged supervised classification algorithms such as Support Vector Machines (SVM), as training samples tend to be highly limited due to the expensive and laborious task of ground…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Yiqing Guo , Xiuping Jia , David Paull

Often, when dealing with real-world recognition problems, we do not need, and often cannot have, knowledge of the entire set of possible classes that might appear during operational testing. In such cases, we need to think of robust…

Machine Learning · Computer Science 2022-02-23 Pedro Ribeiro Mendes Júnior , Terrance E. Boult , Jacques Wainer , Anderson Rocha

Multiclass probability estimation is the problem of estimating conditional probabilities of a data point belonging to a class given its covariate information. It has broad applications in statistical analysis and data science. Recently a…

Methodology · Statistics 2022-09-23 Liyun Zeng , Hao Helen Zhang

Quantile regression, based on check loss, is a widely used inferential paradigm in Econometrics and Statistics. The conditional quantiles provide a robust alternative to classical conditional means, and also allow uncertainty quantification…

Machine Learning · Computer Science 2021-02-15 Anuj Tambwekar , Anirudh Maiya , Soma Dhavala , Snehanshu Saha