English
Related papers

Related papers: Support vector machine and its bias correction in …

200 papers

Support vector machine (SVM) is a well-known statistical technique for classification problems in machine learning and other fields. An important question for SVM is the selection of covariates (or features) for the model. Many studies have…

Methodology · Statistics 2022-02-22 Jiahui Zou , Chaoxia Yuan , Xinyu Zhang , Guohua Zou , Alan T. K. Wan

A common feature of high-dimensional data is that the data dimension is high, however, the sample size is relatively low. We call such data HDLSS data. In this paper, we study asymptotic properties of the first principal component in the…

Statistics Theory · Mathematics 2015-03-26 Aki Ishii , Kazuyoshi Yata , Makoto Aoshima

This paper aims at developing an automatic algorithm for moth recognition from trap images in real-world conditions. This method uses our previous work for detection [1] and introduces an adapted classification step. More precisely, SVM…

Computer Vision and Pattern Recognition · Computer Science 2018-09-19 Mohamed Chafik Bakkay , Sylvie Chambon , Hatem A. Rashwan , Christian Lubat , Sébastien Barsotti

We consider the problem of best subset selection (BSS) under high-dimensional sparse linear regression model. Recently, Guo et al. (2020) showed that the model selection performance of BSS depends on a certain identifiability margin, a…

Statistics Theory · Mathematics 2025-04-15 Saptarshi Roy , Ambuj Tewari , Ziwei Zhu

A key problem in deep learning and computational neuroscience is relating the geometrical properties of neural representations to task performance. Here, we consider this problem for continuous decoding tasks where neural variability may…

Disordered Systems and Neural Networks · Physics 2025-07-01 Abdulkadir Canatar , SueYeon Chung

In the area of data classification, the different classifiers have been developed by their own strengths and weaknesses. Among these classifiers, we propose a method that is based on the maximum margin between two classes. One of the main…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Hassan Ataeian , Shahriar Esmaeili , Saeideh Roshanfekr , Neda Maleki Khas , Ali Amiri , Hossein Safari

A new procedure for learning cost-sensitive SVM(CS-SVM) classifiers is proposed. The SVM hinge loss is extended to the cost sensitive setting, and the CS-SVM is derived as the minimizer of the associated risk. The extension of the hinge…

Machine Learning · Computer Science 2015-02-17 Hamed Masnadi-Shirazi , Nuno Vasconcelos , Arya Iranmehr

Transductive SVM (TSVM) is a well known semi-supervised large margin learning method for binary text classification. In this paper we extend this method to multi-class and hierarchical classification problems. We point out that the…

Machine Learning · Computer Science 2012-11-02 Sathiya Keerthi Selvaraj , Sundararajan Sellamanickam , Shirish Shevade

It is important to identify the change point of a system's health status, which usually signifies an incipient fault under development. The One-Class Support Vector Machine (OC-SVM) is a popular machine learning model for anomaly detection…

Machine Learning · Computer Science 2019-02-19 Baihong Jin , Yuxin Chen , Dan Li , Kameshwar Poolla , Alberto Sangiovanni-Vincentelli

This paper describes an innovative way to optimize a multivariate classifier, in particular a Support Vector Machine algorithm, on a problem characterized by a biased training sample. This is possible thanks to the feedback of a…

High Energy Physics - Experiment · Physics 2014-07-02 Federico Sforza , Vittorio Lippi

Semi-supervised support vector machines (S3VMs) are a kind of popular approaches which try to improve learning performance by exploiting unlabeled data. Though S3VMs have been found helpful in many situations, they may degenerate…

Machine Learning · Computer Science 2011-05-10 Yu-Feng Li , Zhi-Hua Zhou

We derive improved regression and classification rates for support vector machines using Gaussian kernels under the assumption that the data has some low-dimensional intrinsic structure that is described by the box-counting dimension. Under…

Statistics Theory · Mathematics 2021-04-08 Thomas Hamm , Ingo Steinwart

In many applications, input data are sampled functions taking their values in infinite dimensional spaces rather than standard vectors. This fact has complex consequences on data analysis algorithms that motivate modifications of them. In…

Statistics Theory · Mathematics 2007-05-23 Fabrice Rossi , Nathalie Villa

The capacity of a learning machine is measured by its Vapnik-Chervonenkis dimension, and learning machines with a low VC dimension generalize better. It is well known that the VC dimension of SVMs can be very large or unbounded, even though…

Machine Learning · Computer Science 2017-05-02 Jayadeva , Suresh Chandra , Siddarth Sabharwal , Sanjit S. Batra

We study high-dimensional asymptotic performance limits of binary supervised classification problems where the class conditional densities are Gaussian with unknown means and covariances and the number of signal dimensions scales faster…

Machine Learning · Statistics 2016-11-17 Mohammad Hossein Rohban , Prakash Ishwar , Birant Orten , William C. Karl , Venkatesh Saligrama

Support vector machine (SVM) has achieved many successes in machine learning, especially for a small sample problem. As a famous extension of the traditional SVM, the $\nu$ support vector machine ($\nu$-SVM) has shown outstanding…

Machine Learning · Computer Science 2024-03-05 Zhiji Yang , Wanyi Chen , Huan Zhang , Yitian Xu , Lei Shi , Jianhua Zhao

We propose a novel integrated formulation for multiclass and multilabel support vector machines (SVMs). A number of approaches have been proposed to extend the original binary SVM to an all-in-one multiclass SVM. However, its direct…

Machine Learning · Computer Science 2020-03-26 Hoda Shajari , Anand Rangarajan

Over the past two decades, support vector machine (SVM) has become a popular supervised machine learning model, and plenty of distinct algorithms are designed separately based on different KKT conditions of the SVM model for…

Machine Learning · Computer Science 2022-04-04 Zhou Shuisheng , Zhou Wendi

Recent advance on linear support vector machine with the 0-1 soft margin loss ($L_{0/1}$-SVM) shows that the 0-1 loss problem can be solved directly. However, its theoretical and algorithmic requirements restrict us extending the linear…

Machine Learning · Computer Science 2022-12-02 Ju Liu , Ling-Wei Huang , Yuan-Hai Shao , Wei-Jie Chen , Chun-Na Li

Support vector machines (SVMs) are powerful supervised learning tools developed to solve classification problems. However, SVMs are likely to perform poorly in the classification of imbalanced data. The rough set theory presents a…

Machine Learning · Computer Science 2021-05-25 Maysam Behmanesh , Peyman Adibi , Hossein Karshenas