English
Related papers

Related papers: Simple and Efficient Learning using Privileged Inf…

200 papers

Support vector machine (SVM) is a particularly powerful and flexible supervised learning model that analyzes data for both classification and regression, whose usual algorithm complexity scales polynomially with the dimension of data space…

Machine Learning · Computer Science 2023-03-08 Chen Ding , Tian-Yi Bao , He-Liang Huang

The classical hinge-loss support vector machines (SVMs) model is sensitive to outlier observations due to the unboundedness of its loss function. To circumvent this issue, recent studies have focused on non-convex loss functions, such as…

Machine Learning · Computer Science 2022-07-19 Ítalo Santana , Breno Serrano , Maximilian Schiffer , Thibaut Vidal

We consider classification tasks in the regime of scarce labeled training data in high dimensional feature space, where specific expert knowledge is also available. We propose a new hybrid optimization algorithm that solves the elastic-net…

Machine Learning · Statistics 2014-11-18 Zhiwei Qin , Xiaocheng Tang , Ioannis Akrotirianakis , Amit Chakraborty

Support vector machines (SVM) and other kernel techniques represent a family of powerful statistical classification methods with high accuracy and broad applicability. Because they use all or a significant portion of the training data,…

Machine Learning · Statistics 2023-01-31 Peter Mills

We analyze the computational complexity of Quantum Sparse Support Vector Machine, a linear classifier that minimizes the hinge loss and the $L_1$ norm of the feature weights vector and relies on a quantum linear programming solver instead…

Machine Learning · Computer Science 2022-04-26 Seyran Saeedi , Tom Arodz

We present a novel framework to exploit privileged information for recognition which is provided only during the training phase. Here, we focus on recognition task where images are provided as the main view and soft biometric traits…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Seyed Mehdi Iranmanesh , Ali Dabouei , Nasser M. Nasrabadi

We introduce a new Bayesian multi-class support vector machine by formulating a pseudo-likelihood for a multi-class hinge loss in the form of a location-scale mixture of Gaussians. We derive a variational-inference-based training objective…

Machine Learning · Computer Science 2018-06-08 Martin Wistuba , Ambrish Rawat

This paper presents the impact of using quantization on the efficiency of multi-class text classification in the training process of a support vector machine (SVM). This work is focused on comparing the efficiency of SVM model trained using…

Machine Learning · Computer Science 2020-07-20 Dominik Żurek , Marcin Pietroń

In this paper, we propose a novel approach for learning multi-label classifiers with the help of privileged information. Specifically, we use similarity constraints to capture the relationship between available information and privileged…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Shiyu Chen , Shangfei Wang , Tanfang Chen , Xiaoxiao Shi

Although Support Vector Machine (SVM) algorithm has a high generalization property to classify for unseen examples after training phase and it has small loss value, the algorithm is not suitable for real-life classification and regression…

Machine Learning · Computer Science 2013-12-17 Ferhat Özgür Çatak , Mehmet Erdal Balaban

Support vector machines (SVM) can classify data sets along highly non-linear decision boundaries because of the kernel-trick. This expressiveness comes at a price: During test-time, the SVM classifier needs to compute the kernel…

Machine Learning · Computer Science 2015-02-03 Zhixiang Xu , Jacob R. Gardner , Stephen Tyree , Kilian Q. Weinberger

Support vector machine (SVM) is a well-known statistical technique for classification problems in machine learning and other fields. An important question for SVM is the selection of covariates (or features) for the model. Many studies have…

Methodology · Statistics 2022-02-22 Jiahui Zou , Chaoxia Yuan , Xinyu Zhang , Guohua Zou , Alan T. K. Wan

A novel linear classification method that possesses the merits of both the Support Vector Machine (SVM) and the Distance-weighted Discrimination (DWD) is proposed in this article. The proposed Distance-weighted Support Vector Machine method…

Machine Learning · Statistics 2015-10-09 Xingye Qiao , Lingsong Zhang

The support vector machines (SVM) algorithm is a popular classification technique in data mining and machine learning. In this paper, we propose a distributed SVM algorithm and demonstrate its use in a number of applications. The algorithm…

Machine Learning · Computer Science 2019-05-02 Taiping He , Tao Wang , Ralph Abbey , Joshua Griffin

A number of important applied problems in engineering, finance and medicine can be formulated as a problem of anomaly detection. A classical approach to the problem is to describe a normal state using a one-class support vector machine.…

Machine Learning · Statistics 2016-11-22 Evgeny Burnaev , Dmitry Smolyakov

Support vector machine is an important and fundamental technique in machine learning. Soft-margin SVM models have stronger generalization performance compared with the hard-margin SVM. Most existing works use the hinge-loss function which…

Optimization and Control · Mathematics 2021-05-18 Lu Sitong , Li Qinana

In supervised learning with distributional inputs in the two-stage sampling setup, relevant to applications like learning-based medical screening or causal learning, the inputs (which are probability distributions) are not accessible in the…

Machine Learning · Computer Science 2026-01-22 Christian Fiedler

Quantum algorithms can enhance machine learning in different aspects. Here, we study quantum-enhanced least-square support vector machine (LS-SVM). Firstly, a novel quantum algorithm that uses continuous variable to assist matrix inversion…

Quantum Physics · Physics 2020-07-15 Jie Lin , Dan-Bo Zhang , Shuo Zhang , Xiang Wang , Tan Li , Wan-su Bao

The linear Support Vector Machine (SVM) is a classic classification technique in machine learning. Motivated by applications in modern high dimensional statistics, we consider penalized SVM problems involving the minimization of a…

Machine Learning · Statistics 2021-08-31 Antoine Dedieu , Rahul Mazumder , Haoyue Wang

Although support vector machines (SVMs) are theoretically well understood, their underlying optimization problem becomes very expensive, if, for example, hundreds of thousands of samples and a non-linear kernel are considered. Several…

Machine Learning · Statistics 2018-02-09 Philipp Thomann , Ingrid Blaschzyk , Mona Meister , Ingo Steinwart