English
Related papers

Related papers: Feature Selection for Linear SVM with Provable Gua…

200 papers

Using a support vector machine requires to set two types of hyperparameters: the soft margin parameter C and the parameters of the kernel. To perform this model selection task, the method of choice is cross-validation. Its leave-one-out…

Machine Learning · Computer Science 2008-12-18 Emmanuel Monfrini , Yann Guermeur

In structured prediction problems where we have indirect supervision of the output, maximum marginal likelihood faces two computational obstacles: non-convexity of the objective and intractability of even a single gradient computation. In…

Machine Learning · Statistics 2016-08-11 Aditi Raghunathan , Roy Frostig , John Duchi , Percy Liang

We analyze the computational complexity of Quantum Sparse Support Vector Machine, a linear classifier that minimizes the hinge loss and the $L_1$ norm of the feature weights vector and relies on a quantum linear programming solver instead…

Machine Learning · Computer Science 2022-04-26 Seyran Saeedi , Tom Arodz

In this paper, we consider the problem of minimizing a linear functional subject to uncertain linear and bilinear matrix inequalities, which depend in a possibly nonlinear way on a vector of uncertain parameters. Motivated by recent results…

Optimization and Control · Mathematics 2015-05-29 Mohammadreza Chamanbaz , Fabrizio Dabbene , Roberto Tempo , Venkatakrishnan Venkataramanan , Qing-Guo Wang

Much more attention has been paid to unsupervised feature selection nowadays due to the emergence of massive unlabeled data. The distribution of samples and the latent effect of training a learning method using samples in more effective…

Machine Learning · Computer Science 2021-12-15 Weiyi Li , Hongmei Chen , Tianrui Li , Jihong Wan , Binbin Sang

Support vector machine (SVM) is a powerful classification method that has achieved great success in many fields. Since its performance can be seriously impaired by redundant covariates, model selection techniques are widely used for SVM…

Machine Learning · Statistics 2022-07-25 Chaoxia Yuan , Chao Ying , Zhou Yu , Fang Fang

The support vector machine (SVM) is a widely used method for classification. Although many efforts have been devoted to develop efficient solvers, it remains challenging to apply SVM to large-scale problems. A nice property of SVM is that…

Machine Learning · Computer Science 2013-10-29 Jie Wang , Peter Wonka , Jieping Ye

Our contribution in this paper is two folded. We consider first the case of linear programming with real coefficients and give a method which allows the computation of a new upper bound on the distance from the origin to a feasible point.…

Optimization and Control · Mathematics 2020-10-30 Beniamin Costandin , Marius Costandin , Petru Dobra

This paper studies the addition of linear constraints to the Support Vector Regression (SVR) when the kernel is linear. Adding those constraints into the problem allows to add prior knowledge on the estimator obtained, such as finding…

Optimization and Control · Mathematics 2019-11-07 Quentin Klopfenstein , Samuel Vaiter

Motivated by the success of score-based generative models, a number of diffusion-based algorithms have recently been proposed for the problem of sampling from a probability measure whose unnormalized density can be accessed. Among them,…

Machine Learning · Computer Science 2026-04-01 Jakob Kellermann

The massive amount of available data potentially used to discover patters in machine learning is a challenge for kernel based algorithms with respect to runtime and storage capacities. Local approaches might help to relieve these issues.…

Machine Learning · Statistics 2017-03-21 Florian Dumpert

Support vector machines (SVMs) are widely used and constitute one of the best examined and used machine learning models for two-class classification. Classification in SVM is based on a score procedure, yielding a deterministic…

Machine Learning · Statistics 2023-10-11 Sandra Benítez-Peña , Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo

Although support vector machines (SVMs) are theoretically well understood, their underlying optimization problem becomes very expensive, if, for example, hundreds of thousands of samples and a non-linear kernel are considered. Several…

Machine Learning · Statistics 2018-02-09 Philipp Thomann , Ingrid Blaschzyk , Mona Meister , Ingo Steinwart

Support Vector Machine (SVM) is an efficient classification approach, which finds a hyperplane to separate data from different classes. This hyperplane is determined by support vectors. In existing SVM formulations, the objective function…

Machine Learning · Computer Science 2018-04-09 Shuai Zheng , Chris Ding

Support vector machine (SVM) has attracted great attentions for the last two decades due to its extensive applications, and thus numerous optimization models have been proposed. To distinguish all of them, in this paper, we introduce a new…

Optimization and Control · Mathematics 2021-04-06 Huajun Wang , Yuanhai Shao , Shenglong Zhou , Ce Zhang , Naihua Xiu

A mean field variational Bayes approach to support vector machines (SVMs) using the latent variable representation on Polson & Scott (2012) is presented. This representation allows circumvention of many of the shortcomings associated with…

Methodology · Statistics 2013-05-14 Jan Luts , John T. Ormerod

Support vector machine (SVM), is a popular kernel method for data classification that demonstrated its efficiency for a large range of practical applications. The method suffers, however, from some weaknesses including; time processing,…

Machine Learning · Computer Science 2023-08-23 Lakhdar Remaki

Supervised manifold learning methods learn data representations by preserving the geometric structure of data while enhancing the separation between data samples from different classes. In this work, we propose a theoretical study of…

Machine Learning · Computer Science 2018-01-08 Elif Vural , Christine Guillemot

Motion planning is a central challenge in robotics, with learning-based approaches gaining significant attention in recent years. Our work focuses on a specific aspect of these approaches: using machine-learning techniques, particularly…

Robotics · Computer Science 2025-02-07 Sapir Tubul , Aviv Tamar , Kiril Solovey , Oren Salzman

Tackling pattern recognition problems in areas such as computer vision, bioinformatics, speech or text recognition is often done best by taking into account task-specific statistical relations between output variables. In structured…

Machine Learning · Statistics 2016-03-14 Rein Houthooft , Filip De Turck