English
Related papers

Related papers: On $\ell_p$-Support Vector Machines and Multidimen…

200 papers

In supervised learning with distributional inputs in the two-stage sampling setup, relevant to applications like learning-based medical screening or causal learning, the inputs (which are probability distributions) are not accessible in the…

Machine Learning · Computer Science 2026-01-22 Christian Fiedler

Machine learning is capable of discriminating phases of matter, and finding associated phase transitions, directly from large data sets of raw state configurations. In the context of condensed matter physics, most progress in the field of…

Statistical Mechanics · Physics 2017-12-06 Pedro Ponte , Roger G. Melko

We propose a unifying setting that combines existing restricted kernel machine methods into a single primal-dual multi-view framework for kernel principal component analysis in both supervised and unsupervised settings. We derive the primal…

Machine Learning · Computer Science 2023-07-07 Sonny Achten , Arun Pandey , Hannes De Meulemeester , Bart De Moor , Johan A. K. Suykens

The paper presents a new framework for complex Support Vector Regression as well as Support Vector Machines for quaternary classification. The method exploits the notion of widely linear estimation to model the input-out relation for…

Machine Learning · Computer Science 2016-11-15 Pantelis Bouboulis , Sergios Theodoridis , Charalampos Mavroforakis , Leoni Dalla

The support vector machines (SVM) is one of the most widely used and practical optimization based classification models in machine learning because of its interpretability and flexibility to produce high quality results. However, the big…

Machine Learning · Computer Science 2020-11-06 Ehsan Sadrfaridpour , Korey Palmer , Ilya Safro

Typically, nonlinear Support Vector Machines (SVMs) produce significantly higher classification quality when compared to linear ones but, at the same time, their computational complexity is prohibitive for large-scale datasets: this…

Machine Learning · Computer Science 2021-11-11 S. Cipolla , J. Gondzio

Subgradient algorithms for training support vector machines have been quite successful for solving large-scale and online learning problems. However, they have been restricted to linear kernels and strongly convex formulations. This paper…

Machine Learning · Computer Science 2011-11-04 Sangkyun Lee , Stephen J. Wright

Support vector machine (SVM) is one of the most studied paradigms in the realm of machine learning for classification and regression problems. It relies on vectorized input data. However, a significant portion of the real-world data exists…

Machine Learning · Computer Science 2023-10-31 Anuradha Kumari , Mushir Akhtar , Rupal Shah , M. Tanveer

Survival analysis is a fundamental tool in medical research to identify predictors of adverse events and develop systems for clinical decision support. In order to leverage large amounts of patient data, efficient optimisation routines are…

Machine Learning · Computer Science 2016-11-23 Sebastian Pölsterl , Nassir Navab , Amin Katouzian

Support vector machines (SVMs) are a well-established classifier effectively deployed in an array of pattern recognition and classification tasks. In this work, we consider extending classic SVMs with quantum kernels and applying them to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Artur Miroszewski , Jakub Mielczarek , Filip Szczepanek , Grzegorz Czelusta , Bartosz Grabowski , Bertrand Le Saux , Jakub Nalepa

In many problems of supervised tensor learning (STL), real world data such as face images or MRI scans are naturally represented as matrices, which are also called as second order tensors. Most existing classifiers based on tensor…

Machine Learning · Statistics 2018-12-20 Yunfei Ye

As one of the most popular classifiers, linear SVMs still have challenges in dealing with very large-scale problems, even though linear or sub-linear algorithms have been developed recently on single machines. Parallel computing methods…

Machine Learning · Computer Science 2015-12-25 Hugh Perkins , Minjie Xu , Jun Zhu , Bo Zhang

This paper studies the addition of linear constraints to the Support Vector Regression (SVR) when the kernel is linear. Adding those constraints into the problem allows to add prior knowledge on the estimator obtained, such as finding…

Optimization and Control · Mathematics 2019-11-07 Quentin Klopfenstein , Samuel Vaiter

We address the problem of model selection for Support Vector Machine (SVM) classification. For fixed functional form of the kernel, model selection amounts to tuning kernel parameters and the slack penalty coefficient $C$. We begin by…

Disordered Systems and Neural Networks · Physics 2007-05-23 Carl Gold , Peter Sollich

Many classification problems focus on maximizing the performance only on the samples with the highest relevance instead of all samples. As an example, we can mention ranking problems, accuracy at the top or search engines where only the top…

Machine Learning · Computer Science 2023-03-29 Václav Mácha , Lukáš Adam , Václav Šmídl

The time complexity of support vector machines (SVMs) prohibits training on huge data sets with millions of data points. Recently, multilevel approaches to train SVMs have been developed to allow for time-efficient training on huge data…

Machine Learning · Computer Science 2020-01-29 Sebastian Schlag , Matthias Schmitt , Christian Schulz

The aim of this paper is to study the convergence of the primal-dual dynamics pertaining to Support Vector Machines (SVM). The optimization routine, used for determining an SVM for classification, is first formulated as a dynamical system.…

Systems and Control · Computer Science 2018-05-03 Krishna Chaitanya Kosaraju , Shravan Mohan , Ramkrishna Pasumarthy

Any applied mathematical model contains parameters. The paper proposes to use kernel learning for the parametric analysis of the model. The approach consists in setting a distribution on the parameter space, obtaining a finite training…

Optimization and Control · Mathematics 2025-01-27 Vladimir Norkin , Alois Pichler

We formulate the Multiple Kernel Learning (abbreviated as MKL) problem for the support vector machine with the infamous $(0,1)$-loss function. Some first-order optimality conditions are given and then exploited to develop a fast ADMM solver…

Machine Learning · Statistics 2023-04-03 Yijie Shi , Bin Zhu

This Note proposes a new methodology for function classification with Support Vector Machine (SVM). Rather than relying on projection on a truncated Hilbert basis as in our previous work, we use an implicit spline interpolation that allows…

Statistics Theory · Mathematics 2007-05-23 Nathalie Villa , Fabrice Rossi