English
Related papers

Related papers: A Nonconformity Approach to Model Selection for SV…

200 papers

In this work we study binary classification problems where we assume that our training data is subject to uncertainty, i.e. the precise data points are not known. To tackle this issue in the field of robust machine learning the aim is to…

Machine Learning · Computer Science 2022-03-04 Jannis Kurtz

Sparse support vector machine (SVM) is a popular classification technique that can simultaneously learn a small set of the most interpretable features and identify the support vectors. It has achieved great successes in many real-world…

Machine Learning · Statistics 2019-07-19 Weizhong Zhang , Bin Hong , Wei Liu , Jieping Ye , Deng Cai , Xiaofei He , Jie Wang

Using methods of Statistical Physics, we investigate the generalization performance of support vector machines (SVMs), which have been recently introduced as a general alternative to neural networks. For nonlinear classification rules, the…

Disordered Systems and Neural Networks · Physics 2009-10-31 Rainer Dietrich , Manfred Opper , Haim Sompolinsky

This paper presents a review on methods for class-imbalanced learning with the Support Vector Machine (SVM) and its variants. We first explain the structure of SVM and its variants and discuss their inefficiency in learning with…

Machine Learning · Computer Science 2024-07-23 Salim Rezvani , Farhad Pourpanah , Chee Peng Lim , Q. M. Jonathan Wu

Objective: Classifier transfers usually come with dataset shifts. To overcome them, online strategies have to be applied. For practical applications, limitations in the computational resources for the adaptation of batch learning…

Machine Learning · Computer Science 2022-08-11 Mario Michael Krell , Nils Wilshusen , Anett Seeland , Su Kyoung Kim

Fitting models to data is an important part of the practice of science. Advances in machine learning have made it possible to fit more -- and more complex -- models, but have also exacerbated a problem: when multiple models fit the data…

Methodology · Statistics 2025-10-27 Alexandre René , André Longtin

It is important to identify the change point of a system's health status, which usually signifies an incipient fault under development. The One-Class Support Vector Machine (OC-SVM) is a popular machine learning model for anomaly detection…

Machine Learning · Computer Science 2019-02-19 Baihong Jin , Yuxin Chen , Dan Li , Kameshwar Poolla , Alberto Sangiovanni-Vincentelli

An unsolved issue in widely used methods such as Support Vector Data Description (SVDD) and Small Sphere and Large Margin SVM (SSLM) for anomaly detection is their nonconvexity, which hampers the analysis of optimal solutions in a manner…

Machine Learning · Computer Science 2025-10-01 Hongying Liu , Hao Wang , Haoran Chu , Yibo Wu

We propose a batchwise monotone algorithm for dictionary learning. Unlike the state-of-the-art dictionary learning algorithms which impose sparsity constraints on a sample-by-sample basis, we instead treat the samples as a batch, and impose…

Machine Learning · Computer Science 2015-02-03 Huan Wang , John Wright , Daniel Spielman

We study the understanding of deep neural networks from the scope in which they are trained on. While the accuracy of these models is usually impressive on the aggregate level, they still make mistakes, sometimes on cases that appear to be…

Machine Learning · Computer Science 2023-12-12 Roozbeh Yousefzadeh

The support vector machine (SVM) is a well-established classification method whose name refers to the particular training examples, called support vectors, that determine the maximum margin separating hyperplane. The SVM classifier is known…

Statistics Theory · Mathematics 2022-06-15 Daniel Hsu , Vidya Muthukumar , Ji Xu

Recent stochastic gradient methods that have appeared in the literature base their efficiency and global convergence properties on a suitable control of the variance of the gradient batch estimate. This control is typically achieved by…

Optimization and Control · Mathematics 2025-06-11 Marco Boresta , Alberto De Santis , Stefano Lucidi

The support vector machines (SVM) is one of the most widely used and practical optimization based classification models in machine learning because of its interpretability and flexibility to produce high quality results. However, the big…

Machine Learning · Computer Science 2020-11-06 Ehsan Sadrfaridpour , Korey Palmer , Ilya Safro

Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial…

Machine Learning · Computer Science 2024-03-25 André Bertolace , Konstatinos Gatsis , Kostas Margellos

Support vector machine (SVM), is a popular kernel method for data classification that demonstrated its efficiency for a large range of practical applications. The method suffers, however, from some weaknesses including; time processing,…

Machine Learning · Computer Science 2023-08-23 Lakhdar Remaki

Testing of deep learning models is challenging due to the excessive number and complexity of computations involved. As a result, test data selection is performed manually and in an ad hoc way. This raises the question of how we can…

Machine Learning · Computer Science 2019-05-01 Wei Ma , Mike Papadakis , Anestis Tsakmalis , Maxime Cordy , Yves Le Traon

A general approach for anomaly detection or novelty detection consists in estimating high density regions or Minimum Volume (MV) sets. The One-Class Support Vector Machine (OCSVM) is a state-of-the-art algorithm for estimating such regions…

Machine Learning · Statistics 2015-09-01 Albert Thomas , Vincent Feuillard , Alexandre Gramfort

Neural networks have become ubiquitous tools for solving signal and image processing problems, and they often outperform standard approaches. Nevertheless, training neural networks is a challenging task in many applications. The prevalent…

Optimization and Control · Mathematics 2022-10-28 Patrick L. Combettes , Jean-Christophe Pesquet , Audrey Repetti

Support Vector Machine (SVM) stands out as a prominent machine learning technique widely applied in practical pattern recognition tasks. It achieves binary classification by maximizing the "margin", which represents the minimum distance…

Machine Learning · Computer Science 2026-01-21 Zhezheng Hao , Feiping Nie , Rong Wang

The problem of model selection is inevitable in an increasingly large number of applications involving partial theoretical knowledge and vast amounts of information, like in medicine, biology or economics. The associated techniques are…

Methodology · Statistics 2015-11-17 Stephane Guerrier , Maria-Pia Victoria-Feser