English
Related papers

Related papers: Optimization meets Machine Learning: An Exact Algo…

200 papers

In this paper we promote the use of Support Vector Machines (SVM) as a machine learning tool for searches in high-energy physics. As an example for a new- physics search we discuss the popular case of Supersymmetry at the Large Hadron…

High Energy Physics - Experiment · Physics 2022-11-16 Mehmet Özgür Sahin , Dirk Krücker , Isabell-Alissandra Melzer-Pellmann

Semidefinite programs (SDPs) and their solvers are powerful tools with many applications in machine learning and data science. Designing scalable SDP solvers is challenging because by standard the positive semidefinite decision variable is…

Optimization and Control · Mathematics 2024-08-09 Yufan Huang , David F. Gleich

The support vector machines (SVM) is a powerful classifier used for binary classification to improve the prediction accuracy. However, the non-differentiability of the SVM hinge loss function can lead to computational difficulties in high…

Machine Learning · Statistics 2023-03-17 Rachid Kharoubi , Abdallah Mkhadri , Karim Oualkacha

In this work we study binary classification problems where we assume that our training data is subject to uncertainty, i.e. the precise data points are not known. To tackle this issue in the field of robust machine learning the aim is to…

Machine Learning · Computer Science 2022-03-04 Jannis Kurtz

In this paper, we study the embedded feature selection problem in linear Support Vector Machines (SVMs), in which a cardinality constraint is employed, leading to an interpretable classification model. The problem is NP-hard due to the…

Optimization and Control · Mathematics 2024-12-20 Immanuel Bomze , Federico D'Onofrio , Laura Palagi , Bo Peng

Training a Support Vector Machine (SVM) requires the solution of a quadratic programming problem (QP) whose computational complexity becomes prohibitively expensive for large scale datasets. Traditional optimization methods cannot be…

Machine Learning · Computer Science 2014-01-29 Emanuele Frandi , Ricardo Nanculef , Maria Grazia Gasparo , Stefano Lodi , Claudio Sartori

Kernel-based methods for support vector machines (SVM) have shown highly advantageous performance in various applications. However, they may incur prohibitive computational costs for large-scale sample datasets. Therefore, data reduction…

Optimization and Control · Mathematics 2021-04-27 Shenglong Zhou

An unsolved issue in widely used methods such as Support Vector Data Description (SVDD) and Small Sphere and Large Margin SVM (SSLM) for anomaly detection is their nonconvexity, which hampers the analysis of optimal solutions in a manner…

Machine Learning · Computer Science 2025-10-01 Hongying Liu , Hao Wang , Haoran Chu , Yibo Wu

We introduce a new class of semidefinite programming (SDP) relaxations for sparse box-constrained quadratic programs, obtained by a novel integration of the Reformulation Linearization Technique into standard SDP relaxations while…

Optimization and Control · Mathematics 2026-02-13 Aida Khajavirad

The soft-margin support vector machine (SVM) is a ubiquitous tool for prediction of binary-response data. However, the SVM is characterized entirely via a numerical optimization problem, rather than a probability model, and thus does not…

Methodology · Statistics 2020-07-24 Hien D Nguyen , Daniel V Fryer

Recent advancements in semi-supervised deep learning have introduced effective strategies for leveraging both labeled and unlabeled data to improve classification performance. This work proposes a semi-supervised framework that utilizes a…

Machine Learning · Computer Science 2025-05-21 Aydin Abedinia , Shima Tabakhi , Vahid Seydi

With data sizes constantly expanding, and with classical machine learning algorithms that analyze such data requiring larger and larger amounts of computation time and storage space, the need to distribute computation and memory…

Machine Learning · Computer Science 2015-12-08 Aruna Govada , Shree Ranjani , Aditi Viswanathan , S. K. Sahay

Statistical inference problems arising within signal processing, data mining, and machine learning naturally give rise to hard combinatorial optimization problems. These problems become intractable when the dimensionality of the data is…

Statistical Mechanics · Physics 2017-04-27 Adel Javanmard , Andrea Montanari , Federico Ricci-Tersenghi

Support vector machine (SVM) is a powerful classification method that has achieved great success in many fields. Since its performance can be seriously impaired by redundant covariates, model selection techniques are widely used for SVM…

Machine Learning · Statistics 2022-07-25 Chaoxia Yuan , Chao Ying , Zhou Yu , Fang Fang

The stochastic block model (SBM) is a popular tool for community detection in networks, but fitting it by maximum likelihood (MLE) involves a computationally infeasible optimization problem. We propose a new semidefinite programming (SDP)…

Machine Learning · Computer Science 2016-03-17 Arash A. Amini , Elizaveta Levina

For a variety of regularized optimization problems in machine learning, algorithms computing the entire solution path have been developed recently. Most of these methods are quadratic programs that are parameterized by a single parameter,…

Machine Learning · Computer Science 2012-10-31 Bernd Gärtner , Martin Jaggi , Clément Maria

The kernel support vector machine (SVM) is one of the most widely used classification methods; however, the amount of computation required becomes the bottleneck when facing millions of samples. In this paper, we propose and analyze a novel…

Machine Learning · Computer Science 2013-11-06 Cho-Jui Hsieh , Si Si , Inderjit S. Dhillon

We give sublinear-time approximation algorithms for some optimization problems arising in machine learning, such as training linear classifiers and finding minimum enclosing balls. Our algorithms can be extended to some kernelized versions…

Machine Learning · Computer Science 2010-10-22 Kenneth L. Clarkson , Elad Hazan , David P. Woodruff

Semi supervised learning methods have gained importance in today's world because of large expenses and time involved in labeling the unlabeled data by human experts. The proposed hybrid approach uses SVM and Label Propagation to label the…

Machine Learning · Computer Science 2015-12-08 Aruna Govada , Pravin Joshi , Sahil Mittal , Sanjay K Sahay

We introduce semi-supervised data classification algorithms based on total variation (TV), Reproducing Kernel Hilbert Space (RKHS), support vector machine (SVM), Cheeger cut, labeled and unlabeled data points. We design binary and…

Machine Learning · Computer Science 2012-10-03 Xavier Bresson , Ruiliang Zhang