English
Related papers

Related papers: Optimization meets Machine Learning: An Exact Algo…

200 papers

We review the concept of Support Vector Machines (SVMs) and discuss examples of their use in a number of scenarios. Several SVM implementations have been used in HEP and we exemplify this algorithm using the Toolkit for Multivariate…

Data Analysis, Statistics and Probability · Physics 2017-12-06 Adrian Bevan , Rodrigo Gamboa Goñi , Jon Hays , Tom Stevenson

In this paper, we introduce a new class of nonsmooth convex functions called SOS-convex semialgebraic functions extending the recently proposed notion of SOS-convex polynomials. This class of nonsmooth convex functions covers many common…

Optimization and Control · Mathematics 2017-02-09 N. H. Chieu , J. W. Feng , W. Gao , G. Li , D. Wu

This paper deals with an extension of the Support Vector Machine (SVM) for classification problems where, in addition to maximize the margin, i.e., the width of strip defined by the two supporting hyperplanes, the minimum of the ordered…

Optimization and Control · Mathematics 2021-07-15 Alfredo Marín , Luisa I. Martínez-Merino , Justo Puerto , Antonio M. Rodríguez-Chía

The support vector machine (SVM) is a powerful and widely used classification algorithm. This paper uses the Karush-Kuhn-Tucker conditions to provide rigorous mathematical proof for new insights into the behavior of SVM. These insights…

Machine Learning · Statistics 2018-10-11 Iain Carmichael , J. S. Marron

The purpose of this report is in examining the generalization performance of Support Vector Machines (SVM) as a tool for pattern recognition and object classification. The work is motivated by the growing popularity of the method that is…

Machine Learning · Computer Science 2014-12-16 Eugene Borovikov

This paper proposes a frequent pattern data mining algorithm based on support vector machine (SVM), aiming to solve the performance bottleneck of traditional frequent pattern mining algorithms in high-dimensional and sparse data…

Machine Learning · Computer Science 2024-12-23 Pochun Li

We introduce an innovative numerical technique based on convex optimization to solve a range of infinite dimensional variational problems arising from the application of the background method to fluid flows. In contrast to most existing…

Fluid Dynamics · Physics 2016-04-13 G. Fantuzzi , A. Wynn

Vector-valued learning, where the output space admits a vector-valued structure, is an important problem that covers a broad family of important domains, e.g. multi-task learning and transfer learning. Using local Rademacher complexity and…

Machine Learning · Computer Science 2023-08-30 Jian Li , Yong Liu , Weiping Wang

Training deep networks for semantic segmentation requires large amounts of labeled training data, which presents a major challenge in practice, as labeling segmentation masks is a highly labor-intensive process. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Lukas Hoyer , Dengxin Dai , Qin Wang , Yuhua Chen , Luc Van Gool

Support Vector Machine (SVM) algorithm requires a high computational cost (both in memory and time) to solve a complex quadratic programming (QP) optimization problem during the training process. Consequently, SVM necessitates high…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-28 Islam Elgarhy

Machine Learning is an important sub-field of the Artificial Intelligence and it has been become a very critical task to train Machine Learning techniques via effective method or techniques. Recently, researchers try to use alternative…

Neural and Evolutionary Computing · Computer Science 2019-02-05 M. Hanefi Calp

We show how, using linear-algebraic tools developed to prove Tverberg's theorem in combinatorial geometry, we can design new models of multi-class support vector machines (SVMs). These supervised learning protocols require fewer conditions…

Machine Learning · Computer Science 2024-04-26 Pablo Soberón

The accuracy and complexity of machine learning algorithms based on kernel optimization are determined by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for…

Machine Learning · Statistics 2024-10-30 Aleksandr Talitckii , Brendon K. Colbert , Matthew M. Peet

One Class Slab Support Vector Machines (OCSSVM) have turned out to be better in terms of accuracy in certain classes of classification problems than the traditional SVMs and One Class SVMs or even other One class classifiers. This paper…

Machine Learning · Computer Science 2024-09-05 Bagesh Kumar , Ayush Sinha , Sourin Chakrabarti , O. P. Vyas

The support vector machine (SVM) and deep learning (e.g., convolutional neural networks (CNNs)) are the two most famous algorithms in small and big data, respectively. Nonetheless, smaller datasets may be very important, costly, and not…

Machine Learning · Computer Science 2020-02-19 Wei-Chang Yeh

Survival analysis is a fundamental tool in medical research to identify predictors of adverse events and develop systems for clinical decision support. In order to leverage large amounts of patient data, efficient optimisation routines are…

Machine Learning · Computer Science 2016-11-23 Sebastian Pölsterl , Nassir Navab , Amin Katouzian

Support vector machines (SVMs) are a standard method in the machine learning toolbox, in particular for tabular data. Non-linear kernel SVMs often deliver highly accurate predictors, however, at the cost of long training times. That problem…

Machine Learning · Computer Science 2022-07-05 Tobias Glasmachers

Background: Most of the existing machine learning models for security tasks, such as spam detection, malware detection, or network intrusion detection, are built on supervised machine learning algorithms. In such a paradigm, models need a…

Cryptography and Security · Computer Science 2022-05-03 Rui Shu , Tianpei Xia , Huy Tu , Laurie Williams , Tim Menzies

The previous support vector machine(SVM) including $0/1$ loss SVM, hinge loss SVM, ramp loss SVM, truncated pinball loss SVM, and others, overlooked the degree of penalty for the correctly classified samples within the margin. This…

Machine Learning · Computer Science 2024-03-26 Yan Li , Liping Zhang

We consider the problem of identifying underlying community-like structures in graphs. Towards this end we study the Stochastic Block Model (SBM) on $k$-clusters: a random model on $n=km$ vertices, partitioned in $k$ equal sized clusters,…

Data Structures and Algorithms · Computer Science 2015-07-10 Naman Agarwal , Afonso S. Bandeira , Konstantinos Koiliaris , Alexandra Kolla