English
Related papers

Related papers: Randomized Algorithms for Large scale SVMs

200 papers

Support Vector Machines (SVMs) are well-established Machine Learning (ML) algorithms. They rely on the fact that i) linear learning can be formalized as a well-posed optimization problem; ii) non-linear learning can be brought into linear…

Artificial Intelligence · Computer Science 2016-08-16 Christian Gagné , Marc Schoenauer , Michèle Sebag , Marco Tomassini

We shall investigate randomized algorithms for solving large-scale linear inverse problems with general regularizations. We first present some techniques to transform inverse problems of general form into the ones of standard form, then…

Numerical Analysis · Mathematics 2014-12-30 Hua Xiang , Jun Zou

This paper proposes a robust classification model, based on support vector machine (SVM), which simultaneously deals with outliers detection and feature selection. The classifier is built considering the ramp loss margin error and it…

Optimization and Control · Mathematics 2024-03-13 Marta Baldomero-Naranjo , Luisa I. Martínez-Merino , Antonio M. Rodríguez-Chía

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

Data mining algorithms are originally designed by assuming the data is available at one centralized site.These algorithms also assume that the whole data is fit into main memory while running the algorithm. But in today's scenario the data…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-03 Aruna Govada , Bhavul Gauri , S. K. Sahay

This paper analyzes a new regularized learning scheme for high dimensional partially linear support vector machine. The proposed approach consists of an empirical risk and the Lasso-type penalty for linear part, as well as the standard…

Statistics Theory · Mathematics 2020-06-08 Yifan Xia , Yongchao Hou , Shaogao Lv

The support vector machines (SVM) is one of the most widely used and practical optimization based classification models in machine learning because of its interpretability and flexibility to produce high quality results. However, the big…

Machine Learning · Computer Science 2020-11-06 Ehsan Sadrfaridpour , Korey Palmer , Ilya Safro

Machine learning is capable of discriminating phases of matter, and finding associated phase transitions, directly from large data sets of raw state configurations. In the context of condensed matter physics, most progress in the field of…

Statistical Mechanics · Physics 2017-12-06 Pedro Ponte , Roger G. Melko

Support vector machine (SVM) is a popular classifier known for accuracy, flexibility, and robustness. However, its intensive computation has hindered its application to large-scale datasets. In this paper, we propose a new optimal leverage…

Methodology · Statistics 2023-08-25 Yixin Han , Jun Yu , Nan Zhang , Cheng Meng , Ping Ma , Wenxuan Zhong , Changliang Zou

Kernel-based support vector machines (SVMs) are supervised machine learning algorithms for classification and regression problems. We introduce a method to train SVMs on a D-Wave 2000Q quantum annealer and study its performance in…

Machine Learning · Computer Science 2021-01-27 Dennis Willsch , Madita Willsch , Hans De Raedt , Kristel Michielsen

This paper considers convex quadratic programs associated with the training of support vector machines (SVM). Exploiting the special structure of the SVM problem a new type of active set method with long cycles and stable rank-one-updates…

Optimization and Control · Mathematics 2025-04-09 Florian Jarre

In this paper, we consider the binary classification problem via distributed Support-Vector-Machines (SVM), where the idea is to train a network of agents, with limited share of data, to cooperatively learn the SVM classifier for the global…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Mohammadreza Doostmohammadian , Alireza Aghasi , Themistoklis Charalambous , Usman A. Khan

Support vector machines (SVMs) are an important tool in modern data analysis. Traditionally, support vector machines have been fitted via quadratic programming, either using purpose-built or off-the-shelf algorithms. We present an…

Computation · Statistics 2017-05-15 Hien D. Nguyen , Geoffrey J. McLachlan

Learning a dynamical system from input/output data is a fundamental task in the control design pipeline. In the partially observed setting there are two components to identification: parameter estimation to learn the Markov parameters, and…

Optimization and Control · Mathematics 2021-09-08 Han Wang , James Anderson

We introduce a principal support vector machine (PSVM) approach that can be used for both linear and nonlinear sufficient dimension reduction. The basic idea is to divide the response variables into slices and use a modified form of support…

Statistics Theory · Mathematics 2012-03-14 Bing Li , Andreas Artemiou , Lexin Li

This paper addresses the problem of efficiently classifying high-dimensional data over decentralized networks. Penalized support vector machines (SVMs) are widely used for high-dimensional classification tasks. However, the double…

Machine Learning · Statistics 2025-03-11 Canyi Chen , Nan Qiao , Liping Zhu

Support vector machine (SVM) is a powerful machine learning algorithm to handle classification tasks. However, the classical SVM is developed for binary problems with the assumption of balanced datasets. Obviously, the multi-class…

Machine Learning · Computer Science 2025-02-21 Zhong-Liang Zhang , Jie Yang , Jian-Ming Ru , Xiao-Xi Zhao , Xing-Gang Luo

The huge amount of available data nowadays is a challenge for kernel-based machine learning algorithms like SVMs with respect to runtime and storage capacities. Local approaches might help to relieve these issues and to improve statistical…

Machine Learning · Statistics 2019-03-05 Florian Dumpert

Support vector machines (SVM) and other kernel techniques represent a family of powerful statistical classification methods with high accuracy and broad applicability. Because they use all or a significant portion of the training data,…

Machine Learning · Statistics 2023-01-31 Peter Mills

Support Vector Machines (SVMs) are powerful learners that have led to state-of-the-art results in various computer vision problems. SVMs suffer from various drawbacks in terms of selecting the right kernel, which depends on the image…

Computer Vision and Pattern Recognition · Computer Science 2014-03-31 Gemma Roig , Xavier Boix , Luc Van Gool