English
Related papers

Related papers: Sparse SVM for Sufficient Data Reduction

200 papers

The support vector machine (SVM) algorithm is well known to the computer learning community for its very good practical results. The goal of the present paper is to study this algorithm from a statistical perspective, using tools of…

Statistics Theory · Mathematics 2008-12-18 Gilles Blanchard , Olivier Bousquet , Pascal Massart

Stochastic First-Order (SFO) methods have been a cornerstone in addressing a broad spectrum of modern machine learning (ML) challenges. However, their efficacy is increasingly questioned, especially in large-scale applications where…

Machine Learning · Computer Science 2024-08-01 Di Zhang , Suvrajeet Sen

This paper presents a low-overhead optimizer for the ubiquitous sparse matrix-vector multiplication (SpMV) kernel. Architectural diversity among different processors together with structural diversity among different sparse matrices lead to…

Performance · Computer Science 2017-11-16 Athena Elafrou , Georgios Goumas , Nektarios Koziris

This paper proposes a frequent pattern data mining algorithm based on support vector machine (SVM), aiming to solve the performance bottleneck of traditional frequent pattern mining algorithms in high-dimensional and sparse data…

Machine Learning · Computer Science 2024-12-23 Pochun Li

The support vector machines (SVM) is one of the most widely used and practical optimization based classification models in machine learning because of its interpretability and flexibility to produce high quality results. However, the big…

Machine Learning · Computer Science 2020-11-06 Ehsan Sadrfaridpour , Korey Palmer , Ilya Safro

Existing support vector machines(SVM) models are sensitive to noise and lack sparsity, which limits their performance. To address these issues, we combine the elastic net loss with a robust loss framework to construct a sparse…

Machine Learning · Statistics 2026-04-10 Haiyan Du , Hu Yang

Quantum algorithms can enhance machine learning in different aspects. Here, we study quantum-enhanced least-square support vector machine (LS-SVM). Firstly, a novel quantum algorithm that uses continuous variable to assist matrix inversion…

Quantum Physics · Physics 2020-07-15 Jie Lin , Dan-Bo Zhang , Shuo Zhang , Xiang Wang , Tan Li , Wan-su Bao

The computational complexity of solving nonlinear support vector machine (SVM) is prohibitive on large-scale data. In particular, this issue becomes very sensitive when the data represents additional difficulties such as highly imbalanced…

Machine Learning · Computer Science 2019-04-09 E. Sadrfaridpour , T. Razzaghi , I. Safro

This paper studies the addition of linear constraints to the Support Vector Regression (SVR) when the kernel is linear. Adding those constraints into the problem allows to add prior knowledge on the estimator obtained, such as finding…

Optimization and Control · Mathematics 2019-11-07 Quentin Klopfenstein , Samuel Vaiter

The hard margin loss function has been at the core of the support vector machine (SVM) research from the very beginning due to its generalization capability.On the other hand, the cardinality constraint has been widely used for feature…

Optimization and Control · Mathematics 2023-08-01 Penghe Zhang , Naihua Xiu , Hou-Duo Qi

Support vector machines (SVMs) are well-studied supervised learning models for binary classification. In many applications, large amounts of samples can be cheaply and easily obtained. What is often a costly and error-prone process is to…

Optimization and Control · Mathematics 2024-12-20 Veronica Piccialli , Jan Schwiddessen , Antonio M. Sudoso

Training a Support Vector Machine (SVM) requires the solution of a quadratic programming problem (QP) whose computational complexity becomes prohibitively expensive for large scale datasets. Traditional optimization methods cannot be…

Machine Learning · Computer Science 2014-01-29 Emanuele Frandi , Ricardo Nanculef , Maria Grazia Gasparo , Stefano Lodi , Claudio Sartori

Covariance Neural Networks (VNNs) perform graph convolutions on the covariance matrix of input data to leverage correlation information as pairwise connections. They have achieved success in a multitude of applications such as neuroscience,…

Machine Learning · Computer Science 2025-09-30 Andrea Cavallo , Zhan Gao , Elvin Isufi

Sparse classifiers such as the support vector machines (SVM) are efficient in test-phases because the classifier is characterized only by a subset of the samples called support vectors (SVs), and the rest of the samples (non SVs) have no…

Machine Learning · Statistics 2014-01-28 Kohei Ogawa , Yoshiki Suzuki , Shinya Suzumura , Ichiro Takeuchi

Support Vector Machine (SVM) is a robust machine learning algorithm with broad applications in classification, regression, and outlier detection. SVM requires tuning the regularization parameter (RP) which controls the model capacity and…

Machine Learning · Statistics 2023-05-18 Mahdi Shamsi , Soosan Beheshti

Logistic regression, the Support Vector Machine (SVM), and least squares are well-studied methods in the statistical and computer science community, with various practical applications. High-dimensional data arriving on a real-time basis…

Machine Learning · Computer Science 2024-11-07 Debbie Lim , Yixian Qiu , Patrick Rebentrost , Qisheng Wang

Kernel-based machine learning algorithms are based on mapping data from the original input feature space to a kernel feature space of higher dimensionality to solve a linear problem in that space. Over the last decade, kernel based…

Computer Vision and Pattern Recognition · Computer Science 2011-01-18 Mahesh Pal

Several decades ago, Support Vector Machines (SVMs) were introduced for performing binary classification tasks, under a supervised framework. Nowadays, they often outperform other supervised methods and remain one of the most popular…

Kernel methods provide a powerful framework for non parametric learning. They are based on kernel functions and allow learning in a rich functional space while applying linear statistical learning tools, such as Ridge Regression or Support…

Machine Learning · Computer Science 2025-04-03 Sofiane Tanji , Andrea Della Vecchia , François Glineur , Silvia Villa

The Nystr\"om methods have been popular techniques for scalable kernel based learning. They approximate explicit, low-dimensional feature mappings for kernel functions from the pairwise comparisons with the training data. However, Nystr\"om…

Machine Learning · Computer Science 2018-05-21 Mert Al , Thee Chanyaswad , Sun-Yuan Kung