English
Related papers

Related papers: Improving Efficiency of SVM k-fold Cross-validatio…

200 papers

In machine learning one often assumes the data are independent when evaluating model performance. However, this rarely holds in practise. Geographic information data sets are an example where the data points have stronger dependencies among…

Applications · Statistics 2020-06-01 Jonne Pohjankukka , Tapio Pahikkala , Paavo Nevalainen , Jukka Heikkonen

We review the concept of Support Vector Machines (SVMs) and discuss examples of their use in a number of scenarios. Several SVM implementations have been used in HEP and we exemplify this algorithm using the Toolkit for Multivariate…

Data Analysis, Statistics and Probability · Physics 2017-12-06 Adrian Bevan , Rodrigo Gamboa Goñi , Jon Hays , Tom Stevenson

Selecting learning machines such as classifiers is an important task when using AI in the clinic. K-fold crossvalidation is a practical technique that allows simple inference of such machines. However, the recipe generates many models and…

Signal Processing · Electrical Eng. & Systems 2023-01-02 Muhammad Haziq Bin Kamarul Azman , Olivier Meste , Kushsairy Kadir

Support Vector Machines (SVM), a popular machine learning technique, has been applied to a wide range of domains such as science, finance, and social networks for supervised learning. Whether it is identifying high-risk patients by…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-06-20 Jeyanthi Narasimhan , Abhinav Vishnu , Lawrence Holder , Adolfy Hoisie

We review the concept of support vector machines (SVMs) and discuss examples of their use. One of the benefits of SVM algorithms, compared with neural networks and decision trees is that they can be less susceptible to over fitting than…

Data Analysis, Statistics and Probability · Physics 2016-12-21 A. Bethani , A. J. Bevan , J. Hays , T. J. Stevenson

We introduce an advanced, swift pattern recognition strategy for various multiple robotics during curve negotiation. This method, leveraging a sophisticated k-means clustering-enhanced Support Vector Machine algorithm, distinctly…

Robotics · Computer Science 2024-05-07 Rui Liu , Xuanzhen Xu , Yuwei Shen , Armando Zhu , Chang Yu , Tianjian Chen , Ye Zhang

We study the mean-squared error of $k$-fold cross-validation as a risk estimator, with particular emphasis on how its accuracy depends on the number of folds $k$. Despite the widespread use of cross-validation, principled guidance for…

Statistics Theory · Mathematics 2026-05-26 Ido Nachum , Rüdiger Urbanke , Thomas Weinberger

The Support Vector Machine using Privileged Information (SVM+) has been proposed to train a classifier to utilize the additional privileged information that is only available in the training phase but not available in the test phase. In…

Machine Learning · Computer Science 2016-04-07 Xinxing Xu , Joey Tianyi Zhou , IvorW. Tsang , Zheng Qin , Rick Siow Mong Goh , Yong Liu

It is crucial to assess the predictive performance of a model to establish its practicality and relevance in real-world scenarios, particularly for high-dimensional data analysis. Among data splitting or resampling methods, cross-validation…

Methodology · Statistics 2025-11-26 Iris Ivy Gauran , Hernando Ombao , Zhaoxia Yu

The time complexity of support vector machines (SVMs) prohibits training on huge data sets with millions of data points. Recently, multilevel approaches to train SVMs have been developed to allow for time-efficient training on huge data…

Machine Learning · Computer Science 2020-01-29 Sebastian Schlag , Matthias Schmitt , Christian Schulz

Cross-validation is the workhorse of modern applied statistics and machine learning, as it provides a principled framework for selecting the model that maximizes generalization performance. In this paper, we show that the cross-validation…

Machine Learning · Statistics 2018-05-21 Shane Barratt , Rishi Sharma

Training a Support Vector Machine (SVM) requires the solution of a quadratic programming problem (QP) whose computational complexity becomes prohibitively expensive for large scale datasets. Traditional optimization methods cannot be…

Machine Learning · Computer Science 2014-01-29 Emanuele Frandi , Ricardo Nanculef , Maria Grazia Gasparo , Stefano Lodi , Claudio Sartori

Least-squares models such as linear regression and Linear Discriminant Analysis (LDA) are amongst the most popular statistical learning techniques. However, since their computation time increases cubically with the number of features, they…

Machine Learning · Computer Science 2018-03-28 Matthias S. Treder

We consider classification tasks in the regime of scarce labeled training data in high dimensional feature space, where specific expert knowledge is also available. We propose a new hybrid optimization algorithm that solves the elastic-net…

Machine Learning · Statistics 2014-11-18 Zhiwei Qin , Xiaocheng Tang , Ioannis Akrotirianakis , Amit Chakraborty

The support vector machines (SVM) algorithm is a popular classification technique in data mining and machine learning. In this paper, we propose a distributed SVM algorithm and demonstrate its use in a number of applications. The algorithm…

Machine Learning · Computer Science 2019-05-02 Taiping He , Tao Wang , Ralph Abbey , Joshua Griffin

Effective data partitioning is known to be crucial in machine learning. Traditional cross-validation methods like K-Fold Cross-Validation (KFCV) enhance model robustness but often compromise generalisation assessment due to high…

Machine Learning · Computer Science 2025-08-05 Christopher Godwin Udomboso , Caston Sigauke , Ini Adinya

Cross-validation (CV) is a common method to tune machine learning methods and can be used for model selection in regression as well. Because of the structured nature of small, traditional experimental designs, the literature has warned…

Applications · Statistics 2025-06-18 Maria L. Weese , Byran J. Smucker , David J. Edwards

The support vector machine (SVM) is a powerful and widely used classification algorithm. This paper uses the Karush-Kuhn-Tucker conditions to provide rigorous mathematical proof for new insights into the behavior of SVM. These insights…

Machine Learning · Statistics 2018-10-11 Iain Carmichael , J. S. Marron

Deep learning methods are useful for high-dimensional data and are becoming widely used in many areas of software engineering. Deep learners utilizes extensive computational power and can take a long time to train-- making it difficult to…

Software Engineering · Computer Science 2024-02-19 Suvodeep Majumder , Nikhila Balaji , Katie Brey , Wei Fu , Tim Menzies

Safety validation is important during the development of safety-critical autonomous systems but can require significant computational effort. Existing algorithms often start from scratch each time the system under test changes. We apply…

Machine Learning · Computer Science 2020-12-11 Anthony Corso , Mykel J. Kochenderfer