English
Related papers

Related papers: Train on Validation: Squeezing the Data Lemon

200 papers

As the use of machine learning in high impact domains becomes widespread, the importance of evaluating safety has increased. An important aspect of this is evaluating how robust a model is to changes in setting or population, which…

Machine Learning · Computer Science 2021-03-16 Adarsh Subbaswamy , Roy Adams , Suchi Saria

In health related machine learning applications, the training data often corresponds to a non-representative sample from the target populations where the learners will be deployed. In anticausal prediction tasks, selection biases often make…

Machine Learning · Statistics 2020-11-10 Elias Chaibub Neto , Phil Snyder , Solveig K Sieberts , Larsson Omberg

We present a reformulation of the regression and classification, which aims to validate the result of a machine learning algorithm. Our reformulation simplifies the original problem and validates the result of the machine learning algorithm…

Machine Learning · Computer Science 2021-01-19 Wolfgang Fuhl , Yao Rong , Thomas Motz , Michael Scheidt , Andreas Hartel , Andreas Koch , Enkelejda Kasneci

The performance of a machine learning system is usually evaluated by using i.i.d.\ observations with true labels. However, acquiring ground truth labels is expensive, while obtaining unlabeled samples may be cheaper. Stratified sampling can…

Machine Learning · Computer Science 2019-07-29 Tiancheng Yu , Xiyu Zhai , Suvrit Sra

Building deep reinforcement learning (RL) agents that find a good policy with few samples has proven notoriously challenging. To achieve sample efficiency, recent work has explored updating neural networks with large numbers of gradient…

Machine Learning · Computer Science 2025-04-04 Claas A Voelcker , Marcel Hussing , Eric Eaton , Amir-massoud Farahmand , Igor Gilitschenski

In modern recommendation systems, the standard pipeline involves training machine learning models on historical data to predict user behaviors and improve recommendations continuously. However, these data training loops can introduce…

Methodology · Statistics 2024-04-08 Nian Si

Machine learning models are being used extensively in many important areas, but there is no guarantee a model will always perform well or as its developers intended. Understanding the correctness of a model is crucial to prevent potential…

Machine Learning · Computer Science 2021-04-13 Huong Ha , Sunil Gupta , Santu Rana , Svetha Venkatesh

Highly overparametrized neural networks can display curiously strong generalization performance - a phenomenon that has recently garnered a wealth of theoretical and empirical research in order to better understand it. In contrast to most…

Machine Learning · Computer Science 2020-09-29 Jorg Bornschein , Francesco Visin , Simon Osindero

We show, to our knowledge, the first theoretical treatments of two common questions in cross-validation based hyperparameter selection: (1) After selecting the best hyperparameter using a held-out set, we train the final model using {\em…

Machine Learning · Computer Science 2023-01-13 Parikshit Ram , Alexander G. Gray , Horst C. Samulowitz , Gregory Bramble

Support vector machine (SVM) is a well-known statistical technique for classification problems in machine learning and other fields. An important question for SVM is the selection of covariates (or features) for the model. Many studies have…

Methodology · Statistics 2022-02-22 Jiahui Zou , Chaoxia Yuan , Xinyu Zhang , Guohua Zou , Alan T. K. Wan

With an increasing use of data-driven models to control robotic systems, it has become important to develop a methodology for validating such models before they can be deployed to design a controller for the actual system. Specifically, it…

Systems and Control · Computer Science 2018-03-28 Somil Bansal , Shromona Ghosh , Alberto Sangiovanni-Vincentelli , Sanjit A. Seshia , Claire J. Tomlin

In many machine learning applications, it is important for the model to provide confidence scores that accurately capture its prediction uncertainty. Although modern learning methods have achieved great success in predictive accuracy,…

Machine Learning · Computer Science 2022-07-12 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , James Zou

Data augmentation has become a standard practice in software engineering to address limited or imbalanced data sets, particularly in specialized domains like test classification and bug detection where data can be scarce. Although…

Software Engineering · Computer Science 2025-02-05 Riddhi More , Jeremy S. Bradbury

Multiple intriguing problems are hovering in adversarial training, including robust overfitting, robustness overestimation, and robustness-accuracy trade-off. These problems pose great challenges to both reliable evaluation and practical…

Machine Learning · Computer Science 2021-10-08 Chengyu Dong , Liyuan Liu , Jingbo Shang

Weakly supervised data are widespread and have attracted much attention. However, since label quality is often difficult to guarantee, sometimes the use of weakly supervised data will lead to unsatisfactory performance, i.e., performance…

Machine Learning · Computer Science 2019-04-23 Lan-Zhe Guo , Yu-Feng Li , Ming Li , Jin-Feng Yi , Bo-Wen Zhou , Zhi-Hua Zhou

Numerical simulations are ubiquitous in science and engineering. Machine learning for science investigates how artificial neural architectures can learn from these simulations to speed up scientific discovery and engineering processes. Most…

Artificial Intelligence · Computer Science 2022-12-12 Lucas Meyer , Alejandro Ribés , Bruno Raffin

This paper addresses the challenge of overfitting in the learning of dynamical systems by introducing a novel approach for the generation of synthetic data, aimed at enhancing model generalization and robustness in scenarios characterized…

Machine Learning · Computer Science 2024-03-11 Dario Piga , Matteo Rufolo , Gabriele Maroni , Manas Mejari , Marco Forgione

Selecting techniques is a crucial element of the business analysis approach planning in IT projects. Particular attention is paid to the choice of techniques for requirements elicitation. One of the promising methods for selecting…

Software Engineering · Computer Science 2023-08-22 Denys Gobov , Olga Solovei

Solving image classification tasks given small training datasets remains an open challenge for modern computer vision. Aggressive data augmentation and generative models are among the most straightforward approaches to overcoming the lack…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Lorenzo Brigato , Stavroula Mougiakakou

Recent years have witnessed amazing outcomes from "Big Models" trained by "Big Data". Most popular algorithms for model training are iterative. Due to the surging volumes of data, we can usually afford to process only a fraction of the…

Databases · Computer Science 2015-12-15 Jinyang Gao , H. V. Jagadish , Beng Chin Ooi