English
Related papers

Related papers: Testing for Overfitting

200 papers

System modeling is a classical approach to ensure their reliability since it is suitable both for a formal verification and for software testing techniques. In the context of model-based testing an approach combining random testing and…

Software Engineering · Computer Science 2018-06-14 Julien Bernard , Pierre-Cyrille Héam , Olga Kouchnarenko

Recent work has shown that models trained to the same objective, and which achieve similar measures of accuracy on consistent test data, may nonetheless behave very differently on individual predictions. This inconsistency is undesirable in…

Machine Learning · Computer Science 2021-11-17 Emily Black , Klas Leino , Matt Fredrikson

A major problem in machine learning is that of inductive bias: how to choose a learner's hypothesis space so that it is large enough to contain a solution to the problem being learnt, yet small enough to ensure reliable generalization from…

Artificial Intelligence · Computer Science 2011-06-02 J. Baxter

In science and medicine, model interpretations may be reported as discoveries of natural phenomena or used to guide patient treatments. In such high-stakes tasks, false discoveries may lead investigators astray. These applications would…

Machine Learning · Statistics 2020-08-18 Collin Burns , Jesse Thomason , Wesley Tansey

Efficiently harvesting thermodynamic resources requires a precise understanding of their structure. This becomes explicit through the lens of information engines -- thermodynamic engines that use information as fuel. Maximizing the work…

Statistical Mechanics · Physics 2024-02-28 Alexander B. Boyd , James P. Crutchfield , Mile Gu , Felix C. Binder

Quantitative properties of stochastic systems are usually specified in logics that allow one to compare the measure of executions satisfying certain temporal properties with thresholds. The model checking problem for stochastic systems with…

Logic in Computer Science · Computer Science 2010-05-11 Axel Legay , Benoit Delahaye

The goal of machine learning is to develop predictors that generalize well to test data. Ideally, this is achieved by training on an almost infinitely large training data set that captures all variations in the data distribution. In…

Machine Learning · Computer Science 2014-02-28 Laurens van der Maaten , Minmin Chen , Stephen Tyree , Kilian Weinberger

Machine learning systems deployed in the real world must operate under dynamic and often unpredictable distribution shifts. This challenges the validity of statistical safety assurances on the system's risk established beforehand. Common…

Machine Learning · Statistics 2025-06-23 Alexander Timans , Rajeev Verma , Eric Nalisnick , Christian A. Naesseth

The model selection procedure is usually a single-criterion decision making in which we select the model that maximizes a specific metric in a specific set, such as the Validation set performance. We claim this is very naive and can perform…

Machine Learning · Computer Science 2022-07-15 Felipe Costa Farias , Teresa Bernarda Ludermir , Carmelo José Albanez Bastos-Filho

Ensemble models often achieve higher accuracy than single learners, but their ability to maintain small generalization gaps is not always well understood. This study examines how ensembles balance accuracy and overfitting across four…

Machine Learning · Computer Science 2025-12-08 Zubair Ahmed Mohammad

With the advents of deep learning, improved image classification with complex discriminative models has been made possible. However, such deep models with increased complexity require a huge set of labeled samples to generalize the…

Machine Learning · Computer Science 2019-10-08 Walid Abdullah Al , Il Dong Yun

In supervised learning, automatically assessing the quality of the labels before any learning takes place remains an open research question. In certain particular cases, hypothesis testing procedures have been proposed to assess whether a…

Machine Learning · Computer Science 2023-12-19 Weisong Yang , Rafael Poyiadzi , Niall Twomey , Raul Santos Rodriguez

Motivated by a recent literature on the double-descent phenomenon in machine learning, we consider highly over-parameterized models in causal inference, including synthetic control with many control units. In such models, there may be so…

Econometrics · Economics 2023-10-16 Jann Spiess , Guido Imbens , Amar Venugopal

Classification with imbalanced data is a common challenge in data analysis, where certain classes (minority classes) account for a small fraction of the training data compared with other classes (majority classes). Classical statistical…

Statistics Theory · Mathematics 2025-02-18 Jingyang Lyu , Kangjie Zhou , Yiqiao Zhong

Experimental limits on supersymmetry and similar theories are difficult to set because of the enormous available parameter space and difficult to generalize because of the complexity of single points. Therefore, more phenomenological,…

High Energy Physics - Experiment · Physics 2012-02-21 C. Gütschow , Z. Marshall

We propose a hypothesis test that allows for many tested restrictions in a heteroskedastic linear regression model. The test compares the conventional F statistic to a critical value that corrects for many restrictions and conditional…

Econometrics · Economics 2023-01-24 Stanislav Anatolyev , Mikkel Sølvsten

Evaluating the performance of machine learning models on diverse and underrepresented subgroups is essential for ensuring fairness and reliability in real-world applications. However, accurately assessing model performance becomes…

Machine Learning · Computer Science 2023-10-26 Boris van Breugel , Nabeel Seedat , Fergus Imrie , Mihaela van der Schaar

Trust is a crucial factor affecting the adoption of machine learning (ML) models. Qualitative studies have revealed that end-users, particularly in the medical domain, need models that can express their uncertainty in decision-making…

Machine Learning · Computer Science 2023-04-21 Andrew Houston , Georgina Cosma

Recent research suggests that predictions made by machine-learning models can amplify biases present in the training data. When a model amplifies bias, it makes certain predictions at a higher rate for some groups than expected based on…

Machine Learning · Computer Science 2022-10-20 Melissa Hall , Laurens van der Maaten , Laura Gustafson , Maxwell Jones , Aaron Adcock

Overfitting is one of the fundamental challenges when training convolutional neural networks and is usually identified by a diverging training and test loss. The underlying dynamics of how the flow of activations induce overfitting is…

Machine Learning · Computer Science 2021-04-14 Karim Huesmann , Luis Garcia Rodriguez , Lars Linsen , Benjamin Risse