English
Related papers

Related papers: Overfitting and correlations in model fitting with…

200 papers

Results in epidemiology and social science often require the removal of confounding effects from measurements of the pairwise correlation of variables in survey data. This is typically accomplished by some variant of linear regression…

Methodology · Statistics 2025-12-02 William H. Press

Context: There is considerable diversity in the range and design of computational experiments to assess classifiers for software defect prediction. This is particularly so, regarding the choice of classifier performance metrics.…

Software Engineering · Computer Science 2020-03-04 Jingxiu Yao , Martin Shepperd

In this paper, I will introduce a new form of regression, that can adjust overfitting and underfitting through, "distance-based regression." Overfitting often results in finding false patterns causing inaccurate results, so by having a new…

Machine Learning · Computer Science 2024-10-25 Dylan Wilson

In software engineering, deep learning models are increasingly deployed for critical tasks such as bug detection and code review. However, overfitting remains a challenge that affects the quality, reliability, and trustworthiness of…

Software Engineering · Computer Science 2024-05-21 Hao Li , Gopi Krishnan Rajbahadur , Dayi Lin , Cor-Paul Bezemer , Zhen Ming , Jiang

In a regression context, when the relevant subset of explanatory variables is uncertain, it is common to use a data-driven model selection procedure. Classical linear model theory, applied naively to the selected sub-model, may not be valid…

Statistics Theory · Mathematics 2017-12-08 Liang Hong , Todd A. Kuffner , Ryan Martin

The properties of the normal distribution under linear transformation, as well the easy way to compute the covariance matrix of marginals and conditionals, offer a unique opportunity to get an insight about several aspects of uncertainties…

Data Analysis, Statistics and Probability · Physics 2018-02-12 Giulio D'Agostini

We present an updated fit of supersymmetric SO(10) models to quark and lepton masses and mixing parameters. Including latest results from lattice QCD determinations of quark masses and neutrino oscillation data, we show that fits neglecting…

High Energy Physics - Phenomenology · Physics 2019-01-08 Thomas Deppisch , Stefan Schacht , Martin Spinrath

The Seemingly Unrelated Regressions (SUR) model is a wide used estimation procedure in econometrics, insurance and finance, where very often, the regression model contains more than one equation. Unknown parameters, regression coefficients…

Methodology · Statistics 2021-07-05 Giovanni Saraceno , Fatemah Alqallaf , Claudio Agostinelli

Consecutive points in rotation curve measurements are correlated with each other, but this is usually ignored when constructing galaxy mass models. We apply a recently proposed data-driven approach to include the characteristic amplitude…

Astrophysics of Galaxies · Physics 2026-05-25 Helena Chase , Diego Dado , Katherine E. Harborne , Kyle A. Oman

The ratios $r_{01}$ and $r_{10}$ of small to large separations of KIC 2837475 primarily exhibit an increase behavior in the observed frequency range. The calculations indicate that only the models with overshooting parameter $\delta_{\rm…

Solar and Stellar Astrophysics · Physics 2015-08-19 Wuming Yang , Zhijia Tian , Shaolan Bi , Zhishuai Ge , Yaqian Wu , Jinghua Zhang

The analysis of experimental data with mixed-effects models requires decisions about the specification of the appropriate random-effects structure. Recently, Barr, Levy, Scheepers, and Tily, 2013 recommended fitting `maximal' models with…

Methodology · Statistics 2018-05-29 Douglas Bates , Reinhold Kliegl , Shravan Vasishth , Harald Baayen

A separable covariance model for a random matrix provides a parsimonious description of the covariances among the rows and among the columns of the matrix, and permits likelihood-based inference with a very small sample size. However, in…

Methodology · Statistics 2022-07-27 Peter Hoff , Andrew McCormack , Anru R. Zhang

On the universal seesaw mass matrix model, which is a promising model of the unified description of the quark and lepton mass matrices, the behaviors of the gauge coupling constants and intermediate energy scales in the SO(10)_L\times…

High Energy Physics - Phenomenology · Physics 2011-09-13 Yoshio Koide

This paper investigates a statistical procedure for testing the equality of two independently estimated covariance matrices when the number of potentially dependent data vectors is large and proportional to the size of the vectors, that is,…

Methodology · Statistics 2020-07-13 Rémy Mariétan , Stephan Morgenthaler

This paper investigates a statistical procedure for testing the equality of two independent estimated covariance matrices when the number of potentially dependent data vectors is large and proportional to the size of the vectors, that is,…

Statistics Theory · Mathematics 2020-03-09 Rémy Mariétan , Stephan Morgenthaler

Superradiance is a quantum phenomenon in which coherence between emitters results in enhanced and directional radiative emission. Many quantum optical phenomena can be characterized by the two-time quantum correlation function…

Quantum Physics · Physics 2026-01-30 Daniel Eyles , Emmanuel Lassalle , Adam Stokes , Ramón Paniagua-Domínguez , Ahsan Nazir

The one-epoch overfitting problem has drawn widespread attention, especially in CTR and CVR estimation models in search, advertising, and recommendation domains. These models which rely heavily on large-scale sparse categorical features,…

Machine Learning · Computer Science 2026-01-28 Mang Li , Wei Lyu

The repeated community-wide reuse of test sets in popular benchmark problems raises doubts about the credibility of reported test-error rates. Verifying whether a learned model is overfitted to a test set is challenging as independent test…

Machine Learning · Computer Science 2019-11-15 Roman Werpachowski , András György , Csaba Szepesvári

This paper discusses linear regression of strongly correlated data that arises, for example, in magnetohydrodynamic equilibrium reconstructions. We have proved that, generically, the covariance matrix of the estimated regression parameters…

Statistics Theory · Mathematics 2007-06-13 C. S. Jones , J. M. Finn , N. Hengartner

The prevailing IR-threshold paradigm posits a positive correlation between imbalance ratio (IR) and oversampling effectiveness, yet this assumption remains empirically unsubstantiated through controlled experimentation. We conducted 12…

Machine Learning · Computer Science 2026-04-07 Yuwen Jiang , Songyun Ye