English
Related papers

Related papers: Overfitting and correlations in model fitting with…

200 papers

Copulas are essential tools in statistics and probability theory, enabling the study of the dependence structure between random variables independently of their marginal distributions. Among the various types of copulas, Ratio-Type Copulas…

Statistics Theory · Mathematics 2025-05-21 Ziad Adwan , Nicola Sottocornola

We consider the problem of predicting several response variables using the same set of explanatory variables. This setting naturally induces a group structure over the coefficient matrix, in which every explanatory variable corresponds to a…

Methodology · Statistics 2019-10-03 Aviv Navon , Saharon Rosset

This study is about inducing classifiers using data that is imbalanced, with a minority class being under-represented in relation to the majority classes. The first section of this research focuses on the main characteristics of data that…

Machine Learning · Computer Science 2022-10-25 Shivaditya Shivganesh , Nitin Narayanan N , Pranav Murali , Ajaykumar M

To what extent can agents with misspecified subjective models predict false correlations? We study an "analyst" who utilizes models that take the form of a recursive system of linear regression equations. The analyst fits each equation to…

Theoretical Economics · Economics 2019-11-05 Kfir Eliaz , Ran Spiegler , Yair Weiss

Indistinguishable quantum emitters confined to length scales smaller than the wavelength of the light become superradiant. Compared to uncorrelated and distinguishable emitters, superradiance results in qualitative modifications of optical…

Data analysis based on information from several sources is common in economic and biomedical studies. This setting is often referred to as the data fusion problem, which differs from traditional missing data problems since no complete data…

Methodology · Statistics 2022-04-07 Wei Li , Shanshan Luo , Wangli Xu

We propose new methods for multivariate linear regression when the regression coefficient matrix is sparse and the error covariance matrix is dense. We assume that the error covariance matrix has equicorrelation across the response…

Methodology · Statistics 2025-08-13 Daeyoung Ham , Bradley S. Price , Adam J. Rothman

High dimensional error covariance matrices and their inverses are used to weight the contribution of observation and background information in data assimilation procedures. As observation error covariance matrices are often obtained by…

Optimization and Control · Mathematics 2019-10-02 Jemima M. Tabeart , Sarah L. Dance , Amos S. Lawless , Nancy K. Nichols , Joanne A. Waller

We introduce the coverage correlation coefficient, a novel nonparametric measure of statistical association designed to quantifies the extent to which two random variables have a joint distribution concentrated on a singular subset with…

Methodology · Statistics 2025-08-18 Xuzhi Yang , Mona Azadkia , Tengyao Wang

Relational models generalize log-linear models to arbitrary discrete sample spaces by specifying effects associated with any subsets of their cells. A relational model may include an overall effect, pertaining to every cell after a…

Methodology · Statistics 2019-05-17 Anna Klimova , Tamás Rudas

Using the LRT statistic, a model R^2 is proposed for the generalized linear mixed model for assessing the association between the correlated outcomes and fixed effects. The R^2 compares the full model to a null model with all fixed effects…

Methodology · Statistics 2010-11-03 Lloyd J. Edwards

Aims. To describe the theory of surface layer independent model fitting by phase matching and to apply this to the stars HD49933 observed by CoRoT, and HD177153 (aka Perky), observed by Kepler Methods. We use theoretical analysis, phase…

Solar and Stellar Astrophysics · Physics 2015-06-22 Ian W. Roxburgh

In matched observational studies with continuous treatments, individuals with different treatment doses but the same or similar covariate values are paired for causal inference. While inexact covariate matching (i.e., covariate imbalance…

Methodology · Statistics 2025-02-13 Anthony Frazier , Siyu Heng , Wen Zhou

The maximal correlation coefficient is a well-established generalization of the Pearson correlation coefficient for measuring non-linear dependence between random variables. It is appealing from a theoretical standpoint, satisfying…

Information Theory · Computer Science 2019-06-04 Elad Domanovitz , Uri Erez

We compute exactly the overlap between the eigenvectors of two large empirical covariance matrices computed over intersecting time intervals, generalizing the results obtained previously for non-intersecting intervals. Our method relies on…

Statistical Mechanics · Physics 2025-09-30 Volodymyr Riabov , Konstantin Tikhonov , Jean-Philippe Bouchaud

We investigate the impact of limited data on training pairwise energy-based models for inverse problems aimed at identifying interaction networks. Utilizing the Gaussian model as testbed, we dissect training trajectories across the…

Machine Learning · Computer Science 2025-06-06 Giovanni Catania , Aurélien Decelle , Cyril Furtlehner , Beatriz Seoane

Missing covariate data commonly occur in epidemiological and clinical research, and are often dealt with using multiple imputation (MI). Imputation of partially observed covariates is complicated if the substantive model is non-linear (e.g.…

Methodology · Statistics 2014-02-17 Jonathan W. Bartlett , Shaun R. Seaman , Ian R. White , James R. Carpenter

Mixtures of Linear Regressions (MLR) is an important mixture model with many applications. In this model, each observation is generated from one of the several unknown linear regression components, where the identity of the generated…

Machine Learning · Computer Science 2020-03-31 Yuanzhi Li , Yingyu Liang

The Cox proportional hazards model is ubiquitous in the analysis of time-to-event data. However, when the data dimension p is comparable to the sample size $N$, maximum likelihood estimates for its regression parameters are known to be…

Methodology · Statistics 2020-01-08 M Sheikh , A. C. C. Coolen

Correlation matrices are widely used to analyze the interdependence of variables in various real-world scenarios. Often, a perturbation in a few variables leads to mild differences in many correlation coefficients associated with these…

Applications · Statistics 2023-03-07 Itamar Faran , Michael Peer , Shahar Arzy , Yuval Benjamini