English
Related papers

Related papers: Coping with Selection Effects: A Primer on Regress…

200 papers

Model selection and assessment with incomplete data pose challenges in addition to the ones encountered with complete data. There are two main reasons for this. First, many models describe characteristics of the complete data, in spite of…

Methodology · Statistics 2008-08-28 Geert Verbeke , Geert Molenberghs , Caroline Beunckens

In several applications, ultimately at the largest data, truncation effects can be observed when analysing tail characteristics of statistical distributions. In some cases truncation effects are forecasted through physical models such as…

Methodology · Statistics 2017-05-17 Jan Beirlant , Isabel Fraga Alves , Tom Reynkens

Statistical models that include random effects are commonly used to analyze longitudinal and correlated data, often with strong and parametric assumptions about the random effects distribution. There is marked disagreement in the literature…

Methodology · Statistics 2012-01-11 Charles E. McCulloch , John M. Neuhaus

We consider statistical inference in high-dimensional regression problems under affine constraints on the parameter space. The theoretical study of this is motivated by the study of genetic determinants of diseases, such as diabetes, using…

We address the important question of the extent to which random variables and vectors with truncated power tails retain the characteristic features of random variables and vectors with power tails. We define two truncation regimes, soft…

Probability · Mathematics 2010-01-20 Arijit Chakrabarty , Gennady Samorodnitsky

In a regression context, when the relevant subset of explanatory variables is uncertain, it is common to use a data-driven model selection procedure. Classical linear model theory, applied naively to the selected sub-model, may not be valid…

Statistics Theory · Mathematics 2017-12-08 Liang Hong , Todd A. Kuffner , Ryan Martin

This paper develops an analytical method of truncating inequality constrained Gaussian distributed variables where the constraints are themselves described by Gaussian distributions. Existing truncation methods either assume hard…

Systems and Control · Computer Science 2016-06-08 Andrew W. Palmer , Andrew J. Hill , Steven J. Scheding

Unobserved confounding arises when an unmeasured feature influences both the treatment and the outcome, leading to biased causal effect estimates. This issue undermines observational studies in fields like economics, medicine, ecology or…

Machine Learning · Computer Science 2025-09-09 Alexander Merkov , David Rohde , Alexandre Gilotte , Benjamin Heymann

We study the basic statistical problem of testing whether normally distributed $n$-dimensional data has been truncated, i.e. altered by only retaining points that lie in some unknown truncation set $S \subseteq \mathbb{R}^n$. As our main…

Data Structures and Algorithms · Computer Science 2024-11-25 Anindya De , Shivam Nadimpalli , Rocco A. Servedio

Clinical machine learning applications are often plagued with confounders that are clinically irrelevant, but can still artificially boost the predictive performance of the algorithms. Confounding is especially problematic in mobile health…

Applications · Statistics 2018-11-29 Elias Chaibub Neto

Missing data is pervasive in econometric applications, and rarely is it plausible that the data are missing (completely) at random. This paper proposes a methodology for studying the robustness of results drawn from incomplete datasets.…

Econometrics · Economics 2025-12-29 Daniel Ober-Reynolds

In medical settings, treatment assignment may be determined by a clinically important covariate that predicts patients' risk of event. There is a class of methods from the social science literature known as regression discontinuity (RD)…

Methodology · Statistics 2019-08-13 Youngjoo Cho , Chen Hu , Debashis Ghosh

When studying the causal effect of $x$ on $y$, researchers may conduct regression and report a confidence interval for the slope coefficient $\beta_{x}$. This common confidence interval provides an assessment of uncertainty from sampling…

Methodology · Statistics 2019-08-26 Brian Knaeble , Braxton Osting , Mark Abramson

Regression plays a key role in many research areas and its variable selection is a classic and major problem. This study emphasizes cost of predictors to be purchased for future use, when we select a subset of them. Its economic aspect is…

Methodology · Statistics 2021-03-19 Steven N. MacEachern , Koji Miyawaki

A persistent challenge in astronomical machine learning is a systematic bias where predictions compress the dynamic range of true values-high values are consistently predicted too low while low values are predicted too high. Understanding…

Instrumentation and Methods for Astrophysics · Physics 2025-07-17 Yuan-Sen Ting

The concept of biased data is well known and its practical applications range from social sciences and biology to economics and quality control. These observations arise when a sampling procedure chooses an observation with probability that…

Statistics Theory · Mathematics 2007-06-13 Sam Efromovich

Large-scale datasets are increasingly being used to inform decision making. While this effort aims to ground policy in real-world evidence, challenges have arisen as selection bias and other forms of distribution shifts often plague…

Methodology · Statistics 2023-11-07 Santiago Cortes-Gomez , Mateo Dulce , Carlos Patino , Bryan Wilder

The method of constrained randomisation is applied to three-dimensional simulated galaxy distributions. With this technique we generate for a given data set surrogate data sets which have the same linear properties as the original data…

Astrophysics · Physics 2009-11-07 C. Raeth , W. Bunk , M. Huber , G. Morfill , J. Retzlaff , P. Schuecker

Sampling is often a necessary evil to reduce the processing and storage costs of distributed tracing. In this work, we describe a scalable and adaptive sampling approach that can preserve events of interest better than the widely used…

Data Structures and Algorithms · Computer Science 2021-07-19 Otmar Ertl

In this paper we consider the statistical inference of the unknown parameter of an exponential distribution based on the time truncated data. The time truncated data occurs quite often in the reliability analysis for type-I or hybrid…

Applications · Statistics 2017-03-06 Arnab Koley , Debasis Kundu