English
Related papers

Related papers: Coping with Selection Effects: A Primer on Regress…

200 papers

In certain situations that shall be undoubtedly more and more common in the Big Data era, the datasets available are so massive that computing statistics over the full sample is hardly feasible, if not unfeasible. A natural approach in this…

Machine Learning · Statistics 2015-01-12 Stéphan Clémençon , Patrice Bertail , Emilie Chautru , Guillaume Papa

This paper considers the problem of kernel regression and classification with possibly unobservable response variables in the data, where the mechanism that causes the absence of information is unknown and can depend on both predictors and…

Statistics Theory · Mathematics 2022-12-07 Majid Mojirsheibani , William Pouliot , Andre Shakhbandaryan

The problem of searching for a model-based scene interpretation is analyzed within a probabilistic framework. Object models are formulated as generative models for range data of the scene. A new statistical criterion, the truncated object…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Ulrich Hillenbrand , Gerd Hirzinger

In natural phenomena, data distributions often deviate from normality. One can think of cataclysms as a self-explanatory example: events that occur almost never, and at the same time are many standard deviations away from the common…

Machine Learning · Computer Science 2022-12-16 Nuno Costa , Nuno Moniz

Randomized controlled trials generate experimental variation that can credibly identify causal effects, but often suffer from limited scale, while observational datasets are large, but often violate desired identification assumptions. To…

Econometrics · Economics 2023-12-27 George Z. Gui

The issue of spatial confounding between the spatial random effect and the fixed effects in regression analyses has been identified as a concern in the statistical literature. Multiple authors have offered perspectives and potential…

Methodology · Statistics 2023-01-18 Kori Khan , Catherine A. Calder

Optimization problems with an auxiliary latent variable structure in addition to the main model parameters occur frequently in computer vision and machine learning. The additional latent variables make the underlying optimization task…

Machine Learning · Computer Science 2020-03-13 Christopher Zach , Huu Le

Treatment effect estimation is a fundamental problem in causal inference. We focus on designing efficient randomized controlled trials, to accurately estimate the effect of some treatment on a population of $n$ individuals. In particular,…

Machine Learning · Computer Science 2022-10-14 Raghavendra Addanki , David Arbour , Tung Mai , Cameron Musco , Anup Rao

Omitted variables are one of the most important threats to the identification of causal effects. Several widely used methods assess the impact of omitted variables on empirical conclusions by comparing measures of selection on observables…

Econometrics · Economics 2026-02-05 Paul Diegert , Matthew A. Masten , Alexandre Poirier

This expository paper discusses Bayesian decision analysis perspectives on problems of constrained forecasting. Foundational and pedagogic discussion contrasts decision analytic approaches with the traditional, but typically inappropriate,…

Methodology · Statistics 2021-12-01 Mike West

One obstacle to ``elevating" correlation to causation is the phenomenon of confounding, i.e., when a correlation between two variables exists because both variables are in fact caused by a third variable. The situation where the confounders…

Applications · Statistics 2025-06-24 Caren Marzban , Yikun Zhang , Nicholas Bond , Michael Richman

With the wide adoption of machine learning techniques, requirements have evolved beyond sheer high performance, often requiring models to be trustworthy. A common approach to increase the trustworthiness of such systems is to allow them to…

Machine Learning · Computer Science 2023-11-16 Andrea Pugnana , Carlos Mougan , Dan Saattrup Nielsen

In truncated linear regression, samples $(x,y)$ are shown only when the outcome $y$ falls inside a certain survival set $S^\star$ and the goal is to estimate the unknown $d$-dimensional regressor $w^\star$. This problem has a long history…

Machine Learning · Statistics 2026-05-25 Alexandros Kouridakis , Anay Mehrotra , Alkis Kalavasis , Constantine Caramanis

Regression models for limited continuous dependent variables having a non-negligible probability of attaining exactly their limits are presented. The models differ in the number of parameters and in their flexibility. Fractional data being…

Applications · Statistics 2012-05-31 Fabio Sigrist , Werner A. Stahel

A common problem in health research is that we have a large database with many variables measured on a large number of individuals. We are interested in measuring additional variables on a subsample; these measurements may be newly…

Methodology · Statistics 2022-03-22 Thomas Lumley , Tong Chen

When estimating a regression model, we might have data where some labels are missing, or our data might be biased by a selection mechanism. When the response or selection mechanism is ignorable (i.e., independent of the response variable…

Statistics Theory · Mathematics 2023-08-22 Philip Boeken , Noud de Kroon , Mathijs de Jong , Joris M. Mooij , Onno Zoeter

Given a large dataset and an estimation task, it is common to pre-process the data by reducing them to a set of sufficient statistics. This step is often regarded as straightforward and advantageous (in that it simplifies statistical…

Computation · Statistics 2015-07-31 Andrea Montanari

We study linear regressions in a context where the outcome of interest and some of the covariates are observed in two different datasets that cannot be matched. Traditional approaches obtain point identification by relying, often…

Econometrics · Economics 2025-11-18 Xavier D'Haultfoeuille , Christophe Gaillac , Arnaud Maurel

Varying-coefficient functional linear models consider the relationship between a response and a predictor, where the response depends not only the predictor but also an exogenous variable. It then accounts for the relation of the predictors…

Methodology · Statistics 2022-03-22 Hidetoshi Matsui

Upcoming large redshift surveys potentially allow precision measurements of the galaxy power spectrum. To accurately measure P(k) on the largest scales, comparable to the depth of the survey, it is crucial that finite volume effects are…

Astrophysics · Physics 2016-01-27 Max Tegmark