English
Related papers

Related papers: Selection Bias Correction and Effect Size Estimati…

200 papers

Large-scale datasets are increasingly being used to inform decision making. While this effort aims to ground policy in real-world evidence, challenges have arisen as selection bias and other forms of distribution shifts often plague…

Methodology · Statistics 2023-11-07 Santiago Cortes-Gomez , Mateo Dulce , Carlos Patino , Bryan Wilder

In genome-wide association studies (GWAS), hundreds of thousands of genetic markers (SNPs) are tested for association with a trait or phenotype. Reported effects tend to be larger in magnitude than the true effects of these markers, the…

Methodology · Statistics 2010-10-25 Michael E. Goddard , Naomi R. Wray , Klara Verbyla , Peter M. Visscher

When teaching and discussing statistical assumptions, our focus is oftentimes placed on how to test and address potential violations rather than the effects of violating assumptions on the estimates produced by our statistical models. The…

Methodology · Statistics 2022-06-14 Ian A Silver

Clinical prediction models must be developed using sufficiently large datasets to minimise overfitting and ensure robust predictive performance. Existing sample size calculations assume complete predictor data for all included participants,…

Effect modification occurs when the effect of the treatment on an outcome varies according to the level of other covariates and often has important implications in decision making. When there are tens or hundreds of covariates, it becomes…

Methodology · Statistics 2021-11-23 Qingyuan Zhao , Dylan S. Small , Ashkan Ertefaie

We consider the problem of efficient inference of the Average Treatment Effect in a sequential experiment where the policy governing the assignment of subjects to treatment or control can change over time. We first provide a central limit…

Machine Learning · Statistics 2024-03-05 Thomas Cook , Alan Mishler , Aaditya Ramdas

Most data for evaluating and training recommender systems is subject to selection biases, either through self-selection by the users or through the actions of the recommendation system itself. In this paper, we provide a principled approach…

Machine Learning · Computer Science 2016-05-30 Tobias Schnabel , Adith Swaminathan , Ashudeep Singh , Navin Chandak , Thorsten Joachims

The Negative Binomial distribution becomes highly skewed under extreme dispersion. Even at moderately large sample sizes, the sample mean exhibits a heavy right tail. The standard Normal approximation often does not provide adequate…

Methodology · Statistics 2015-03-13 David Shilane , Derek Bean

Empirical research typically involves a robustness-efficiency tradeoff. A researcher seeking to estimate a scalar parameter can invoke strong assumptions to motivate a restricted estimator that is precise but may be heavily biased, or they…

Econometrics · Economics 2025-09-17 Timothy B. Armstrong , Patrick Kline , Liyang Sun

As a consequence of the strong and usually violated conditional independence assumption (CIA) of naive Bayes (NB) classifier, the performance of NB becomes less and less favorable compared to sophisticated classifiers when the sample size…

Machine Learning · Statistics 2014-12-23 Kim-Hung Li , Cheuk Ting Li

In this paper, we introduce a novel method to generate interpretable regression function estimators. The idea is based on called data-dependent coverings. The aim is to extract from the data a covering of the feature space instead of a…

Statistics Theory · Mathematics 2021-01-27 Vincent Margot , Jean-Patrick Baudry , Frédéric Guilloux , Olivier Wintenberger

Percentage coefficient (bp) has emerged in recent publications as an additional and alternative estimator of effect size for regression analysis. This paper retraces the theory behind the estimator. It's posited that an estimator must first…

Applications · Statistics 2024-05-07 Xinshu Zhao , Dianshi Moses Li , Ze Zack Lai , Piper Liping Liu , Song Harris Ao , Fei You

Recently we have presented the analytical relationship between choice probabilities, noise correlations and read-out weights in the classical feedforward decision-making framework (Haefner et al. 2013). The derivation assumed that…

Neurons and Cognition · Quantitative Biology 2015-01-15 Ralf M. Haefner

We consider the hypothesis testing problem of detecting conditional dependence, with a focus on high-dimensional feature spaces. Our contribution is a new test statistic based on samples from a generative adversarial network designed to…

Machine Learning · Statistics 2019-12-20 Alexis Bellot , Mihaela van der Schaar

In an observational study, it is common to leverage known null effect to detect bias. One such strategy is to set aside a placebo sample -- a subset of data immune from the hypothesized cause-and-effect relationship. Existence of an effect…

Methodology · Statistics 2022-07-05 Ting Ye , Shuxiao Chen , Bo Zhang

When random effects are correlated with sample design variables, the usual approach of employing individual survey weights (constructed to be inversely proportional to the unit survey inclusion probabilities) to form a pseudo-likelihood no…

Methodology · Statistics 2021-08-26 Terrance D. Savitsky , Matthew R. Williams

This paper studies the problem of estimating the contributions of features to the prediction of a specific instance by a machine learning model and the overall contribution of a feature to the model. The causal effect of a feature…

Machine Learning · Computer Science 2022-06-24 Jiuyong Li , Ha Xuan Tran , Thuc Duy Le , Lin Liu , Kui Yu , Jixue Liu

Observational data is often readily available in large quantities, but can lead to biased causal effect estimates due to the presence of unobserved confounding. Recent works attempt to remove this bias by supplementing observational data…

Estimating causal effects from observational data is not always possible due to confounding. Identifying a set of appropriate covariates (adjustment set) and adjusting for their influence can remove confounding bias; however, such a set is…

Methodology · Statistics 2020-11-19 Sofia Triantafillou , Gregory Cooper

Many estimators of the average effect of a treatment on an outcome require estimation of the propensity score, the outcome regression, or both. It is often beneficial to utilize flexible techniques such as semiparametric regression or…

Methodology · Statistics 2019-05-14 Cheng Ju , David Benkeser , Mark J. van der Laan