中文
相关论文

相关论文: Statistical quantification of confounding bias in …

200 篇论文

While language embeddings have been shown to have stereotyping biases, how these biases affect downstream question answering (QA) models remains unexplored. We present UNQOVER, a general framework to probe and quantify biases through…

计算与语言 · 计算机科学 2020-10-13 Tao Li , Tushar Khot , Daniel Khashabi , Ashish Sabharwal , Vivek Srikumar

We study the problem of learning personalized decision policies from observational data while accounting for possible unobserved confounding. Previous approaches, which assume unconfoundedness, i.e., that no unobserved confounders affect…

机器学习 · 计算机科学 2019-11-05 Nathan Kallus , Angela Zhou

In statistical inference, it is rarely realistic that the hypothesized statistical model is well-specified, and consequently it is important to understand the effects of misspecification on inferential procedures. When the hypothesized…

统计方法学 · 统计学 2025-09-01 Beomjo Park , Sivaraman Balakrishnan , Larry Wasserman

Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities, but their susceptibility to biases poses significant risks, since biases may negatively impact generalization performance. In this…

机器学习 · 计算机科学 2025-04-29 Haroui Ma , Francesco Quinzan , Theresa Willem , Stefan Bauer

Causal inference with observational data can be performed under an assumption of no unobserved confounders (unconfoundedness assumption). There is, however, seldom clear subject-matter or empirical evidence for such an assumption. We…

统计方法学 · 统计学 2023-11-13 Minna Genbäck , Xavier de Luna

Two recently introduced model based bias corrected estimators for proportion of true null hypotheses ($\pi_0$) under multiple hypotheses testing scenario have been restructured for exponentially distributed random observations available for…

统计理论 · 数学 2020-07-28 Aniket Biswas , Gaurangadeb Chattopadhyay , Aditya Chatterjee

Unintended bias in Machine Learning can manifest as systemic differences in performance for different demographic groups, potentially compounding existing challenges to fairness in society at large. In this paper, we introduce a suite of…

机器学习 · 计算机科学 2019-05-09 Daniel Borkan , Lucas Dixon , Jeffrey Sorensen , Nithum Thain , Lucy Vasserman

Testing for association or dependence between pairs of random variables is a fundamental problem in statistics. In some applications, data are subject to selection bias that causes dependence between observations even when it is absent from…

统计方法学 · 统计学 2020-10-13 Yaniv Tenzer , Micha Mandel , Or Zuk

A recent literature considers causal inference using noisy proxies for unobserved confounding factors. The proxies are divided into two sets that are independent conditional on the confounders. One set of proxies are `negative control…

计量经济学 · 经济学 2021-10-11 Ben Deaner

Scientific knowledge expands by observing the world, hypothesizing some theories about it, and testing them against collected data. When those theories take the form of statistical models, statistical analyses are involved in the process of…

机器学习 · 统计学 2026-03-11 Arnaud Delaunoy

Causal inference from observational data often assumes "ignorability," that all confounders are observed. This assumption is standard yet untestable. However, many scientific studies involve multiple causes, different variables whose…

机器学习 · 统计学 2019-04-16 Yixin Wang , David M. Blei

Large Language Models (LLMs) have shown impressive potential to simulate human behavior. We identify a fundamental challenge in using them to simulate experiments: when LLM-simulated subjects are blind to the experimental design (as is…

人工智能 · 计算机科学 2025-11-25 George Gui , Olivier Toubia

We consider the problem of precision matrix estimation where, due to extraneous confounding of the underlying precision matrix, the data are independent but not identically distributed. While such confounding occurs in many scientific…

机器学习 · 统计学 2019-07-01 Sinong Geng , Mladen Kolar , Oluwasanmi Koyejo

No unmeasured confounding is often assumed in estimating treatment effects in observational data when using approaches such as propensity scores and inverse probability weighting. However, in many such studies due to the limitation of the…

应用统计 · 统计学 2019-08-06 Rong Huang , Ronghui Xu , Parambir S. Dulai

Statistical hypothesis testing is the central method to demarcate scientific theories in both exploratory and inferential analyses. However, whether this method befits such purpose remains a matter of debate. Established approaches to…

数据分析、统计与概率 · 物理学 2024-10-29 Orestis Loukas , Ho-Ryun Chung

Predictive algorithms inform consequential decisions in settings with selective labels: outcomes are observed only for units selected by past decision makers. This creates an identification problem under unobserved confounding -- when…

计量经济学 · 经济学 2025-11-07 Ashesh Rambachan , Amanda Coston , Edward Kennedy

Open-generation bias benchmarks evaluate social biases in Large Language Models (LLMs) by analyzing their outputs. However, the classifiers used in analysis often have inherent biases, leading to unfair conclusions. This study examines such…

计算与语言 · 计算机科学 2025-01-22 Nathaniel Demchak , Xin Guan , Zekun Wu , Ziyi Xu , Adriano Koshiyama , Emre Kazim

Datasets typically contain inaccuracies due to human error and societal biases, and these inaccuracies can affect the outcomes of models trained on such datasets. We present a technique for certifying whether linear regression models are…

机器学习 · 计算机科学 2022-06-09 Anna P. Meyer , Aws Albarghouthi , Loris D'Antoni

Unmeasured confounding remains a critical challenge in causal inference for the social sciences. This paper proposes a sensitivity analysis framework to systematically evaluate how unmeasured confounders influence statistical inference in…

统计方法学 · 统计学 2025-04-21 Cheng Lin , Jose M. Pena , Adel Daoud

Pre-validation is a way to build prediction model with two datasets of significantly different feature dimensions. Previous work showed that the asymptotic distribution of the resulting test statistic for the pre-validated predictor…

统计方法学 · 统计学 2025-05-23 Jing Shang , Sourav Chatterjee , Trevor Hastie , Robert Tibshirani