English
Related papers

Related papers: Statistical quantification of confounding bias in …

200 papers

In the past decades, most work in the area of data analysis and machine learning was focused on optimizing predictive models and getting better results than what was possible with existing models. To what extent the metrics with which such…

Machine Learning · Statistics 2024-05-06 Nicolas Dewolf

The simple and partial Mantel tests are routinely used in many areas of evolutionary biology to assess the significance of the association between two or more matrices of distances relative to the same pairs of individuals or demes. Partial…

Populations and Evolution · Quantitative Biology 2012-11-01 Gilles Guillot , François Rousset

Regression on observational data can fail to capture a causal relationship in the presence of unobserved confounding. Confounding strength measures this mismatch, but estimating it requires itself additional assumptions. A common assumption…

Machine Learning · Statistics 2022-11-04 Luca Rendsburg , Leena Chennuru Vankadara , Debarghya Ghoshdastidar , Ulrike von Luxburg

When drawing causal inference from observational data, there is always concern about unmeasured confounding. One way to tackle this is to conduct a sensitivity analysis. One widely-used sensitivity analysis framework hypothesizes the…

Methodology · Statistics 2022-06-22 Bo Zhang , Eric J. Tchetgen Tchetgen

Efficient estimation under bias sampling, censoring or truncation is a difficult question which has been partially answered and the usual estimators are not always consistent. Several biased designs are considered for models with variables…

Statistics Theory · Mathematics 2007-10-22 Odile Pons

Machine learning (ML) models show strong promise for new biomedical prediction tasks, but concerns about trustworthiness have hindered their clinical adoption. In particular, it is often unclear whether a model relies on true clinical cues…

Machine Learning · Computer Science 2026-01-13 Dushan N. Wadduwage , Dineth Jayakody , Leonidas Zimianitis

Nonparametric two-sample tests such as the Maximum Mean Discrepancy (MMD) are often used to detect differences between two distributions in machine learning applications. However, the majority of existing literature assumes that error-free…

Machine Learning · Statistics 2023-08-08 Ron Nafshi , Maggie Makar

Large language models (LLMs) show potential as simulators of human behavior, offering a scalable way to study responses to interventions. However, because LLMs are trained largely on observational data, interventions in experiments with…

Computation and Language · Computer Science 2026-05-21 Victoria Lin , Taedong Yun , Maja Matarić , John Canny , Arthur Gretton , Alexander D'Amour

In this paper we motivate the causal mechanisms behind sample selection induced collider bias (selection collider bias) that can cause Large Language Models (LLMs) to learn unconditional dependence between entities that are unconditionally…

Computation and Language · Computer Science 2022-09-14 Emily McMilin

This paper studies model checking for general parametric regression models having no dimension reduction structures on the predictor vector. Using any U-statistic type test as an initial test, this paper combines the sample-splitting and…

Methodology · Statistics 2023-08-21 Feng Liang , Chuhan Wang , jiaqi Huang , Lixing Zhu

The comprehensive integration of machine learning healthcare models within clinical practice remains suboptimal, notwithstanding the proliferation of high-performing solutions reported in the literature. A predominant factor hindering…

Image and Video Processing · Electrical Eng. & Systems 2023-10-12 Ling Huang , Su Ruan , Yucheng Xing , Mengling Feng

We study the identification and estimation of long-term treatment effects when both experimental and observational data are available. Since the long-term outcome is observed only after a long delay, it is not measured in the experimental…

Methodology · Statistics 2024-09-04 Guido Imbens , Nathan Kallus , Xiaojie Mao , Yuhao Wang

Traditional recommender systems aim to estimate a user's rating to an item based on observed ratings from the population. As with all observational studies, hidden confounders, which are factors that affect both item exposures and user…

Machine Learning · Computer Science 2022-11-22 Yaochen Zhu , Jing Yi , Jiayi Xie , Zhenzhong Chen

Negative control variables are increasingly used to adjust for unmeasured confounding bias in causal inference using observational data. They are typically identified by subject matter knowledge and there is currently a severe lack of…

Methodology · Statistics 2022-10-04 Erich Kummerfeld , Jaewon Lim , Xu Shi

This paper develops new insights into quantitative methods for the validation of computational model prediction. Four types of methods are investigated, namely classical and Bayesian hypothesis testing, a reliability-based method, and an…

Data Analysis, Statistics and Probability · Physics 2012-06-25 You Ling , Sankaran Mahadevan

Trustworthy machine learning is of primary importance to the practical deployment of deep learning models. While state-of-the-art models achieve astonishingly good performance in terms of accuracy, recent literature reveals that their…

Machine Learning · Computer Science 2023-02-07 Ailin Deng , Shen Li , Miao Xiong , Zhirui Chen , Bryan Hooi

We train convolutional neural networks to predict whether or not a set of measurements is informationally complete to uniquely reconstruct any given quantum state with no prior information. In addition, we perform fidelity benchmarking…

Evaluating classifications is crucial in statistics and machine learning, as it influences decision-making across various fields, such as patient prognosis and therapy in critical conditions. The Matthews correlation coefficient (MCC) is…

Methodology · Statistics 2024-06-18 Yuki Itaya , Jun Tamura , Kenichi Hayashi , Kouji Yamamoto

Applying a machine learning model for decision-making in the real world requires to distinguish what the model knows from what it does not. A critical factor in assessing the knowledge of a model is to quantify its predictive uncertainty.…

Machine Learning · Computer Science 2023-11-15 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Sepp Hochreiter

Unmeasured confounders are a major source of bias in regression-based effect estimation and causal inference. In this paper, we advocate a new profiled transfer learning framework, ProTrans, to address confounding effects in the target…

Methodology · Statistics 2025-09-04 Ziyuan Chen , Yifan Jiang , Jingyuan Liu , Fang Yao