English
Related papers

Related papers: Statistical quantification of confounding bias in …

200 papers

Predictive models ground many state-of-the-art developments in statistical brain image analysis: decoding, MVPA, searchlight, or extraction of biomarkers. The principled approach to establish their validity and usefulness is…

Quantitative Methods · Quantitative Biology 2017-06-26 Gaël Varoquaux

Intuitively, unfamiliarity should lead to lack of confidence. In reality, current algorithms often make highly confident yet wrong predictions when faced with relevant but unfamiliar examples. A classifier we trained to recognize gender is…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Zhizhong Li , Derek Hoiem

Many practical studies rely on hypothesis testing procedures applied to data sets with missing information. An important part of the analysis is to determine the impact of the missing data on the performance of the test, and this can be…

Methodology · Statistics 2011-02-15 Dan L. Nicolae , Xiao-Li Meng , Augustine Kong

Researchers have devised numerous ways to quantify social biases vested in pretrained language models. As some language models are capable of generating coherent completions given a set of textual prompts, several prompting datasets have…

Computation and Language · Computer Science 2022-05-25 Afra Feyza Akyürek , Muhammed Yusuf Kocyigit , Sejin Paik , Derry Wijaya

Recent advances in probabilistic deep learning enable efficient amortized Bayesian inference in settings where the likelihood function is only implicitly defined by a simulation program (simulation-based inference; SBI). But how faithful is…

Machine Learning · Computer Science 2024-06-07 Marvin Schmitt , Paul-Christian Bürkner , Ullrich Köthe , Stefan T. Radev

The identification of causal effects in observational studies typically relies on two standard assumptions: unconfoundedness and overlap. However, both assumptions are often questionable in practice: unconfoundedness is inherently…

Methodology · Statistics 2025-09-17 Han Cui , Xinran Li

The awareness and mitigation of biases are of fundamental importance for the fair and transparent use of contextual language models, yet they crucially depend on the accurate detection of biases as a precursor. Consequently, numerous bias…

Computation and Language · Computer Science 2022-11-17 Silke Husse , Andreas Spitz

Diagnostic tests play a crucial role in medical care. Thus any new diagnostic tests must undergo a thorough evaluation. New diagnostic tests are evaluated in comparison with the respective gold standard tests. The performance of binary…

Applications · Statistics 2025-09-17 Wan Nor Arifin , Umi Kalsom Yusof

Clustering is part of unsupervised analysis methods that consist in grouping samples into homogeneous and separate subgroups of observations also called clusters. To interpret the clusters, statistical hypothesis testing is often used to…

Methodology · Statistics 2022-10-25 Benjamin Hivert , Denis Agniel , Rodolphe Thiébaut , Boris P Hejblum

Incomplete data are common in practical applications. Most predictive machine learning models do not handle missing values so they require some preprocessing. Although many algorithms are used for data imputation, we do not understand the…

Machine Learning · Statistics 2020-07-07 Katarzyna Woźnica , Przemysław Biecek

When studying the causal effect of $x$ on $y$, researchers may conduct regression and report a confidence interval for the slope coefficient $\beta_{x}$. This common confidence interval provides an assessment of uncertainty from sampling…

Methodology · Statistics 2019-08-26 Brian Knaeble , Braxton Osting , Mark Abramson

It is increasingly common to collect pre-post data with pseudonyms or self-constructed identifiers. On survey responses from sensitive populations, identifiers may be made optional to encourage higher response rates. The ability to match…

Methodology · Statistics 2023-12-25 Raymond Pomponio , Bailey K. Fosdick , Julia Wrobel , Ryan A. Peterson

Unobserved confounders are a long-standing issue in causal inference using propensity score methods. This study proposed nonparametric indices to quantify the impact of unobserved confounders through pseudo-experiments with an application…

Methodology · Statistics 2020-08-27 Beilin Jia , Donglin Zeng , Qing Yang , Wei Pan

Unobserved confounding is a central barrier to drawing causal inferences from observational data. Several authors have recently proposed that this barrier can be overcome in the case where one attempts to infer the effects of several…

Machine Learning · Statistics 2019-03-20 Alexander D'Amour

Existing techniques for mitigating dataset bias often leverage a biased model to identify biased instances. The role of these biased instances is then reduced during the training of the main model to enhance its robustness to…

Machine Learning · Computer Science 2021-09-03 Hossein Amirkhani , Mohammad Taher Pilehvar

Debiased machine learning is a meta algorithm based on bias correction and sample splitting to calculate confidence intervals for functionals, i.e. scalar summaries, of machine learning algorithms. For example, an analyst may desire the…

Machine Learning · Statistics 2022-10-25 Victor Chernozhukov , Whitney K. Newey , Rahul Singh

For some variants of regression models, including partial, measurement error or error-in-variables, latent effects, semi-parametric and otherwise corrupted linear models, the classical parametric tests generally do not perform well. Various…

Statistics Theory · Mathematics 2015-03-25 Pranab K. Sen , Jana Jureckova , Jan Picek

Selective classification allows models to abstain from making predictions (e.g., say "I don't know") when in doubt in order to obtain better effective accuracy. While typical selective models can be effective at producing more accurate…

Machine Learning · Computer Science 2024-06-24 Adam Fisch , Tommi Jaakkola , Regina Barzilay

Count outcomes in longitudinal studies are frequent in clinical and engineering studies. In frequentist and Bayesian statistical analysis, methods such as Mixed linear models allow the variability or correlation within individuals to be…

Methodology · Statistics 2024-07-15 Alejandra Estefanía Patiño Hoyos , Johnatan Cardona Jiménez

The estimation of linear causal models (also known as structural equation models) from data is a well-known problem which has received much attention in the past. Most previous work has, however, made an explicit or implicit assumption of…

Artificial Intelligence · Computer Science 2007-05-23 Patrik O. Hoyer , Shohei Shimizu , Antti J. Kerminen