English
Related papers

Related papers: Why So Many Published Sensitivity Analyses Are Fal…

200 papers

In observational studies, identification of ATEs is generally achieved by assuming that the correct set of confounders has been measured and properly included in the relevant models. Because this assumption is both strong and untestable, a…

Methodology · Statistics 2020-12-18 Matteo Bonvini , Edward H Kennedy

Causal inference necessarily relies upon untestable assumptions; hence, it is crucial to assess the robustness of obtained results to violations of identification assumptions. However, such sensitivity analysis is only occasionally…

Methodology · Statistics 2025-05-19 Tobias Freidling , Qingyuan Zhao

Researchers have proposed several approaches for neural network (NN) based uncertainty quantification (UQ). However, most of the approaches are developed considering strong assumptions. Uncertainty quantification algorithms often perform…

We derive a novel sensitivity analysis of input variables for predictive epistemic and aleatoric uncertainty. We use Bayesian neural networks with latent variables as a model class and illustrate the usefulness of our sensitivity analysis…

Machine Learning · Statistics 2017-12-12 Stefan Depeweg , José Miguel Hernández-Lobato , Steffen Udluft , Thomas Runkler

Causal inference, especially in observational studies, relies on untestable assumptions about the true data-generating process. Sensitivity analysis helps us determine how robust our conclusions are when we alter these underlying…

Machine Learning · Computer Science 2026-05-11 Nikita Dhawan , Daniel Shen , Leonardo Cotta , Chris J. Maddison

Global sensitivity analysis (GSA) is a recommended step in the use of computer simulation models. GSA quantifies the relative importance of model inputs on outputs (Factor Ranking), identifies inputs that could be fixed, thus simplifying…

Methodology · Statistics 2025-10-27 Ken Newman , Shaini Naha , Leah Jackson-Blake , Cairistiona Topp , Miriam Glendell , Adam Butler

The assumption of no unmeasured confounders is a critical but unverifiable assumption required for causal inference yet quantitative sensitivity analyses to assess robustness of real-world evidence remains underutilized. The lack of use is…

As the use of deep learning in high impact domains becomes ubiquitous, it is increasingly important to assess the resilience of models. One such high impact domain is that of face recognition, with real world applications involving images…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Aparna R. Joshi , Xavier Suau , Nivedha Sivakumar , Luca Zappella , Nicholas Apostoloff

This paper offers a commentary on the use of notions of statistical significance in choice modelling. We review the reasons for uncertainty in parameter estimates, provide a precise discussion on the computation of measures of uncertainty…

Econometrics · Economics 2026-05-18 Stephane Hess , Andrew Daly , Michiel Bliemer , Angelo Guevara , Ricardo Daziano , Thijs Dekker

Within the last few years, there has been a move towards using statistical models in conjunction with neural networks with the end goal of being able to better answer the question, "what do our models know?". From this trend, classical…

Machine Learning · Computer Science 2021-12-03 Achintya Gopal

Random-effects meta-analyses of observational studies can produce biased estimates if the synthesized studies are subject to unmeasured confounding. We propose sensitivity analyses quantifying the extent to which unmeasured confounding of…

Methodology · Statistics 2017-10-10 Maya B. Mathur , Tyler J. VanderWeele

Sensitivity analysis is popular in dealing with missing data problems particularly for non-ignorable missingness. It analyses how sensitively the conclusions may depend on assumptions about missing data e.g. missing data mechanism (MDM). We…

Methodology · Statistics 2015-01-26 Peng Yin , Jian Qing Shi

The complexity and size of state-of-the-art cell models have significantly increased in part due to the requirement that these models possess complex cellular functions which are thought--but not necessarily proven--to be important. Modern…

Neurons and Cognition · Quantitative Biology 2018-11-22 J. L. Hart , P. A. Gremaud , T. David

Model-form uncertainty (MFU) in assumptions made during physics-based model development is widely considered a significant source of uncertainty; however, there are limited approaches that can quantify MFU in predictions extrapolating…

Computational Engineering, Finance, and Science · Computer Science 2025-09-16 Teresa Portone , Rebekah D. White , Joseph L. Hart

Decision circuits have been developed to perform efficient evaluation of influence diagrams [Bhattacharjya and Shachter, 2007], building on the advances in arithmetic circuits for belief network inference [Darwiche,2003]. In the process of…

Artificial Intelligence · Computer Science 2012-06-18 Debarun Bhattacharjya , Ross D. Shachter

Nowadays, the numerical models of real-world structures are more precise, more complex and, of course, more time-consuming. Despite the growth of a computational effort, the exploration of model behaviour remains a complex task. The…

Computational Engineering, Finance, and Science · Computer Science 2014-10-17 Eliska Janouchova , Anna Kucerova

In many applications of causal inference, the treatment received by one unit may influence the outcome of another, a phenomenon referred to as interference. Although there are several frameworks for conducting causal inference in the…

Methodology · Statistics 2025-11-27 Matvey Ortyashov , AmirEmad Ghassami

Although neural networks can achieve very high predictive performance on various different tasks such as image recognition or natural language processing, they are often considered as opaque "black boxes". The difficulty of interpreting the…

Machine Learning · Statistics 2020-01-22 Enguerrand Horel , Virgile Mison , Tao Xiong , Kay Giesecke , Lidia Mangu

Sentiment analysis (SA) has been, and is still, a thriving research area. However, the task of Arabic sentiment analysis (ASA) is still underrepresented in the body of research. This study offers the first in-depth and in-breadth analysis…

Computation and Language · Computer Science 2024-03-05 Latifah Almurqren , Ryan Hodgson , Alexandra Cristea

Fairness metrics are a core tool in the fair machine learning literature (FairML), used to determine that ML models are, in some sense, "fair". Real-world data, however, are typically plagued by various measurement biases and other violated…

Machine Learning · Computer Science 2024-10-16 Jake Fawkes , Nic Fishman , Mel Andrews , Zachary C. Lipton