English
Related papers

Related papers: Robustness Metric for Quantifying Causal Model Con…

200 papers

In causal inference, sensitivity models assess how unmeasured confounders could alter causal analyses, but the sensitivity parameter -- which quantifies the degree of unmeasured confounding -- is often difficult to interpret. For this…

Methodology · Statistics 2025-09-04 Alec McClean , Zach Branson , Edward H. Kennedy

We introduce an approach which allows detecting causal relationships between variables for which the time evolution is available. Causality is assessed by a variational scheme based on the Information Imbalance of distance ranks, a…

Methodology · Statistics 2024-05-07 Vittorio Del Tatto , Gianfranco Fortunato , Domenica Bueti , Alessandro Laio

Robustness checks are routine in empirical work, but there is no standard statistical procedure to formally measure what one can learn from them. I propose a "robustness radius" measure to quantify the amount by which the robustness checks…

Econometrics · Economics 2026-02-24 Brenda Prallon

The validity OF a causal model can be tested ONLY IF the model imposes constraints ON the probability distribution that governs the generated data. IN the presence OF unmeasured variables, causal models may impose two types OF constraints :…

Artificial Intelligence · Computer Science 2013-01-07 Jin Tian , Judea Pearl

This work develops a measurement-driven and model-based formal verification approach, applicable to systems with partly unknown dynamics. We provide a principled method, grounded on reachability analysis and on Bayesian inference, to…

Systems and Control · Computer Science 2015-09-14 Sofie Haesaert , Paul M. J. Van den Hof , Alessandro Abate

The predominant method for evaluating the quality of causal models is to measure the graphical accuracy of the learned model structure. We present an alternative method for evaluating causal models that directly measures the accuracy of…

Artificial Intelligence · Computer Science 2016-08-17 Dan Garant , David Jensen

Multiple metrics have been developed to detect causality relations between data describing the elements constituting complex systems, all of them considering their evolution through time. Here we propose a metric able to detect causality…

Data Analysis, Statistics and Probability · Physics 2016-05-20 Massimiliano Zanin

Statistical modeling plays a fundamental role in understanding the underlying mechanism of massive data (statistical inference) and predicting the future (statistical prediction). Although all models are wrong, researchers try their best to…

Methodology · Statistics 2020-06-17 Hangjin Jiang

We have recently witnessed a number of impressive results on hard mathematical reasoning problems with language models. At the same time, the robustness of these models has also been called into question; recent works have shown that models…

Computation and Language · Computer Science 2023-06-09 Alessandro Stolfo , Zhijing Jin , Kumar Shridhar , Bernhard Schölkopf , Mrinmaya Sachan

Measurement error in the observed values of the variables can greatly change the output of various causal discovery methods. This problem has received much attention in multiple fields, but it is not clear to what extent the causal model…

Methodology · Statistics 2017-06-14 Kun Zhang , Mingming Gong , Joseph Ramsey , Kayhan Batmanghelich , Peter Spirtes , Clark Glymour

The robustness of signal temporal logic not only assesses whether a signal adheres to a specification but also provides a measure of how much a formula is fulfilled or violated. The calculation of robustness is based on evaluating the…

Robotics · Computer Science 2024-03-13 Yuanfei Lin , Haoxuan Li , Matthias Althoff

The aim of this paper is to discuss a recent result which shows that probabilistic inference in the presence of (unknown) causal mechanisms can be tractable for models that have traditionally been viewed as intractable. This result was…

Artificial Intelligence · Computer Science 2022-02-08 Adnan Darwiche

Causal inference is central to many areas of artificial intelligence, including complex reasoning, planning, knowledge-base construction, robotics, explanation, and fairness. An active community of researchers develops and enhances…

Artificial Intelligence · Computer Science 2019-11-05 Amanda Gentzel , Dan Garant , David Jensen

What is the difference of a prediction that is made with a causal model and a non-causal model? Suppose we intervene on the predictor variables or change the whole environment. The predictions from a causal model will in general work as…

Methodology · Statistics 2024-04-27 Jonas Peters , Peter Bühlmann , Nicolai Meinshausen

Trusting machine learning algorithms requires having confidence in their outputs. Confidence is typically interpreted in terms of model reliability, where a model is reliable if it produces a high proportion of correct outputs. However,…

Machine Learning · Computer Science 2023-11-01 Jonathan Vandenburgh

The assumption of no unmeasured confounders is a critical but unverifiable assumption required for causal inference yet quantitative sensitivity analyses to assess robustness of real-world evidence remains underutilized. The lack of use is…

Accurately predicting the relevance of items to users is crucial to the success of many social platforms. Conventional approaches train models on logged historical data; but recommendation systems, media services, and online marketplaces…

Machine Learning · Computer Science 2022-10-11 Amir Feder , Guy Horowitz , Yoav Wald , Roi Reichart , Nir Rosenfeld

Mathematical models simulate various events under different conditions, enabling an early overview of the system to be implemented in practice, reducing the waste of resources and in less time. In project optimization, these models play a…

Optimization and Control · Mathematics 2021-05-11 Gustavo Barbosa Libotte , Fran Sérgio Lobato , Francisco Duarte Moura Neto , Gustavo Mendes Platt

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

Machine Learning · Statistics 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi

We present an extension to the robust phase estimation protocol, which can identify incorrect results that would otherwise lie outside the expected statistical range. Robust phase estimation is increasingly a method of choice for…