English
Related papers

Related papers: Reasoning About Causal Models With Infinitely Many…

200 papers

We show that large language models (LLMs) are remarkably good at working with interpretable models that decompose complex outcomes into univariate graph-represented components. By adopting a hierarchical approach to reasoning, LLMs can…

Ensuring robust model performance in diverse real-world scenarios requires addressing generalizability across domains with covariate shifts. However, no formal procedure exists for statistically evaluating generalizability in machine…

Machine Learning · Computer Science 2025-06-13 Daniel de Vassimon Manela , Linying Yang , Robin J. Evans

To perform counterfactual reasoning in Structural Causal Models (SCMs), one needs to know the causal mechanisms, which provide factorizations of conditional distributions into noise sources and deterministic functions mapping realizations…

Machine Learning · Computer Science 2021-11-16 Guy Lorberbom , Daniel D. Johnson , Chris J. Maddison , Daniel Tarlow , Tamir Hazan

We present a domain-general account of causation that applies to settings in which macro-level causal relations between two systems are of interest, but the relevant causal features are poorly understood and have to be aggregated from vast…

Machine Learning · Statistics 2015-12-29 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

We present Spatial Reasoners, a software framework to perform spatial reasoning over continuous variables with generative denoising models. Denoising generative models have become the de-facto standard for image generation, due to their…

Machine Learning · Computer Science 2025-07-16 Bart Pogodzinski , Christopher Wewer , Bernt Schiele , Jan Eric Lenssen

We introduce structural causal bottleneck models (SCBMs), a novel class of structural causal models. At the core of SCBMs lies the assumption that causal effects between high-dimensional variables only depend on low-dimensional summary…

Machine Learning · Statistics 2026-03-17 Simon Bing , Jonas Wahl , Jakob Runge

Causal reasoning is a cornerstone of human intelligence and a critical capability for artificial systems aiming to achieve advanced understanding and decision-making. This thesis delves into various dimensions of causal reasoning and…

Computation and Language · Computer Science 2025-04-22 Zhijing Jin

The relationship between algebraic geometry and the inferential framework of the Bayesian Networks with hidden variables has now been fruitfully explored and exploited by a number of authors. More recently the algebraic formulation of…

Methodology · Statistics 2007-09-24 Eva Riccomagno , Jim Q Smith

Causal discovery for both cross-sectional and temporal data has traditionally followed a dataset-specific paradigm, where a new model is fitted for each individual dataset. Such an approach limits the potential of multi-dataset pretraining.…

Scaling arguments provide valuable analysis tools across physics and complex systems yet are often employed as one generic method, without explicit reference to the various mathematical concepts underlying them. A careful understanding of…

General Physics · Physics 2021-06-16 Marc Timme , Malte Schröder

We developed a novel approach to identification and model testing in linear structural equation models (SEMs) based on auxiliary variables (AVs), which generalizes a widely-used family of methods known as instrumental variables. The…

Methodology · Statistics 2019-10-09 Bryant Chen , Daniel Kumor , Elias Bareinboim

Three distinct phenomena complicate statistical causal analysis: latent common causes, causal cycles, and latent selection. Foundational works on Structural Causal Models (SCMs), e.g., Bongers et al. (2021, Ann. Stat., 49(5): 2885-2915),…

Methodology · Statistics 2025-11-23 Leihao Chen , Onno Zoeter , Joris M. Mooij

This work addresses the challenge of providing consistent explanations for predictive models in the presence of model indeterminacy, which arises due to the existence of multiple (nearly) equally well-performing models for a given dataset…

Machine Learning · Computer Science 2023-06-14 Dan Ley , Leonard Tang , Matthew Nazari , Hongjin Lin , Suraj Srinivas , Himabindu Lakkaraju

We introduce a novel framework for causal explanations of stochastic, sequential decision-making systems built on the well-studied structural causal model paradigm for causal reasoning. This single framework can identify multiple,…

Artificial Intelligence · Computer Science 2023-01-12 Samer B. Nashed , Saaduddin Mahmud , Claudia V. Goldman , Shlomo Zilberstein

As language models (LMs) deliver increasing performance on a range of NLP tasks, probing classifiers have become an indispensable technique in the effort to better understand their inner workings. A typical setup involves (1) defining an…

Computation and Language · Computer Science 2024-08-01 Charles Jin , Martin Rinard

Heterogeneous graph neural networks have become popular in various domains. However, their generalizability and interpretability are limited due to the discrepancy between their inherent inference flows and human reasoning logic or…

Machine Learning · Computer Science 2023-12-12 Tianqianjin Lin , Kaisong Song , Zhuoren Jiang , Yangyang Kang , Weikang Yuan , Xurui Li , Changlong Sun , Cui Huang , Xiaozhong Liu

This paper considers the problem of invoking auxiliary, unobservable variables to facilitate the structuring of causal tree models for a given set of continuous variables. Paralleling the treatment of bi-valued variables in [Pearl 1986], we…

Artificial Intelligence · Computer Science 2013-04-11 Lei Xu , Judea Pearl

Event Structures (ESs) address the representation of direct relationships between individual events, usually capturing the notions of causality and conflict. Up to now, such relationships have been static, i.e., they cannot change during a…

Logic in Computer Science · Computer Science 2023-06-22 Youssef Arbach , David S. Karcher , Kirstin Peters , Uwe Nestmann

Explaining AI systems is fundamental both to the development of high performing models and to the trust placed in them by their users. The Shapley framework for explainability has strength in its general applicability combined with its…

Machine Learning · Statistics 2021-12-21 Christopher Frye , Colin Rowat , Ilya Feige

Causality plays an important role in understanding intelligent behavior, and there is a wealth of literature on mathematical models for causality, most of which is focused on causal graphs. Causal graphs are a powerful tool for a wide range…

Artificial Intelligence · Computer Science 2024-12-23 Scott Garrabrant , Matthias Georg Mayer , Magdalena Wache , Leon Lang , Sam Eisenstat , Holger Dell