English
Related papers

Related papers: Multi-Level Causal Embeddings

200 papers

The concept of causal abstraction got recently popularised to demystify the opaque decision-making processes of machine learning models; in short, a neural network can be abstracted as a higher-level algorithm if there exists a function…

Machine Learning · Computer Science 2025-11-13 Denis Sutter , Julian Minder , Thomas Hofmann , Tiago Pimentel

A common model for question answering (QA) is that a good answer is one that is closely related to the question, where relatedness is often determined using general-purpose lexical models such as word embeddings. We argue that a better…

Computation and Language · Computer Science 2016-09-27 Rebecca Sharp , Mihai Surdeanu , Peter Jansen , Peter Clark , Michael Hammond

Causal abstraction provides a theory describing how several causal models can represent the same system at different levels of detail. Existing theoretical proposals limit the analysis of abstract models to "hard" interventions fixing…

Artificial Intelligence · Computer Science 2022-11-23 Riccardo Massidda , Atticus Geiger , Thomas Icard , Davide Bacciu

We explore in depth how categorical data can be processed with embeddings in the context of claim severity modeling. We develop several models that range in complexity from simple neural networks to state-of-the-art attention based…

Applications · Statistics 2021-04-09 Kevin Kuo , Ronald Richman

We present a domain-general account of causation that applies to settings in which macro-level causal relations between two systems are of interest, but the relevant causal features are poorly understood and have to be aggregated from vast…

Machine Learning · Statistics 2015-12-29 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

We describe the interface between measure theoretic probability and causal inference by constructing causal models on probability spaces within the potential outcomes framework. We find that measure theory provides a precise and instructive…

Statistics Theory · Mathematics 2019-07-04 Irineo Cabreros , John D. Storey

Explanations of cognitive behavior often appeal to computations over representations. What does it take for a system to implement a given computation over suitable representational vehicles within that system? We argue that the language of…

Machine Learning · Computer Science 2025-08-18 Atticus Geiger , Jacqueline Harding , Thomas Icard

In many applications, there is a need to predict the effect of an intervention on different individuals from data. For example, which customers are persuadable by a product promotion? which patients should be treated with a certain type of…

Machine Learning · Computer Science 2021-03-16 Jiuyong Li , Weijia Zhang , Lin Liu , Kui Yu , Thuc Duy Le , Jixue Liu

Identifying the effect of a treatment from observational data typically requires assuming a fully specified causal diagram. However, such diagrams are rarely known in practice, especially in complex or high-dimensional settings. To overcome…

Artificial Intelligence · Computer Science 2025-07-09 Clément Yvernes , Emilie Devijver , Marianne Clausel , Eric Gaussier

Recent years have seen rapid progress at the intersection between causality and machine learning. Motivated by scientific applications involving high-dimensional data, in particular in biomedicine, we propose a deep neural architecture for…

Machine Learning · Computer Science 2022-12-12 Kai Lagemann , Christian Lagemann , Bernd Taschler , Sach Mukherjee

Structural-equations models (SEMs) are perhaps the most commonly used framework for modeling causality. However, as we show, naively extending this framework to infinitely many variables, which is necessary, for example, to model dynamical…

Artificial Intelligence · Computer Science 2021-12-20 Spencer Peters , Joseph Y. Halpern

Causal representation learning (CRL) enhances machine learning models' robustness and generalizability by learning structural causal models associated with data-generating processes. We focus on a family of CRL methods that uses contrastive…

Machine Learning · Statistics 2025-03-17 Xiusi Li , Sékou-Oumar Kaba , Siamak Ravanbakhsh

Causal abstraction provides a theoretical foundation for mechanistic interpretability, the field concerned with providing intelligible algorithms that are faithful simplifications of the known, but opaque low-level details of black box AI…

Causal artificial intelligence aims to enhance explainability, trustworthiness, and robustness in AI by leveraging structural causal models (SCMs). In this pursuit, recent advances formalize network sheaves and cosheaves of causal…

Machine Learning · Computer Science 2026-02-04 Gabriele D'Acunto , Paolo Di Lorenzo , Sergio Barbarossa

The aim of this paper is to offer the first systematic exploration and definition of equivalent causal models in the context where both models are not made up of the same variables. The idea is that two models are equivalent when they agree…

Artificial Intelligence · Computer Science 2020-12-11 Sander Beckers

Causal Models are like Dependency Graphs and Belief Nets in that they provide a structure and a set of assumptions from which a joint distribution can, in principle, be computed. Unlike Dependency Graphs, Causal Models are models of…

Artificial Intelligence · Computer Science 2013-03-08 John F. Lemmer

In many problems, the measured variables (e.g., image pixels) are just mathematical functions of the latent causal variables (e.g., the underlying concepts or objects). For the purpose of making predictions in changing environments or…

Machine Learning · Computer Science 2024-08-13 Kun Zhang , Shaoan Xie , Ignavier Ng , Yujia Zheng

The proposed method extends upon the representational output of semantic instance segmentation by explicitly including both visible and occluded parts. A fully convolutional network is trained to produce consistent pixel-level embedding…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Yanfeng Liu , Eric Psota , Lance Pérez

Causal inference is a science with multi-disciplinary evolution and applications. On the one hand, it measures effects of treatments in observational data based on experimental designs and rigorous statistical inference to draw causal…

Methodology · Statistics 2022-09-05 Jingying Zeng , Run Wang

Consensus clustering fuses diverse basic partitions (i.e., clustering results obtained from conventional clustering methods) into an integrated one, which has attracted increasing attention in both academic and industrial areas due to its…

Machine Learning · Computer Science 2019-06-04 Hongfu Liu , Zhiqiang Tao , Zhengming Ding