English
Related papers

Related papers: Towards Causal Foundation Model: on Duality betwee…

200 papers

Causal influence measures for machine learnt classifiers shed light on the reasons behind classification, and aid in identifying influential input features and revealing their biases. However, such analyses involve evaluating the classifier…

Machine Learning · Computer Science 2018-04-10 Shayak Sen , Piotr Mardziel , Anupam Datta , Matthew Fredrikson

Attention mechanism has demonstrated great potential in fine-grained visual recognition tasks. In this paper, we present a counterfactual attention learning method to learn more effective attention based on causal inference. Unlike most…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Yongming Rao , Guangyi Chen , Jiwen Lu , Jie Zhou

Behavioral cloning reduces policy learning to supervised learning by training a discriminative model to predict expert actions given observations. Such discriminative models are non-causal: the training procedure is unaware of the causal…

Machine Learning · Computer Science 2019-11-05 Pim de Haan , Dinesh Jayaraman , Sergey Levine

The notion of causality assumes a paramount position within the realm of human cognition. Over the past few decades, there has been significant advancement in the domain of causal effect estimation across various disciplines, including but…

Machine Learning · Statistics 2024-05-24 Zongyu Li , Xiaobo Guo , Siwei Qiang

Imitation learning is a powerful approach for learning autonomous driving policy by leveraging data from expert driver demonstrations. However, driving policies trained via imitation learning that neglect the causal structure of expert…

Causal Machine Learning has emerged as a powerful tool for flexibly estimating causal effects from observational data in both industry and academia. However, causal inference from observational data relies on untestable assumptions about…

We propose a causal interpretation of self-attention in the Transformer neural network architecture. We interpret self-attention as a mechanism that estimates a structural equation model for a given input sequence of symbols (tokens). The…

Artificial Intelligence · Computer Science 2023-11-01 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov

Classical machine learning techniques often struggle with overfitting and unreliable predictions when exposed to novel conditions. Introducing causality into the modelling process offers a promising way to mitigate these challenges by…

Computational Engineering, Finance, and Science · Computer Science 2025-05-28 David Zapata Gonzalez , Marcel Meyer , Oliver Mueller

Inferring the effect of interventions within complex systems is a fundamental problem of statistics. A widely studied approach employs structural causal models that postulate noisy functional relations among a set of interacting variables.…

Methodology · Statistics 2024-02-14 David Strieder , Mathias Drton

Inferring causal effects of a treatment, intervention or policy from observational data is central to many applications. However, state-of-the-art methods for causal inference seldom consider the possibility that covariates have missing…

Methodology · Statistics 2020-02-26 Imke Mayer , Julie Josse , Félix Raimundo , Jean-Philippe Vert

Causal inference is the process of using assumptions, study designs, and estimation strategies to draw conclusions about the causal relationships between variables based on data. This allows researchers to better understand the underlying…

Machine Learning · Computer Science 2022-12-13 Anpeng Wu , Kun Kuang , Ruoxuan Xiong , Fei Wu

Estimation of causal effects is critical to a range of scientific disciplines. Existing methods for this task either require interventional data, knowledge about the ground truth causal graph, or rely on assumptions such as…

Machine Learning · Computer Science 2025-11-21 Jake Robertson , Arik Reuter , Siyuan Guo , Noah Hollmann , Frank Hutter , Bernhard Schölkopf

Most algorithms in classical and contemporary machine learning focus on correlation-based dependence between features to drive performance. Although success has been observed in many relevant problems, these algorithms fail when the…

Machine Learning · Computer Science 2021-10-26 Moritz Willig , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

In many fields$\unicode{x2013}$including genomics, epidemiology, natural language processing, social and behavioral sciences, and economics$\unicode{x2013}$it is increasingly important to address causal questions in the context of factor…

Methodology · Statistics 2025-06-30 Jenna M. Landy , Dafne Zorzetto , Roberta De Vito , Giovanni Parmigiani

The paper reviews methods that seek to draw causal inference from observational data and demonstrates how they can be applied to empirical problems in engineering research. It presents a framework for causal identification based on the…

Applications · Statistics 2022-11-28 Daniel J Graham

As systems are getting more autonomous with the development of artificial intelligence, it is important to discover the causal knowledge from observational sensory inputs. By encoding a series of cause-effect relations between events,…

Machine Learning · Computer Science 2020-01-16 Yuhao Wang , Vlado Menkovski , Hao Wang , Xin Du , Mykola Pechenizkiy

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most…

Machine Learning · Computer Science 2022-04-01 Sainyam Galhotra , Karthikeyan Shanmugam , Prasanna Sattigeri , Kush R. Varshney

This dissertation focuses on modern causal inference under uncertainty and data restrictions, with applications to neoadjuvant clinical trials, distributed data networks, and robust individualized decision making. In the first project, we…

Methodology · Statistics 2023-01-24 Xiaoqing Tan

Unobserved confounding is a fundamental challenge for estimating causal effects. To address unobserved confounding, recent literature has turned to two different approaches -- proxy variables and the use of multiple treatments. The first…

Methodology · Statistics 2026-05-20 Aytijhya Saha , Stephen Bates , Devavrat Shah

Causal inference has gained much popularity in recent years, with interests ranging from academic, to industrial, to educational, and all in between. Concurrently, the study and usage of neural networks has also grown profoundly (albeit at…

Machine Learning · Statistics 2024-05-07 Demetrios Papakostas , Andrew Herren , P. Richard Hahn , Francisco Castillo