English
Related papers

Related papers: How Reliable are Causal Probing Interventions?

200 papers

Causal disentanglement aims to learn about latent causal factors behind data, holding the promise to augment existing representation learning methods in terms of interpretability and extrapolation. Recent advances establish identifiability…

Machine Learning · Computer Science 2024-12-25 Ryan Welch , Jiaqi Zhang , Caroline Uhler

Identifying cause-effect relations among variables is a key step in the decision-making process. While causal inference requires randomized experiments, researchers and policymakers are increasingly using observational studies to test…

Optimization and Control · Mathematics 2021-11-22 Md Saiful Islam , Md Sarowar Morshed , Md. Noor-E-Alam

The goal of causal inference is to understand the outcome of alternative courses of action. However, all causal inference requires assumptions. Such assumptions can be more influential than in typical tasks for probabilistic modeling, and…

Methodology · Statistics 2016-10-31 Dustin Tran , Francisco J. R. Ruiz , Susan Athey , David M. Blei

To make effective decisions, it is important to have a thorough understanding of the causal relationships among actions, environments, and outcomes. This review aims to surface three crucial aspects of decision-making through a causal lens:…

Machine Learning · Statistics 2026-04-22 Lin Ge , Hengrui Cai , Runzhe Wan , Yang Xu , Rui Song

Machine Learning explainability techniques have been proposed as a means of `explaining' or interrogating a model in order to understand why a particular decision or prediction has been made. Such an ability is especially important at a…

Machine Learning · Statistics 2022-02-28 Matthew J. Vowels

Understanding causality helps to structure interventions to achieve specific goals and enables predictions under interventions. With the growing importance of learning causal relationships, causal discovery tasks have transitioned from…

Machine Learning · Computer Science 2022-09-15 Hang Chen , Keqing Du , Xinyu Yang , Chenguang Li

Causal reasoning capability is critical in advancing large language models (LLMs) toward strong artificial intelligence. While versatile LLMs appear to have demonstrated capabilities in understanding contextual causality and providing…

Artificial Intelligence · Computer Science 2025-06-30 Haoang Chi , He Li , Wenjing Yang , Feng Liu , Long Lan , Xiaoguang Ren , Tongliang Liu , Bo Han

We study causal representation learning, the task of inferring latent causal variables and their causal relations from high-dimensional mixtures of the variables. Prior work relies on weak supervision, in the form of counterfactual pre- and…

Causality lays the foundation for the trajectory of our world. Causal inference (CI), which aims to infer intrinsic causal relations among variables of interest, has emerged as a crucial research topic. Nevertheless, the lack of observation…

Machine Learning · Computer Science 2024-06-21 Yaochen Zhu , Yinhan He , Jing Ma , Mengxuan Hu , Sheng Li , Jundong Li

Prompt-based probing has been widely used in evaluating the abilities of pretrained language models (PLMs). Unfortunately, recent studies have discovered such an evaluation may be inaccurate, inconsistent and unreliable. Furthermore, the…

Computation and Language · Computer Science 2022-03-24 Boxi Cao , Hongyu Lin , Xianpei Han , Fangchao Liu , Le Sun

Evaluating the causal effect of recommendations is an important objective because the causal effect on user interactions can directly leads to an increase in sales and user engagement. To select an optimal recommendation model, it is common…

Machine Learning · Computer Science 2021-07-16 Masahiro Sato

Causal discovery procedures aim to deduce causal relationships among variables in a multivariate dataset. While various methods have been proposed for estimating a single causal model or a single equivalence class of models, less attention…

Methodology · Statistics 2024-10-08 Y. Samuel Wang , Mladen Kolar , Mathias Drton

Causal learning is the cognitive process of developing the capability of making causal inferences based on available information, often guided by normative principles. This process is prone to errors and biases, such as the illusion of…

Faithful evaluation of language model capabilities is crucial for deriving actionable insights that can inform model development. However, rigorous causal evaluations in this domain face significant methodological challenges, including…

Machine Learning · Computer Science 2025-06-13 Jikai Jin , Vasilis Syrgkanis , Sham Kakade , Hanlin Zhang

Probing experiments investigate the extent to which neural representations make properties -- like part-of-speech -- predictable. One suggests that a representation encodes a property if probing that representation produces higher accuracy…

Computation and Language · Computer Science 2021-09-21 John Hewitt , Kawin Ethayarajh , Percy Liang , Christopher D. Manning

Causal inference is a science with multi-disciplinary evolution and applications. On the one hand, it measures effects of treatments in observational data based on experimental designs and rigorous statistical inference to draw causal…

Methodology · Statistics 2022-09-05 Jingying Zeng , Run Wang

Randomized controlled trials are a cornerstone of medicine and the social sciences as they enable reliable estimates of causal effects. However, they are costly and time-consuming to conduct, motivating interest in predicting causal effects…

Causal Bayesian networks are 'causal' models since they make predictions about interventional distributions. To connect such causal model predictions to real-world outcomes, we must determine which actions in the world correspond to which…

Machine Learning · Statistics 2025-02-04 Frederik Hytting Jørgensen , Luigi Gresele , Sebastian Weichwald

Causal disentanglement aims to uncover a representation of data using latent variables that are interrelated through a causal model. Such a representation is identifiable if the latent model that explains the data is unique. In this paper,…

A fundamental challenge in causal inference with observational data is correct specification of a causal model. When there is model uncertainty, analysts may seek to use estimates from multiple candidate models that rely on distinct, and…

Methodology · Statistics 2026-03-03 Rohit Bhattacharya , Ina Ocelli , Ted Westling