English
Related papers

Related papers: We Are Not Your Real Parents: Telling Causal from …

200 papers

We introduce a method to determine if a certain capability helps to achieve an accurate model of given data. We view labels as being generated from the inputs by a program composed of subroutines with different capabilities, and we posit…

Machine Learning · Computer Science 2021-03-08 Ethan Perez , Douwe Kiela , Kyunghyun Cho

In the Minimum Description Length (MDL) principle, learning from the data is equivalent to an optimal coding problem. We show that the codes that achieve optimal compression in MDL are critical in a very precise sense. First, when they are…

Methodology · Statistics 2018-10-03 Ryan John Cubero , Matteo Marsili , Yasser Roudi

Latent or unobserved phenomena pose a significant difficulty in data analysis as they induce complicated and confounding dependencies among a collection of observed variables. Factor analysis is a prominent multivariate statistical modeling…

Methodology · Statistics 2020-06-22 Armeen Taeb , Venkat Chandrasekaran

Unobserved confounding is a fundamental challenge for estimating causal effects. To address unobserved confounding, recent literature has turned to two different approaches -- proxy variables and the use of multiple treatments. The first…

Methodology · Statistics 2026-05-20 Aytijhya Saha , Stephen Bates , Devavrat Shah

Revealing the underlying causal mechanisms in the real world is crucial for scientific and technological progress. Despite notable advances in recent decades, the lack of high-quality data and the reliance of traditional causal discovery…

Machine Learning · Computer Science 2026-02-17 Huaming Du , Tao Hu , Yijie Huang , Yu Zhao , Guisong Liu , Tao Gu , Gang Kou , Carl Yang

We generalize the proximal g-formula of Miao, Geng, and Tchetgen Tchetgen (2018) for causal inference under unobserved confounding using proxy variables. Specifically, we show that the formula holds true for all causal models in a certain…

Methodology · Statistics 2020-12-15 Nikos Vlassis , Phil Hebda , Stephan McBride , Athanasios Noulas

The Minimum Description Length (MDL) principle selects the model that has the shortest code for data plus model. We show that for a countable class of models, MDL predictions are close to the true distribution in a strong sense. The result…

Probability · Mathematics 2010-12-30 Marcus Hutter

The principal stratification has become a popular tool to address a broad class of causal inference questions, particularly in dealing with non-compliance and truncation-by-death problems. The causal effects within principal strata which…

Methodology · Statistics 2022-06-20 Shanshan Luo , Wei Li , Wang Miao , Yangbo He

Unmeasured confounding is a major challenge for identifying causal relationships from non-experimental data. Here, we propose a method that can accommodate unmeasured discrete confounding. Extending recent identifiability results in deep…

Machine Learning · Computer Science 2024-08-13 Patrick Burauel , Frederick Eberhardt , Michel Besserve

In settings where ML models are used to inform the allocation of resources, agents affected by the allocation decisions might have an incentive to strategically change their features to secure better outcomes. While prior work has studied…

Causal models have proven extremely useful in offering formal representations of causal relationships between a set of variables. Yet in many situations, there are non-causal relationships among variables. For example, we may want variables…

Artificial Intelligence · Computer Science 2023-01-18 Sander Beckers , Joseph Y. Halpern , Christopher Hitchcock

To measure how well pretrained representations encode some linguistic property, it is common to use accuracy of a probe, i.e. a classifier trained to predict the property from the representations. Despite widespread adoption of probes,…

Computation and Language · Computer Science 2020-03-30 Elena Voita , Ivan Titov

Causal disentanglement aims to learn about latent causal factors behind data, holding the promise to augment existing representation learning methods in terms of interpretability and extrapolation. Recent advances establish identifiability…

Machine Learning · Computer Science 2024-12-25 Ryan Welch , Jiaqi Zhang , Caroline Uhler

We study the identification and estimation of long-term treatment effects when both experimental and observational data are available. Since the long-term outcome is observed only after a long delay, it is not measured in the experimental…

Methodology · Statistics 2024-09-04 Guido Imbens , Nathan Kallus , Xiaojie Mao , Yuhao Wang

We study the task of conducting structured reasoning as generating a reasoning graph from natural language input using large language models (LLMs). Previous approaches have explored various prompting schemes, yet they suffer from error…

Computation and Language · Computer Science 2024-06-04 Inderjeet Nair , Lu Wang

In causal inference, it is a fundamental task to estimate the causal effect from observational data. However, latent confounders pose major challenges in causal inference in observational data, for example, confounding bias and M-bias.…

Machine Learning · Computer Science 2023-12-12 Debo Cheng , Yang Xie , Ziqi Xu , Jiuyong Li , Lin Liu , Jixue Liu , Yinghao Zhang , Zaiwen Feng

Owing to the cross-pollination between causal discovery and deep learning, non-statistical data (e.g., images, text, etc.) encounters significant conflicts in terms of properties and methods with traditional causal data. To unify these data…

Machine Learning · Computer Science 2023-08-14 Hang Chen , Xinyu Yang , Qing Yang

We investigate the estimation of the causal effect of a treatment variable on an outcome in the presence of a latent confounder. We first show that the causal effect is identifiable under certain conditions when data is available from…

Artificial Intelligence · Computer Science 2025-06-16 Yaroslav Kivva , Sina Akbari , Saber Salehkaleybar , Negar Kiyavash

This paper considers an extension of the linear non-Gaussian acyclic model (LiNGAM) that determines the causal order among variables from a dataset when the variables are expressed by a set of linear equations, including noise. In…

Machine Learning · Computer Science 2021-08-17 Joe Suzuki , Yusuke Inaoka

Healthcare data often come from multiple sites in which the correlations between confounding variables can vary widely. If deep learning models exploit these unstable correlations, they might fail catastrophically in unseen sites. Although…

Machine Learning · Computer Science 2023-10-25 Minh Nguyen , Alan Q. Wang , Heejong Kim , Mert R. Sabuncu