English
Related papers

Related papers: Causal Discovery using Compression-Complexity Meas…

200 papers

If $X,Y,Z$ denote sets of random variables, two different data sources may contain samples from $P_{X,Y}$ and $P_{Y,Z}$, respectively. We argue that causal discovery can help inferring properties of the `unobserved joint distributions'…

Machine Learning · Statistics 2023-05-12 Dominik Janzing , Philipp M. Faller , Leena Chennuru Vankadara

We propose a novel framework that leverages LLMs for full causal graph discovery. While previous LLM-based methods have used a pairwise query approach, this requires a quadratic number of queries which quickly becomes impractical for larger…

Machine Learning · Computer Science 2026-04-06 Thomas Jiralerspong , Xiaoyin Chen , Yash More , Vedant Shah , Yoshua Bengio

Causal knowledge extraction is the task of extracting relevant causes and effects from text by detecting the causal relation. Although this task is important for language understanding and knowledge discovery, recent works in this domain…

Computation and Language · Computer Science 2023-08-09 Anik Saha , Oktie Hassanzadeh , Alex Gittens , Jian Ni , Kavitha Srinivas , Bulent Yener

Deep generative models have shown tremendous capability in data density estimation and data generation from finite samples. While these models have shown impressive performance by learning correlations among features in the data, some…

Machine Learning · Computer Science 2024-05-24 Aneesh Komanduri , Xintao Wu , Yongkai Wu , Feng Chen

Causal discovery methods seek to identify causal relations between random variables from purely observational data, as opposed to actively collected experimental data where an experimenter intervenes on a subset of correlates. One of the…

Machine Learning · Computer Science 2021-02-08 Samir Wadhwa , Roy Dong

Causal discovery from observational data is an important tool in many branches of science. Under certain assumptions it allows scientists to explain phenomena, predict, and make decisions. In the large sample limit, sound and complete…

Machine Learning · Statistics 2021-07-13 Shami Nisimov , Yaniv Gurwicz , Raanan Y. Rohekar , Gal Novik

The class of problems in causal inference which seeks to isolate causal correlations solely from observational data even without interventions has come to the forefront of machine learning, neuroscience and social sciences. As new large…

Emerging Technologies · Computer Science 2022-01-02 Mohammad Ali Javidian , Vaneet Aggarwal , Fanglin Bao , Zubin Jacob

Much of our experiments are designed to uncover the cause(s) and effect(s) behind a data generating mechanism (i.e., phenomenon) we happen to be interested in. Uncovering such relationships allows us to identify the true working of a…

Machine Learning · Computer Science 2023-07-11 M. Z. Naser

Detecting and measuring confounding effects from data is a key challenge in causal inference. Existing methods frequently assume causal sufficiency, disregarding the presence of unobserved confounding variables. Causal sufficiency is both…

Artificial Intelligence · Computer Science 2024-09-27 Abbavaram Gowtham Reddy , Vineeth N Balasubramanian

We present a novel approach to constraint-based causal discovery, that takes the form of straightforward logical inference, applied to a list of simple, logical statements about causal relations that are derived directly from observed…

Artificial Intelligence · Computer Science 2012-02-20 Tom Claassen , Tom Heskes

Discovering causal direction from temporal observational data is particularly challenging for symbolic sequences, where functional models and noise assumptions are often unavailable. We propose a novel \emph{Dictionary Based Pattern Entropy…

Machine Learning · Statistics 2026-03-06 Harikrishnan N B , Shubham Bhilare , Aditi Kathpalia , Nithin Nagaraj

Scientific discovery catalyzes human intellectual advances, driven by the cycle of hypothesis generation, experimental design, evaluation, and assumption refinement. Central to this process is causal inference, uncovering the mechanisms…

Machine Learning · Computer Science 2025-09-26 Ivaxi Sheth , Sahar Abdelnabi , Mario Fritz

Reasoning based on causality, instead of association has been considered as a key ingredient towards real machine intelligence. However, it is a challenging task to infer causal relationship/structure among variables. In recent years, an…

Machine Learning · Computer Science 2019-09-15 Zhitang Chen , Shengyu Zhu , Yue Liu , Tim Tse

We introduce a causal modeling framework that captures the input-output behavior of predictive models (e.g., machine learning models). The framework enables us to identify features that directly cause the predictions, which has broad…

Machine Learning · Computer Science 2025-05-20 Yizuo Chen , Amit Bhatia

The safe deployment of large language models (LLMs) in high-stakes fields like biomedicine, requires them to be able to reason about cause and effect. We investigate this ability by testing 13 open-source LLMs on a fundamental task:…

Computation and Language · Computer Science 2026-03-13 Sydney Anuyah , Sneha Shajee-Mohan , Ankit-Singh Chauhan , Sunandan Chakraborty

Understanding causal relationships between variables is fundamental across scientific disciplines. Most causal discovery algorithms rely on two key assumptions: (i) all variables are observed, and (ii) the underlying causal graph is…

Machine Learning · Computer Science 2026-01-26 Muralikrishnna G. Sethuraman , Faramarz Fekri

Large language models (LLMs) have triggered a new stream of research focusing on compressing the context length to reduce the computational cost while ensuring the retention of helpful information for LLMs to answer the given question.…

Computation and Language · Computer Science 2024-12-20 Barys Liskavets , Maxim Ushakov , Shuvendu Roy , Mark Klibanov , Ali Etemad , Shane Luke

Many questions in science center around the fundamental problem of understanding causal relationships. However, most constraint-based causal discovery algorithms, including the well-celebrated PC algorithm, often incur an exponential number…

Machine Learning · Computer Science 2024-06-05 Kirankumar Shiragur , Jiaqi Zhang , Caroline Uhler

Given a response $Y$ and a vector $X = (X^1, \dots, X^d)$ of $d$ predictors, we investigate the problem of inferring direct causes of $Y$ among the vector $X$. Models for $Y$ that use all of its causal covariates as predictors enjoy the…

Statistics Theory · Mathematics 2020-03-12 Rune Christiansen , Jonas Peters

Many frameworks exist to infer cause and effect relations in complex nonlinear systems but a complete theory is lacking. A new framework is presented that is fully nonlinear, provides a complete information theoretic disentanglement of…

Methodology · Statistics 2022-01-12 Peter Jan van Leeuwen , Michael DeCaria , Nachiketa Chakaborty , Manuel Pulido