English
Related papers

Related papers: Telling Cause from Effect using MDL-based Local an…

200 papers

We consider the problem of identifying the causal direction between two discrete random variables using observational data. Unlike previous work, we keep the most general functional model but make an assumption on the unobserved exogenous…

Artificial Intelligence · Computer Science 2016-11-16 Murat Kocaoglu , Alexandros G. Dimakis , Sriram Vishwanath , Babak Hassibi

Inferring causal directions on discrete and categorical data is an important yet challenging problem. Even though the additive noise models (ANMs) approach can be adapted to the discrete data, the functional structure assumptions make it…

Machine Learning · Statistics 2021-09-02 Austin Goddard , Yu Xiang

Evaluating the causal effect of an intervention on multivariate outcomes is challenging when the outcomes are interdependent and derived rather than directly observed. Effective connectivity, which summarizes the directional neural…

Methodology · Statistics 2026-04-02 Haiyue Song , Ani Eloyan , Youjin Lee

This paper discusses the problem of causal query in observational data with hidden variables, with the aim of seeking the change of an outcome when "manipulating" a variable while given a set of plausible confounding variables which affect…

Artificial Intelligence · Computer Science 2020-11-25 Debo Cheng , Jiuyong Li , Lin Liu , Jixue Liu , Kui Yu , Thuc Duy Le

It is a long-standing question to discover causal relations among a set of variables in many empirical sciences. Recently, Reinforcement Learning (RL) has achieved promising results in causal discovery from observational data. However,…

Machine Learning · Computer Science 2021-09-16 Xiaoqiang Wang , Yali Du , Shengyu Zhu , Liangjun Ke , Zhitang Chen , Jianye Hao , Jun Wang

Symbolic regression is a fundamental tool for discovering interpretable mathematical expressions from data, with broad applications across scientific and engineering domains. Recently, large language models (LLMs) have demonstrated strong…

Machine Learning · Computer Science 2025-06-06 Runxiang Wang , Boxiao Wang , Kai Li , Yifan Zhang , Jian Cheng

Two-sample testing is a fundamental problem in statistics. Despite its long history, there has been renewed interest in this problem with the advent of high-dimensional and complex data. Specifically, in the machine learning literature,…

Methodology · Statistics 2019-11-19 Ilmun Kim , Ann B. Lee , Jing Lei

In this paper we consider the linear regression model $Y =S X+\varepsilon $ with functional regressors and responses. We develop new inference tools to quantify deviations of the true slope $S$ from a hypothesized operator $S_0$ with…

Statistics Theory · Mathematics 2021-08-17 Tim Kutta , Gauthier Dierickx , Holger Dette

Learning causal relationships between pairs of complex traits from observational studies is of great interest across various scientific domains. However, most existing methods assume the absence of unmeasured confounding and restrict causal…

Methodology · Statistics 2024-07-17 Wei Li , Rui Duan , Sai Li

Supervised machine learning (ML) and deep learning (DL) algorithms excel at predictive tasks, but it is commonly assumed that they often do so by exploiting non-causal correlations, which may limit both interpretability and…

Machine Learning · Statistics 2023-06-21 Maximilian Pichler , Florian Hartig

Causal relationships play a fundamental role in understanding the world around us. The ability to identify and understand cause-effect relationships is critical to making informed decisions, predicting outcomes, and developing effective…

Statistical Mechanics · Physics 2025-09-10 Sergio Chibbaro , Cyril Furtlehner , Théo Marchetta , Andrei-Tiberiu Pantea , Davide Rossetti

The relationship between the Bayesian approach and the minimum description length approach is established. We sharpen and clarify the general modeling principles MDL and MML, abstracted as the ideal MDL principle and defined from Bayes's…

Machine Learning · Computer Science 2007-07-16 Paul Vitanyi , Ming Li

Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the model with smallest…

Machine Learning · Computer Science 2025-09-23 Spencer Compton , Kristjan Greenewald , Dmitriy Katz , Murat Kocaoglu

We are interested in learning causal relationships between pairs of random variables, purely from observational data. To effectively address this task, the state-of-the-art relies on strong assumptions regarding the mechanisms mapping…

Machine Learning · Statistics 2014-09-16 David Lopez-Paz , Krikamol Muandet , Benjamin Recht

In the Minimum Description Length (MDL) principle, learning from the data is equivalent to an optimal coding problem. We show that the codes that achieve optimal compression in MDL are critical in a very precise sense. First, when they are…

Methodology · Statistics 2018-10-03 Ryan John Cubero , Matteo Marsili , Yasser Roudi

In modeling multivariate time series for either forecast or policy analysis, it would be beneficial to have figured out the cause-effect relations within the data. Regression analysis, however, is generally for correlation relation, and…

Machine Learning · Statistics 2021-11-23 Xingwei Hu

Causal discovery methods aim to determine the causal direction between variables using observational data. Functional causal discovery methods, such as those based on the Linear Non-Gaussian Acyclic Model (LiNGAM), rely on structural and…

Methodology · Statistics 2024-09-27 Shreya Prakash , Fan Xia , Elena Erosheva

Identifying the causal relationship among variables from observational data is an important yet challenging task. This work focuses on identifying the direct causes of an outcome and estimating their magnitude, i.e., learning the causal…

Methodology · Statistics 2026-01-08 Zhenyu Wang , Yifan Hu , Peter Bühlmann , Zijian Guo

Learning the structure of Bayesian networks and causal relationships from observations is a common goal in several areas of science and technology. We show that the prequential minimum description length principle (MDL) can be used to…

Machine Learning · Computer Science 2021-07-13 Jorg Bornschein , Silvia Chiappa , Alan Malek , Rosemary Nan Ke

Uncovering cause-effect relationships from observational time series is fundamental to understanding complex systems. While many methods infer static causal graphs, real-world systems often exhibit dynamic causality-where relationships…

Machine Learning · Computer Science 2025-11-06 Tingzhu Bi , Yicheng Pan , Xinrui Jiang , Huize Sun , Meng Ma , Ping Wang