English
Related papers

Related papers: Formally Justifying MDL-based Inference of Cause a…

200 papers

The principle of independent causal mechanisms (ICM) states that generative processes of real world data consist of independent modules which do not influence or inform each other. While this idea has led to fruitful developments in the…

Computation and Language · Computer Science 2021-10-20 Zhijing Jin , Julius von Kügelgen , Jingwei Ni , Tejas Vaidhya , Ayush Kaushal , Mrinmaya Sachan , Bernhard Schölkopf

In this paper a conditional logic is defined and studied. This conditional logic, DmBL, is constructed as close as possible to the Bayesian and is unrestricted, that is one is able to use any operator without restriction. A notion of…

Logic · Mathematics 2016-09-07 Frederic Dambreville

Estimating causal interactions in complex dynamical systems is an important problem encountered in many fields of current science. While a theoretical solution for detecting the causal interactions has been previously formulated in the…

Data Analysis, Statistics and Probability · Physics 2020-01-20 Jakub Kořenek , Jaroslav Hlinka

Most traditional models of uncertainty have focused on the associational relationship among variables as captured by conditional dependence. In order to successfully manage intelligent systems for decision making, however, we must be able…

Artificial Intelligence · Computer Science 2015-05-19 David Heckerman , Ross D. Shachter

We present an extension of Logic Programming (under stable models semantics) that, not only allows concluding whether a true atom is a cause of another atom, but also deriving new conclusions from these causal-effect relations. This is…

Logic in Computer Science · Computer Science 2016-08-03 Jorge Fandinno

This paper shows that conditional independence reasoning can be applied to optimize epistemic model checking, in which one verifies that a model for a number of agents operating with imperfect information satisfies a formula expressed in a…

Logic in Computer Science · Computer Science 2017-07-28 Ron van der Meyden

At the heart of causal structure learning from observational data lies a deceivingly simple question: given two statistically dependent random variables, which one has a causal effect on the other? This is impossible to answer using…

Machine Learning · Computer Science 2020-10-13 Nikolaos Nikolaou , Konstantinos Sechidis

We introduce a causal modeling framework that captures the input-output behavior of predictive models (e.g., machine learning models). The framework enables us to identify features that directly cause the predictions, which has broad…

Machine Learning · Computer Science 2025-05-20 Yizuo Chen , Amit Bhatia

We analyze differences between two information-theoretically motivated approaches to statistical inference and model selection: the Minimum Description Length (MDL) principle, and the Minimum Message Length (MML) principle. Based on this…

Machine Learning · Computer Science 2013-02-01 Peter D Grunwald , Petri Kontkanen , Petri Myllymaki , Tomi Silander , Henry Tirri

Causal inference revealing causal dependencies between variables from empirical data has found applications in multiple sub-fields of scientific research. A quantum perspective of correlations holds the promise of overcoming the limitation…

We propose a simple yet effective use of LLM-powered AI tools to improve causal estimation. In double machine learning, the accuracy of causal estimates of the effect of a treatment on an outcome in the presence of a high-dimensional…

Machine Learning · Computer Science 2025-10-14 Chris Engh , P. M. Aronow

The postulate of independence of cause and mechanism (ICM) has recently led to several new causal discovery algorithms. The interpretation of independence and the way it is utilized, however, varies across these methods. Our aim in this…

Machine Learning · Statistics 2017-05-08 Michel Besserve , Naji Shajarisales , Bernhard Schölkopf , Dominik Janzing

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most…

Machine Learning · Computer Science 2022-04-01 Sainyam Galhotra , Karthikeyan Shanmugam , Prasanna Sattigeri , Kush R. Varshney

Independence and conditional independence are fundamental concepts for reasoning about groups of random variables in probabilistic programs. Verification methods for independence are still nascent, and existing methods cannot handle…

Logic in Computer Science · Computer Science 2021-05-04 Jialu Bao , Simon Docherty , Justin Hsu , Alexandra Silva

Scientific discovery catalyzes human intellectual advances, driven by the cycle of hypothesis generation, experimental design, evaluation, and assumption refinement. Central to this process is causal inference, uncovering the mechanisms…

Machine Learning · Computer Science 2025-09-26 Ivaxi Sheth , Sahar Abdelnabi , Mario Fritz

Real world decision-making requires constructing mental models under uncertainty over evidence, over the underlying causal rules, and over the state of the world itself. Which computational principles underpin human inference under such…

Artificial Intelligence · Computer Science 2026-05-26 Jeffrey Qin , Wasu Top Piriyakulki , Zhuangfei Gao , Mia Radovanovic , Jessica Sommerville , Kevin Ellis , Marta Kryven

This paper discusses the fundamental principles of causal inference - the area of statistics that estimates the effect of specific occurrences, treatments, interventions, and exposures on a given outcome from experimental and observational…

Methodology · Statistics 2021-12-03 Francesca Dominici , Falco J. Bargagli-Stoffi , Fabrizia Mealli

Causal relationships play a fundamental role in understanding the world around us. The ability to identify and understand cause-effect relationships is critical to making informed decisions, predicting outcomes, and developing effective…

Statistical Mechanics · Physics 2025-09-10 Sergio Chibbaro , Cyril Furtlehner , Théo Marchetta , Andrei-Tiberiu Pantea , Davide Rossetti

In-context learning (ICL) enables multimodal large language models (MLLMs) to classify images from a few labelled examples. Yet, how these models use the provided context remains opaque. While Chain-of-Thought prompting is widely used,…

Artificial Intelligence · Computer Science 2026-05-28 Carmen Quiles-Ramírez , Leticia L. Rodríguez , Nicolás Martorell , Natalia Díaz-Rodríguez

Double (debiased) machine learning (DML) has seen widespread use in recent years for learning causal/structural parameters, in part due to its flexibility and adaptability to high-dimensional nuisance functions as well as its ability to…

Methodology · Statistics 2024-09-12 Abhinandan Dalal , Patrick Blöbaum , Shiva Kasiviswanathan , Aaditya Ramdas