English
Related papers

Related papers: Causal Entropy and Information Gain for Measuring …

200 papers

Causal inference often hinges on strong assumptions - such as no unmeasured confounding or perfect compliance - that are rarely satisfied in practice. Partial identification offers a principled alternative: instead of relying on…

Machine Learning · Computer Science 2025-08-20 Tobias Maringgele

The class of problems in causal inference which seeks to isolate causal correlations solely from observational data even without interventions has come to the forefront of machine learning, neuroscience and social sciences. As new large…

Emerging Technologies · Computer Science 2022-01-02 Mohammad Ali Javidian , Vaneet Aggarwal , Fanglin Bao , Zubin Jacob

In classical information theory, a causal relationship between two variables is typically modelled by assuming that, for every possible state of one of the variables, there exists a particular distribution of states of the second variable.…

Information Theory · Computer Science 2023-02-28 Joel R. Peck , David Waxman

Explaining machine learning (ML) predictions has become crucial as ML models are increasingly deployed in high-stakes domains such as healthcare. While SHapley Additive exPlanations (SHAP) is widely used for model interpretability, it fails…

Machine Learning · Computer Science 2025-09-03 Woon Yee Ng , Li Rong Wang , Siyuan Liu , Xiuyi Fan

Causal inference is the process of using assumptions, study designs, and estimation strategies to draw conclusions about the causal relationships between variables based on data. This allows researchers to better understand the underlying…

Machine Learning · Computer Science 2022-12-13 Anpeng Wu , Kun Kuang , Ruoxuan Xiong , Fei Wu

The analysis of temporal networks heavily depends on the analysis of time-respecting paths. However, before being able to model and analyze the time-respecting paths, we have to infer the timescales at which the temporal edges influence…

Physics and Society · Physics 2023-01-30 Luka V. Petrović , Anatol Wegner , Ingo Scholtes

Modern Artificial Intelligence achieves remarkable predictive power by optimizing statistical risk functionals over vast corpora. Yet a gap separates this from genuine intelligence: the inability to distinguish correlation from causation.…

Machine Learning · Statistics 2026-05-26 Ernest Fokoué

Learning about cause and effect is arguably the main goal in applied econometrics. In practice, the validity of these causal inferences is contingent on a number of critical assumptions regarding the type of data that has been collected and…

Econometrics · Economics 2023-03-03 Paul Hünermund , Elias Bareinboim

When a machine-learning algorithm makes biased decisions, it can be helpful to understand the sources of disparity to explain why the bias exists. Towards this, we examine the problem of quantifying the contribution of each individual…

Machine Learning · Computer Science 2022-06-20 Sanghamitra Dutta , Praveen Venkatesh , Pulkit Grover

The abundance of data produced daily from large variety of sources has boosted the need of novel approaches on causal inference analysis from observational data. Observational data often contain noisy or missing entries. Moreover, causal…

Methodology · Statistics 2017-03-14 Fani Tsapeli , Peter Tino , Mirco Musolesi

Causal influence measures for machine learnt classifiers shed light on the reasons behind classification, and aid in identifying influential input features and revealing their biases. However, such analyses involve evaluating the classifier…

Machine Learning · Computer Science 2018-04-10 Shayak Sen , Piotr Mardziel , Anupam Datta , Matthew Fredrikson

The convenient access to copious multi-faceted data has encouraged machine learning researchers to reconsider correlation-based learning and embrace the opportunity of causality-based learning, i.e., causal machine learning (causal…

Machine Learning · Computer Science 2022-02-08 Lu Cheng , Ruocheng Guo , Raha Moraffah , Paras Sheth , K. Selcuk Candan , Huan Liu

Causal discovery methods seek to identify causal relations between random variables from purely observational data, as opposed to actively collected experimental data where an experimenter intervenes on a subset of correlates. One of the…

Machine Learning · Computer Science 2021-02-08 Samir Wadhwa , Roy Dong

The representations of conditional entropy and conditional mutual information are significant in explaining the unique effects among variables. While previous studies based on conditional contrastive sampling have effectively removed…

Machine Learning · Computer Science 2025-01-07 Keng Hou Leong , Yuxuan Xiu , Wai Kin , Chan

We investigate causal inference in the asymptotic regime as the number of variables approaches infinity using an information-theoretic framework. We define structural entropy of a causal model in terms of its description complexity measured…

Artificial Intelligence · Computer Science 2021-09-21 Sridhar Mahadevan

Inducing causal relationships from observations is a classic problem in machine learning. Most work in causality starts from the premise that the causal variables themselves are observed. However, for AI agents such as robots trying to make…

Mathematical models are fundamental building blocks in the design of dynamical control systems. As control systems are becoming increasingly complex and networked, approaches for obtaining such models based on first principles reach their…

Machine Learning · Computer Science 2022-07-19 Dominik Baumann , Friedrich Solowjow , Karl H. Johansson , Sebastian Trimpe

The existence of a global causal order between events places constraints on the correlations that parties may share. Such "causal correlations" have been the focus of recent attention, driven by the realization that some extensions of…

Quantum Physics · Physics 2019-07-15 Nikolai Miklin , Alastair A. Abbott , Cyril Branciard , Rafael Chaves , Costantino Budroni

We propose a formal expansion of the transfer entropy to put in evidence irreducible sets of variables which provide information for the future state of each assigned target. Multiplets characterized by a large contribution to the expansion…

Quantitative Methods · Quantitative Biology 2015-06-04 S. Stramaglia , Guo-Rong Wu , M. Pellicoro , D. Marinazzo

This paper discusses the fundamental principles of causal inference - the area of statistics that estimates the effect of specific occurrences, treatments, interventions, and exposures on a given outcome from experimental and observational…

Methodology · Statistics 2021-12-03 Francesca Dominici , Falco J. Bargagli-Stoffi , Fabrizia Mealli