English
Related papers

Related papers: Information Causality and Noisy Computations

200 papers

The concept of causality has a controversial history. The question of whether it is possible to represent and address causal problems with probability theory, or if fundamentally new mathematics such as the do calculus is required has been…

Machine Learning · Statistics 2021-12-13 Finnian Lattimore , David Rohde

We propose a partial information decomposition based on the newly introduced framework of causal tensors, i.e., multilinear stochastic maps that transform source data into destination data. This framework enables us to express an indirect…

Information Theory · Computer Science 2020-05-04 David Sigtermans

Inferring causal interactions from observed data is a challenging problem, especially in the presence of measurement noise. To alleviate the problem of spurious causality, Haufe et al. (2013) proposed to contrast measures of information…

Statistics Theory · Mathematics 2016-05-04 Irene Winkler , Danny Panknin , Daniel Bartz , Klaus-Robert Müller , Stefan Haufe

A notion of directed information between two continuous-time processes is proposed. A key component in the definition is taking an infimum over all possible partitions of the time interval, which plays a role no less significant than the…

Information Theory · Computer Science 2012-11-01 Tsachy Weissman , Young-Han Kim , Haim H. Permuter

Measures of the direction and strength of the interdependence between two time series are evaluated and modified in order to reduce the bias in the estimation of the measures, so that they give zero values when there is no causal effect.…

Data Analysis, Statistics and Probability · Physics 2015-05-27 A. Papana , D. Kugiumtzis , P. G. Larsson

Uncertainty quantification is central to many applications of causal machine learning, yet principled Bayesian inference for causal effects remains challenging. Standard Bayesian approaches typically require specifying a probabilistic model…

Machine Learning · Statistics 2026-03-04 Emil Javurek , Dennis Frauen , Yuxin Wang , Stefan Feuerriegel

Causality has the potential to truly transform the way we solve a large number of real-world problems. Yet, so far, its potential largely remains to be unlocked as causality often requires crucial assumptions which cannot be tested in…

Machine Learning · Computer Science 2024-02-15 Jeroen Berrevoets , Krzysztof Kacprzyk , Zhaozhi Qian , Mihaela van der Schaar

Causality knowledge is vital to building robust AI systems. Deep learning models often perform poorly on tasks that require causal reasoning, which is often derived using some form of commonsense knowledge not immediately available in the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Aman Chadha , Vinija Jain

We demonstrate that the algorithmic information content of a system is deeply connected to its potential dynamics, thus affording an avenue for moving systems in the information-theoretic space and controlling them in the phase space. To…

Other Quantitative Biology · Quantitative Biology 2018-04-06 Hector Zenil , Narsis A. Kiani , Francesco Marabita , Yue Deng , Szabolcs Elias , Angelika Schmidt , Gordon Ball , Jesper Tegnér

Originally developed as a theory of consciousness, integrated information theory provides a mathematical framework to quantify the causal irreducibility of systems and subsets of units in the system. Specifically, mechanism integrated…

Neurons and Cognition · Quantitative Biology 2024-04-23 Alireza Zaeemzadeh , Giulio Tononi

The widespread applicability of analytics in cyber-physical systems has motivated research into causal inference methods. Predictive estimators are not sufficient when analytics are used for decision making; rather, the flow of causal…

Systems and Control · Computer Science 2017-03-22 Roy Dong , Eric Mazumdar , S. Shankar Sastry

In this position paper we discuss three main shortcomings of existing approaches to counterfactual causality from the computer science perspective, and sketch lines of work to try and overcome these issues: (1) causality definitions should…

Logic in Computer Science · Computer Science 2017-10-11 Gregor Gössler , Oleg Sokolsky , Jean-Bernard Stefani

In order to analyze an information theoretical derivation of Tsirelson's bound based on information causality, we introduce a generalized mutual information (GMI), defined as the optimal coding rate of a channel with classical inputs and…

Quantum Physics · Physics 2012-12-05 Eyuri Wakakuwa , Mio Murao

Causal inference from observational data provides strong evidence for the best action in decision-making without performing expensive randomized trials. The effect of an action is usually not identifiable under unobserved confounding, even…

Machine Learning · Computer Science 2026-02-02 Md Musfiqur Rahman , Ziwei Jiang , Hilaf Hasson , Murat Kocaoglu

Causality has become a fundamental approach for explaining the relationships between events, phenomena, and outcomes in various fields of study. It has invaded various fields and applications, such as medicine, healthcare, economics,…

Artificial Intelligence · Computer Science 2024-03-19 Abraham Itzhak Weinberg , Cristiano Premebida , Diego Resende Faria

Causal inference in a nonlinear system of multivariate timeseries is instrumental in disentangling the intricate web of relationships among variables, enabling us to make more accurate predictions and gain deeper insights into real-world…

Machine Learning · Computer Science 2024-01-17 Wasim Ahmad , Maha Shadaydeh , Joachim Denzler

As inductive inference and machine learning methods in computer science see continued success, researchers are aiming to describe ever more complex probabilistic models and inference algorithms. It is natural to ask whether there is a…

Logic · Mathematics 2019-11-19 Nathanael L. Ackerman , Cameron E. Freer , Daniel M. Roy

Departing from traditional communication theory where decoding algorithms are assumed to perform without error, a system where noise perturbs both computational devices and communication channels is considered here. This paper studies…

Information Theory · Computer Science 2010-05-31 Lav R. Varshney

The difficulty of explaining non-local correlations in a fixed causal structure sheds new light on the old debate on whether space and time are to be seen as fundamental. Refraining from assuming space-time as given a priori has a number of…

Quantum Physics · Physics 2018-01-15 Ämin Baumeler , Stefan Wolf

Structural causal models postulate noisy functional relations among a set of interacting variables. The causal structure underlying each such model is naturally represented by a directed graph whose edges indicate for each variable which…

Statistics Theory · Mathematics 2022-03-15 David Strieder , Tobias Freidling , Stefan Haffner , Mathias Drton