English
Related papers

Related papers: On Geometry of Information Flow for Causal Inferen…

200 papers

Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical…

Probability · Mathematics 2025-03-21 Naveen Kumar , Ambesh Dixit , Vivek Vijay

We introduce the term smooth entanglement entropy transfer, a phenomenon that is a consequence of the causality-cancellation property of the quantum gravity environment. The causality-cancellation of the quantum gravity space removes the…

Quantum Physics · Physics 2014-03-27 Laszlo Gyongyosi

In this paper I conceptualise a novel approach for capturing coincidences between events that have not necessarily an observed causal relationship. Building on the Transcendental Information Cascades approach I outline a tensor theory of…

Physics and Society · Physics 2019-11-19 Markus Luczak-Roesch

Transfer Entropy, a generalisation of Granger Causality, promises to measure "information transfer" from a source to a target signal by ignoring self-predictability of a target signal when quantifying the source-target relationship. A…

Neurons and Cognition · Quantitative Biology 2022-05-23 Christoph Daube , Joachim Gross , Robin A. A. Ince

Important information on the structure of complex systems, consisting of more than one component, can be obtained by measuring to which extent the individual components exchange information among each other. Such knowledge is needed to…

Disordered Systems and Neural Networks · Physics 2009-11-13 Daniele Marinazzo , Mario Pellicoro , Sebastiano Stramaglia

Standard diffusion models are flexible estimators of complex distributions, but they do not encode causal structures and therefore do not by themselves support causal analysis. We propose a causality-encoded diffusion framework that…

Methodology · Statistics 2026-04-24 Li Chen , Xiaotong Shen , Wei Pan

Information flow between components of a system takes many forms and is key to understanding the organization and functioning of large-scale, complex systems. We demonstrate three modalities of information flow from time series X to time…

Statistical Mechanics · Physics 2018-08-22 Ryan G. James , Blanca Daniella Mansante Ayala , Bahti Zakirov , James P. Crutchfield

Human social behaviour is governed by complex interactions shaped by uncertainty, causality, and group dynamics. We propose Causal Spherical Hypergraph Networks (Causal-SphHN), a principled framework for socially grounded prediction that…

Machine Learning · Computer Science 2025-06-24 Anoushka Harit , Zhongtian Sun

With the advancement of data science, the collection of increasingly complex datasets has become commonplace. In such datasets, the data dimension can be extremely high, and the underlying data generation process can be unknown and highly…

Machine Learning · Statistics 2024-03-29 Yaxin Fang , Faming Liang

In this work, we study the causality of near-wall inner and outer turbulent motions. The inner motions are defined as the self-sustained near-wall cycle, and the outer motions as those living in the logarithmic layer exhibiting footprints…

Fluid Dynamics · Physics 2025-10-20 Jingxuan Zhang , Zhengping Zhu , Limin Wang , Ruifeng Hu

This review systematizes the emerging literature for causal inference using deep neural networks under the potential outcomes framework. It provides an intuitive introduction on how deep learning can be used to estimate/predict…

Machine Learning · Computer Science 2023-11-30 Bernard Koch , Tim Sainburg , Pablo Geraldo , Song Jiang , Yizhou Sun , Jacob Gates Foster

We propose a notion of causal influence that describes the `intrinsic' part of the contribution of a node on a target node in a DAG. By recursively writing each node as a function of the upstream noise terms, we separate the intrinsic…

Artificial Intelligence · Computer Science 2024-06-07 Dominik Janzing , Patrick Blöbaum , Atalanti A. Mastakouri , Philipp M. Faller , Lenon Minorics , Kailash Budhathoki

Some general considerations on the notion of entropy in physics are presented. An attempt is made to clarify the question of the differentiation between physical entropy (the Clausius-Boltzmann one) and quantities called entropies…

Statistical Mechanics · Physics 2007-05-23 Roberto Luzzi , Áurea R. Vasconcellos , J. Galvão Ramos

We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and…

Statistical Mechanics · Physics 2007-05-23 R. Balian

A central challenge in statistical inference is the presence of confounding variables that may distort observed associations between treatment and outcome. Conventional "causal" methods, grounded in assumptions such as ignorability, exclude…

Methodology · Statistics 2025-09-09 Ellis Scharfenaker , Duncan K. Foley

This paper presents a groundbreaking approach to causal inference by integrating continuous normalizing flows (CNFs) with parametric submodels, enhancing their geometric sensitivity and improving upon traditional Targeted Maximum Likelihood…

Machine Learning · Computer Science 2024-02-02 Kaiwen Hou

Causality has been the issue of philosophic debate since Hippocrates. It is used in formal verification and testing, e.g., to explain counterexamples or construct fault trees. Recent work defines actual causation in terms of Pearl's…

Logic in Computer Science · Computer Science 2019-11-01 Robert Künnemann , Deepak Garg , Michael Backes

We review of the interface between (theoretical) physics and information for non-experts. The origin of information as related to the notion of entropy is described, first in the context of thermodynamics then in the context of statistical…

Classical Physics · Physics 2007-12-18 F. Alexander Bais , J. Doyne Farmer

Structural causal models postulate noisy functional relations among a set of interacting variables. The causal structure underlying each such model is naturally represented by a directed graph whose edges indicate for each variable which…

Statistics Theory · Mathematics 2022-03-15 David Strieder , Tobias Freidling , Stefan Haffner , Mathias Drton

Granger causal inference is a contentious but widespread method used in fields ranging from economics to neuroscience. The original definition addresses the notion of causality in time series by establishing functional dependence…

Methodology · Statistics 2023-09-19 Noah D. Gade , Jordan Rodu