English
Related papers

Related papers: Homogenizing Entropy Across Different Environmenta…

200 papers

Temporally evolving systems are typically modeled by dynamic equations. A key challenge in accurate modeling is understanding the causal relationships between subsystems, as well as identifying the presence and influence of unobserved…

Methodology · Statistics 2024-10-28 András Telcs , Marcell T. Kurbucz , Antal Jakovác

Causal and attribution studies are essential for earth scientific discoveries and critical for informing climate, ecology, and water policies. However, the current generation of methods needs to keep pace with the complexity of scientific…

Applications · Statistics 2022-09-27 Elizabeth Eldhose , Tejasvi Chauhan , Vikram Chandel , Subimal Ghosh , Auroop R. Ganguly

We are interested in learning causal relationships between pairs of random variables, purely from observational data. To effectively address this task, the state-of-the-art relies on strong assumptions regarding the mechanisms mapping…

Machine Learning · Statistics 2014-09-16 David Lopez-Paz , Krikamol Muandet , Benjamin Recht

In many complex systems, whether biological or artificial, the thermodynamic costs of communication among their components are large. These systems also tend to split information transmitted between any two components across multiple…

Statistical Mechanics · Physics 2024-02-12 Farita Tasnim , Nahuel Freitas , David H. Wolpert

The thermodynamic uncertainty relation expresses a universal trade-off between precision and entropy production, which applies in its original formulation to current observables in steady-state systems. We generalize this relation to…

Statistical Mechanics · Physics 2018-12-06 Timur Koyuk , Udo Seifert , Patrick Pietzonka

Causal discovery aims to recover information about an unobserved causal graph from the observable data it generates. Layerings are orderings of the variables which place causes before effects. In this paper, we provide ways to recover…

Inferring nonlinear and asymmetric causal relationships between multivariate longitudinal data is a challenging task with wide-ranging application areas including clinical medicine, mathematical biology, economics and environmental…

Methodology · Statistics 2021-08-25 Tom Edinburgh , Stephen J. Eglen , Ari Ercole

Causal Graph Dynamics generalize Cellular Automata, extending them to bounded degree, time varying graphs. The dynamics rewrite the graph at each time step with respect to two physics-like symmetries: causality (bounded speed of…

Discrete Mathematics · Computer Science 2016-02-04 Simon Martiel , Bruno Martin

Perfect adaptation in a dynamical system is the phenomenon that one or more variables have an initial transient response to a persistent change in an external stimulus but revert to their original value as the system converges to…

Artificial Intelligence · Computer Science 2023-02-27 Tineke Blom , Joris M. Mooij

We ground the asymmetry of causal relations in the internal physical states of a special kind of open and irreversible physical system, a causal agent. A causal agent is an autonomous physical system, maintained in a steady state, far from…

History and Philosophy of Physics · Physics 2023-06-05 G. J. Milburn , S. Shrapnel , P. W. Evans

Shannon Entropy is the preeminent tool for measuring the level of uncertainty (and conversely, information content) in a random variable. In the field of communications, entropy can be used to express the information content of given…

Information Theory · Computer Science 2024-11-06 Bill Kay , Audun Myers , Thad Boydston , Emily Ellwein , Cameron Mackenzie , Iliana Alvarez , Erik Lentz

Crystallization is a process of great practical relevance in which rare but crucial fluctuations lead to the formation of a solid phase starting from the liquid. Like in all first order first transitions there is an interplay between…

Statistical Mechanics · Physics 2017-07-12 Pablo M. Piaggi , Omar Valsson , Michele Parrinello

Entropic quantifiers of states lie at the cornerstone of the quantum information theory. While a quantum state can be abstracted as a device that only has outputs, the most general quantum device is a quantum channel that also has inputs.…

Quantum Physics · Physics 2019-03-27 Xiao Yuan

All physical process are subject to some laws which determine with math accurately its time-space evolution. These laws are described, in the last analysis for the principle of causality. The physical space can be homogeneous or…

General Physics · Physics 2007-05-23 Enrique Ordaz Romay

Fundamental relations between information and estimation have been established in the literature for the continuous-time Gaussian and Poisson channels, in a long line of work starting from the classical representation theorems by Duncan and…

Information Theory · Computer Science 2017-04-19 Jiantao Jiao , Kartik Venkat , Tsachy Weissman

We propose a novel approach framed in terms of information theory and entropy to tackle the issue of conspiracy theories propagation. We start with the report of an event (such as 9/11 terroristic attack) represented as a series of…

Physics and Society · Physics 2015-10-28 Natasa Golo , Serge Galam

Entanglement and quantum information lie at the root of quantum theory. These remarkable resources are generally believed to diminish when systems carrying them interact with their environment. By contrast, we find that engaging a system…

Quantum Physics · Physics 2025-05-28 Vikesh Siddhu

Recent research has explored the increasingly important role of social media by examining the dynamics of individual and group behavior, characterizing patterns of information diffusion, and identifying influential individuals. In this…

Social and Information Networks · Computer Science 2011-10-13 Greg Ver Steeg , Aram Galstyan

A fundamental task in science is to determine the underlying causal relations because it is the knowledge of this functional structure what leads to the correct interpretation of an effect given the apparent associations in the observed…

Artificial Intelligence · Computer Science 2024-08-02 Alexandre Trilla , Nenad Mijatovic

The causal structure of any system can be analyzed at a multitude of spatial and temporal scales. It has long been thought that while higher scale (macro) descriptions of causal structure may be useful to observers, they are at best a…

Information Theory · Computer Science 2017-05-24 Erik P Hoel