English
Related papers

Related papers: Integrated information in the thermodynamic limit

200 papers

Understanding a complex system entails capturing the non-trivial collective phenomena that arise from interactions between its different parts. Information theory is a flexible and robust framework to study such behaviours, with several…

We implement the Ising model on a structural connectivity matrix describing the brain at a coarse scale. Tuning the model temperature to its critical value, i.e. at the susceptibility peak, we find a maximal amount of total information…

Neurons and Cognition · Quantitative Biology 2013-09-03 Daniele Marinazzo , Mario Pellicoro , Guorong Wu , Leonardo Angelini , Jesus M Cortes , Sebastiano Stramaglia

Information thermodynamics relates the rate of change of mutual information between two interacting subsystems to their thermodynamics when the joined system is described by a bipartite stochastic dynamics satisfying local detailed balance.…

Statistical Mechanics · Physics 2022-08-05 Emanuele Penocchio , Francesco Avanzini , Massimiliano Esposito

Pinning down a precise understanding of information flow within physical interactions remains a central concern to fields like stochastic thermodynamics and quantum information science. In both spheres a careful accounting of bits (or…

Statistical Mechanics · Physics 2026-01-15 Miles Miller-Dickson , Christopher Rose

Fundamental limits on the controllability of physical systems are discussed in the light of information theory. It is shown that the second law of thermodynamics, when generalized to include information, sets absolute limits to the minimum…

chao-dyn · Physics 2007-05-23 Hugo Touchette , Seth Lloyd

It has been shown that sets of oscillators in a modular network can exhibit a rich variety of metastable chimera states, in which synchronisation and desynchronisation coexist. Independently, under the guise of integrated information…

Neurons and Cognition · Quantitative Biology 2016-06-28 Pedro A. M. Mediano , Juan Carlos Farah , Murray Shanahan

While information theory has been introduced to characterize the fundamental limitations of control and filtering for a few decades, the existing information-theoretic methods are indirect and cumbersome for analyzing the limitations of…

Information Theory · Computer Science 2026-02-03 Neng Wan , Dapeng Li , Naira Hovakimyan

Biological sensory systems react to changes in their surroundings. They are characterized by fast response and slow adaptation to varying environmental cues. Insofar as sensory adaptive systems map environmental changes to changes of their…

Statistical Mechanics · Physics 2014-12-15 Pablo Sartori , Léo Granger , Chiu Fan Lee , Jordan M. Horowitz

A communication theory for a transmitter broadcasting to many receivers is presented. In this case energetic considerations cannot be neglected as in Shannon theory. It is shown that, when energy is assigned to the information bit,…

Information Theory · Computer Science 2007-07-16 Oded Kafri

In recent years, the unified theory of information and thermodynamics has been intensively discussed in the context of stochastic thermodynamics. The unified theory reveals that information theory would be useful to understand…

Statistical Mechanics · Physics 2018-07-23 Sosuke Ito

Non-isolated systems have diverse coupling relations with the external environment. These relations generate complex thermodynamics and information transmission between the system and its environment. The framework depicted in the current…

Statistical Mechanics · Physics 2022-06-15 Yang Tian , Pei Sun

Physical systems are often simulated using a stochastic computation where different final states result from identical initial states. Here, we derive the minimum energy cost of simulating a complex data set of a general physical system…

Data Analysis, Statistics and Probability · Physics 2015-05-30 Karoline Wiesner , Mile Gu , Elisabeth Rieper , Vlatko Vedral

The emergence of global order in complex systems with locally interacting components is most striking at criticality, where small changes in control parameters result in a sudden global re-organization. We introduce a measure of…

Statistical Mechanics · Physics 2020-10-02 Ramil Nigmatullin , Mikhail Prokopenko

The relationship between Integrated Information Theory (IIT) and the Free-Energy Principle (FEP) remains unresolved, particularly with respect to how integrated information, proposed as the intrinsic substrate of consciousness, behaves…

Neurons and Cognition · Quantitative Biology 2025-10-07 Teruki Mayama , Sota Shimizu , Yuki Takano , Dai Akita , Hirokazu Takahashi

Quantum information theory is the study of the achievable limits of information processing within quantum mechanics. Many different types of information can be accommodated within quantum mechanics, including classical information, coherent…

Quantum Physics · Physics 2007-05-23 M. A. Nielsen

Gathering information about a system enables greater control over it. This principle lies at the core of information engines, which use measurement-based feedback to rectify thermal noise and convert information into work. Originating from…

Statistical Mechanics · Physics 2025-01-24 Rémi Goerlich , Laura Hoek , Omer Chor , Saar Rahav , Yael Roichman

The statistical mechanical interpretation of algorithmic information theory (AIT, for short) was introduced and developed in our former work [K. Tadaki, Local Proceedings of CiE 2008, pp.425-434, 2008], where we introduced the notion of…

Information Theory · Computer Science 2019-09-04 Kohtaro Tadaki

According to the Integrated Information Theory of Consciousness, consciousness is a fundamental observer-independent property of physical systems, and the measure Phi of integrated information is identical to the quantity or level of…

Neurons and Cognition · Quantitative Biology 2019-02-13 Adam B. Barrett , Pedro A. M. Mediano

The maximal information coefficient (MIC), which measures the amount of dependence between two variables, is able to detect both linear and non-linear associations. However, computational cost grows rapidly as a function of the dataset…

Information Theory · Computer Science 2015-08-18 Ali Mousavi , Richard G. Baraniuk

In the theoretical modelling of a physical system a crucial step consists in the identification of those degrees of freedom that enable a synthetic, yet informative representation of it. While in some cases this selection can be carried out…

Statistical Mechanics · Physics 2020-06-30 Marco Giulini , Roberto Menichetti , M. Scott Shell , Raffaello Potestio