English
Related papers

Related papers: R\'enyi Information flow in the Ising model with s…

200 papers

Bounds on information combining are entropic inequalities that determine how the information, or entropy, of a set of random variables can change when they are combined in certain prescribed ways. Such bounds play an important role in…

Information Theory · Computer Science 2020-11-10 Christoph Hirche

We revisit the one-dimensional ferromagnetic Ising spin-chain with a finite number of spins and periodic boundaries and derive analytically and verify numerically its various stationary and dynamical properties at different temperatures. In…

Statistical Mechanics · Physics 2025-04-24 Varazdat Stepanyan , Andreas F. Tzortzakakis , David Petrosyan , Armen E. Allahverdyan

From the Horowitz-Esposito stochastic thermodynamical description of information flows in dynamical systems [J. M. Horowitz and M. Esposito, Phys. Rev. X4, 031015 (2014)], it is known that while the second law of thermodynamics is satisfied…

Statistical Mechanics · Physics 2016-03-23 Carlo Cafaro , Sean Alan Ali , Adom Giffin

We propose a detailed analysis of datasets generated from simulations of two-dimensional quantum spin systems using the quantum Ising model at absolute zero temperature. Our focus is on examining how fundamental physical properties, energy,…

Quantum Physics · Physics 2024-11-13 Rodrigo Carmo Terin

We explore the cooperative behaviour and phase transitions of interacting networks by studying a simplified model consisting of Ising spins placed on the nodes of two coupled Erd\"os-R\'enyi random graphs. We derive analytical expressions…

Statistical Mechanics · Physics 2018-08-27 Maíra Bolfe , Lucas Nicolao , Fernando L. Metz

We develop a quantum Monte Carlo procedure to compute the Renyi mutual information of an interacting quantum many-body system at non-zero temperature. Performing simulations on a spin-1/2 XXZ model, we observe that for a subregion of fixed…

Strongly Correlated Electrons · Physics 2010-09-21 Roger G. Melko , Ann B. Kallin , Matthew B. Hastings

The transfer entropy is a well-established measure of information flow, which quantifies directed influence between two stochastic time series and has been shown to be useful in a variety fields of science. Here we introduce the transfer…

Statistical Mechanics · Physics 2018-07-23 Sosuke Ito

This paper considers an information bottleneck problem with the objective of obtaining a most informative representation of a hidden feature subject to a R\'enyi entropy complexity constraint. The optimal bottleneck trade-off between…

Information Theory · Computer Science 2021-02-01 Jian-Jia Weng , Fady Alajaji , Tamás Linder

Entropy is a central concept in physics, but can be challenging to calculate even for systems that are easily simulated. This is exacerbated out of equilibrium, where generally little is known about the distribution characterizing simulated…

Statistical Mechanics · Physics 2024-05-09 Samuel D. Gelman , Guy Cohen

A comprehensive investigation of the entanglement characteristics is carried out on tripartite spin-1/2 systems, examining prototypical tripartite states, the thermal Heisenberg model, and the transverse field Ising model. The entanglement…

Quantum Physics · Physics 2024-11-05 Marwa Mannaï , Hisham Sati , Tim Byrnes , Chandrashekar Radhakrishnan

We investigate the nature of information flow in turbulence from an information-thermodynamic viewpoint. For the fully developed three-dimensional fluid turbulence described by the fluctuating Navier-Stokes equation, we prove that…

Statistical Mechanics · Physics 2023-10-10 Tomohiro Tanogami , Ryo Araki

Complex systems produce high-dimensional signals that lack macroscopic variables analogous to entropy, temperature, or free energy. This work introduces a thermoinformational formulation that derives entropy, internal energy, temperature,…

Neurons and Cognition · Quantitative Biology 2026-01-30 George-Rafael Domenikos , Victoria Leong

We propose a formal expansion of the transfer entropy to put in evidence irreducible sets of variables which provide information for the future state of each assigned target. Multiplets characterized by a large contribution to the expansion…

Quantitative Methods · Quantitative Biology 2015-06-04 S. Stramaglia , Guo-Rong Wu , M. Pellicoro , D. Marinazzo

The information entropy budget and the rate of information transfer between variables is studied in the context of a nonlinear reduced-order atmospheric model. The key ingredients of the dynamics are present in this model, namely the…

Atmospheric and Oceanic Physics · Physics 2024-04-02 Stéphane Vannitsem , Carlos A. Pires , David Docquier

The information theoretic observables entropy (a measure of disorder), excess entropy (a measure of complexity) and multi information are used to analyze ground-state spin configurations for disordered and frustrated model systems in 2D and…

Disordered Systems and Neural Networks · Physics 2013-05-30 O. Melchert , A. K. Hartmann

In this paper, a network-based stochastic information propagation model is developed. The information flow is modeled by a probabilistic differential equation system. The numerical solution of these equations leads to the expected number of…

Social and Information Networks · Computer Science 2021-06-02 Peter Laszlo Juhasz

We investigate the analogy between the renormalization group (RG) and deep neural networks, wherein subsequent layers of neurons are analogous to successive steps along the RG. In particular, we quantify the flow of information by…

High Energy Physics - Theory · Physics 2021-12-22 Johanna Erdmenger , Kevin T. Grosvenor , Ro Jefferson

Information flow between components of a system takes many forms and is key to understanding the organization and functioning of large-scale, complex systems. We demonstrate three modalities of information flow from time series X to time…

Statistical Mechanics · Physics 2018-08-22 Ryan G. James , Blanca Daniella Mansante Ayala , Bahti Zakirov , James P. Crutchfield

We present a general framework for incorporating non-reciprocal interactions into the Ising model with Glauber dynamics, without requiring multiple species. We then focus on a model with vision-cone type interactions. We solve it in a fully…

Statistical Mechanics · Physics 2025-05-09 Adrià Garcés , Demian Levis

We introduce and formalize the concept of information flux in a many-body register as the influence that the dynamics of a specific element receive from any other element of the register. By quantifying the information flux in a protocol,…

Quantum Physics · Physics 2007-10-23 C. Di Franco , M. Paternostro , G. M. Palma , M. S. Kim