English
Related papers

Related papers: Unifying Three Perspectives on Information Process…

200 papers

The resolution of the Maxwell's demon paradox linked thermodynamics with information theory through information erasure principle. By considering a demon endowed with a Turing-machine consisting of a memory tape and a processor, we attempt…

Statistical Mechanics · Physics 2015-11-30 Akio Hosoya , Koji Maruyama , Yutaka Shikano

Stochastic thermodynamics and the associated fluctuation relations provide the means to extend the fundamental laws of thermodynamics to small scales and systems out of equilibrium. The fluctuating thermodynamic variables are usually…

Statistical Mechanics · Physics 2015-05-29 Aki Kutvonen , Tapio Ala-Nissilä , Jukka P. Pekola

The classical thermodynamic laws fail to capture the behavior of systems with energy Hamiltonian which is an explicit function of the temperature. Such Hamiltonian arises, for example, in modeling information processing systems, like…

Statistical Mechanics · Physics 2009-11-13 Ori Shental , Ido Kanter

We establish a fundamental connection between score-based diffusion models and non-equilibrium thermodynamics by deriving performance limits based on entropy rates. Our main theoretical contribution is a lower bound on the negative…

Machine Learning · Computer Science 2025-10-08 Nathan X. Kodama , Michael Hinczewski

The Second Law of Thermodynamics states that the entropy of a closed system is non-decreasing. Discussing the Second Law in the quantum world poses new challenges and provides new opportunities, involving fundamental…

Quantum Physics · Physics 2016-12-01 A. V. Lebedev , D. Oehri , G. B. Lesovik , G. Blatter

Adaptive physical and biological systems continually process fluctuating information from their environments. When the environment is nonstationary, inference itself becomes a nonequilibrium process with thermodynamic cost. We analyse a…

Statistical Mechanics · Physics 2026-03-23 Aditya Gupta

The developing field of stochastic thermodynamics extends concepts of macroscopic thermodynamics such as entropy production and work to the microscopic level of individual trajectories taken by a system through phase space. The scheme…

Statistical Mechanics · Physics 2022-06-30 Cillian Cockrell , Ian J Ford

According to E.T. Jaynes and E.P. Wigner, entropy is an anthropomorphic concept in the sense that in a physical system correspond many thermodynamic systems. The physical system can be examined from many points of view each time examining…

Information Theory · Computer Science 2015-12-03 Panteleimon Rodis

Stochastic thermodynamics is a framework for describing non-equilibrium processes at the level of fluctuating trajectories, where the state of a system evolves as a stochastic time series, allowing thermodynamic quantities such as work,…

Biological, artificial, and physical systems dissipate energy to accurately transmit information. While tools of information theory have been used to characterize information-processing capabilities, how reliably this information is…

Statistical Mechanics · Physics 2026-05-29 Giorgio Nicoletti , Daniel M. Busiello

To describe the nonequilibrium states of a system we introduce a new thermodynamic parameter - the lifetime of a system. The statistical distributions which can be obtained out of the mesoscopic description characterizing the behaviour of a…

Statistical Mechanics · Physics 2007-05-23 V. V. Ryazanov , S. G. Shpyrko

Fluctuation theorems impose fundamental bounds in the statistics of the entropy production, with the second law of thermodynamics being the most famous. Using information theory, we quantify the information of entropy production and find an…

Quantum Physics · Physics 2021-02-17 Domingos S. P. Salazar

We develop information theory for the temporal behavior of memoryful agents moving through complex -- structured, stochastic -- environments. We introduce and explore information processes -- stochastic processes produced by cognitive…

Statistical Mechanics · Physics 2025-08-04 James P. Crutchfield , Alexandra Jurgens

We study the reduction in total entropy, and associated conversion of environmental heat into work, arising from the coupling and decoupling of two systems followed by processing determined by suitable mutual feedback. The scheme is based…

Statistical Mechanics · Physics 2016-05-10 Ian J. Ford , Michael Maitland

I give a quick overview of some of the theoretical background necessary for using modern non-equilibrium statistical physics to investigate the thermodynamics of computation. I first present some of the necessary concepts from information…

Statistical Mechanics · Physics 2019-06-20 David H. Wolpert

We develop non-equilibrium theory by using averages in time and space as a generalized way to upscale thermodynamics in non-ergodic systems. The approach offers a classical perspective on the energy dynamics in fluctuating systems. The rate…

Soft Condensed Matter · Physics 2021-09-29 James E. McClure , Steffen Berg , Ryan T. Armstrong

At very small scales, thermodynamic energy exchanges like work and heat become comparable to thermal energy of the system, which leads to unusual phenomena like the transient violations of Second Law. We explore the generic characters of…

Statistical Mechanics · Physics 2019-06-25 Sourabh Lahiri , Arun M Jayannavar

In apparent contradiction to the laws of thermodynamics, Maxwell's demon is able to cyclically extract work from a system in contact with a thermal bath exploiting the information about its microstate. The resolution of this paradox…

Linear, irreversible thermodynamics predicts that the entropy production rate can become negative. We demonstrate this prediction for metals under AC-driving whose conductivity is well-described by the Drude-Sommerfeld model. We then show…

Statistical Mechanics · Physics 2022-01-26 Marcus V. S. Bonança , Sebastian Deffner

Landauer's principle, often regarded as the foundation of the thermodynamics of information processing, holds that any logically irreversible manipulation of information, such as the erasure of a bit or the merging of two computation paths,…

Classical Physics · Physics 2011-01-11 Charles H. Bennett