English
Related papers

Related papers: A Thermodynamic Structure of Asymptotic Inference

200 papers

Thermodynamics and information have intricate inter-relations. The justification of the fact that information is physical, is done by inter-linking information and thermodynamics - through Landauer's principle. This modern approach towards…

Quantum Physics · Physics 2018-05-29 Manabendra Nath Bera , Andreas Winter , Maciej Lewenstein

A message of any sort can be regarded as a source of information. Claude. E. Shannon showed in the last century that information ("what we don't already know") is equivalent to the entropy as defined in statistical mechanics. A string of…

Fluid Dynamics · Physics 2016-09-05 W. I. Goldburg , R. T. Cerbus

The statistical properties of physical systems in thermal equilibrium are blatantly different from their far-from-equilibrium counterparts. In the latter, fluctuations often dominate the dynamics and might cluster in ordered patterns in the…

In this paper, we investigate the asymptotic stability of finite-dimensional stochastic integrable Hamiltonian systems via information entropy. Specifically, we establish the asymptotic vanishing of Shannon entropy difference (with…

Dynamical Systems · Mathematics 2025-10-28 Chen Wang , Yong Li

We provide a simple physical interpretation, in the context of the second law of thermodynamics, to the information inequality (a.k.a. the Gibbs' inequality, which is also equivalent to the log-sum inequality), asserting that the relative…

Information Theory · Computer Science 2009-03-29 Neri Merhav

Complex systems produce high-dimensional signals that lack macroscopic variables analogous to entropy, temperature, or free energy. This work introduces a thermoinformational formulation that derives entropy, internal energy, temperature,…

Neurons and Cognition · Quantitative Biology 2026-01-30 George-Rafael Domenikos , Victoria Leong

Shannon information entropy is a natural measure of probability (de)localization and thus (un)predictability in various procedures of data analysis for model systems. We pay particular attention to links between the Shannon entropy and the…

Statistical Mechanics · Physics 2007-05-23 Piotr Garbaczewski

We set up a framework for quantum stochastic thermodynamics based solely on experimentally controllable, but otherwise arbitrary interventions at discrete times. Using standard assumptions about the system-bath dynamics and insights from…

Quantum Physics · Physics 2019-08-22 Philipp Strasberg

A communication theory for a transmitter broadcasting to many receivers is presented. In this case energetic considerations cannot be neglected as in Shannon theory. It is shown that, when energy is assigned to the information bit,…

Information Theory · Computer Science 2007-07-16 Oded Kafri

This article introduces the physics of information in the context of molecular biology and genomics. Entropy and information, the two central concepts of Shannon's theory of information and communication, are often confused with each other…

Biomolecules · Quantitative Biology 2007-05-23 Christoph Adami

The Shannon information is shown to be different to the thermodynamic entropy, and indifferent to the Second Law of Thermodynamics.

Statistical Mechanics · Physics 2024-07-15 Phil Attard

We investigate a measurement-feedback process of repeated operations with time delay. During a finite-time interval, measurement on the system is performed and the feedback protocol derived from the measurement outcome is applied with time…

Statistical Mechanics · Physics 2020-01-08 Chulan Kwon , Jaegon Um , Hyunggyu Park

A Type-I model of a multicomponent system of fluids with non-constant temperature is derived as the high-friction limit of a Type-II model via a Chapman-Enskog expansion. The asymptotic model is shown to fit into the general theory of…

Analysis of PDEs · Mathematics 2022-08-10 Stefanos Georgiadis , Athanasios E. Tzavaras

The established thermodynamic formalism of chaotic dynamics, valid at statistical equilibrium, is here generalized to systems out of equilibrium, that have yet to relax to a steady state. A relation between information, escape rate, and the…

Chaotic Dynamics · Physics 2024-08-28 Domenico Lippolis

Shannon entropy was defined for probability distributions and then its using was expanded to measure the uncertainty of knowledge for systems with complete information. In this article, it is proposed to extend the using of Shannon entropy…

Information Theory · Computer Science 2017-09-15 Vasile Patrascu

Thermodynamic relations are derived from first principles of mechanics for non-equilibrium processes. Since the key role herein is played by the law of increase of entropy, the latter is analyzed at first. It is shown that its derivation…

chao-dyn · Physics 2008-02-03 J. Kumicak , X. de Hemptinne

We propose a new interpretation of measures of information and disorder by connecting these concepts to group theory in a new way. Entropy and group theory are connected here by their common relation to sets of permutations. A combinatorial…

Information Theory · Computer Science 2019-11-25 David J. Galas

The thermodynamic definition of entropy can be extended to nonequilibrium systems based on its relation to information. To apply this definition in practice requires access to the physical system's microstates, which may be prohibitively…

Statistical Mechanics · Physics 2020-08-21 Gil Ariel , Haim Diamant

We investigate fundamental connections between thermodynamics and quantum information theory. First, we show that the operational framework of thermal operations is nonequivalent to the framework of Gibbs-preserving maps, and we comment on…

Quantum Physics · Physics 2016-07-13 Philippe Faist

Isomorph theory is one of the promising theories to understand the quasi-universal relationship between thermodynamic, dynamic and structural characteristics. Based on the hidden scale invariance of the inverse power law potentials, it…

Statistical Mechanics · Physics 2019-07-31 Tae Jun Yoon , Min Young Ha , Emanuel A. Lazar , Won Bo Lee , Youn-Woo Lee