English
Related papers

Related papers: A Dynamic Theory of Information and Entropy

200 papers

We introduce an axiomatic approach to entropies and relative entropies that relies only on minimal information-theoretic axioms, namely monotonicity under mixing and data-processing as well as additivity for product distributions. We find…

Information Theory · Computer Science 2021-09-22 Gilad Gour , Marco Tomamichel

From the principle of maximum entropy for a closed system in thermal equilibrium, for the first instance a clear relation is shown to exist between total entropy S (in terms of arrangements of particles) and the classical expression for the…

Classical Physics · Physics 2009-11-07 Mario J. Pinheiro

The common saying, that information is power, takes a rigorous form in stochastic thermodynamics, where a quantitative equivalence between the two helps explain the paradox of Maxwell's demon in its ability to reduce entropy. In the present…

Statistical Mechanics · Physics 2021-03-09 Amirhossein Taghvaei , Olga Movilla Miangolarra , Rui Fu , Yongxin Chen , Tryphon T. Georgiou

We investigate the entanglement entropy and the information flow of two-dimensional moving mirrors. Here we point out that various mirror trajectories can help to mimic different candidate resolutions to the information loss paradox…

High Energy Physics - Theory · Physics 2017-07-25 Pisin Chen , Dong-han Yeom

What is information? Is it physical? We argue that in a Bayesian theory the notion of information must be defined in terms of its effects on the beliefs of rational agents. Information is whatever constrains rational beliefs and therefore…

Data Analysis, Statistics and Probability · Physics 2016-09-08 Ariel Caticha

In these decades, it has been revealed that there is rich information-theoretic structure in thermodynamics of out-of-equilibrium systems in both the classical and quantum regimes. This has led to the fruitful interplay among statistical…

Quantum Physics · Physics 2020-09-29 Takahiro Sagawa

We provide a unified thermodynamic formalism describing information transfers in autonomous as well as nonautonomous systems described by stochastic thermodynamics. We demonstrate how information is continuously generated in an auxiliary…

Statistical Mechanics · Physics 2014-08-06 Jordan M. Horowitz , Massimiliano Esposito

A new kind of duality has been proposed by Carr related to the quantum description of black holes, the so-called Compton/Schwarzschild duality \cite{Carr:2015nqa}. In this context, a new form for a Generalized Uncertainty Principle has…

General Relativity and Quantum Cosmology · Physics 2022-05-20 Marcelo Ferreira da Silva , Carlos A. S. Silva

I outline some of my work (some dating back to 1998, some more recent) on my matter-gravity entanglement hypothesis, according to which the entropy of a closed quantum gravitational system is equal to the system's matter-gravity…

High Energy Physics - Theory · Physics 2023-12-15 Bernard S. Kay

We present an axiomatic framework for thermodynamics that incorporates information as a fundamental concept. The axioms describe both ordinary thermodynamic processes and those in which information is acquired, used and erased, as in the…

Quantum Physics · Physics 2018-05-09 Austin Hulse , Benjamin Schumacher , Michael D. Westmoreland

A direct connection of information entropy $S$ and kinetic energy $T$ is obtained for nuclei and atomic clusters, which establishes $T$ as a measure of the information in a distribution. It is conjectured that this is a universal property…

Nuclear Theory · Physics 2009-11-07 S. E. Massen , C. P. Panos

We provide a simple physical interpretation, in the context of the second law of thermodynamics, to the information inequality (a.k.a. the Gibbs' inequality, which is also equivalent to the log-sum inequality), asserting that the relative…

Information Theory · Computer Science 2009-03-29 Neri Merhav

Complex systems produce high-dimensional signals that lack macroscopic variables analogous to entropy, temperature, or free energy. This work introduces a thermoinformational formulation that derives entropy, internal energy, temperature,…

Neurons and Cognition · Quantitative Biology 2026-01-30 George-Rafael Domenikos , Victoria Leong

The black hole information puzzle arises from a discrepancy between conclusions drawn from general relativity and quantum theory about the nature of the radiation emitted by a black hole. According to Hawking's original argument, the…

High Energy Physics - Theory · Physics 2021-12-24 Renato Renner , Jinzhao Wang

In information theory, one major goal is to find useful functions that summarize the amount of information contained in the interaction of several random variables. Specifically, one can ask how the classical Shannon entropy, mutual…

Information Theory · Computer Science 2025-02-14 Leon Lang , Pierre Baudot , Rick Quax , Patrick Forré

The necessary information to distinguish a local inhomogeneous mass density field from its spatial average on a compact domain of the universe can be measured by relative information entropy. The Kullback-Leibler (KL) formula arises very…

General Relativity and Quantum Cosmology · Physics 2016-04-28 Viktor G. Czinner , Filipe C. Mena

We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and…

Statistical Mechanics · Physics 2007-05-23 R. Balian

We give a pedagogical review of how concepts from quantum information theory build up the gravitational side of the AdS/CFT correspondence. The review is self-contained in that it only presupposes knowledge of quantum mechanics and general…

High Energy Physics - Theory · Physics 2022-07-20 Bowen Chen , Bartlomiej Czech , Zi-zhi Wang

Informational entropy is often identified as physical entropy. This is surprising because the two quantities are differently defined and furthermore the former is a subjective quantity while the latter is an objective one. We describe the…

Quantum Physics · Physics 2014-05-01 Won-Young Hwang

Information-theoretic quantities, such as entropy, are used to quantify the amount of information a given variable provides. Entropies can be used together to compute the mutual information, which quantifies the amount of information two…

Data Analysis, Statistics and Probability · Physics 2014-12-22 Kevin H. Knuth , Deniz Gençağa , William B. Rossow