English
Related papers

Related papers: Shannon entropy and particle decays

200 papers

We consider two types of entropy, namely, Shannon and R\'{e}nyi entropies of the Poisson distribution, and establish their properties as the functions of intensity parameter. More precisely, we prove that both entropies increase with…

Information Theory · Computer Science 2024-03-15 Volodymyr Braiman , Anatoliy Malyarenko , Yuliya Mishura , Yevheniia Anastasiia Rudyk

We demonstrate that Shannon's information entropy and the thermodynamic entropy of Boltzmann and Gibbs are quantitatively equivalent for real condensed-matter systems. By interpreting atomic configurations as information sources, we compute…

Statistical Mechanics · Physics 2025-12-03 Dallin Fisher , Qi-Jun Hong

We extend present Shannon's static statistical information theory to dynamic processes and establish a dynamic statistical information theory. We derive the nonlinear evolution equations of dynamic information density and dynamic…

Statistical Mechanics · Physics 2007-05-23 Xing Xiu-San

The ``Gibbs Paradox'' refers to several related questions concerning entropy in thermodynamics and statistical mechanics: whether it is an extensive quantity or not, how it changes when identical particles are mixed, and the proper way to…

Statistical Mechanics · Physics 2009-11-07 Chih-Yuan Tseng , Ariel Caticha

A direct connection of information entropy $S$ and kinetic energy $T$ is obtained for nuclei and atomic clusters, which establishes $T$ as a measure of the information in a distribution. It is conjectured that this is a universal property…

Nuclear Theory · Physics 2009-11-07 S. E. Massen , C. P. Panos

Gamma distributions, which contain the exponential as a special case, have a distinguished place in the representation of near-Poisson randomness for statistical processes; typically, they represent distributions of spacings between events…

Mathematical Physics · Physics 2009-05-22 C. T. J. Dodson

In this study an attempt has been made to propose a way to develop new distribution. For this purpose, we need only idea about distribution function. Some important statistical properties of the new distribution like moments, cumulants,…

Methodology · Statistics 2024-08-30 Brijesh P. Singh , Utpal Dhar Das

In this work, we investigate the reliability of information-theoretic measures based on the electron-density and shape-function, specifically Shannon and R\'enyi entropies, as descriptors of electronic correlation. By establishing a…

Quantum Physics · Physics 2026-05-21 Diogo J. L. Rodrigues , Evelio Francisco , Ángel Martín Pendás

Shannon entropies of one- and two-electron atomic structure factors in the position and momentum representations are used to examine the behavior of the off-diagonal elements of density matrices with respect to the uncertainty principle and…

Quantum Physics · Physics 2009-11-13 Robin P. Sagar , Nicolais L. Guevara

Park et al. [Phys. Rev. A 106, L031504 (2022)] showed that the Shannon entropy of the probability distribution of a single random variable for far-field profiles (FFPs) in deformed microcavity lasers can efficiently measure the…

Optics · Physics 2022-12-14 Kyu-Won Park , Kwon-Wook Son , Chang-Hyun Ju , Kabgyun Jeong

The statistics of work done on a quantum system can be quantified by the two-point measurement scheme. We show how the Shannon entropy of the work distribution admits a general upper bound depending on the initial diagonal entropy, and a…

Quantum Physics · Physics 2023-05-04 Anthony Kiely , Eoin O'Connor , Thomás Fogarty , Gabriel T. Landi , Steve Campbell

The information-theoretic representation of quantum systems, which complements the familiar energy description of the density-functional and wave-function-based theories, is here discussed. According to it, the internal disorder of the…

Quantum Physics · Physics 2013-05-27 J. S. Dehesa , D. Manzano , P. S. Sánchez-Moreno , R. J. Yáñez

In this Thesis, several results in quantum information theory are collected, most of which use entropy as the main mathematical tool. *While a direct generalization of the Shannon entropy to density matrices, the von Neumann entropy behaves…

Quantum Physics · Physics 2018-10-25 Christian Majenz

Hidden Markov chains are widely applied statistical models of stochastic processes, from fundamental physics and chemistry to finance, health, and artificial intelligence. The hidden Markov processes they generate are notoriously…

Chaotic Dynamics · Physics 2021-05-26 Alexandra M. Jurgens , James P. Crutchfield

Near-term quantum devices with limited qubits motivate the study of space-bounded quantum computation in the data stream model. We show that Shannon entropy estimation exhibits an exponential separation between quantum and classical space…

Quantum Physics · Physics 2026-04-21 Weijun Feng , Yongzhen Xu , Lvzhou Li , Gongde Guo , Song Lin

In statistical physics entropy is usually introduced as a global quantity which expresses the amount of information that would be needed to specify the microscopic configuration of a system. However, for lattice models with infinitely many…

Statistical Mechanics · Physics 2015-06-12 Ulrich Müller , Haye Hinrichsen

This paper studies the Shannon regime for the random displacement of stationary point processes. Let each point of some initial stationary point process in $\R^n$ give rise to one daughter point, the location of which is obtained by adding…

Information Theory · Computer Science 2015-03-17 Venkat Anantharam , Francois Baccelli

We investigate the Shannon entropy of the total system and its subsystems, as well as the subsystem Shannon mutual information, in quasiparticle excited states of free bosonic and fermionic chains and the ferromagnetic phase of the spin-1/2…

Quantum Physics · Physics 2024-09-17 Wentao Ye , Jiaju Zhang

Statistical properties of coupled dynamic-stochastic systems are studied within a combination of the maximum information principle and the superstatistical approach. The conditions at which the Shannon entropy functional leads to a…

Statistical Mechanics · Physics 2009-11-11 E. V. Vakarin , J. P. Badiali

The entropic region is formed by the collection of the Shannon entropies of all subvectors of finitely many jointly distributed discrete random variables. For four or more variables, the structure of the entropic region is mostly unknown.…

Information Theory · Computer Science 2026-03-04 E. P. Csirmaz , L. Csirmaz