English
Related papers

Related papers: The Entropy of Floating-Point Numbers

200 papers

Here we deconstruct, and then in a reasoned way reconstruct, the concept of "entropy of a system," paying particular attention to where the randomness may be coming from. We start with the core concept of entropy as a COUNT associated with…

General Physics · Physics 2017-05-10 Tommaso Toffoli

Fluctuating entropy production is studied for a set of linearly coupled complex fields. The general result is applied to non-equilibrium fluctuating hydrodynamic equations for coarse-grained fields (density, temperature and velocity), in…

Statistical Mechanics · Physics 2012-07-09 Giacomo Gradenigo , Andrea Puglisi , Alessandro Sarracino

Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…

Statistics Theory · Mathematics 2019-11-12 Linda Altieri , Daniela Cocchi , Giulia Roli

Entropy measures quantify the amount of information and correlation present in a quantum system. In practice, when the quantum state is unknown and only copies thereof are available, one must resort to the estimation of such entropy…

Quantum Physics · Physics 2024-03-27 Ziv Goldfeld , Dhrumil Patel , Sreejith Sreekumar , Mark M. Wilde

The generalized entropic measure, which is optimized by a given arbitrary distribution under the constraints on normalization of the distribution and the finite ordinary expectation value of a physical random quantity, is considered and its…

Statistical Mechanics · Physics 2009-11-10 Sumiyoshi Abe , G. Kaniadakis , A. M. Scarfone

We derive a measurement-independent asymptotic continuity bound on the observational entropy for general POVM measurements, making essential use of its property of bounded concavity. The same insight is used to obtain continuity bounds for…

Quantum Physics · Physics 2024-09-25 Joseph Schindler , Andreas Winter

The length-scale dependence of the dynamic entropy is studied in a molecular dynamics simulation of a binary Lennard-Jones liquid above the mode-coupling critical temperature $T_c$. A number of methods exist for estimating the entropy of…

Soft Condensed Matter · Physics 2009-10-31 Paolo Allegrini , Jack F. Douglas , Sharon C. Glotzer

Entanglement entropy appears as a central property of quantum systems in broad areas of physics. However, its precise value is often sensitive to unknown microphysics, rendering it incalculable. By considering parametric dependence on…

High Energy Physics - Theory · Physics 2011-02-09 Mark P. Hertzberg , Frank Wilczek

We propose a simple approach to the calculation of the entanglement entropy of a spherically symmetric quantum system composed of two separate regions. We consider bound states of the system described by a wave function that is scale…

Quantum Physics · Physics 2019-02-12 Maurizio Melis

Following the theory of information measures based on the cumulative distribution function, we propose the fractional generalized cumulative entropy, and its dynamic version. These entropies are particularly suitable to deal with…

Probability · Mathematics 2021-06-30 Antonio Di Crescenzo , Suchandan Kayal , Alessandra Meoli

We study the exponential decay of relative entropy functionals for zero-range processes on the complete graph. For the standard model with rates increasing at infinity we prove entropy dissipation estimates, uniformly over the number of…

Probability · Mathematics 2010-10-11 Pietro Caputo , Gustavo Posta

In this article, I give a definition of topological entropy for random dynamical systems associated to an infinite countable discrete amenable group action. I obtain a variational principle between the topological entropy and measurable…

Dynamical Systems · Mathematics 2024-03-13 Yuan Lian

This paper considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of a Poisson random…

Information Theory · Computer Science 2016-11-17 Igal Sason

We show that Frenkel's integral representation of the quantum relative entropy provides a natural framework to derive continuity bounds for quantum information measures. Our main general result is a dimension-independent semi-continuity…

Quantum Physics · Physics 2025-03-04 Mario Berta , Ludovico Lami , Marco Tomamichel

We introduce the concept of inflation word entropy for random substitutions with a constant and primitive substitution matrix. Previous calculations of the topological entropy of such systems implicitly used this concept and established…

Dynamical Systems · Mathematics 2020-04-15 Philipp Gohlke

We locate the relevant degrees of freedom for the entanglement entropy on some 2+1 fuzzy models. It is found that the entropy is stored in the near boundary degrees of freedom. We give a simple analytical derivation for the area law using…

General Relativity and Quantum Cosmology · Physics 2014-11-18 Djamel Dou

Let $X$ be a discrete random variable with support $S$ and $f : S \to S^\prime$ be a bijection. Then it is well-known that the entropy of $X$ is the same as the entropy of $f(X)$. This entropy preservation property has been well-utilized to…

Information Theory · Computer Science 2007-07-13 Chandra Nair , Balaji Prabhakar , Devavrat Shah

In this paper we study time semi-discrete approximations of a class of exponentially stable infinite dimensional systems with unbounded feedbacks. It has recently been proved that for time semi-discrete systems, due to high frequency…

Optimization and Control · Mathematics 2013-06-18 Zayd Hajjej , Mohamed Balegh

We prove existence of asymptotic entropy of random walks on regular languages over a finite alphabet and we give formulas for it. Furthermore, we show that the entropy varies real-analytically in terms of probability measures of constant…

Probability · Mathematics 2015-03-11 Lorenz A. Gilch

Special approximation technique for analysis of different characteristics of states of multipartite infinite-dimensional quantum systems is proposed and applied to study of the relative entropy of entanglement and its regularisation. We…

Quantum Physics · Physics 2024-01-11 M. E. Shirokov