English
Related papers

Related papers: Quantifying magma mixing with the Shannon entropy:…

200 papers

The entropic region is formed by the collection of the Shannon entropies of all subvectors of finitely many jointly distributed discrete random variables. For four or more variables, the structure of the entropic region is mostly unknown.…

Information Theory · Computer Science 2026-03-04 E. P. Csirmaz , L. Csirmaz

In the article the $mm$-entropy (an entropy of a metric measure space) introduced by C. Shannon is evaluated for an $\alpha$-stable L\'evy process. For $\alpha<1$ the double-sided estimates of the same order are obtained for process…

Probability · Mathematics 2026-05-28 Viktor Khamzin , Mikhail Lifshits

A general investigation is made into the intrinsic Riemannian geometry for complex systems, from the perspective of statistical mechanics. The entropic formulation of statistical mechanics is the ingredient which enables a connection…

Statistical Mechanics · Physics 2010-08-18 B. N. Tiwari , Vinod Chandra , Subhashish Banerjee

We have used information theory analogue of entropy, Shannon entropy, for estimating the variations during the isotropic and anisotropic AuNP fractal growth process. We have firstly applied the Shannon entropy on the simulated fractal…

Atomic and Molecular Clusters · Physics 2018-12-21 Anurag Singh , Anushree Roy , Amar Nath Gupta

Shannon entropy is not the only entropy that is relevant to machine-learning datasets, nor possibly even the most important one. Traditional entropies such as Shannon entropy capture information represented by elements' frequencies but not…

Information Theory · Computer Science 2026-04-01 Phuc Nguyen , Josiah Couch , Rahul Bansal , Alexandra Morgan , Chris Tam , Miao Li , Rima Arnaout , Ramy Arnaout

Volcanic regions have shaped human settlements for millennia, placing over 500 million people worldwide within close proximity to active volcanoes. Predicting eruptions that threaten both lives and property remains a critical challenge,…

Geophysics · Physics 2025-11-04 Ligdamis Gutiérrez , Pablo Rey Devesa , Jesús Ibáñez , Carmen Benítez

Estimating the entropy based on data is one of the prototypical problems in distribution property testing and estimation. For estimating the Shannon entropy of a distribution on $S$ elements with independent samples, [Paninski2004] showed…

Machine Learning · Computer Science 2018-09-25 Yanjun Han , Jiantao Jiao , Chuan-Zheng Lee , Tsachy Weissman , Yihong Wu , Tiancheng Yu

The Shannon entropy, one of the cornerstones of information theory, is widely used in physics, particularly in statistical mechanics. Yet its characterization and connection to physics remain vague, leaving ample room for misconceptions and…

Statistical Mechanics · Physics 2021-07-28 Gabriele Carcassi , Christine A. Aidala , Julian Barbour

Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical…

Probability · Mathematics 2025-03-21 Naveen Kumar , Ambesh Dixit , Vivek Vijay

We introduce entropic measures to quantify non-classical resource in hybrid spin-boson systems. We discuss the stabilizer R\'enyi entropy in the framework of phase space quantisation and define an analogous hybrid magic entropy and a mutual…

Strongly Correlated Electrons · Physics 2025-08-11 Samuel Crew , Ying-Lin Li , Heng-Hsi Li , Po-Yao Chang

We introduce R\'enyi entropy of a subsystem energy as a natural quantity which closely mimics the behavior of the entanglement entropy and can be defined for all the quantum many body systems. For this purpose, consider a quantum chain in…

Strongly Correlated Electrons · Physics 2019-11-13 Khadijeh Najafi , M. A. Rajabpour

This research paper delves into the innovative integration of Shannon entropy and rough set theory, presenting a novel approach to generalize the evaluation approach in machine learning. The conventional application of entropy, primarily…

Machine Learning · Computer Science 2024-04-22 Olga Cherednichenko , Dmytro Chernyshov , Dmytro Sytnikov , Polina Sytnikova

Characterizing complexity and criticality in quantum systems requires diagnostics that are both computationally tractable and physically insightful. We apply a measure of quantum state complexity for n-qubit systems, defined as the…

Quantum Physics · Physics 2026-02-10 Imre Varga

Topos formalism for quantum mechanics is interpreted in a broader, information retrieval perspective. Contexts, its basic components, are treated as sources of information. Their interplay, called daseinisation, defined in purely logical…

Quantum Physics · Physics 2020-06-23 Roman Zapatrin

We propose and experimentally measure an entropy that quantifies the volume of correlations among qubits. The experiment is carried out on a nearly isolated quantum system composed of a central spin coupled and initially uncorrelated with…

Quantum Physics · Physics 2021-08-25 Mohamad Niknam , Lea F. Santos , David G. Cory

The problem of Shannon entropy estimation in countable infinite alphabets is addressed from the study and use of convergence results of the entropy functional, which is known to be discontinuous with respect to the total variation distance…

Information Theory · Computer Science 2018-04-03 Jorge F. Silva

We conclude a sequence of work by giving near-optimal sketching and streaming algorithms for estimating Shannon entropy in the most general streaming model, with arbitrary insertions and deletions. This improves on prior results that obtain…

Data Structures and Algorithms · Computer Science 2008-12-18 Nicholas J. A. Harvey , Jelani Nelson , Krzysztof Onak

We build a comprehensive methodology for the fast computation of entropy across both solid and liquid phases. The proposed method utilizes a single trajectory of molecular dynamics (MD) to facilitate the calculation of entropy, which is…

Computational Physics · Physics 2024-04-05 Qi-Jun Hong , Zi-Kui Liu

The extension of thermodynamic principles to active matter remains a challenge due to the non-equilibrium nature inherent to active systems. In this study, we introduce a framework to assess entropy in our minimal macroscopic experiment…

Soft Condensed Matter · Physics 2024-09-26 Francesco Romanò , Michael Riedl

The R\'enyi and Shannon entropies are information-theoretic measures which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation.…

Quantum Physics · Physics 2013-05-24 Pablo Sánchez-Moreno , Steeve Zozor , Jesus S. Dehesa