English
Related papers

Related papers: Shannon Entropy as Characterization Tool in Acoust…

200 papers

We investigate two types of avoided crossings in a chaotic billiard within the framework of information theory. The Shannon entropy in the phase space for the Landau--Zener interaction increases as the center of the avoided crossing is…

Chaotic Dynamics · Physics 2022-10-12 Kyu-Won Park , Juman Kim , Jisung Seo , Songky Moon , Kabgyun Jeong , Kyungwon An

Shannon Entropy is the preeminent tool for measuring the level of uncertainty (and conversely, information content) in a random variable. In the field of communications, entropy can be used to express the information content of given…

Information Theory · Computer Science 2024-11-06 Bill Kay , Audun Myers , Thad Boydston , Emily Ellwein , Cameron Mackenzie , Iliana Alvarez , Erik Lentz

The application of the Shannon entropy to study the relationship between information and structures has yielded insights into molecular and material systems. However, the difficulty in directly observing and manipulating atoms and molecules…

Shannon entropy was defined for probability distributions and then its using was expanded to measure the uncertainty of knowledge for systems with complete information. In this article, it is proposed to extend the using of Shannon entropy…

Information Theory · Computer Science 2017-09-15 Vasile Patrascu

Shannon entropy is often a quantity of interest to linguists studying the communicative capacity of human language. However, entropy must typically be estimated from observed data because researchers do not have access to the underlying…

Computation and Language · Computer Science 2022-04-06 Aryaman Arora , Clara Meister , Ryan Cotterell

The statistical properties of physical systems in thermal equilibrium are blatantly different from their far-from-equilibrium counterparts. In the latter, fluctuations often dominate the dynamics and might cluster in ordered patterns in the…

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

Invisibility or unhearability cloaks have been made possible by using metamaterials making light or sound flow around obstacle without the trace of reflections or shadows. Metamaterials are known for being flexible building units that can…

The interaction between lattice and spins is at the heart of an extremely intriguing ultrafast dynamics in magnetic materials. In this work we formulate a general non-equilibrium theory that disentangles the complex interplay between them…

Materials Science · Physics 2019-07-31 Pablo Maldonado , Yaroslav O. Kvashnin

The Shannon entropy of a random variable has much behaviour analogous to a signed measure. Previous work has explored this connection by defining a signed measure on abstract sets, which are taken to represent the information that different…

Information Theory · Computer Science 2025-05-28 Keenan J. A. Down , Pedro A. M. Mediano

The entropy region is a fundamental object in information theory. An outer bound for the entropy region is defined by a minimal set of Shannon-type inequalities called elemental inequalities also referred to as the Shannon region. This…

Information Theory · Computer Science 2020-05-22 Hitika Tiwari , Satyajit Thakor

The paper presents an extension of Shannon entropy for neutrosophic information. This extension uses a new formula for distance between two neutrosophic triplets. In addition, the obtained results are particularized for bifuzzy,…

Artificial Intelligence · Computer Science 2018-10-02 Vasile Patrascu

A thermodynamic framework for asymptotic inference is developed in which sample size and parameter variance define a state space. Within this description, Shannon information plays the role of entropy, and an integrating factor organizes…

Information Theory · Computer Science 2026-03-26 Willy Wong

Entropic measures provide analytic tools to help us understand correlation in quantum systems. In our previous work, we calculated linear entropy and von Neumann entropy as entanglement measures for the ground state and lower lying excited…

Quantum Physics · Physics 2015-07-21 Chien-Hao Lin , Yew Kam Ho

The Shannon based conditional entropy that underlies five-dimensional Einstein-Hilbert gravity coupled to a dilaton field is investigated in the context of dynamical holographic AdS/QCD models. Considering the UV and IR dominance limits of…

High Energy Physics - Theory · Physics 2016-09-22 Alex E. Bernardini , Roldao da Rocha

This article introduces the physics of information in the context of molecular biology and genomics. Entropy and information, the two central concepts of Shannon's theory of information and communication, are often confused with each other…

Biomolecules · Quantitative Biology 2007-05-23 Christoph Adami

The stretched exponential function, $\exp[-(t/\tau_{K})^{\beta}]$, describes various relaxation processes while it has been suggested that the power exponent, $\beta$ is derived from the non-uniformity of the process. In this paper, we…

Soft Condensed Matter · Physics 2018-09-12 Hirokazu Maruoka , Akio Nishimura , Makoto Yoshida , Keisuke Hatada

Statements of Shannon's Noiseless Coding Theorem by various authors, including the original, are reviewed and clarified. Traditional statements of the theorem are often unclear as to when it applies. A new notation is introduced and the…

Information Theory · Computer Science 2010-11-01 L. F. Johnson

We consider ultracold Bose gases in quasi-random potentials and quantify localization of matter waves by means of Shannon information entropy. We explicitly examine the role of quasi-random potentials in producing localized states in the…

Quantum Gases · Physics 2019-02-05 Kajal Krishna Dey , Sudipta Das , Golam Ali Sekh

Shannon information entropy is a natural measure of probability (de)localization and thus (un)predictability in various procedures of data analysis for model systems. We pay particular attention to links between the Shannon entropy and the…

Statistical Mechanics · Physics 2007-05-23 Piotr Garbaczewski
‹ Prev 1 2 3 10 Next ›