English
Related papers

Related papers: Information entropy and complexity measure in gene…

200 papers

We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…

Information Theory · Computer Science 2011-04-05 Paul M. B. Vitányi

A well-interpretable measure of information has been recently proposed based on a partition obtained by intersecting a random sequence with its moving average. The partition yields disjoint sets of the sequence, which are then ranked…

Statistical Finance · Quantitative Finance 2018-08-01 Linda Ponta , Anna Carbone

In this contribution, quantum Fisher information is utilized to estimate the parameters of a central qubit interacting with a single-spin qubit. The effect of the longitudinal, transverse and the rotating strengths of the magnetic field on…

Quantum Physics · Physics 2018-04-04 N. Metwally

When we extract information from a system by performing a quantum measurement, the state of the system is disturbed due to the backaction of the measurement. Numerous studies have been performed to quantitatively formulate tradeoff…

Quantum Physics · Physics 2016-04-06 Tomohiro Shitara , Yui Kuramochi , Masahito Ueda

Configurational entropy (CE) and configurational complexity (CC) are recently popularized information theoretic measures used to study the stability of solitons. This paper examines their behavior for 2D and 3D lattice Ising Models, where…

Statistical Mechanics · Physics 2025-03-06 Damian R Sowinski , Sean Kelty , Gourab Ghoshal

We propose a unifying picture where the notion of generalized entropy is related to information theory by means of a group-theoretical approach. The group structure comes from the requirement that an entropy be well defined with respect to…

Statistical Mechanics · Physics 2016-04-13 Gabriele Sicuro , Piergiulio Tempesta

We consider a simplified version of a solvable model by Mandal and Jarzynski, which constructively demonstrates the interplay between work extraction and the increase of the Shannon entropy of an information reservoir which is in contact…

Statistical Mechanics · Physics 2015-03-31 Neri Merhav

Shannon's entropy is one of the building blocks of information theory and an essential aspect of Machine Learning methods (e.g., Random Forests). Yet, it is only finitely defined for distributions with fast decaying tails on a countable…

Statistics Theory · Mathematics 2022-05-25 Jialin Zhang , Jingyi Shi

In this work, we investigate the reliability of information-theoretic measures based on the electron-density and shape-function, specifically Shannon and R\'enyi entropies, as descriptors of electronic correlation. By establishing a…

Quantum Physics · Physics 2026-05-21 Diogo J. L. Rodrigues , Evelio Francisco , Ángel Martín Pendás

An existing conjecture states that the Shannon mutual information contained in the ground state wavefunction of conformally invariant quantum chains, on periodic lattices, has a leading finite-size scaling behavior that, similarly as the…

Statistical Mechanics · Physics 2016-09-27 F. C. Alcaraz

Using the supersymmetric method of random matrix theory within the Heidelberg approach framework we provide statistical description of stationary intensity sampled in locations inside an open wave-chaotic cavity, assuming that the…

Disordered Systems and Neural Networks · Physics 2023-10-16 Yan V. Fyodorov , Elizaveta Safonova

We evaluate Shannon entropy for the position and momentum eigenstates of some conditionally exactly solvable potentials which are isospectral to harmonic oscillator and whose solutions are given in terms of exceptional orthogonal…

Mathematical Physics · Physics 2015-05-27 D. Dutta , P. Roy

The information entropy of a nuclear density distribution is calculated for a number of nuclei. Various phenomenological models for the density distribution using different geometry are employed. Nuclear densities calculated within various…

Nuclear Theory · Physics 2015-06-26 G. A. Lalazissis , S. E. Massen , C. P. Panos , S. S. Dimitrova

The Shannon entropy of a collection of random variables is subject to a number of constraints, the best-known examples being monotonicity and strong subadditivity. It remains an open question to decide which of these "laws of information…

Quantum Physics · Physics 2013-08-30 David Gross , Michael Walter

This paper provides a systematic approach to semiparametric identification that is based on statistical information as a measure of its "quality". Identification can be regular or irregular, depending on whether the Fisher information for…

Statistics Theory · Mathematics 2021-07-01 Juan Carlos Escanciano

There are (at least) three approaches to quantifying information. The first, algorithmic information or Kolmogorov complexity, takes events as strings and, given a universal Turing machine, quantifies the information content of a string as…

Information Theory · Computer Science 2011-11-29 David Balduzzi

We present some new results which relate information to chaotic dynamics. In our approach the quantity of information is measured by the Algorithmic Information Content (Kolmogorov complexity) or by a sort of computable version of it…

Statistical Mechanics · Physics 2007-05-23 V. Benci , C. Bonanno , S. Galatolo , G. Menconi , M. Virgilio

Localization of a particle in the wells of an asymmetric double-well (DW) potential is investigated here. Information entropy-based uncertainty measures, such as Shannon entropy, Fisher information, Onicescu energy, etc., and phasespace…

Quantum Physics · Physics 2019-04-15 Neetik Mukherjee , Amlan K. Roy

Experiments with irradiated single-walled carbon nanotubes are shown to generate a set of probability distribution functions and to derive a set of information theoretic entropy-based parameters. Energetic Cs+ ions initiate linear collision…

Mesoscale and Nanoscale Physics · Physics 2018-09-12 Afshan Ashraf , Sumera Javeed , Sumaira Zeeshan , Kashif Yaqub , Shoaib Ahmad

This article proposes a new two-parameter generalized entropy, which can be reduced to the Tsallis and the Shannon entropy for specific values of its parameters. We develop a number of information-theoretic properties of this generalized…

Mathematical Physics · Physics 2024-05-02 Supriyo Dutta , Shigeru Furuichi , Partha Guha