English
Related papers

Related papers: A Coherent View on Entropy

200 papers

Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible $N$--point correlation is measured by a decrease…

Biological Physics · Physics 2016-09-08 Elad Schneidman , Susanne Still , Michael J. Berry , William Bialek

Entropies are fundamental measures of uncertainty with central importance in information theory and statistics and applications across all the quantitative sciences. Under a natural set of operational axioms, the most general form of…

Information Theory · Computer Science 2026-02-02 Roberto Rubboli , Erkka Haapasalo , Marco Tomamichel

The information entropy of a nuclear density distribution is calculated for a number of nuclei. Various phenomenological models for the density distribution using different geometry are employed. Nuclear densities calculated within various…

Nuclear Theory · Physics 2015-06-26 G. A. Lalazissis , S. E. Massen , C. P. Panos , S. S. Dimitrova

A possible mechanism of time is formulated by developing an idea of time replaced by quantum correlations, with the aid of modern quantum information theory. We invent a microscopic model, where correlations of a closed system are steadily…

Quantum Physics · Physics 2011-11-14 Akimasa Miyake

In order to find out the limiting speed of solving a specific problem using computer, this essay provides a method based on information entropy. The relationship between the minimum computational complexity and information entropy change is…

Computational Complexity · Computer Science 2012-03-09 Xue Wu

The principle of entropy increase is not only the basis of statistical mechanics, but also closely related to the irreversibility of time, the origin of life, chaos and turbulence. In this paper, we first discuss the dynamic system…

Statistical Mechanics · Physics 2022-10-11 Zou Dan Dan

Dissipative quantum systems are frequently described within the framework of the so-called "system-plus-reservoir" approach. In this work we assign their description to the Maximum Entropy Formalism and compare the resulting thermodynamic…

Statistical Mechanics · Physics 2017-01-04 Lisan M. M. Durão , Amir O. Caldeira

Entropy is a concept that has traditionally been reliant on a definite notion of causality. However, without a definite notion of causality, the concept of entropy is not all lost. Indefinite causal structure results from combining…

General Relativity and Quantum Cosmology · Physics 2011-07-13 Sonia Markes , Lucien Hardy

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-26 S. K. Katiyar , P. V. Arun

The paper describes an approach to measuring convergence of an algorithm to its result in terms of an entropy-like function of partitions of its inputs of a given length. The goal is to look at the algorithmic data processing from the…

Computational Complexity · Computer Science 2016-05-06 Anatol Slissenko

Quantum information theory, particularly its entropic formulations, has made remarkable strides in characterizing quantum systems and tasks. However, a critical dimension remains underexplored: computational efficiency. While classical…

Quantum Physics · Physics 2026-05-05 Noam Avidan , Thomas A. Hahn , Joseph M. Renes , Rotem Arnon

General characterization of physical measurements is discussed within the framework of a classical information theory. Uncertainty relation for simultaneous measurements of two physical observables is defined in this framework for…

Quantum Physics · Physics 2012-12-18 Yoshimasa Kurihara

In this paper, a method of measuring the entropy is presented. Problems related to the entropy and the heat are also discussed.

General Physics · Physics 2007-05-23 Bin Zhou

A mechanism is proposed that allows to interpret the temporal evolution of a physical system as a result of the inability of an observer to record its whole state and a simple example is given. It is based on a review of the concepts of…

General Physics · Physics 2010-10-15 Alberto Bicego

Entropy and differential entropy are important quantities in information theory. A tractable extension to singular random variables-which are neither discrete nor continuous-has not been available so far. Here, we present such an extension…

Information Theory · Computer Science 2017-01-04 Günther Koliander , Georg Pichler , Erwin Riegler , Franz Hlawatsch

Notwithstanding various attempts to construct a Partial Information Decomposition (PID) for multiple variables by defining synergistic, redundant, and unique information, there is no consensus on how one ought to precisely define either of…

Data Analysis, Statistics and Probability · Physics 2023-06-07 Steven J. van Enk

A recently proposed history formalism is used to define temporal entanglement in quantum systems, and compute its entropy. The procedure is based on the time-reduction of the history density operator, and allows a symmetrical treatment of…

Quantum Physics · Physics 2022-04-05 Leonardo Castellani

The work is devoted to study of the following problem: can we use any qualitative criteria for realization of such universal phenomenon as self-organization in open systems? We have defined values of information at fixed points of…

Adaptation and Self-Organizing Systems · Physics 2016-10-04 Zeinulla Zh. Zhanabaev , Yeldos T. Kozhagulov , Serik A. Khokhlov

We introduce ways to measure information storage in quantum systems, using a recently introduced computation-theoretic model that accounts for measurement effects. The first, the quantum excess entropy, quantifies the shared information…

Quantum Physics · Physics 2010-04-05 James P. Crutchfield , Karoline Wiesner

We propose a unified theoretical framework for quantifying spatio-temporal interactions in a stochastic dynamical system based on information geometry. In the proposed framework, the degree of interactions is quantified by the divergence…

Neurons and Cognition · Quantitative Biology 2016-12-08 Masafumi Oizumi , Naotsugu Tsuchiya , Shun-ichi Amari