English
Related papers

Related papers: Computability of entropy and information in classi…

200 papers

Making decisions freely presupposes that there is some indeterminacy in the environment and in the decision making engine. The former is reflected on the behavioral changes due to communicating: few changes indicate rigid environments;…

Artificial Intelligence · Computer Science 2020-09-23 Luis A. Pineda

The principle of entropy increase is not only the basis of statistical mechanics, but also closely related to the irreversibility of time, the origin of life, chaos and turbulence. In this paper, we first discuss the dynamic system…

Statistical Mechanics · Physics 2022-10-11 Zou Dan Dan

Computers are deterministic dynamical systems (CHAOS 19:033124, 2009). Among other things, that implies that one should be able to use deterministic forecast rules to predict their behavior. That statement is sometimes-but not always-true.…

Chaotic Dynamics · Physics 2013-05-24 Joshua Garland , Ryan James , Elizabeth Bradley

We introduce a notion of computable randomness for infinite sequences that generalises the classical version in two important ways. First, our definition of computable randomness is associated with imprecise probability models, in the sense…

Probability · Mathematics 2020-09-23 Floris Persiau , Jasper De Bock , Gert de Cooman

In the first of this pair of papers, it was proven that that no physical computer can correctly carry out all computational tasks that can be posed to it. The generality of this result follows from its use of a novel definition of…

Computational Physics · Physics 2009-10-02 David H. Wolpert

Can we learn more from data than existed in the generating process itself? Can new and useful information be constructed from merely applying deterministic transformations to existing data? Can the learnable content in data be evaluated…

Machine Learning · Computer Science 2026-03-17 Marc Finzi , Shikai Qiu , Yiding Jiang , Pavel Izmailov , J. Zico Kolter , Andrew Gordon Wilson

In this paper we present an introduction to the area of computability in dynamical systems. This is a fairly new field which has received quite some attention in recent years. One of the central questions in this area is if relevant…

Dynamical Systems · Mathematics 2023-11-08 Michael Burr , Christian Wolf

Informational contributions to thermodynamics can be studied in isolation by considering systems with fully-degenerate Hamiltonians. In this regime, being in non-equilibrium -- termed informational non-equilibrium -- provides thermodynamic…

Quantum Physics · Physics 2025-05-15 Chung-Yun Hsieh , Benjamin Stratton , Hao-Cheng Weng , Valerio Scarani

The logical basis for information theory is the newly developed logic of partitions that is dual to the usual Boolean logic of subsets. The key concept is a "distinction" of a partition, an ordered pair of elements in distinct blocks of the…

Information Theory · Computer Science 2013-01-29 David Ellerman

In the above mentioned paper by J. Dunkel and S. A. Trigger [Phys. Rev. {\bf A 71}, 052102, (2005)] a hypothesis has been pursued that the loss of information associated with the quantum evolution of pure states, quantified in terms of an…

Quantum Physics · Physics 2009-11-11 Piotr Garbaczewski

The concept of entropy in nonequilibrium macroscopic systems is investigated in the light of an extended equation of motion for the density matrix obtained in a previous study. It is found that a time-dependent information entropy can be…

Statistical Mechanics · Physics 2009-11-10 W. T. Grandy

The theory of noncommutative dynamical entropy and quantum symbolic dynamics for quantum dynamical systems is analised from the point of view of quantum information theory. Using a general quantum dynamical system as a communication channel…

Quantum Physics · Physics 2009-11-07 Robert Alicki

A bit-quantum map relates probabilistic information for Ising spins or classical bits to quantum spins or qubits. Quantum systems are subsystems of classical statistical systems. The Ising spins can represent macroscopic two-level…

Quantum Physics · Physics 2019-10-23 C. Wetterich

The necessary information for specifying a complex system may not be completely accessible to us, i.e., to mathematical treatments. This is not to be confounded with the incompleteness of our knowledge about whatever systems or nature,…

Statistical Mechanics · Physics 2007-05-23 Qiuping A. Wang

Informational entropy is often identified as physical entropy. This is surprising because the two quantities are differently defined and furthermore the former is a subjective quantity while the latter is an objective one. We describe the…

Quantum Physics · Physics 2014-05-01 Won-Young Hwang

Computational complexity characterizes the usage of spatial and temporal resources by computational processes. In the classical theory of computation, e.g. in the Turing Machine model, computational processes employ only local space and…

Quantum Physics · Physics 2025-09-25 Chris Fields , James F. Glazebrook , Antonino Marciano , Emanuele Zappala

Scientific knowledge increasingly depends on complex computational processes where both hardware and software layers can influence research outcomes. As computational complexity grows, classical-quantum integration provides a lens for…

Emerging Technologies · Computer Science 2026-03-06 Anna Vrtiak , Duuk Baten , Ariana Torres-Knoop

Algorithmic entropy and Shannon entropy are two conceptually different information measures, as the former is based on size of programs and the later in probability distributions. However, it is known that, for any recursive probability…

Information Theory · Computer Science 2010-06-03 Andreia Teixeira , Andre Souto , Armando Matos , Luis Antunes

Inspired by Quantum Mechanics, we reformulate Hilbert's tenth problem in the domain of integer arithmetics into problems involving either a set of infinitely-coupled non-linear differential equations or a class of linear Schr\"odinger…

General Mathematics · Mathematics 2007-05-23 Tien D. Kieu

Current discrete randomness and information conservation inequalities are over total recursive functions, i.e. restricted to deterministic processing. This restriction implies that an algorithm can break algorithmic randomness conservation…

Computational Complexity · Computer Science 2013-10-15 Samuel Epstein