English
Related papers

Related papers: Entropy of probability kernels from the backwards …

200 papers

We show that a proper expression of the uncertainty relation for a pair of canonically-conjugate continuous variables relies on entropy power, a standard notion in Shannon information theory for real-valued signals. The resulting…

Quantum Physics · Physics 2018-01-16 Anaelle Hertz , Michael G. Jabbour , Nicolas J. Cerf

We study Markov chains with non-negative sectional curvature on finite metric spaces. Neither reversibility, nor the restriction to a particular combinatorial distance are imposed. In this level of generality, we prove that a 1-step…

Probability · Mathematics 2024-02-12 Pietro Caputo , Florentin Münch , Justin Salez

Extending a recent result by Frank and Lieb, we show an entropic uncertainty principle for mixed states in a Hilbert space relatively to pairs of positive operator valued measures that are independent in some sense. This yields…

Functional Analysis · Mathematics 2012-05-29 Michel Rumin

We introduce an axiomatic approach to entropies and relative entropies that relies only on minimal information-theoretic axioms, namely monotonicity under mixing and data-processing as well as additivity for product distributions. We find…

Information Theory · Computer Science 2021-09-22 Gilad Gour , Marco Tomamichel

We study geometric properties of trace functionals that generalize those in [Zhang, Adv. Math. 365:107053 (2020)], arising from a novel family of conditional entropies with applications in quantum information. Building on new convexity…

Quantum Physics · Physics 2026-03-17 Roberto Rubboli , Milad M. Goodarzi , Marco Tomamichel

Recursive stochastic algorithms have gained significant attention in the recent past due to data driven applications. Examples include stochastic gradient descent for solving large-scale optimization problems and empirical dynamic…

Machine Learning · Computer Science 2020-07-27 Abhishek Gupta , Hao Chen , Jianzong Pi , Gaurav Tendolkar

Recently Lewis Bowen introduced a notion of entropy for measure-preserving actions of a countable sofic group on a standard probability space admitting a generating partition with finite entropy. By applying an operator algebra perspective…

Dynamical Systems · Mathematics 2015-05-18 David Kerr , Hanfeng Li

Sparsity and entropy are pillar notions of modern theories in signal processing and information theory. However, there is no clear consensus among scientists on the characterization of these notions. Previous efforts have contributed to…

Information Theory · Computer Science 2015-12-18 Giancarlo Pastor , Inmaculada Mora-Jiménez , Riku Jäntti , Antonio J. Caamaño

Kolmogorov's setting for probability theory is given an original generalization to account for probabilities arising from Quantum Mechanics. The sample space has a central role in this presentation and random variables, i.e., observables,…

Quantum Physics · Physics 2023-06-05 Daniel Lehmann

Information theory on a time-discrete setting in the framework of time series analysis is generalized to the time-continuous case. Considerations of the Roessler and Lorenz dynamics as well as the Ornstein-Uhlenbeck process yield for…

Chaotic Dynamics · Physics 2008-06-04 Detlef Holstein

Let $M$ be a compact manifold and $f:\,M\to M$ be a $C^1$ diffeomorphism on $M$. If $\mu$ is an $f$-invariant probability measure which is absolutely continuous relative to Lebesgue measure and for $\mu$ $a.\,\,e.\,\,x\in M,$ there is a…

Dynamical Systems · Mathematics 2011-10-31 Wenxiang Sun , Xueting Tian

Different notions of entropy play a fundamental role in the classical theory of dynamical systems. Unlike many other concepts used to analyze autonomous dynamics, both measure-theoretic and topological entropy can be extended quite…

Dynamical Systems · Mathematics 2017-08-03 Christoph Kawan

We shall prove that the celebrated R\'enyi entropy is the first example of a new family of infinitely many multi-parametric entropies. We shall call them the $Z$-entropies. Each of them, under suitable hypotheses, generalizes the celebrated…

Mathematical Physics · Physics 2017-02-07 Piergiulio Tempesta

Many complex systems are characterized by non-Boltzmann distribution functions of their statistical variables. If one wants to -- justified or not -- hold on to the maximum entropy principle for complex statistical systems (non-Boltzmann)…

Statistical Mechanics · Physics 2009-11-13 Stefan Thurner , Rudolf Hanel

Probability representation entropy (tomographic entropy) of arbitrary quantum state is introduced. Using the properties of spin tomogram to be standard probability distribution function the tomographic entropy notion is discussed. Relation…

Quantum Physics · Physics 2007-05-23 O. V. Man'ko , V. I. Man'ko

We consider the dynamical behavior of Martin-L\"of random points in dynamical systems over metric spaces with a computable dynamics and a computable invariant measure. We use computable partitions to define a sort of effective symbolic…

Dynamical Systems · Mathematics 2008-04-29 Stefano Galatolo , Mathieu Hoyrup , Cristobal Rojas

We prove the large deviation principle for several entropy and cross entropy estimators based on return times and waiting times on shift spaces over finite alphabets. We consider shift-invariant probability measures satisfying some…

Probability · Mathematics 2024-08-07 Noé Cuneo , Renaud Raquépas

A consequence of Ornstein theory is that the infinite entropy flows associated with Poisson processes and continuous-time irreducible Markov chains on a finite number of states are isomorphic as measure-preserving systems. We give an…

Dynamical Systems · Mathematics 2018-10-09 Terry Soo

The entropy definition is deduced by means of (re)deriving the generalized non-linear Langevin equation using Zwanzig projector operator formalism. It is shown to be necessarily related to an invariant measure which, in classical mechanics,…

Statistical Mechanics · Physics 2007-05-23 E. A. J. F. Peters

We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…

Quantum Physics · Physics 2014-06-23 Steeve Zozor , Gustavo Martín Bosyk , Mariela Portesi