English
Related papers

Related papers: Mean dimension and rate-distortion function revisi…

200 papers

The rate-distortion dimension (RDD) of an analog stationary process is studied as a measure of complexity that captures the amount of information contained in the process. It is shown that the RDD of a process, defined as two times the…

Information Theory · Computer Science 2016-11-18 Farideh Ebrahim Rezagah , Shirin Jalali , Elza Erkip , H. Vincent Poor

The authors have recently defined the R\'enyi information dimension rate $d(\{X_t\})$ of a stationary stochastic process $\{X_t,\,t\in\mathbb{Z}\}$ as the entropy rate of the uniformly-quantized process divided by minus the logarithm of the…

Information Theory · Computer Science 2019-10-11 Bernhard C. Geiger , Tobias Koch

In this note, we show several variational principles for metric mean dimension. First we prove a variational principles in terms of Shapira's entropy related to finite open covers. Second we establish a variational principle in terms of…

Dynamical Systems · Mathematics 2021-02-09 Ruxi Shi

In this work we study the Hausdorff dimension of measures whose weight distribution satisfies a markov non-homogeneous property. We prove, in particular, that the Hausdorff dimensions of this kind of measures coincide with their lower…

Metric Geometry · Mathematics 2007-05-23 Athanasios Batakis

In this paper, we introduce mean dimension and rate distortion dimension for $\mathbb{Z}^{k}$-actions dynamical system $(\mathcal{X},\mathbb{Z}^k,T)$. Suppose $(\mathcal{X},\mathbb{Z}^k,T)$ has the marker property. Taking these two…

Dynamical Systems · Mathematics 2024-01-19 Qiang Huo , Rong Yuan

We develop a variational principle for mean dimension with potential of $\mathbb{R}^d$-actions. We prove that mean dimension with potential is bounded from above by the supremum of the sum of rate distortion dimension and a potential term.…

Dynamical Systems · Mathematics 2023-10-09 Masaki Tsukamoto

Borrowing the idea of topological pressure determining measure-theoretical entropy in topological dynamical systems, we establish a variational principle for upper metric mean dimension with potential in terms of upper measure-theoretical…

Dynamical Systems · Mathematics 2024-12-30 Rui Yang , Ercai Chen , Xiaoyao Zhou

We derive a simple general parametric representation of the rate-distortion function of a memoryless source, where both the rate and the distortion are given by integrals whose integrands include the minimum mean square error (MMSE) of the…

Information Theory · Computer Science 2010-04-30 Neri Merhav

Metric mean dimension is a geometric invariant of dynamical systems with infinite topological entropy. We relate this concept with the fractal structure of the phase space and the H\"older regularity of the map. Afterwards we improve our…

Dynamical Systems · Mathematics 2025-05-29 Alexandre Baraviera , Maria Carvalho , Gustavo Pessil

In this paper, we introduce mean dimension quantities with sub-additive potentials. We define mean dimension with sub-additive potentials and mean metric dimension with sub-additive potentials, and establish a double variational principle…

Dynamical Systems · Mathematics 2020-11-06 Yunping Wang , Ercai Chen

In the late 1990's, M. Gromov introduced the notion of mean dimension for a continuous map, which is, as well as the topological entropy, an invariant under topological conjugacy. The concept of metric mean dimension for a dynamical system…

Dynamical Systems · Mathematics 2019-06-18 Jeovanny de Jesus Muentes Acevedo , Carlos Rafael Payares Guevara

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky

We introduce the notion of Feldman-Katok metric mean dimensions in this note. We show metric mean dimensions defined by different metrics coincide under weak tame growth of covering numbers, and establish variational principles for…

Dynamical Systems · Mathematics 2023-10-11 Yunxiang Xie , Ercai Chen , Rui Yang

Entropy is a measure of self-information which is used to quantify losses. Entropy was developed in thermodynamics, but is also used to compare probabilities based on their deviating information content. Corresponding model uncertainty is…

Probability · Mathematics 2018-01-23 Alois Pichler , Ruben Schlotter

Quantum information processing is limited, in practice, to efficiently implementable operations. This motivates the study of quantum divergences that preserve their operational meaning while faithfully capturing these computational…

Quantum Physics · Physics 2025-09-26 Álvaro Yángüez , Thomas A. Hahn , Jan Kochanowski

New bounds on the rate distortion function of certain non-Gaussian sources, with a proportional-weighted mean-square error (MSE) distortion measure, are given. The growth, g, of the rate distortion function, as a result of changing from a…

Information Theory · Computer Science 2007-07-13 Jacob Binia

We study the rate-distortion relationship in the set of permutations endowed with the Kendall Tau metric and the Chebyshev metric. Our study is motivated by the application of permutation rate-distortion to the average-case and worst-case…

Information Theory · Computer Science 2014-01-15 Farzad Farnoud , Moshe Schwartz , Jehoshua Bruck

Entropy is useful in statistical problems as a measure of irreversibility, randomness, mixing, dispersion, and number of microstates. However, there remains ambiguity over the precise mathematical formulation of entropy, generalized beyond…

Statistical Mechanics · Physics 2023-08-21 Vladimir Zhdankin

In this paper, we introduce the mean $\Psi$-intermediate dimension which has a value between the mean Hausdorff dimension and the metric mean dimension, and prove the equivalent definition of the mean Hausdorff dimension and the metric mean…

Dynamical Systems · Mathematics 2024-07-16 Yu Liu , Bilel Selmi , Zhiming Li

We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging…

Statistical Mechanics · Physics 2009-11-07 David P. Feldman , James P. Crutchfield