Related papers: From rate distortion theory to metric mean dimensi…
We develop a variational principle between mean dimension theory and rate distortion theory. We consider a minimax problem about the rate distortion dimension with respect to two variables (metrics and measures). We prove that the minimax…
This paper contributes to the mean dimension theory of dynamical systems. We introduce a new concept called mean dimension with potential and develop a variational principle for it. This is a mean dimension analogue of the theory of…
Around the mean dimensions and rate-distortion functions, using some tools from local entropy theory this paper establishes the following main results: $(1)$ We prove that for non-ergodic measures associated with almost sure processes, the…
The rate-distortion dimension (RDD) of an analog stationary process is studied as a measure of complexity that captures the amount of information contained in the process. It is shown that the RDD of a process, defined as two times the…
In 1959, R\'enyi proposed the information dimension and the $d$-dimensional entropy to measure the information content of general random variables. This paper proposes a generalization of information dimension to stochastic processes by…
Generalized dimensions of multifractal measures are usually seen as static objects, related to the scaling properties of suitable partition functions, or moments of measures of cells. When these measures are invariant for the flow of a…
Data-dependent metrics are powerful tools for learning the underlying structure of high-dimensional data. This article develops and analyzes a data-dependent metric known as diffusion state distance (DSD), which compares points using a…
We revisit and extend the physical interpretation recently given to a certain identity between large--deviations rate--functions (as well as applications of this identity to Information Theory), as an instance of thermal equilibrium between…
Understanding generalization in modern machine learning settings has been one of the major challenges in statistical learning theory. In this context, recent years have witnessed the development of various generalization bounds suggesting…
We establish three variational principles for the upper metric mean dimension with potential of level sets of continuous maps in terms of the entropy of partitions and Katok's entropy of the underlying system. Our results hold for dynamical…
Rate distortion dimension describes the theoretical limit of lossy data compression methods as the distortion bound goes to zero. It was originally introduced in the context of information theory, and recently it was discovered that it has…
Metric mean dimension is a dynamical counterpart of the box dimension in fractal geometry to characterize the topological complexity of infinite entropy systems. The classical variational principle states that topological entropy equals the…
In this paper, we introduce mean dimension and rate distortion dimension for $\mathbb{Z}^{k}$-actions dynamical system $(\mathcal{X},\mathbb{Z}^k,T)$. Suppose $(\mathcal{X},\mathbb{Z}^k,T)$ has the marker property. Taking these two…
We study the compression of data in the case where the useful information is contained in a set rather than a vector, i.e., the ordering of the data points is irrelevant and the number of data points is unknown. Our analysis is based on…
It is well-known that the relativized variational principle established by Bogenschutz and Kifer connects the fiber topological entropy and fiber measure-theoretic entropy. In context of random dynamical systems, metric mean dimension was…
The dynamics of many-body systems can often be captured in terms of only a few relevant variables. Mathematical and numerical approaches exist to identify these variables by exploiting a separation of time scales between slow relevant and…
Firstly, we answer the problem 1 asked by Gutman and $\rm \acute{\ S}$piewak in \cite{gs20}, then we establish a double variational principle for mean dimension in terms of R$\bar{e}$nyi information dimension and show the order of $\sup$…
This paper is concerned with the lossy compression of general random variables, specifically with rate-distortion theory and quantization of random variables taking values in general measurable spaces such as, e.g., manifolds and fractal…
Finite abstractions are discrete approximations of dynamical systems, such that the set of abstraction trajectories contains all system trajectories. There is a consensus that abstractions suffer from the curse of dimensionality: for the…
Adaptive dynamical systems arise in a multitude of contexts, e.g., optimization, control, communications, signal processing, and machine learning. A precise characterization of their fundamental limitations is therefore of paramount…