Related papers: Entropic independence via sparse localization
In estimating the complexity of objects, in particular of graphs, it is common practice to rely on graph- and information-theoretic measures. Here, using integer sequences with properties such as Borel normality, we explain how these…
A marginal problem asks whether a given family of marginal distributions for some set of random variables arises from some joint distribution of these variables. Here we point out that the existence of such a joint distribution imposes…
We introduce a family of scale-invariant entropy statistics derived from logarithmically aggregated distance distributions of point processes, with prime numbers serving as a motivating example. The construction associates to each finite…
We prove existence of equilibrium states with special properties for a class of distance expanding local homeomorphisms on compact metric spaces and continuous potentials. Moreover, we formulate a C$^1$ generalization of Pesin's Entropy…
Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…
We develop a new framework for establishing approximate factorization of entropy on arbitrary probability spaces, using a geometric notion known as non-negative sectional curvature. The resulting estimates are equivalent to entropy…
Entropy rate is a real valued functional on the space of discrete random sources which lacks a closed formula even for subclasses of sources which have intuitive parameterizations. A good way to overcome this problem is to examine its…
We introduce a new notion of local inverse metric entropy along backward trajectories for ergodic measures preserved by endomorphisms (non-invertible maps) on a compact metric space. A second notion of inverse measure entropy is defined by…
Constraint-based causal discovery algorithms utilize many statistical tests for conditional independence to uncover networks of causal dependencies. These approaches to causal discovery rely on an assumed correspondence between the…
We prove the spectral gap property for random walks on the product of two non-locally isomorphic analytic real or p-adic compact groups with simple Lie algebras, under the necessary condition that the marginals posses a spectral gap.…
It has been known for some years that entanglement entropy obtained from partial trace does not provide the correct entanglement measure when applied to systems of identical particles. Several criteria have been proposed that have the…
In the case of systems composed of identical particles, a typical instance in quantum statistical mechanics, the standard approach to separability and entanglement ought to be reformulated and rephrased in terms of correlations between…
If nonlocality is to be inferred from a violation of Bell's inequality, an important assumption is that the measurement settings are freely chosen by the observers, or alternatively, that they are random and uncorrelated with the…
The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…
The core idea of stochastic stability is that thermodynamic observables must be robust under small (random) perturbations of the quenched Gibbs measure. Combining this idea with the cavity field technique, which aims to measure the free…
We introduce a new measure of interdependence among the components of a random vector along the main diagonal of the vector copula, i.e. along the line $u_{1}=\ldots=u_{J}$, for $\left(u_{1},\ldots,u_{J}\right)\in\left[0,1\right]^{J}$. Our…
Structural independence is the (conditional) independence that arises from the structure rather than the precise numerical values of a distribution. We develop this concept and relate it to $d$-separation and structural causal models.…
This paper generalizes sofic entropy theory, in both the topological and measure-theory settings, to actions of locally compact groups. We prove invariance under topological and measure conjugacy of these entropies and establish the…
For any C1 diffeomorphism with dominated splitting we consider a nonempty set of invariant measures which describes the asymptotic statistics of Lebesgue-almost all orbits. They are the limits of convergent subsequences of averages of the…
We develop a fine-scale local analysis of measure entropy and measure sequence entropy based on combinatorial independence. The concepts of measure IE-tuples and measure IN-tuples are introduced and studied in analogy with their…