English
Related papers

Related papers: Entropic independence via sparse localization

200 papers

In estimating the complexity of objects, in particular of graphs, it is common practice to rely on graph- and information-theoretic measures. Here, using integer sequences with properties such as Borel normality, we explain how these…

Information Theory · Computer Science 2017-07-12 Hector Zenil , Narsis Kiani , Jesper Tegnér

A marginal problem asks whether a given family of marginal distributions for some set of random variables arises from some joint distribution of these variables. Here we point out that the existence of such a joint distribution imposes…

Information Theory · Computer Science 2013-01-25 Tobias Fritz , Rafael Chaves

We introduce a family of scale-invariant entropy statistics derived from logarithmically aggregated distance distributions of point processes, with prime numbers serving as a motivating example. The construction associates to each finite…

Methodology · Statistics 2026-04-06 Mohamed Gewily

We prove existence of equilibrium states with special properties for a class of distance expanding local homeomorphisms on compact metric spaces and continuous potentials. Moreover, we formulate a C$^1$ generalization of Pesin's Entropy…

Dynamical Systems · Mathematics 2019-04-09 Vitor Araujo , Felipe Santos

Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…

Statistics Theory · Mathematics 2026-02-16 Nicholas G. Polson , Daniel Zantedeschi

We develop a new framework for establishing approximate factorization of entropy on arbitrary probability spaces, using a geometric notion known as non-negative sectional curvature. The resulting estimates are equivalent to entropy…

Probability · Mathematics 2024-07-29 Pietro Caputo , Justin Salez

Entropy rate is a real valued functional on the space of discrete random sources which lacks a closed formula even for subclasses of sources which have intuitive parameterizations. A good way to overcome this problem is to examine its…

Information Theory · Computer Science 2015-01-14 Alexander Schönhuth

We introduce a new notion of local inverse metric entropy along backward trajectories for ergodic measures preserved by endomorphisms (non-invertible maps) on a compact metric space. A second notion of inverse measure entropy is defined by…

Dynamical Systems · Mathematics 2025-03-11 Eugen Mihailescu , Radu B. Munteanu

Constraint-based causal discovery algorithms utilize many statistical tests for conditional independence to uncover networks of causal dependencies. These approaches to causal discovery rely on an assumed correspondence between the…

Machine Learning · Computer Science 2025-04-18 Bijan Mazaheri , Jiaqi Zhang , Caroline Uhler

We prove the spectral gap property for random walks on the product of two non-locally isomorphic analytic real or p-adic compact groups with simple Lie algebras, under the necessary condition that the marginals posses a spectral gap.…

Group Theory · Mathematics 2024-04-18 Alireza S Golsefidy , Keivan Mallahi-Karai , Amir Mohammadi

It has been known for some years that entanglement entropy obtained from partial trace does not provide the correct entanglement measure when applied to systems of identical particles. Several criteria have been proposed that have the…

High Energy Physics - Theory · Physics 2013-03-05 A. P. Balachandran , T. R. Govindarajan , Amilcar R. de Queiroz , A. F. Reyes-Lega

In the case of systems composed of identical particles, a typical instance in quantum statistical mechanics, the standard approach to separability and entanglement ought to be reformulated and rephrased in terms of correlations between…

Quantum Physics · Physics 2014-05-21 F. Benatti , R. Floreanini

If nonlocality is to be inferred from a violation of Bell's inequality, an important assumption is that the measurement settings are freely chosen by the observers, or alternatively, that they are random and uncorrelated with the…

Quantum Physics · Physics 2013-05-29 Jonathan Barrett , Nicolas Gisin

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

The core idea of stochastic stability is that thermodynamic observables must be robust under small (random) perturbations of the quenched Gibbs measure. Combining this idea with the cavity field technique, which aims to measure the free…

Disordered Systems and Neural Networks · Physics 2015-04-15 Peter Sollich , Adriano Barra

We introduce a new measure of interdependence among the components of a random vector along the main diagonal of the vector copula, i.e. along the line $u_{1}=\ldots=u_{J}$, for $\left(u_{1},\ldots,u_{J}\right)\in\left[0,1\right]^{J}$. Our…

Methodology · Statistics 2014-08-29 Jhan Rodríguez , András Bárdossy

Structural independence is the (conditional) independence that arises from the structure rather than the precise numerical values of a distribution. We develop this concept and relate it to $d$-separation and structural causal models.…

Probability · Mathematics 2025-06-24 Matthias Georg Mayer

This paper generalizes sofic entropy theory, in both the topological and measure-theory settings, to actions of locally compact groups. We prove invariance under topological and measure conjugacy of these entropies and establish the…

Dynamical Systems · Mathematics 2023-11-07 Lewis Bowen

For any C1 diffeomorphism with dominated splitting we consider a nonempty set of invariant measures which describes the asymptotic statistics of Lebesgue-almost all orbits. They are the limits of convergent subsequences of averages of the…

Dynamical Systems · Mathematics 2016-06-28 Eleonora Catsigeras , Marcelo Cerminara , Heber Enrich

We develop a fine-scale local analysis of measure entropy and measure sequence entropy based on combinatorial independence. The concepts of measure IE-tuples and measure IN-tuples are introduced and studied in analogy with their…

Dynamical Systems · Mathematics 2007-05-24 David Kerr , Hanfeng Li