English
Related papers

Related papers: Entropic independence via sparse localization

200 papers

We introduce the notion of metric entropy for a nonautonomous dynamical system given by a sequence of probability spaces and a sequence of measure-preserving maps between these spaces. This notion generalizes the classical concept of metric…

Dynamical Systems · Mathematics 2016-11-26 Christoph Kawan

Measure-theoretic slow entropy is a more refined invariant than the classical measure-theoretic entropy to characterize the complexity of dynamical systems with subexponential growth rates of distinguishable orbit types. In this paper we…

Dynamical Systems · Mathematics 2021-09-20 Shilpak Banerjee , Philipp Kunde , Daren Wei

We describe a scheme to demonstrate the nonlocal properties of a single particle by showing a violation of Bell's inequality. The scheme is experimentally achievable as the only inputs are number states and mixed states, which serve as…

Quantum Physics · Physics 2009-11-13 J. J. Cooper , J. A. Dunningham

The entropy region is a fundamental object in information theory. An outer bound for the entropy region is defined by a minimal set of Shannon-type inequalities called elemental inequalities also referred to as the Shannon region. This…

Information Theory · Computer Science 2020-05-22 Hitika Tiwari , Satyajit Thakor

Standard probabilistic sparse coding assumes a Laplace prior, a linear mapping from latents to observables, and Gaussian observable distributions. We here derive a solely entropy-based learning objective for the parameters of standard…

Machine Learning · Statistics 2024-04-11 Dmytro Velychko , Simon Damm , Asja Fischer , Jörg Lücke

The enumeration of independent sets of regular graphs is of interest in statistical mechanics, as it corresponds to the solution of hard-particle models. In 2004, it was conjectured by Fendleyet al. that for some rectangular grids, with…

Combinatorics · Mathematics 2008-10-31 Mireille Bousquet-Mélou , Svante Linusson , Eran Nevo

We consider the one-parameter family of interval maps arising from generalized continued fraction expansions known as alpha-continued fractions. For such maps, we perform a numerical study of the behaviour of metric entropy as a function of…

Dynamical Systems · Mathematics 2015-05-14 Carlo Carminati , Stefano Marmi , Alessandro Profeti , Giulio Tiozzo

We study entropies caused by the unstable part of partially hyperbolic systems. We define unstable metric entropy and unstable topological entropy, and establish a variational principle for partially hyperbolic diffeomorphsims, which states…

Dynamical Systems · Mathematics 2017-10-10 Huyi Hu , Yongxia Hua , Weisheng Wu

The paper deals with conditional linear information inequalities valid for entropy functions induced by discrete random variables. Specifically, the so-called conditional Ingleton inequalities are in the center of interest: these are valid…

Information Theory · Computer Science 2022-03-16 Milan Studeny

We show that for any invariant measure $\mu$ on a free group shift system, there are two numbers $h^\flat \leq h^\sharp$ which in some sense are the typical upper and lower sofic entropy values. We also give a condition under which $h^\flat…

Probability · Mathematics 2023-08-17 Christopher Shriver

This paper introduces a new concept of stochastic dependence among many random variables which we call conditional neighborhood dependence (CND). Suppose that there are a set of random variables and a set of sigma algebras where both sets…

Statistics Theory · Mathematics 2018-06-06 Ji Hyung Lee , Kyungchul Song

A new computationally efficient dependence measure, and an adaptive statistical test of independence, are proposed. The dependence measure is the difference between analytic embeddings of the joint distribution and the product of the…

Machine Learning · Statistics 2016-10-18 Wittawat Jitkrittum , Zoltan Szabo , Arthur Gretton

Randomized measurements access nonlinear functionals without full tomography, yet turning third-order local single-copy data into a strong entanglement test remains difficult. We convert the reduction criterion into an experimentally…

Quantum Physics · Physics 2026-04-16 Giovanni Scala , Gniewomir Sarbicki

We develop an entropy based framework for analyzing symmetry breaking in dynamical systems. Information transfer, which measures the directional exchange of entropy between observables, provides a quantitative early indicator of symmetry…

Statistical Mechanics · Physics 2025-11-20 Subhrajit Sinha , Parvathi Kooloth

We utilize a discrete version of the notion of degree of freedom to prove a sharp min-entropy-variance inequality for integer valued log-concave random variables. More specifically, we show that the geometric distribution minimizes the…

Probability · Mathematics 2023-09-08 Heshan Aravinda

We introduce the notions of over- and under-independence for weakly mixing and (free) ergodic measure preserving actions and establish new results which complement and extend the theorems obtained in [BoFW] and [A]. Here is a sample of…

Dynamical Systems · Mathematics 2018-07-12 Terry Adams , Vitaly Bergelson , Wenbo Sun

Identifying dependency between two random variables is a fundamental problem. The clear interpretability and ability of a procedure to provide information on the form of possible dependence is particularly important when exploring…

Methodology · Statistics 2026-04-27 Bogdan Ćmiel , Teresa Ledwina

Certified randomness guaranteed to be unpredictable by adversaries is central to information security. The fundamental randomness inherent in quantum physics makes certification possible from devices that are only weakly characterised, i.e.…

Information plays an important role in our understanding of the physical world. We hence propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical world,…

Quantum Physics · Physics 2010-05-04 Anthony J. Short , Stephanie Wehner

The classical Maximum-Entropy Principle (MEP) based on Shannon entropy is widely used to construct least-biased probability distributions from partial information. However, the Shore-Johnson axioms that single out the Shannon functional…

Methodology · Statistics 2025-11-03 Giuseppe M. Ferro , Edwin T. Pos , Andrea Somazzi