English
Related papers

Related papers: Independence, sequence entropy and mean sensitivit…

200 papers

Invariant tensors are states in the (local) SU(2) tensor product representation but invariant under global SU(2) action. They are of importance in the study of loop quantum gravity. A random tensor is an ensemble of tensor states. An…

Quantum Physics · Physics 2018-05-29 Youning Li , Muxin Han , Dong Ruan , Bei Zeng

The purpose of this paper is to study the phenomenon of large intersections in the framework of multiple recurrence for measure-preserving actions of countable abelian groups. Among other things, we show: (1) If $G$ is a countable abelian…

Dynamical Systems · Mathematics 2021-10-04 Ethan Ackelsberg , Vitaly Bergelson , Andrew Best

We introduce a notion called entropic independence that is an entropic analog of spectral notions of high-dimensional expansion. Informally, entropic independence of a background distribution $\mu$ on $k$-sized subsets of a ground set of…

Data Structures and Algorithms · Computer Science 2021-11-08 Nima Anari , Vishesh Jain , Frederic Koehler , Huy Tuan Pham , Thuy-Duong Vuong

We show that the spectral measure of any non-commutative polynomial of a non-commutative $n$-tuple cannot have atoms if the free entropy dimension of that $n$-tuple is $n$ (see also work of Mai, Speicher, and Weber). Under stronger…

Operator Algebras · Mathematics 2015-08-10 I. Charlesworth , D. Shlyakhtenko

We study constrained versions of the Ingleton inequality in the entropic setting and quantify its stability under small violations of conditional independence. Although the classical Ingleton inequality fails for general entropy profiles,…

Information Theory · Computer Science 2026-03-24 Rostislav Matveev , Andrei Romashchenko

Approximate entropy (ApEn) and sample entropy (SampEn) are widely used for temporal complexity analysis of real-world phenomena. However, their relationship with the Hurst exponent as a measure of self-similarity is not widely studied.…

Computational Physics · Physics 2018-12-17 Amir Omidvarnia , Mostefa Mesbah , Mangor Pedersen , Graeme Jackson

Information-theoretic (IT) measures are ubiquitous in artificial intelligence: entropy drives decision-tree splits and uncertainty quantification, cross-entropy is the default classification loss, mutual information underpins representation…

Artificial Intelligence · Computer Science 2026-04-28 Nikolaos Al. Papadopoulos , Konstantinos E. Psannis

We study expansive measures for continuous flows without fixed points on compact metric spaces. We provide a new characterization of expansive measures through dynamical balls that, in contrast to the dynamical balls considered in [\emph{J.…

Dynamical Systems · Mathematics 2026-04-30 Eduardo Pedrosa , Elias Rego , Alexandre Trilles

We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…

Information Theory · Computer Science 2011-04-05 Paul M. B. Vitányi

For a measurable map $T$ and a sequence of $T$-invariant probability measures $\mu_n$ that converges in some sense to a $T$-invariant probability measure $\mu$, an estimate from below for the Kolmogorov--Sinai entropy of $T$ with respect to…

Dynamical Systems · Mathematics 2014-08-08 B. Gurevich

The study is devoted to definition of generalized metrical and topological (informational entropy) characteristics of neural signals via their well-known theoretical models. We have shown that time dependence of action potential of neurons…

Neurons and Cognition · Quantitative Biology 2016-10-06 Z. Zh. Zhanabaev , T. Yu. Grevtseva , Y. T. Kozhagulov

Shannon Entropy is the preeminent tool for measuring the level of uncertainty (and conversely, information content) in a random variable. In the field of communications, entropy can be used to express the information content of given…

Information Theory · Computer Science 2024-11-06 Bill Kay , Audun Myers , Thad Boydston , Emily Ellwein , Cameron Mackenzie , Iliana Alvarez , Erik Lentz

Information-theoretic quantities like entropy and mutual information have found numerous uses in machine learning. It is well known that there is a strong connection between these entropic quantities and submodularity since entropy over a…

Machine Learning · Computer Science 2021-03-04 Rishabh Iyer , Ninad Khargonkar , Jeff Bilmes , Himanshu Asnani

Persistent entropy (PE) is an information-theoretic summary statistic of persistence barcodes that has been widely used to detect regime changes in complex systems. Despite its empirical success, a general theoretical understanding of when…

Machine Learning · Statistics 2026-02-11 Matteo Rucco

This paper is aim to extend Kenneth R. Berg's findings on the maximal entropy theorem and the ergodicity of measure convolution to the case of surjective homomorphisms. We further explores dynamical systems under surjective homomorphism in…

Dynamical Systems · Mathematics 2024-03-22 Binghui Xiao

The aim of this note is to introduce a notion of dynamical entropy, which we call infinite-product entropy, for probability measures on (countable) infinite cartesian product of any measurable space with itself. The idea behind the…

Probability · Mathematics 2024-10-29 Maysam Maysami Sadr , Mina Shahrestani , Danial Bouzarjomehri Amnieh

Classical ergodic theory for integer-group actions uses entropy as a complete invariant for isomorphism of IID (independent, identically distributed) processes (a.k.a. product measures). This theory holds for amenable groups as well.…

Dynamical Systems · Mathematics 2018-09-10 Russell Lyons

The notion of metric entropy dimension is introduced to measure the complexity of entropy zero dynamical systems. For measure preserving systems, we define entropy dimension via the dimension of entropy generating sequences. This…

Dynamical Systems · Mathematics 2018-02-27 Dou Dou , Wen Huang , Kyewon Koh Park

Motivated by Sarnak's conjecture on M\"obius orthogonality, we investigate the general problem of orthogonality for a bounded sequence to topological models of characteristic classes of measure-preserving automorphisms. Our main observation…

Dynamical Systems · Mathematics 2026-04-24 J. Aaronson , A. I. Danilenko , J. Kułaga-Przymus , M. Lemańczyk

We study the structure of invariant measures for continuous automorphisms of compact metrizable abelian groups satisfying the descending chain condition. We show that the finitely supported invariant measures are weak-* dense in the space…

Dynamical Systems · Mathematics 2025-07-21 Rotem Yaari