English
Related papers

Related papers: Universally Typical Sets for Ergodic Sources of Mu…

200 papers

Multidimensional record patterns are random sets of lattice points defined by means of a recursive stochastic construction. The patterns thus generated owe their richness to the fact that the construction is not based on a total order,…

Statistical Mechanics · Physics 2020-06-11 P. L. Krapivsky , J. M. Luck

The proof of the theorem, which states that the Euclidean metric on the set of random points in an $n$-dimensional Euclidean space with the distribution of a special class, converges in probability in the limit $n\rightarrow\infty$ to the…

Mathematical Physics · Physics 2014-04-22 Alexander P. Zubarev

Sample selection improves the efficiency and effectiveness of machine learning models by providing informative and representative samples. Typically, samples can be modeled as a sample graph, where nodes are samples and edges represent…

Machine Learning · Computer Science 2025-03-04 Tianchi Xie , Jiangning Zhu , Guozu Ma , Minzhi Lin , Wei Chen , Weikai Yang , Shixia Liu

Entropy estimation is of practical importance in information theory and statistical science. Many existing entropy estimators suffer from fast growing estimation bias with respect to dimensionality, rendering them unsuitable for…

Information Theory · Computer Science 2023-08-22 Ziqiao Ao , Jinglai Li

Expanding Thurston maps were introduced by M. Bonk and D. Meyer with motivation from complex dynamics and Cannon's conjecture from geometric group theory via Sullivan's dictionary. In this paper, we show that the entropy map of an expanding…

Dynamical Systems · Mathematics 2024-06-05 Zhiqiang Li , Xianghui Shi

A general method is presented for modeling high entropy alloys as ensembles of randomly sampled, ordered configurations on a given lattice. Statistical mechanics is applied post hoc to derive the ensemble properties as a function of…

Materials Science · Physics 2022-11-24 Andrew Novick , Quan Nguyen , Roman Garnett , Eric Toberer , Vladan Stevanović

This study investigates a multiplicative integer system using a method that was developed for studying pattern generation problems. The entropy and the Minkowski dimensions of general multiplicative systems can thus be computed. A…

Dynamical Systems · Mathematics 2015-03-20 Jung-Chao Ban , Wen-Guei Hu , Song-Sun Lin

Monte Carlo simulations using entropic sampling to estimate the number of configurations of a given energy are a valuable alternative to traditional methods. We introduce {\it tomographic} entropic sampling, a scheme which uses multiple…

Statistical Mechanics · Physics 2015-05-28 Ronald Dickman , A. G. Cunha-Netto

We study how the Shannon entropy of sequences produced by an information source converges to the source's entropy rate. We synthesize several phenomenological approaches to applying information theoretic measures of randomness and memory to…

Statistical Mechanics · Physics 2007-05-23 James P. Crutchfield , David P. Feldman

Entropy rate is a real valued functional on the space of discrete random sources which lacks a closed formula even for subclasses of sources which have intuitive parameterizations. A good way to overcome this problem is to examine its…

Information Theory · Computer Science 2015-01-14 Alexander Schönhuth

During a spontaneous change, a macroscopic physical system will evolve towards a macro-state with more realizations. This observation is at the basis of the Statistical Mechanical version of the Second Law of Thermodynamics, and it provides…

Statistical Mechanics · Physics 2020-04-22 Mengjie Zu , Arunkumar Bupathy , Daan Frenkel , Srikanth Sastry

This paper introduces a concept for change-point detection based on normalized entropy as a fundamental metric, aiming to overcome the dependence of traditional entropy methods on assumptions about data distribution and absolute scales.…

Applications · Statistics 2025-11-18 Qingqing Song , Shaoliang Xia

Estimating the entropy rate of discrete time series is a challenging problem with important applications in numerous areas including neuroscience, genomics, image processing and natural language processing. A number of approaches have been…

Methodology · Statistics 2023-03-22 Ioannis Papageorgiou , Ioannis Kontoyiannis

It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…

Information Theory · Computer Science 2016-09-06 Kieran G. Larkin

In this article, the historic set is divided into different level sets and we use topological pressure to describe the size of these level sets. We give an application of these results to dimension theory. Especially, we use topological…

Dynamical Systems · Mathematics 2015-06-12 Xiaoyao Zhou , Ercai Chen

We consider some classes of piecewise expanding maps in finite dimensional spaces having invariant probability measures which are absolutely continuous with respect to Lebesgue measure. We derive an entropy formula for such measures and,…

Dynamical Systems · Mathematics 2018-06-05 Jose F. Alves , Antonio Pumarino

We provide a framework for studying randomly coloured point sets in a locally compact, second-countable space on which a metrisable unimodular group acts continuously and properly. We first construct and describe an appropriate dynamical…

Dynamical Systems · Mathematics 2019-08-15 Peter Müller , Christoph Richard

We address the problem of nonparametric estimation of characteristics for stationary and ergodic time series. We consider finite-alphabet time series and real-valued ones and the following four problems: i) estimation of the (limiting)…

Information Theory · Computer Science 2007-11-01 Boris Ryabko

It is demonstrated how to represent asymptotically mean stationary (AMS) random sources with values in standard spaces as mixtures of ergodic AMS sources. This an extension of the well known decomposition of stationary sources which has…

Information Theory · Computer Science 2008-04-17 Alexander Schoenhuth

The theory of regular model sets is highly developed, but does not cover examples such as the visible lattice points, the k-th power-free integers, or related systems. They belong to the class of weak model sets, where the window may have a…

Dynamical Systems · Mathematics 2022-11-29 Michael Baake , Christian Huck , Nicolae Strungaru