English
Related papers

Related papers: Entropy estimators for Markovian sequences: A comp…

200 papers

Parameter estimation in Markov random fields (MRFs) is a difficult task, in which inference over the network is run in the inner loop of a gradient descent procedure. Replacing exact inference with approximate methods such as loopy belief…

Machine Learning · Computer Science 2012-06-18 Varun Ganapathi , David Vickrey , John Duchi , Daphne Koller

We present a simple comparative framework for testing and developing uncertainty modeling in uncertain marching cubes implementations. The selection of a model to represent the probability distribution of uncertain values directly…

Human-Computer Interaction · Computer Science 2024-09-16 Robert Sisneros , Tushar M. Athawale , David Pugmire , Kenneth Moreland

The interrelationships of the fundamental biological processes natural selection, mutation, and stochastic drift are quantified by the entropy rate of Moran processes with mutation, measuring the long-run variation of a Markov process. The…

Dynamical Systems · Mathematics 2014-01-14 Marc Harper

Understanding the structural complexity and predictability of complex networks is a central challenge in network science. Although recent studies have revealed a relationship between compression-based entropy and link prediction…

Social and Information Networks · Computer Science 2025-10-14 Sebastián Brzovic , Cristóbal Rojas , Andrés Abeliuk

The scalable calculation of matrix determinants has been a bottleneck to the widespread application of many machine learning methods such as determinantal point processes, Gaussian processes, generalised Markov random fields, graph models…

Numerical Analysis · Computer Science 2017-04-25 Jack Fitzsimons , Diego Granziol , Kurt Cutajar , Michael Osborne , Maurizio Filippone , Stephen Roberts

We propose two different approaches for introducing the information temperature of the binary N-th order Markov chains. The first approach is based on comparing the Markov sequences with the equilibrium Ising chains at given temperatures.…

Data Analysis, Statistics and Probability · Physics 2022-10-05 O. V. Usatenko , S. S. Melnyk , G. M. Pritula , V. A. Yampol'skii

In a recent Letter [1] a framework for estimating entropy was introduced and applied to one-dimensional and two-dimensional systems. In this Comment we show that the method is not well suited for estimating entropy in bidimensional systems…

Statistical Mechanics · Physics 2022-07-15 E. Brigatti , F. N. M. de Sousa Filho

Entropy production (EP) is a central measure in nonequilibrium thermodynamics, as it can quantify the irreversibility of a process as well as its energy dissipation in special cases. Using the time-reversal asymmetry in a system's path…

Statistical Mechanics · Physics 2022-04-26 Dong-Kyum Kim , Sangyun Lee , Hawoong Jeong

Estimating Monte Carlo error is critical to valid simulation results in Markov chain Monte Carlo (MCMC) and initial sequence estimators were one of the first methods introduced for this. Over the last few years, focus has been on…

Computation · Statistics 2025-07-08 Arka Banerjee , Dootika Vats

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson

We consider overdamped physical systems evolving under a feedback-controlled fluctuating potential and in contact with a thermal bath at temperature $T$. A Markovian description of the dynamics, which keeps only the last value of the…

Statistical Mechanics · Physics 2026-02-12 Natalia Ruiz-Pino , Antonio Prados

Reliable data-driven estimation of Shannon entropy from small data sets, where the number of examples is potentially smaller than the number of possible outcomes, is a critical matter in several applications. In this paper, we introduce a…

Machine Learning · Computer Science 2025-12-12 Gabriel F. A. Bastos , Jugurta Montalvão

Loosely speaking, the Shannon entropy rate is used to gauge a stochastic process' intrinsic randomness; the statistical complexity gives the cost of predicting the process. We calculate, for the first time, the entropy rate and statistical…

Statistical Mechanics · Physics 2017-09-13 S. E. Marzen , J. P. Crutchfield

A problem of improving the accuracy of nonparametric entropy estimation for a stationary ergodic process is considered. New weak metrics are introduced and relations between metrics, measures, and entropy are discussed. Based on weak…

Information Theory · Computer Science 2024-11-04 Evgeniy Timofeev , Alexei Kaltchenko

We present two classes of improved estimators for mutual information $M(X,Y)$, from samples of random points distributed according to some joint probability density $\mu(x,y)$. In contrast to conventional estimators based on binnings, they…

Statistical Mechanics · Physics 2009-11-10 Alexander Kraskov , Harald Stoegbauer , Peter Grassberger

Transfer entropy is a widely used measure for quantifying directed information flows in complex systems. While the challenges of estimating transfer entropy for continuous data are well known, it has two major shortcomings for data of…

Data Analysis, Statistics and Probability · Physics 2025-11-27 Alec Kirkley

In the paper, we introduce the maximum entropy estimator based on 2-dimensional empirical distribution of the observation sequence of hidden Markov model , when the sample size is big: in that case computing the maximum likelihood estimator…

Statistics Theory · Mathematics 2023-03-16 Shulan Hu , Xinyu Wang , Liming Wu

In stochastic modeling, the excess entropy -- the mutual information shared between a process's past and future -- represents the fundamental lower bound of the memory needed to simulate its dynamics. However, this bound cannot be saturated…

Quantum Physics · Physics 2026-02-27 Kelvin Onggadinata , Andrew Tanggara , Mile Gu , Dagomir Kaszlikowski

Entropy is a central concept in physics, but can be challenging to calculate even for systems that are easily simulated. This is exacerbated out of equilibrium, where generally little is known about the distribution characterizing simulated…

Statistical Mechanics · Physics 2024-05-09 Samuel D. Gelman , Guy Cohen

Language prediction is constrained by informational entropy intrinsic to language, such that there exists a limit to how accurate any language model can become and equivalently a lower bound to language compression. The most efficient…

Computation and Language · Computer Science 2025-11-14 Benjamin L. Badger , Matthew Neligeorge