English
Related papers

Related papers: The typical set and entropy in stochastic systems …

200 papers

Entropy is a central concept in physics, but can be challenging to calculate even for systems that are easily simulated. This is exacerbated out of equilibrium, where generally little is known about the distribution characterizing simulated…

Statistical Mechanics · Physics 2024-05-09 Samuel D. Gelman , Guy Cohen

Many complex systems are characterized by non-Boltzmann distribution functions of their statistical variables. If one wants to -- justified or not -- hold on to the maximum entropy principle for complex statistical systems (non-Boltzmann)…

Statistical Mechanics · Physics 2009-11-13 Stefan Thurner , Rudolf Hanel

Background: Autocatalytic sets are often considered a necessary (but not sufficient) condition for the origin and early evolution of life. Although the idea of autocatalytic sets was already conceived of many years ago, only recently have…

Molecular Networks · Quantitative Biology 2012-06-06 Wim Hordijk , Mike Steel

Adaptive dynamical systems arise in a multitude of contexts, e.g., optimization, control, communications, signal processing, and machine learning. A precise characterization of their fundamental limitations is therefore of paramount…

Information Theory · Computer Science 2010-10-13 Maxim Raginsky

Although coarse-grained models have been widely used to explain exotic phenomena in complex fluids, such as droplet formation in living cells, these conventional approaches often fail to capture the intricate microscopic degrees of freedom…

Soft Condensed Matter · Physics 2025-06-13 Masanari Shimada , Tetsuya J. Kobayashi

Entropy is one of the key thermodynamic variables reflecting changes in the state of matter. Unlike other thermodynamic variables, it is well-defined also for nonequilibrium steady states through its relation to information. Applying this…

Statistical Mechanics · Physics 2026-04-15 Haim Diamant , Gil Ariel

We lift important results about universally typical sets, typically sampled sets, and empirical entropy estimation in the theory of samplings of discrete ergodic information sources from the usual one-dimensional discrete-time setting to a…

Information Theory · Computer Science 2013-11-13 Tyll Krueger , Guido Montufar , Ruedi Seiler , Rainer Siegmund-Schultze

Random perturbations applied in tandem to an ensemble of oscillating objects can synchronize their motion. We study multiple copies of an arbitrary dynamical system in a stable limit cycle, described via a standard phase reduction picture.…

Statistical Mechanics · Physics 2024-02-23 Yunxiang Song , Thomas A. Witten

Permutation entropy measures the complexity of deterministic time series via a data symbolic quantization consisting of rank vectors called ordinal patterns or just permutations. The reasons for the increasing popularity of this entropy in…

Data Analysis, Statistics and Probability · Physics 2021-03-08 José M. Amigó , Roberto Dale , Piergiulio Tempesta

The concept of entropy in statistical physics is related to the existence of irreversible macroscopic processes. In this work, we explore a recently introduced entropy formula for a class of stochastic processes with more than one absorbing…

Populations and Evolution · Quantitative Biology 2022-10-21 Diogo Costa-Cabanas , Fabio A. C. C. Chalub , Max O. Souza

Consider a uniformly sampled random $d$-regular graph on $n$ vertices. If $d$ is fixed and $n$ goes to $\infty$ then we can relate typical (large probability) properties of such random graph to a family of invariant random processes (called…

Probability · Mathematics 2021-12-07 Ágnes Backhausz , Charles Bordenave , Balázs Szegedy

In this paper, we extend the concept of generalized entropy to uniform spaces, allowing computations beyond metrizable settings. We apply this to parabolic dynamics - systems with a unique fixed point uniformly attracting all compact…

Dynamical Systems · Mathematics 2025-07-02 Frederico A. C. L. Marinho , Hellen de Paula , Lucas H. R. de Souza

We investigate the role of a statistical complexity measure to assign equilibration in isolated quantum systems. While unitary dynamics preserve global purity, expectation values of observables often exhibit equilibration-like behavior,…

Quantum Physics · Physics 2025-08-14 Marcos G. Alpino , Tiago Debarba , Reinaldo O. Vianna , André T. Cesário

Complexity science offers a wide range of measures for quantifying unpredictability, structure, and information. Yet, a systematic conceptual organization of these measures is still missing. We present a unified framework that locates…

Machine Learning · Computer Science 2025-05-13 Nima Dehghani

The maximum entropy principle (MEP) apparently allows us to derive, or justify, fundamental results of equilibrium statistical mechanics. Because of this, a school of thought considers the MEP as a powerful and elegant way to make…

Statistical Mechanics · Physics 2015-12-09 Gennaro Auletta , Lamberto Rondoni , Angelo Vulpiani

In this paper, we introduce a notion of algorithmic stability called typical stability. When our goal is to release real-valued queries (statistics) computed over a dataset, this notion does not require the queries to be of bounded…

Machine Learning · Computer Science 2016-09-20 Raef Bassily , Yoav Freund

We review the behaviour of the Gibbs' and conditional entropies in deterministic and stochastic systems and continue to a formulation appropriate for a stochastically perturbed system with delayed dynamics. The underlying question driving…

Mathematical Physics · Physics 2024-06-24 Michael C. Mackey , Marta Tyran-Kaminska

Complex systems are characterised by a tight, nontrivial interplay of their constituents, which gives rise to a multi-scale spectrum of emergent properties. In this scenario, it is practically and conceptually difficult to identify those…

Statistical Mechanics · Physics 2022-10-19 Roi Holtzman , Marco Giulini , Raffaello Potestio

One calls attention to the fact that the stochastic physical systems are not random completely. They have both random and regular components of their evolution. Dynamic system is considered to be a special case of physical system with…

General Physics · Physics 2007-05-23 Yuri A. Rylov

With a view to connecting random mutation on the molecular level to punctuated equilibrium behavior on the phenotype level, we propose a new model for biological evolution, which incorporates random mutation and natural selection. In this…

Condensed Matter · Physics 2009-10-28 M. Y. Choi , H. Y. Lee , D. Kim , S. H. Park