English
Related papers

Related papers: Differential Entropy Rate Characterisations of Lon…

200 papers

On a fine grained scale the Gibbs entropy of an isolated system remains constant throughout its dynamical evolution. This is a consequence of Liouville's theorem for Hamiltonian systems and appears to contradict the second law of…

Statistical Mechanics · Physics 2017-07-05 Renato Pakter , Yan Levin

The conditional mean is a fundamental and important quantity whose applications include the theories of estimation and rate-distortion. It is also notoriously difficult to work with. This paper establishes novel bounds on the differential…

Information Theory · Computer Science 2022-11-23 Arda Atalik , Alper Köse , Michael Gastpar

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

We prove quantitative convergence rates at which discrete Langevin-like processes converge to the invariant distribution of a related stochastic differential equation. We study the setup where the additive noise can be non-Gaussian and…

Machine Learning · Computer Science 2020-11-20 Xiang Cheng , Dong Yin , Peter L. Bartlett , Michael I. Jordan

We consider Stochastic Volatility processes with heavy tails and possible long memory in volatility. We study the limiting conditional distribution of future events given that some present or past event was extreme (i.e. above a level which…

Statistics Theory · Mathematics 2011-08-17 Rafał Kulik , Philippe Soulier

We consider the problem of estimating the mean entropy production rate in a nonequilibrium process from the measurements of first-passage quantities associated with a single current. For first-passage processes with large thresholds, Refs.…

Statistical Mechanics · Physics 2025-06-05 Izaak Neri

We study entanglement properties of systems with spontaneously broken continuous symmetry. We find that in addition to the expected area law behavior, the entanglement entropy contains a subleading contribution which diverges…

Strongly Correlated Electrons · Physics 2015-01-09 Max A. Metlitski , Tarun Grover

Entropy rate is a real valued functional on the space of discrete random sources which lacks a closed formula even for subclasses of sources which have intuitive parameterizations. A good way to overcome this problem is to examine its…

Information Theory · Computer Science 2015-01-14 Alexander Schönhuth

In a glassy system different degrees of freedom have well-separated characteristic times, and are described by different temperatures. The stationary state is essentially non-equilibrium. A generalized statistical thermodynamics is…

Disordered Systems and Neural Networks · Physics 2007-05-23 A. E. Allahverdyan , Th. M. Nieuwenhuizen

The entropy power inequality for independent random vectors is a foundational result of information theory, with deep connections to probability and geometric functional analysis. Several extensions of the entropy power inequality have been…

Information Theory · Computer Science 2025-12-23 Mokshay Madiman , James Melbourne , Cyril Roberto

For quantum many-body systems with short-range correlations (SRCs), the intimate relationship between their magnitude, the behavior of the single-particle occupation probabilities at momenta larger than the Fermi momentum, and the…

Nuclear Theory · Physics 2023-06-23 Aurel Bulgac

The hydrodynamic part of the velocity autocorrelation function of a granular fluid in the homogeneous cooling state has been calculated by using mode-coupling theory for a finite system with periodic boundary conditions. The existence of…

Statistical Mechanics · Physics 2015-06-23 J. Javier Brey , M. J. Ruiz-Montero

We find the asymptotic distribution of the sample autocovariances of long-memory processes in cases of finite and infinite fourth moment. Depending on the interplay of assumptions on moments and the intensity of dependence, there are three…

Statistics Theory · Mathematics 2008-12-18 Lajos Horváth , Piotr Kokoszka

In this second part, we analyze the dissipation properties of Generalized Poisson-Kac (GPK) processes, considering the decay of suitable $L^2$-norms and the definition of entropy functions. In both cases, consistent energy dissipation and…

Statistical Mechanics · Physics 2017-08-02 Massimiliano Giona , Antonio Brasiello , Silvestro Crescitelli

The minimum entropy production principle provides an approximative variational characterization of close-to-equilibrium stationary states, both for macroscopic systems and for stochastic models. Analyzing the fluctuations of the empirical…

Mathematical Physics · Physics 2009-11-05 C. Maes , K. Netocny

We consider stochastic dynamical systems defined by differential equations with a uniform random time delay. The latter equations are shown to be equivalent to deterministic higher-order differential equations: for an $n$-th order equation…

Statistical Mechanics · Physics 2011-10-11 P. L. Krapivsky , J. M. Luck , K. Mallick

We present a method of estimating the rate of entropy production in underdamped dynamics by decomposing it into contributions originating in different non-equilibrium effects. Specifically, a non-zero average velocity, a non-thermal width…

Statistical Mechanics · Physics 2025-12-01 Mario A. Ciampini , Jakob Rieser , Nikolai Kiesel , Andreas Dechant

New entropy measures have been recently introduced for the quantification of the complexity of networks. Most of these entropy measures apply to static networks or to dynamical processes defined on static complex networks. In this paper we…

Disordered Systems and Neural Networks · Physics 2015-05-30 Kun Zhao , Arda Halu , Simone Severini , Ginestra Bianconi

The maximum entropy ansatz, as it is often invoked in the context of time-series analysis, suggests the selection of a power spectrum which is consistent with autocorrelation data and corresponds to a random process least predictable from…

Probability · Mathematics 2008-07-19 Tryphon T. Georgiou

The problem of estimating a parameter in the drift coefficient is addressed for $N$ discretely observed independent and identically distributed stochastic differential equations (SDEs). This is done considering additional constraints,…

Statistics Theory · Mathematics 2024-10-17 Chiara Amorino , Arnaud Gloter , Hélène Halconruy