English
Related papers

Related papers: Entropy Rate Bounds via Second-Order Statistics

200 papers

Overdamped stochastic systems maintained far from equilibrium can display sustained oscillations with fluctuations that decrease with the system size. The correlation time of such noisy limit cycles expressed in units of the cycle period is…

Statistical Mechanics · Physics 2025-01-31 Davide Santolin , Gianmaria Falasco

We consider a one-dimensional persisent random walk viewed as a deterministic process with a form of time reversal symmetry. Particle reservoirs placed at both ends of the system induce a density current which drives the system out of…

Chaotic Dynamics · Physics 2009-10-31 T. Gilbert , J. R. Dorfman

We demonstrate the existence of stochastic resonance (SR) in confined systems arising from entropy variations associated to the presence of irregular boundaries. When the motion of a Brownian particle is constrained to a region with uneven…

Statistical Mechanics · Physics 2009-06-05 P. S. Burada , G. Schmid , D. Reguera , J. M. Rubi , P. Hänggi

The universal bound on specific entropy was originally inferred from black hole thermodynamics. We here show from classical thermodynamics alone that for a system at fixed volume or fixed pressure, the ratio of entropy to nonrelativistic…

General Relativity and Quantum Cosmology · Physics 2014-05-29 Jacob D. Bekenstein

Estimating the entropy rate of discrete time series is a challenging problem with important applications in numerous areas including neuroscience, genomics, image processing and natural language processing. A number of approaches have been…

Methodology · Statistics 2023-03-22 Ioannis Papageorgiou , Ioannis Kontoyiannis

This paper provides a non-asymptotic analysis of linear stochastic approximation (LSA) algorithms with fixed stepsize. This family of methods arises in many machine learning tasks and is used to obtain approximate solutions of a linear…

Machine Learning · Statistics 2021-06-03 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Kevin Scaman , Hoi-To Wai

This paper investigates the asymptotic expansion for the maximum rate of fixed-length codes over a parallel Gaussian channel with feedback under the following setting: A peak power constraint is imposed on every transmitted codeword, and…

Information Theory · Computer Science 2017-07-11 Silas L. Fong , Vincent Y. F. Tan

For Gaussian random fields with values in $\mathbb{R}^d$, sharp upper and lower bounds on the probability of hitting a fixed set have been available for many years. These apply in particular to the solutions of systems of linear SPDEs. For…

Probability · Mathematics 2025-08-19 Robert C. Dalang , David Nualart , Fei Pu

This note is concerned with weakly interacting stochastic particle systems with possibly singular pairwise interactions. In this setting, we observe a connection between entropic propagation of chaos and exponential concentration bounds for…

Probability · Mathematics 2024-06-06 Joe Jackson , Antonios Zitridis

This paper focuses on systems of nonlinear second-order stochastic differential equations with multi-scales. The motivation for our study stems from mathematical physics and statistical mechanics, for examples, Langevin dynamics and…

Probability · Mathematics 2024-04-08 Nhu N. Nguyen , George Yin

This paper addresses the quantitative verification of finite-time constrained occupation time for stochastic continuous-time systems governed by stochastic differential equations (SDEs). Unlike classical reachability analysis, which focuses…

Systems and Control · Electrical Eng. & Systems 2026-04-22 Bai Xue , C. -H. Luke Ong

This paper considers the derivative of the entropy rate of a hidden Markov process with respect to the observation probabilities. The main result is a compact formula for the derivative that can be evaluated easily using Monte Carlo…

Information Theory · Computer Science 2010-01-11 Henry D. Pfister

We derive universal bounds for the finite-time survival probability of the stochastic work extracted in steady-state heat engines and the stochastic heat dissipated to the environment. We also find estimates for the time-dependent…

Statistical Mechanics · Physics 2022-02-23 Gonzalo Manzano , Édgar Roldán

In this paper relations among some kinds of cumulative entropies and moments of order statistics are presented. By using some characterizations and the symmetry of a non negative and absolutely continuous random variable X, lower and upper…

Statistics Theory · Mathematics 2020-09-07 Narayanaswamy Balakrishnan , Francesco Buono , Maria Longobardi

Consider a bound state (an eigenfunction) $\psi$ of an atom with $N$ electrons. We study the spectra of the one-particle density matrix $\gamma$ and of the one-particle kinetic energy density matrix $\tau$ associated with $\psi$. The paper…

Spectral Theory · Mathematics 2025-06-23 Alexander V. Sobolev

This paper focuses on stochastic partial differential equations (SPDEs) under two-time-scale formulation. Distinct from the work in the existing literature, the systems are driven by $\alpha$-stable processes with $\alpha \in(1,2)$. In…

Statistics Theory · Mathematics 2016-09-30 Jianhai Bao , George Yin , Chenggui Yuan

Configurational entropy is an important factor in the free energy change of many macromolecular recognition and binding processes, and has been intensively studied. Despite great progresses that have been made, the global sampling remains…

Biological Physics · Physics 2012-12-04 Wenzhao Li , Kai Wang , Suyan Tian , Pu Tian

We investigate the total stochastic entropy production of a two-level bosonic open quantum system under protocols of time dependent coupling to a harmonic environment. These processes are intended to represent the measurement of a system…

Quantum Physics · Physics 2023-01-24 D. Matos , L. Kantorovich , I. J. Ford

The Random Permutation Set (RPS) is a new type of set proposed recently, which can be regarded as the generalization of evidence theory. To measure the uncertainty of RPS, the entropy of RPS and its corresponding maximum entropy have been…

Information Theory · Computer Science 2024-03-12 Jiefeng Zhou , Zhen Li , Kang Hao Cheong , Yong Deng

The maximum entropy principle from statistical mechanics states that a closed system attains an equilibrium distribution that maximizes its entropy. We first show that for graphs with fixed number of edges one can define a stochastic edge…

Disordered Systems and Neural Networks · Physics 2007-05-23 Jesse S. A. Bridgewater , P. Oscar Boykin , Vwani P. Roychowdhury