English
Related papers

Related papers: Fluctuation-response theorem for Kullback-Leibler …

200 papers

A coupling of structural and thermodynamic fluctuations in the course of various-type insertion processes is investigated within a combination of Gibbsian statistics and the information theory approach. It is shown that the coupling makes…

Statistical Mechanics · Physics 2007-05-23 E. V. Vakarin , J. P. Badiali

Sagawa and Ueda established a fluctuation theorem of information exchange by revealing the role of correlations in stochastic thermodynamics and unified the non-equilibrium thermodynamics of measurement and feedback control [T. Sagawa and…

Statistical Mechanics · Physics 2019-03-26 Lee Jinwoo

We propose a new perspective on Turbulence using Information Theory. We compute the entropy rate of a turbulent velocity signal and we particularly focus on its dependence on the scale. We first report how the entropy rate is able to…

Statistical Mechanics · Physics 2016-11-03 Carlos Granero-Belinchon , Stephane G. Roux , Nicolas B. Garnier

Turbulent flows are out-of-equilibrium because the energy supply at large scales and its dissipation by viscosity at small scales create a net transfer of energy among all scales. Here, the energy cascade is approximated by a combined…

Fluid Dynamics · Physics 2021-01-11 Amilcare Porporato , Milad Hooshyar , Andrew D Bragg , Gabriel Katul

The capability of a novel Kullback-Leibler divergence method is examined herein within the Kalman filter framework to select the input-parameter-state estimation execution with the most plausible results. This identification suffers from…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Marios Impraimakis

It will be shown, how the Boltzmannian ideas on statistical physics can be naturally applied to nonequilibrium thermodynamics. A similar approach for treating nonequilibrium phenomena has been successfully used by Einstein and Smoluchowski…

Statistical Mechanics · Physics 2007-05-23 W. Pietsch

We analytically describe the decay to equilibrium of generic observables of a non-integrable system after a perturbation in the form of a random matrix. We further obtain an analytic form for the time-averaged fluctuations of an observable…

Quantum Physics · Physics 2019-06-05 Charlie Nation , Diego Porras

A well-known technique in estimating probabilities of rare events in general and in information theory in particular (used, e.g., in the sphere-packing bound), is that of finding a reference probability measure under which the event of…

Information Theory · Computer Science 2014-12-23 Rami Atar , Neri Merhav

We derive the fluctuation dynamics of a probe in weak coupling with a "living" medium, modeled as particles undergoing an active Ornstein-Uhlenbeck dynamics. Nondissipative corrections to the fluctuation-dissipation relation are written out…

Soft Condensed Matter · Physics 2020-11-18 Christian Maes

The article provides a unitary and complete solution to the fluctuation-dissipation relations for particle hydromechanics in a generic fluid, accounting for the hydrodynamic fluid-particle interactions (including arbitrary memory kernels in…

Statistical Mechanics · Physics 2024-12-30 Massimiliano Giona , Giuseppe Procopio , Chiara Pezzotti

Fluctuation theorems have become an important tool in single molecule biophysics to measure free energy differences from non-equilibrium experiments. When significant coarse-graining or noise affect the measurements, the determination of…

Statistical Mechanics · Physics 2016-03-09 Reinaldo García-García , Sourabh Lahiri , David Lacoste

We relate the information exchange between two stochastic systems to the nonequilibrium entropy production in the whole system. By deriving a general formula that decomposes the total entropy production into the thermodynamic and…

Statistical Mechanics · Physics 2015-06-16 Takahiro Sagawa , Masahito Ueda

Measures of information transfer have become a popular approach to analyze interactions in complex systems such as the Earth or the human brain from measured time series. Recent work has focused on causal definitions of information transfer…

Methodology · Statistics 2016-03-21 Jakob Runge

Physical systems that power motion and create structure in a fixed amount of time dissipate energy and produce entropy. Whether living or synthetic, systems performing these dynamic functions must balance dissipation and speed. Here, we…

Statistical Mechanics · Physics 2020-12-18 Schuyler B. Nicholson , Luis Pedro Garcia-Pintos , Adolfo del Campo , Jason R. Green

We address the trade-off between information and disturbance in qubit thermometry from the perspective of quantum estimation theory. Given a quantum measurement, we quantify information via the Fisher information of the measurement and…

Quantum Physics · Physics 2018-04-16 Luigi Seveso , Matteo G. A. Paris

Large deviation theory (LDT) provides a mathematical framework to quantify the probabilities of rare events in stochastic systems. In this study, we applied LDT to model a chemical reaction system and demonstrated that the fluctuation…

Chemical Physics · Physics 2025-01-22 Tatsuaki Tsuruyama

For the multivariate linear regression model with unknown covariance, the corrected Akaike information criterion is the minimum variance unbiased estimator of the expected Kullback--Leibler discrepancy. In this study, based on the loss…

Statistics Theory · Mathematics 2023-03-20 Takeru Matsuda

We show that an appropriately defined fluctuation-dissipation theorem, connecting generalized susceptibilities and time correlation functions, is valid for times shorter than the nucleation time of the metastable state of Markovian systems…

Statistical Mechanics · Physics 2009-11-10 G. Baez , H. Larralde , F. Leyvraz , R. A. Mendez-Sanchez

In this work we present a new method for the estimation of Mutual Information (MI) between random variables. Our approach is based on an original interpretation of the Girsanov theorem, which allows us to use score-based diffusion models to…

Machine Learning · Computer Science 2024-05-16 Giulio Franzese , Mustapha Bounoua , Pietro Michiardi

Any physical system can be viewed from the perspective that information is implicitly represented in its state. However, the quantification of this information when it comes to complex networks has remained largely elusive. In this work, we…

Physics and Society · Physics 2016-12-23 Manlio De Domenico , Jacob Biamonte