English
Related papers

Related papers: Learning entropy production via neural networks

200 papers

The problem of estimating entropy production from incomplete information in stochastic thermodynamics is essential for theory and experiments. Whereas a considerable amount of work has been done on this topic, arguably, most of it is…

Statistical Mechanics · Physics 2024-12-17 Pedro E. Harunari , Carlos E. Fiore , Andre C. Barato

The estimation of entropy rates for stationary discrete-valued stochastic processes is a well studied problem in information theory. However, estimating the entropy rate for stationary continuous-valued stochastic processes has not received…

Information Theory · Computer Science 2021-05-26 Andrew Feutrill , Matthew Roughan

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Ilya Nemenman , William Bialek , Rob de Ruyter van Steveninck

Stochastic thermodynamics allows us to define heat and work for microscopic systems far from thermodynamic equilibrium, based on observations of their stochastic dynamics. However, a complete account of the energetics necessitates that all…

Statistical Mechanics · Physics 2021-08-31 Jannik Ehrich

We present a general framework for deriving entropy production rates (EPRs) in active matter systems driven by non-Gaussian active fluctuations. Employing the probability-flow equivalence technique, we rigorously obtain an entropy…

Statistical Mechanics · Physics 2025-12-12 Yuanfei Huang , Chengyu Liu , Bing Miao , Xiang Zhou

Entropy production characterizes the thermodynamic irreversibility and reflects the amount of heat dissipated into the environment and free energy lost in nonequilibrium systems. According to the thermodynamic uncertainty relation, we…

Statistical Mechanics · Physics 2020-05-01 Tan Van Vu , Van Tuan Vo , Yoshihiko Hasegawa

One among the most intriguing results coming from the application of statistical mechanics to the study of brain is the understanding that it, as a dynamical system, is inherently out of equilibrium. In the realm of non-equilibrium…

Disordered Systems and Neural Networks · Physics 2025-12-01 Dario Lucente , Giacomo Gradenigo , Luca Salasnich

In many realistic systems, maximum entropy principle (MEP) analysis provides an effective characterization of the probability distribution of network states. However, to implement the MEP analysis, a sufficiently long-time data recording in…

Biological Physics · Physics 2019-02-27 Zhi-Qin John Xu , Jennifer Crodelle , Douglas Zhou , David Cai

In this article a classification of some proposed macroscopic entropy production (MEP) principles is given. With the help of simple electrical network models, at least six interesting and most used principles are distinguished: the least…

Statistical Mechanics · Physics 2007-05-23 Stijn Bruers

For a network of discrete states with a periodically driven Markovian dynamics, we develop an inference scheme for an external observer who has access to some transitions. Based on waiting-time distributions between these transitions, the…

Statistical Mechanics · Physics 2024-09-12 Alexander M. Maier , Julius Degünther , Jann van der Meer , Udo Seifert

Entropy is a central concept in physics, but can be challenging to calculate even for systems that are easily simulated. This is exacerbated out of equilibrium, where generally little is known about the distribution characterizing simulated…

Statistical Mechanics · Physics 2024-05-09 Samuel D. Gelman , Guy Cohen

Maximum likelihood estimation of energy-based models is a challenging problem due to the intractability of the log-likelihood gradient. In this work, we propose learning both the energy function and an amortized approximate sampling…

Machine Learning · Computer Science 2019-05-29 Rithesh Kumar , Sherjil Ozair , Anirudh Goyal , Aaron Courville , Yoshua Bengio

Entropy notions for $\varepsilon$-incremental practical stability and incremental stability of deterministic nonlinear systems under disturbances are introduced. The entropy notions are constructed via a set of points in state space which…

Optimization and Control · Mathematics 2022-09-13 Michelle S. Chong

Entropy production (EP) is a central quantity in nonequilibrium physics as it monitors energy dissipation, irreversibility, and free energy differences during thermodynamic transformations. Estimating EP, however, is challenging both…

Statistical Mechanics · Physics 2024-06-26 Jinghao Lyu , Kyle J. Ray , James P. Crutchfield

Entropy production is arguably the most universally applicable measure of non-equilibrium behavior, particularly for systems coupled to a heat bath. This setting encompasses driven soft matter as well as biomolecular, biochemical, and…

Statistical Mechanics · Physics 2025-12-09 Udo Seifert

The selection of an equilibrium state by maximising the entropy of a system, subject to certain constraints, is often powerfully motivated as an exercise in logical inference, a procedure where conclusions are reached on the basis of…

Statistical Mechanics · Physics 2015-12-03 Ian J. Ford

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

In this paper, we show how the MEP hypothesis may be used to build simple climate models without representing explicitly the energy transport by the atmosphere. The purpose is twofold. First, we assess the performance of the MEP hypothesis…

Atmospheric and Oceanic Physics · Physics 2017-03-21 Corentin Herbert , Didier Paillard

We study entropy production (EP) in processes involving repeated quantum measurements of finite quantum systems. Adopting a dynamical system approach, we develop a thermodynamic formalism for the EP and study fine aspects of irreversibility…

Mathematical Physics · Physics 2017-08-02 Tristan Benoist , Vojkan Jaksic , Yan Pautrat , Claude-Alain Pillet

The stochastic entropy generated during the evolution of a system interacting with an environment may be separated into three components, but only two of these have a non-negative mean. The third component of entropy production is…

Statistical Mechanics · Physics 2013-05-30 Ian J. Ford , Richard E. Spinney