English
Related papers

Related papers: Learning entropy production via neural networks

200 papers

A method is provided for designing and training noise-driven recurrent neural networks as models of stochastic processes. The method unifies and generalizes two known separate modeling approaches, Echo State Networks (ESN) and Linear…

Adaptation and Self-Organizing Systems · Physics 2014-04-14 Mathieu N. Galtier , Camille Marini , Gilles Wainrib , Herbert Jaeger

We find the relation between reliability and entropy production in a realistic model of electronic memory (low-power MOS-based SRAM) where logical values are encoded as metastable non-equilibrium states. We employ large deviations…

Statistical Mechanics · Physics 2022-03-14 Nahuel Freitas , Karel Proesmans , Massimiliano Esposito

This work develops a new method for estimating and optimizing the directed information rate between two jointly stationary and ergodic stochastic processes. Building upon recent advances in machine learning, we propose a recurrent neural…

Information Theory · Computer Science 2022-03-29 Dor Tsur , Ziv Aharoni , Ziv Goldfeld , Haim Permuter

Metriplectic systems are learned from data in a way that scales quadratically in both the size of the state and the rank of the metriplectic data. Besides being provably energy conserving and entropy stable, the proposed approach comes with…

Machine Learning · Computer Science 2025-01-28 Anthony Gruber , Kookjin Lee , Haksoo Lim , Noseong Park , Nathaniel Trask

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…

Classical Physics · Physics 2016-10-03 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

We derive a bound for entropy production in terms of the mean of normalizable path-antisymmetric observables. The optimal observable for this bound is shown to be the signum of entropy production, which is often easier determined or…

Statistical Mechanics · Physics 2024-10-07 Gabriel Knotz , Till M. Muenker , Timo Betz , Matthias Krüger

Energy flow in bio-molecular motors and machines are vital to their function. Yet experimental observations are often limited to a small subset of variables that participate in energy transport and dissipation. Here we show, through a…

Statistical Mechanics · Physics 2016-08-17 Shou-Wen Wang , Kyogo Kawaguchi , Shin-ichi Sasa , Lei-Han Tang

Nonequilibrium thermodynamics (NET) investigates processes in systems out of global equilibrium. On a mesoscopic level, it provides a statistical dynamic description of various complex phenomena such as chemical reactions, ion transport,…

Statistical Mechanics · Physics 2016-04-20 Hong Qian , Signe Kjelstrup , Anatoly B. Kolomeisky , Dick Bedeaux

Active matter systems, from self-propelled colloids to motile bacteria, are characterized by the conversion of free energy into useful work at the microscopic scale. They involve physics beyond the reach of equilibrium statistical…

Statistical Mechanics · Physics 2024-06-18 Nicholas M. Boffi , Eric Vanden-Eijnden

Modelling the evolution of a system using stochastic dynamics typically implies a greater subjective uncertainty in the adopted system coordinates as time progresses, and stochastic entropy production has been developed as a measure of this…

Statistical Mechanics · Physics 2023-02-06 Jonathan Dexter , Ian J. Ford

This study examines a new formulation of non-equilibrium thermodynamics, which gives a conditional derivation of the ``maximum entropy production'' (MEP) principle for flow and/or chemical reaction systems at steady state. The analysis uses…

Populations and Evolution · Quantitative Biology 2009-08-25 Robert K. Niven

Many have speculated whether nonequilibrium systems obey principles of maximum or minimum entropy production. In this work, we use stochastic thermodynamics to derive the condition for the minimum entropy production state (MEPS) for…

Statistical Mechanics · Physics 2025-07-25 Kyle J. Ray , Alexander B. Boyd

Measuring the predictability and complexity of time series using entropy is essential tool de-signing and controlling a nonlinear system. However, the existing methods have some drawbacks related to the strong dependence of entropy on the…

Machine Learning · Computer Science 2022-01-14 Andrei Velichko , Hanif Heidari

Modern deep neural networks achieved remarkable progress in medical image segmentation tasks. However, it has recently been observed that they tend to produce overconfident estimates, even in situations of high uncertainty, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Agostina Larrazabal , Cesar Martinez , Jose Dolz , Enzo Ferrante

Estimating entropy production from real observation data can be difficult due to finite resolution in both space and time and finite measurement statistics. We characterize the statistical error introduced by finite sample size and compare…

Statistical Mechanics · Physics 2025-04-09 Jonas H. Fritz , Benjamin Ertel , Udo Seifert

Entropy measures are effective features for time series classification problems. Traditional entropy measures, such as Shannon entropy, use probability distribution function. However, for the effective separation of time series, new entropy…

Machine Learning · Computer Science 2023-05-19 Andrei Velichko , Maksim Belyaev , Yuriy Izotov , Murugappan Murugappan , Hanif Heidari

Distributed state estimation is examined for a sensor network tasked with reconstructing a system's state through the use of a distributed and event-triggered observer. Each agent in the sensor network employs a deep neural network (DNN) to…

Systems and Control · Electrical Eng. & Systems 2022-02-07 Federico M. Zegers , Runhan Sun , Girish Chowdhary , Warren E. Dixon

For a Markovian dynamics on discrete states, the logarithmic ratio of waiting-time distributions between two successive, instantaneous transitions in forward and backward direction is a measure of time-irreversibility. It thus serves as an…

Statistical Mechanics · Physics 2024-06-13 Ellen Meyberg , Julius Degünther , Udo Seifert

Inspired by the success of generative pretraining in natural language, we ask whether the same principles can yield strong self-supervised visual learners. Instead of training models to output features for downstream use, we train them to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Sihan Xu , Ziqiao Ma , Wenhao Chai , Xuweiyi Chen , Weiyang Jin , Joyce Chai , Saining Xie , Stella X. Yu

The information on a quantum process acquired through measurements plays a crucial role in the determination of its non-equilibrium thermodynamic properties. We report on the experimental inference of the stochastic entropy production rate…