English
Related papers

Related papers: Thermodynamic Irreversibility of Training Algorith…

200 papers

Irreversibility is one of the most intriguing concepts in physics. While microscopic physical laws are perfectly reversible, macroscopic average behavior has a preferred direction of time. According to the second law of thermodynamics, this…

Quantum Physics · Physics 2017-04-12 T. B. Batalhao , A. M. Souza , R. S. Sarthour , I. S. Oliveira , M. Paternostro , E. Lutz , R. M. Serra

The entropy production is commonly interpreted as measuring the distance from equilibrium. However, this explanation lacks a rigorous description due to the absence of a natural equilibrium measure. The present analysis formalizes this…

Statistical Mechanics · Physics 2025-10-23 David Andrieux

The mechanism by which thermodynamics sets the direction of time's arrow has long fascinated scientists. Here, we show that a machine learning algorithm can learn to discern the direction of time's arrow when provided with a system's…

Statistical Mechanics · Physics 2019-09-30 Alireza Seif , Mohammad Hafezi , Christopher Jarzynski

In the statistical description of dynamical systems, an indication of the irreversibility of a given state change is given geometrically by means of a (pre-)ordering of state pairs. Reversible state changes of classical and quantum systems…

Mathematical Physics · Physics 2011-01-04 P. Busch

Time-irreversible stochastic processes are frequently used in natural sciences to explain non-equilibrium phenomena and to design efficient stochastic algorithms. Our main goal in this thesis is to analyse their dynamics by means of large…

Probability · Mathematics 2021-09-21 Mikola C. Schlottke

We propose to learn to distinguish reversible from irreversible actions for better informed decision-making in Reinforcement Learning (RL). From theoretical considerations, we show that approximate reversibility can be learned through a…

Machine Learning · Computer Science 2021-11-01 Nathan Grinsztajn , Johan Ferret , Olivier Pietquin , Philippe Preux , Matthieu Geist

A set of core features is set forth as the essence of a thermodynamic description, which derive from large-deviation properties in systems with hierarchies of timescales, but which are \emph{not} dependent upon conservation laws or…

Statistical Mechanics · Physics 2020-10-28 Eric Smith

Active matter describes systems whose constituents convert energy from their surroundings into directed motion, such as bacteria or catalytic colloids. We establish a thermodynamic law for dilute suspensions of interacting active particles…

Statistical Mechanics · Physics 2025-07-22 Lennart Dabelow , Ralf Eichhorn

This paper discusses the thermodynamic irreversibility realized in high-dimensional Hamiltonian systems with a time-dependent parameter. A new quantity, the irreversible information loss, is defined from the Lyapunov analysis so as to…

Statistical Mechanics · Physics 2009-10-31 Shin-ichi Sasa , Teruhisa S. Komatsu

We introduce Teleodynamic Learning, a new paradigm for machine learning in which learning is not the minimization of a fixed objective, but the emergence and stabilization of functional organization under constraint. Inspired by living…

Machine Learning · Computer Science 2026-03-13 Enrique ter Horst , Juan Diego Zambrano

It is a central question in quantum thermodynamics to determine how irreversible is a process that transforms an initial state $\rho$ to a final state $\sigma$, and whether such irreversibility can be thought of as a useful resource. For…

Quantum Physics · Physics 2018-08-09 Álvaro M. Alhambra , Stephanie Wehner , Mark M. Wilde , Mischa P. Woods

Entropy creation rate is introduced for a system interacting with thermostats ({\it i.e.}, in the usual language, for a system subject to internal conservative forces interacting with ``external'' thermostats via conservative forces) and a…

Statistical Mechanics · Physics 2007-05-23 G. Gallavotti

The efficient manipulation of thermodynamic states within the finite time is fundamentally constrained by the intrinsic dissipative cost. While the slow-driving regime is well-characterized by a universal $1/\tau$-scaling of…

Statistical Mechanics · Physics 2026-02-17 Cong Fu , Youhui Lin , Shanhe Su , Yu-Han Ma

Time-reversal had always been assumed to be a symmetry of physics at the fundamental level. In this paper we will explore the violations of time-reversal symmetry at the fundamental level and the consequences on thermodynamic systems.…

Statistical Mechanics · Physics 2015-06-05 Jose A. Magpantay

How is the irreversibility of a high-dimensional chaotic system controlled by the heterogeneity in the non-reciprocal interactions among its elements? In this paper, we address this question using a stochastic model of random recurrent…

Statistical Mechanics · Physics 2025-02-18 Tuan Pham , Albert Alonso , Karel Proesmans

Information dynamics is an emerging description of information processing in complex systems which describes systems in terms of intrinsic computation, identifying computational primitives of information storage and transfer. In this paper…

Statistical Mechanics · Physics 2018-10-03 Richard E. Spinney , Joseph T. Lizier , Mikhail Prokopenko

The second law of thermodynamics states that entropy production in macroscopic systems is non-negative, reaching zero only at thermodynamic equilibrium. As a corollary, this implies that the state trajectory of macroscopic systems is…

Statistical Mechanics · Physics 2025-01-30 O. Politano , Alejandro L. Garcia , F. Baras , M. Malek Mansour

We prove the equivalence among symmetricity, time reversibility, and zero entropy production of the stationary solutions of linear stochastic differential equations. A sufficient and necessary reversibility condition expressed in terms of…

Mathematical Physics · Physics 2007-05-23 Hong Qian

Most natural systems operate far from equilibrium, displaying time-asymmetric, irreversible dynamics characterized by a positive entropy production while exchanging energy and matter with the environment. Although stochastic thermodynamics…

Statistical Mechanics · Physics 2023-06-27 Miguel Aguilera , Masanao Igarashi , Hideaki Shimazaki

The process of training an artificial neural network involves iteratively adapting its parameters so as to minimize the error of the network's prediction, when confronted with a learning task. This iterative change can be naturally…

Machine Learning · Computer Science 2024-04-10 Kaloyan Danovski , Miguel C. Soriano , Lucas Lacasa