English
Related papers

Related papers: A Development of Continuous-Time Transfer Entropy

200 papers

The method of maximum entropy (ME) is extended to address the following problem: Once one accepts that the ME distribution is to be preferred over all others, the question is to what extent are distributions with lower entropy supposed to…

Mathematical Physics · Physics 2009-10-31 Ariel Caticha

Consider a uniformly sampled random $d$-regular graph on $n$ vertices. If $d$ is fixed and $n$ goes to $\infty$ then we can relate typical (large probability) properties of such random graph to a family of invariant random processes (called…

Probability · Mathematics 2021-12-07 Ágnes Backhausz , Charles Bordenave , Balázs Szegedy

We study entropy production (EP) in processes involving repeated quantum measurements of finite quantum systems. Adopting a dynamical system approach, we develop a thermodynamic formalism for the EP and study fine aspects of irreversibility…

Mathematical Physics · Physics 2017-08-02 Tristan Benoist , Vojkan Jaksic , Yan Pautrat , Claude-Alain Pillet

The time evolution of complex systems usually can be described through stochastic processes. These processes are measured at finite resolution, what necessarily reduces them to finite sequences of real numbers. In order to relate these data…

Condensed Matter · Physics 2007-05-23 D. M. Tavares , L. S. Lucena

In this paper, we examine the Renyi entropy rate of stationary ergodic processes. For a special class of stationary ergodic processes, we prove that the Renyi entropy rate always exists and can be polynomially approximated by its defining…

Information Theory · Computer Science 2022-07-18 Chengyu Wu , Yonglong Li , Li Xu , Guangyue Han

Local correlation entropy, introduced by Takens in 1983, represents the exponential decay rate of the relative frequency of recurrences in the trajectory of a point, as the embedding dimension grows to infinity. In this paper we study…

Dynamical Systems · Mathematics 2021-12-09 Vladimír Špitalský

Semi-Markov processes play an important role in the effective description of partially accessible systems in stochastic thermodynamics. They occur, for instance, in coarse-graining procedures such as state lumping and when analyzing waiting…

Statistical Mechanics · Physics 2026-01-19 Alexander M. Maier , Jonas H. Fritz , Udo Seifert

We propose a novel, tractable latent state inference scheme for Markov jump processes, for which exact inference is often intractable. Our approach is based on an entropic matching framework that can be embedded into the well-known…

Machine Learning · Computer Science 2026-02-27 Yannick Eich , Bastian Alt , Heinz Koeppl

The thermodynamic uncertainty relation expresses a universal trade-off between precision and entropy production, which applies in its original formulation to current observables in steady-state systems. We generalize this relation to…

Statistical Mechanics · Physics 2018-12-06 Timur Koyuk , Udo Seifert , Patrick Pietzonka

The fluctuation relations have received considerable attention since their emergence and development in the 1990s. We present a summary of the main results and suggest ways to interpret this material. Starting with a consideration of the…

Statistical Mechanics · Physics 2012-02-01 Richard E. Spinney , Ian J. Ford

Entanglement entropies of two-dimensional gapped ground states are expected to satisfy an area law, with a constant correction term known as the topological entanglement entropy (TEE). In many models, the TEE takes a universal value that…

Quantum Physics · Physics 2023-11-02 Isaac H. Kim , Michael Levin , Ting-Chun Lin , Daniel Ranard , Bowen Shi

A notion of entropy is introduced for causal fermion systems. This entropy is a measure of the state of disorder of a causal fermion system at a given time compared to the vacuum. The definition is given both in the finite and…

Mathematical Physics · Physics 2021-10-07 Felix Finster

The problem of assigning probability distributions which objectively reflect the prior information available about experiments is one of the major stumbling blocks in the use of Bayesian methods of data analysis. In this paper the method of…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

'Causal' direction is of great importance when dealing with complex systems. Often big volumes of data in the form of time series are available and it is important to develop methods that can inform about possible causal connections between…

Statistical Mechanics · Physics 2014-01-24 Fatimah Abdul Razak , Henrik Jeldtoft Jensen

Finding the entropy rate of Hidden Markov Processes is an active research topic, of both theoretical and practical importance. A recently used approach is studying the asymptotic behavior of the entropy rate in various regimes. In this…

Information Theory · Computer Science 2016-11-17 Or Zuk , Eytan Domany , Ido Kanter , Michael Aizenman

In this paper we develop the concept of information transfer between the Borel-measurable sets for a dynamical system described by a measurable space and a non-singular transformation. The concept is based on how Shannon entropy is…

Systems and Control · Electrical Eng. & Systems 2019-10-01 Subhrajit Sinha , Umesh Vaidya , Enoch Yeung

Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical…

Probability · Mathematics 2025-03-21 Naveen Kumar , Ambesh Dixit , Vivek Vijay

Topological entropy or spatial entropy is a way to measure the complexity of shift spaces. This study investigates the relationships between the spatial entropy and the various periodic entropies which are computed by skew-coordinated…

Dynamical Systems · Mathematics 2022-07-26 Wen-Guei Hu , Guan-Yu Lai , Song-Sun Lin

Entropy production characterizes the thermodynamic irreversibility and reflects the amount of heat dissipated into the environment and free energy lost in nonequilibrium systems. According to the thermodynamic uncertainty relation, we…

Statistical Mechanics · Physics 2020-05-01 Tan Van Vu , Van Tuan Vo , Yoshihiko Hasegawa

Thermo-Kinetic relations bound thermodynamic quantities such as entropy production with statistics of dynamical observables. We introduce a Thermo-Kinetic Relation to bound the entropy production or the non-adiabatic (Hatano-Sasa, excess)…

Statistical Mechanics · Physics 2022-06-06 Jean-Charles Delvenne , Gianmaria Falasco