English
Related papers

Related papers: Polyadic Entropy, Synergy and Redundancy among Sta…

200 papers

Information entropy is applied to the state of knowledge of reaction amplitudes in pseudoscalar meson photoproduction, and a scheme is developed that quantifies the information content of a measured set of polarization observables. It is…

High Energy Physics - Phenomenology · Physics 2010-09-02 D. G. Ireland

Information transfer between coupled stochastic dynamics, measured by transfer entropy and information flow, is suggested as a physical process underlying the causal relation of systems. While information transfer analysis has booming…

Statistical Mechanics · Physics 2022-04-29 Yang Tian , Hedong Hou , Yaoyuan Wang , Ziyang Zhang , Pei Sun

This paper investigates the fundamental information-theoretic limits for the control and sensing of noiseless linear dynamical systems subject to a broad class of nonlinear observations. We analyze the interactions between the control and…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Ming Li , Fan Liu , Yifeng Xiong , Jie Xu , Tao Liu

With the help of a general expression of the entropies in extensive and nonextensive systems, some important relations between thermodynamics and statistical mechanics are revealed through the views of thermodynamics and statistic physics.…

Statistical Mechanics · Physics 2009-11-13 Zhifu Huang , Congjie Ou , A. Le Mehaute , Qiuping A. Wang , Jincan Chen

Causal inference seeks to identify cause-and-effect interactions in coupled systems. A recently proposed method by Liang detects causal relations by quantifying the direction and magnitude of information flow between time series. The…

Data Analysis, Statistics and Probability · Physics 2024-03-20 Dionissios T. Hristopulos

The information on a quantum process acquired through measurements plays a crucial role in the determination of its non-equilibrium thermodynamic properties. We report on the experimental inference of the stochastic entropy production rate…

The extension of thermodynamic principles to active matter remains a challenge due to the non-equilibrium nature inherent to active systems. In this study, we introduce a framework to assess entropy in our minimal macroscopic experiment…

Soft Condensed Matter · Physics 2024-09-26 Francesco Romanò , Michael Riedl

Entropy is a central concept in physics, but can be challenging to calculate even for systems that are easily simulated. This is exacerbated out of equilibrium, where generally little is known about the distribution characterizing simulated…

Statistical Mechanics · Physics 2024-05-09 Samuel D. Gelman , Guy Cohen

Proteins are regularly described with some general indices (mass fractal dimension, surface fractal dimension, entropy, enthalpy, free energies, hydrophobicity, denaturation temperature etc..), which are inherently statistical in nature.…

Biomolecules · Quantitative Biology 2009-07-02 Anirban Banerji , Indira Ghosh

This paper provides a perspective on applying the concepts of information thermodynamics, developed recently in non-equilibrium statistical physics, to problems in theoretical neuroscience. Historically, information and energy in…

Neurons and Cognition · Quantitative Biology 2024-09-27 Jan Karbowski

An important issue during an engineering design process is to develop an understanding which design parameters have the most influence on the performance. Especially in the context of optimization approaches this knowledge is crucial in…

Information Theory · Computer Science 2024-10-28 Patricia Wollstadt , Sebastian Schmitt

Assessing the synergistic high-order behaviors (HOBs) that emerge from underlying structural mechanisms is crucial to characterize complex systems. This work leverages the combined use of predictability and information measures to detect…

Quantitative Methods · Quantitative Biology 2025-12-16 Chiara Barà , Yuri Antonacci , Laura Sparacino , Helder Pinto , Michal Javorka , Sebastiano Stramaglia , Luca Faes

General characterization of physical measurements is discussed within the framework of a classical information theory. Uncertainty relation for simultaneous measurements of two physical observables is defined in this framework for…

Quantum Physics · Physics 2012-12-18 Yoshimasa Kurihara

Entropic dynamics is a framework for defining dynamical systems that is aligned with the principles of information theory. In an entropic dynamics model for motion on a statistical manifold, we find that the rate of changes for expected…

Dynamical Systems · Mathematics 2021-07-15 Pedro Pessoa

Is reduction always a good scientific strategy? Does it always lead to a gain in information? The very existence of the special sciences above and beyond physics seems to hint no. Previous research has shown that dimension reduction…

Information Theory · Computer Science 2021-04-28 Thomas Varley , Erik Hoel

The physical foundations of a variety of emerging technologies --- ranging from the applications of quantum entanglement in quantum information to the applications of nonequilibrium bulk and interface phenomena in microfluidics, biology,…

Quantum Physics · Physics 2014-03-25 Gian Paolo Beretta , Enzo Zanchini

The concept of entropy, firstly introduced in information theory, rapidly became popular in many applied sciences via Shannon's formula to measure the degree of heterogeneity among observations. A rather recent research field aims at…

Methodology · Statistics 2017-03-20 Linda Altieri , Daniela Cocchi , Giulia Roli

The degree of non-Markovianity of quantum processes has been characterized in several different ways in the recent literature. However, the relationship between the non-Markovian behavior and the flow of information between the system and…

Psychological network approaches propose to see symptoms or questionnaire items as interconnected nodes, with links between them reflecting pairwise statistical dependencies evaluated cross-sectional, time-series, or panel data. These…

Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible $N$--point correlation is measured by a decrease…

Biological Physics · Physics 2016-09-08 Elad Schneidman , Susanne Still , Michael J. Berry , William Bialek