English
Related papers

Related papers: Quantifying system-environment synergistic informa…

200 papers

Bistable biological regulatory systems need to cope with stochastic noise to fine-tune their function close to bifurcation points. Here, we study stability properties of this regime in generic systems to demonstrate that cooperative…

Adaptation and Self-Organizing Systems · Physics 2025-08-04 Daniele Proverbio , Arthur N. Montanari , Alexander Skupin , Jorge Gonçalves

Decomposing knowledge into interchangeable pieces promises a generalization advantage when there are changes in distribution. A learning agent interacting with its environment is likely to be faced with situations requiring novel…

Machine Learning · Computer Science 2021-05-20 Kanika Madan , Nan Rosemary Ke , Anirudh Goyal , Bernhard Schölkopf , Yoshua Bengio

Intelligent behavior in life-like systems often arises from the ability to gather, process, and act on information. While active matter provides a framework for studying life-like dynamics, it typically omits internal information-processing…

Statistical Mechanics · Physics 2026-03-02 Kristian Stølevik Olsen , Mitsusuke Tarama , Hartmut Löwen

In this paper, we define a new measure of the redundancy of information from a fault tolerance perspective. The partial information decomposition (PID) emerged last decade as a framework for decomposing the multi-source mutual information…

Information Theory · Computer Science 2024-04-03 Jesse Milzman

Most nervous systems encode information about stimuli in the responding activity of large neuronal networks. This activity often manifests itself as dynamically coordinated sequences of action potentials. Since multiple electrode recordings…

Neurons and Cognition · Quantitative Biology 2011-11-09 Kristina Lisa Klinkner , Cosma Rohilla Shalizi , Marcelo F. Camperi

We consider the formalism of information decomposition of target effects from multi-source interactions, i.e. the problem of defining redundant and synergistic components of the information that a set of source variables provides about a…

Statistical Mechanics · Physics 2019-04-24 Daniele Marinazzo , Leonardo Angelini , Mario Pellicoro , Sebastiano Stramaglia

Understanding the dynamical behavior of complex systems is of exceptional relevance in everyday life, from biology to economy. In order to describe the dynamical organization of complex systems, existing methods require the knowledge of the…

Adaptation and Self-Organizing Systems · Physics 2017-03-07 Marco Fiorucci

I propose here a new concept of information based on two relevant aspects of its expression. The first related to the undeniable fact that the expression of information modifies the physical state of its receiver. The second to the…

Populations and Evolution · Quantitative Biology 2007-05-23 Antonio Leon

Since its introduction, the partial information decomposition (PID) has emerged as a powerful, information-theoretic technique useful for studying the structure of (potentially higher-order) interactions in complex systems. Despite its…

Information Theory · Computer Science 2023-12-11 Thomas F. Varley

The dynamic range measures the capacity of a system to discriminate the intensity of an external stimulus. Such an ability is fundamental for living beings to survive: to leverage resources and to avoid danger. Consequently, the larger is…

Neurons and Cognition · Quantitative Biology 2012-05-02 Leonardo L. Gollo , Claudio Mirasso , Víctor M. Eguíluz

Bivariate Partial Information Decomposition (PID) describes how the mutual information between a random variable M and two random variables Y and Z is decomposed into unique, redundant, and synergistic terms. Recently, PID has shown promise…

Information Theory · Computer Science 2023-05-12 Chaitanya Goswami , Amanda Merkley , Pulkit Grover

As a living information and communications system, the genome encodes patterns in single nucleotide polymorphisms (SNPs) reflecting human adaption that optimizes population survival in differing environments. This paper mathematically…

Populations and Evolution · Quantitative Biology 2018-03-22 James Lindesay , Tshela E. Mason , William Hercules , Georgia M. Dunston

The dynamics of systems biological processes are usually modeled by a system of ordinary differential equations (ODEs) with many unknown parameters that need to be inferred from noisy and sparse measurements. Here, we introduce…

Quantitative Methods · Quantitative Biology 2022-02-04 Mitchell Daneker , Zhen Zhang , George Em Karniadakis , Lu Lu

The integration and transfer of information from multiple sources to multiple targets is a core motive of neural systems. The emerging field of partial information decomposition (PID) provides a novel information-theoretic lens into these…

Information Theory · Computer Science 2021-10-28 Ari Pakman , Amin Nejatbakhsh , Dar Gilboa , Abdullah Makkeh , Luca Mazzucato , Michael Wibral , Elad Schneidman

The recent explosion of interest in multimodal applications has resulted in a wide selection of datasets and methods for representing and integrating information from different modalities. Despite these empirical advances, there remain…

Recently, we have demonstrated that our approach is a highly effective tool while analysing complex phenomena existing in networks of coupled nonlinear systems. In the present article we present the results of our investigations into a…

Dynamical Systems · Mathematics 2025-07-04 Volodymyr Denysenko , Artur Dabrowski

Complex systems such as ecological communities and neuron networks are essential parts of our everyday lives. These systems are composed of units which interact through intricate networks. The ability to predict sudden changes in the…

Adaptation and Self-Organizing Systems · Physics 2021-07-07 Deniz Eroglu , Matteo Tanzi , Sebastian van Strien , Tiago Pereira

Striking progress has recently been made in understanding human cognition by analyzing how its neuronal underpinnings are engaged in different modes of information processing. Specifically, neural information can be decomposed into…

Neurons and Cognition · Quantitative Biology 2022-10-07 Alexandra M. Proca , Fernando E. Rosas , Andrea I. Luppi , Daniel Bor , Matthew Crosby , Pedro A. M. Mediano

Biological organisms are adaptive, able to function in unpredictably changing environments. Drawing on recent nonequilibrium physics, we show that in adaptation, fitness has two components parameterized by observable coordinates: a static…

Statistical Mechanics · Physics 2026-02-19 Ying-Jen Yang , Charles D. Kocher , Ken A. Dill

In this paper, we wish to investigate the dynamics of information transfer in evolutionary dynamics. We use information theoretic tools to track how much information an evolving population has obtained and managed to retain about different…

Populations and Evolution · Quantitative Biology 2021-04-09 Nicholas Guttenberg