English
Related papers

Related papers: Towards a Synergy-based Approach to Measuring Info…

200 papers

Defining administrative workflow events as a nonlinear dynamics that assume a random ordered or disordered growth rate of information processing, a method has been proposed for large-scale administrative systems that structures hybrid…

Adaptation and Self-Organizing Systems · Physics 2019-10-21 Charles Roberto Telles

Integrated information theory (IIT) has established itself as one of the leading theories for the study of consciousness. IIT essentially proposes that quantitative consciousness is identical to maximally integrated conceptual information,…

Neurons and Cognition · Quantitative Biology 2017-03-06 Stephan Krohn , Dirk Ostwald

We analyze a distributed information network in which each node has access to the information contained in a limited set of nodes (its neighborhood) at a given time. A collective computation is carried out in which each node calculates a…

Social and Information Networks · Computer Science 2014-04-18 Antonio Córdoba , Daniel Aguilar-Hidalgo , M. Carmen Lemos

The decomposition of channel information into synergies of different order is an open, active problem in the theory of complex systems. Most approaches to the problem are based on information theory, and propose decompositions of mutual…

Information Theory · Computer Science 2015-12-14 Paolo Perrone , Nihat Ay

In inverse problems, one attempts to infer spatially variable functions from indirect measurements of a system. To practitioners of inverse problems, the concept of "information" is familiar when discussing key questions such as which parts…

Numerical Analysis · Mathematics 2025-02-12 Wolfgang Bangerth , Chris R. Johnson , Dennis K. Njeru , Bart van Bloemen Waanders

This work proposes a novel computing performance unit grounded in information theory. Modern computing systems are increasingly diverse, supporting low-precision formats, hardware specialization, and emerging paradigms such as analog,…

Performance · Computer Science 2025-08-08 Max Hawkins , Richard Vuduc

Analysis of a probabilistic system often requires to learn the joint probability distribution of its random variables. The computation of the exact distribution is usually an exhaustive precise analysis on all executions of the system. To…

Information Theory · Computer Science 2023-07-19 Fabrizio Biondi , Yusuke Kawamoto , Axel Legay , Louis-Marie Traonouez

Scientific discovery can be framed as a thermodynamic process in which an agent invests physical work to acquire information about an environment under a finite work budget. Using established results about the thermodynamics of computing,…

Information Theory · Computer Science 2025-11-20 Mihir Rao

An outstanding problem in neuroscience is to understand how information is integrated across the many modules of the brain. While classic information-theoretic measures have transformed our understanding of feedforward information…

Neurons and Cognition · Quantitative Biology 2019-02-12 Daniel Toker , Friedrich T. Sommer

Asynchronous executions of a distributed algorithm differ from each other due to the nondeterminism in the order in which the messages exchanged are handled. In many situations of interest, the asynchronous executions induced by restricting…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-11 Ricardo C. Correa , Valmir C. Barbosa

Quantifying synergy among stochastic variables is an important open problem in information theory. Information synergy occurs when multiple sources together predict an outcome variable better than the sum of single-source predictions. It is…

Information Theory · Computer Science 2017-04-05 Rick Quax , Omri Har-Shemesh , Peter M. A. Sloot

Information dynamics is an emerging description of information processing in complex systems which describes systems in terms of intrinsic computation, identifying computational primitives of information storage and transfer. In this paper…

Statistical Mechanics · Physics 2018-10-03 Richard E. Spinney , Joseph T. Lizier , Mikhail Prokopenko

The characterisation of information processing is an important task in complex systems science. Information dynamics is a quantitative methodology for modelling the intrinsic information processing conducted by a process represented as a…

Information Theory · Computer Science 2018-08-01 Richard E. Spinney , Joseph T. Lizier

The Partial Information Decomposition (PID) takes one step beyond Shannon's theory in decomposing the information two variables $A,B$ possess about a third variable $T$ into distinct parts: unique, shared (or redundant) and synergistic…

Quantum Physics · Physics 2023-11-27 S. J. van Enk

Information asymmetry is a pervasive feature of multi-agent systems, especially evident in economics and social sciences. In these settings, agents tailor their actions based on private information to maximize their rewards. These strategic…

Machine Learning · Computer Science 2025-06-12 Jiachen Hu , Rui Ai , Han Zhong , Xiaoyu Chen , Liwei Wang , Zhaoran Wang , Zhuoran Yang

Assessing where and how information is stored in biological networks (such as neuronal and genetic networks) is a central task both in neuroscience and in molecular genetics, but most available tools focus on the network's structure as…

Information Theory · Computer Science 2023-02-24 Clifford Bohm , Douglas Kirkpatrick , Victoria Cao , Christoph Adami

Recently, the partial information decomposition emerged as a promising framework for identifying the meaningful components of the information contained in a joint distribution. Its adoption and practical application, however, have been…

Information Theory · Computer Science 2018-08-28 Ryan G. James , Jeffrey Emenheiser , James P. Crutchfield

This paper proposes an iterative methodology to integrate large-scale behavioral activity-based models with dynamic traffic assignment models. The main novelty of the proposed approach is the decoupling of the two parts, allowing the…

Computers and Society · Computer Science 2024-04-12 Serio Agriesti , Claudio Roncoli , Bat-hen Nahmias-Biran

Prediction polling is an increasingly popular form of crowdsourcing in which multiple participants estimate the probability or magnitude of some future event. These estimates are then aggregated into a single forecast. Historically,…

Methodology · Statistics 2016-04-25 Ville A. Satopää , Shane T. Jensen , Robin Pemantle , Lyle H. Ungar

We present PartComposer: a framework for part-level concept learning from single-image examples that enables text-to-image diffusion models to compose novel objects from meaningful components. Existing methods either struggle with…

Graphics · Computer Science 2025-09-16 Junyu Liu , R. Kenny Jones , Daniel Ritchie