English
Related papers

Related papers: Information Flow Decomposition in Feedback Systems…

200 papers

We explore the dynamics of information systems. We show that the driving force for information dynamics is determined by both the information landscape and information flux which determines the equilibrium time reversible and the…

Statistical Mechanics · Physics 2018-02-14 Qian Zeng , Jin Wang

A central task in analyzing complex dynamics is to determine the loci of information storage and the communication topology of information flows within a system. Over the last decade and a half, diagnostics for the latter have come to be…

Statistical Mechanics · Physics 2016-06-20 Ryan G. James , Nix Barnett , James P. Crutchfield

Pairwise interactions between individuals are taken as fundamental drivers of collective behavior responsible for group cohesion and decision-making. While an individual directly influences only a few neighbors, over time indirect…

Adaptation and Self-Organizing Systems · Physics 2022-04-12 Sulimon Sattari , Udoy S. Basak , Ryan G. James , James P. Crutchfield , Tamiki Komatsuzaki

The main objective of this paper is to analyze a closed-loop feedback system where a transmitter probes a discrete memoryless channel (DMC) and can adapt its inputs based on the previous channel outputs. We prove that, regardless of the…

Information Theory · Computer Science 2025-07-23 Thomas Sturma , Michèle Wigger

Feedback is an essential composition operator in many classes of reactive and other systems. This paper studies feedback in the context of compositional theories with refinement. Such theories allow to reason about systems on a…

Software Engineering · Computer Science 2016-04-28 Viorel Preoteasa , Stavros Tripakis

Biological and artificial neural systems are composed of many local processors, and their capabilities depend upon the transfer function that relates each local processor's outputs to its inputs. This paper uses a recent advance in the…

Information Theory · Computer Science 2018-03-16 Jim W. Kay , William A. Phillips

Complex systems, from the human brain to the global economy, are made of multiple elements that interact in such ways that the behaviour of the `whole' often seems to be more than what is readily explainable in terms of the `sum of the…

Neurons and Cognition · Quantitative Biology 2021-09-28 Pedro A. M. Mediano , Fernando E. Rosas , Andrea I Luppi , Robin L. Carhart-Harris , Daniel Bor , Anil K. Seth , Adam B. Barrett

Recent developments have created the ability to quantify information flow among components that interact in a dynamical system, and have led to significant advances in characterizing the dependence between the variables involved. In…

Data Analysis, Statistics and Probability · Physics 2023-09-27 Praveen Kumar

Closed-loop positivity of feedback interconnections of positive monotone nonlinear systems is investigated. It is shown that an instantaneous gain condition on the open-loop systems which implies feedback well-posedness also guarantees…

Optimization and Control · Mathematics 2015-08-27 Sei Zhen Khong , Corentin Briat , Anders Rantzer

In a software system it is possible to quantify the amount of information that is leaked or corrupted by analysing the flows of information present in the source code. In a cyber-physical system, information flows are not only present at…

Cryptography and Security · Computer Science 2017-08-17 Eric Rothstein Morris , Carlos G. Murguia , Martín Ochoa

Recommender systems play a key role in shaping modern web ecosystems. These systems alternate between (1) making recommendations (2) collecting user responses to these recommendations, and (3) retraining the recommendation algorithm based…

Information Retrieval · Computer Science 2022-07-18 Karl Krauth , Yixin Wang , Michael I. Jordan

We investigate a measurement-feedback process of repeated operations with time delay. During a finite-time interval, measurement on the system is performed and the feedback protocol derived from the measurement outcome is applied with time…

Statistical Mechanics · Physics 2020-01-08 Chulan Kwon , Jaegon Um , Hyunggyu Park

We investigate the possibility of correcting errors occurring on a multipartite system through a feedback mechanism that acquires information from partial access to the environment. A partial control scheme of this kind might be useful when…

Quantum Physics · Physics 2015-03-17 Laleh Memarzadeh , Chiara Macchiavello , Stefano Mancini

The description of an open quantum system's decay almost always requires several approximations as to remain tractable. Here, we first revisit the meaning, domain and seeming contradictions of a few of the most widely used of such…

Quantum Physics · Physics 2021-06-02 Juliane Klatt , Chahan Michael Kropf , Stefan Yoshi Buhmann

Multivariate information decompositions hold promise to yield insight into complex systems, and stand out for their ability to identify synergistic phenomena. However, the adoption of these approaches has been hindered by there being…

Information Theory · Computer Science 2020-12-02 Fernando Rosas , Pedro Mediano , Borzoo Rassouli , Adam Barrett

We investigate some structural properties of an efficient feedback law that stabilize linear time-reversible systems with an arbitrarily large decay rate. After giving a short proof of the generation of a group by the closed-loop operator,…

Optimization and Control · Mathematics 2013-02-26 Ambroise Vest

Mode-based model-reduction is used to reduce the degrees of freedom of high dimensional systems, often by describing the system state by a linear combination of spatial modes. Transport dominated phenomena, ubiquitous in technical and…

Numerical Analysis · Mathematics 2020-02-28 Julius Reiss

Decomposing knowledge into interchangeable pieces promises a generalization advantage when there are changes in distribution. A learning agent interacting with its environment is likely to be faced with situations requiring novel…

Machine Learning · Computer Science 2021-05-20 Kanika Madan , Nan Rosemary Ke , Anirudh Goyal , Bernhard Schölkopf , Yoshua Bengio

Partial information decomposition has recently found applications in biological signal processing and machine learning. Despite its impacts, the decomposition was introduced through an informal and heuristic route, and its exact operational…

Information Theory · Computer Science 2025-02-18 Chao Tian , Shlomo Shamai

Denoising diffusion models enable conditional generation and density modeling of complex relationships like images and text. However, the nature of the learned relationships is opaque making it difficult to understand precisely what…

Machine Learning · Computer Science 2024-05-21 Xianghao Kong , Ollie Liu , Han Li , Dani Yogatama , Greg Ver Steeg