English
Related papers

Related papers: Information decomposition in complex systems via m…

200 papers

Living organisms rely on molecular networks, such as gene circuits and signaling pathways, for information processing and robust decision-making in crowded, noisy environments. Recent advances show that interacting biomolecules…

Probabilistic representation spaces convey information about a dataset and are shaped by factors such as the training data, network architecture, and loss function. Comparing the information content of such spaces is crucial for…

Machine Learning · Computer Science 2025-02-20 Kieran A. Murphy , Sam Dillavou , Dani S. Bassett

Spuriousness arises when there is an association between two or more variables in a dataset that are not causally related. In this work, we propose an explainability framework to preemptively disentangle the nature of such spurious…

Machine Learning · Computer Science 2025-11-17 Barproda Halder , Faisal Hamman , Pasan Dissanayake , Qiuyi Zhang , Ilia Sucholutsky , Sanghamitra Dutta

Decomposition analysis is a critical tool for understanding the social and spatial dimensions of segregation and diversity. In this paper, I highlight the conceptual, mathematical, and empirical distinctions between segregation and…

Methodology · Statistics 2024-02-22 Elizabeth Roberto

The decomposition of large unitary matrices into smaller ones is important, because it provides ways to realization of classical and quantum information processing schemes. Today, most of the methods use planar meshes of tunable two-channel…

When employing non-linear methods to characterise complex systems, it is important to determine to what extent they are capturing genuine non-linear phenomena that could not be assessed by simpler spectral methods. Specifically, we are…

Methodology · Statistics 2021-09-22 Pedro A. M. Mediano , Fernando E. Rosas , Adam B. Barrett , Daniel Bor

Spectral densities encode essential information about system-environment interactions in open-quantum systems, playing a pivotal role in shaping the system's dynamics. In this work, we leverage machine learning techniques to reconstruct key…

Quantum Physics · Physics 2025-01-14 Jessica Barr , Alessandro Ferraro , Mauro Paternostro , Giorgio Zicari

Digital image correlation (DIC) is a well-established, non-invasive technique for tracking and quantifying the deformation of mechanical samples under strain. While it provides an obvious way to observe incremental and aggregate…

Materials Science · Physics 2019-04-16 Stefanos Papanikolaou , Michail Tzimas , Andrew C. E. Reid , Stephen A. Langer

A set of curves or images of similar shape is an increasingly common functional data set collected in the sciences. Principal Component Analysis (PCA) is the most widely used technique to decompose variation in functional data. However, the…

Methodology · Statistics 2009-09-29 Rima Izem , J. S. Marron

Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that is shared across modalities, we can improve interpretability…

Machine Learning · Computer Science 2025-03-18 Chenyu Wang , Sharut Gupta , Xinyi Zhang , Sana Tonekaboni , Stefanie Jegelka , Tommi Jaakkola , Caroline Uhler

Recommender systems aim to recommend new items to users by learning user and item representations. In practice, these representations are highly entangled as they consist of information about multiple factors, including user's interests,…

Information Retrieval · Computer Science 2022-04-18 Paras Sheth , Ruocheng Guo , Lu Cheng , Huan Liu , K. Selçuk Candan

Mutual information between two random variables is a well-studied notion, whose understanding is fairly complete. Mutual information between one random variable and a pair of other random variables, however, is a far more involved notion.…

Information Theory · Computer Science 2026-05-05 Aobo Lyu , Andrew Clark , Netanel Raviv

Uncertainty plays a crucial role in the machine learning field. Both model trustworthiness and performance require the understanding of uncertainty, especially for models used in high-stake applications where errors can cause cataclysmic…

Machine Learning · Computer Science 2022-11-29 Shuo Chen

Pairwise interactions between individuals are taken as fundamental drivers of collective behavior responsible for group cohesion and decision-making. While an individual directly influences only a few neighbors, over time indirect…

Adaptation and Self-Organizing Systems · Physics 2022-04-12 Sulimon Sattari , Udoy S. Basak , Ryan G. James , James P. Crutchfield , Tamiki Komatsuzaki

The problem of how to properly quantify redundant information is an open question that has been the subject of much recent research. Redundant information refers to information about a target variable S that is common to two or more…

Information Theory · Computer Science 2017-07-14 Robin A. A. Ince

We propose a method to decompose dynamical systems based on the idea that modules constrain the spread of perturbations. We find partitions of system variables that maximize 'perturbation modularity', defined as the autocovariance of…

Physics and Society · Physics 2022-11-22 Artemy Kolchinsky , Alexander J. Gates , Luis M. Rocha

Whether or not there is growing static order accompanying the dynamical heterogeneity and increasing relaxation times seen in glassy systems is a matter of dispute. An obstacle to resolving this issue is that the order is expected to be…

Soft Condensed Matter · Physics 2017-12-27 Andrew J. Dunleavy , Karoline Wiesner , C. Patrick Royall

An effective way to model the complex real world is to view the world as a composition of basic components of objects and transformations. Although humans through development understand the compositionality of the real world, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 T. Takada , W. Shimaya , Y. Ohmura , Y. Kuniyoshi

Complex adaptive systems (CAS) can be described as systems of information flows dynamically interacting across scales in order to adapt and survive. CAS often consist of many components that work towards a shared goal, and interact across…

Multiagent Systems · Computer Science 2025-05-20 Louisa Jane Di Felice , Ada Diaconescu , Payam Zahadat , Patricia Mellodge

The problem of decomposing non-manifold object has already been studied in solid modeling. However, the few proposed solutions are limited to the problem of decomposing solids described through their boundaries. In this thesis we study the…

Graphics · Computer Science 2019-04-03 Franco Morando