English
Related papers

Related papers: A Compression-Complexity Measure of Integrated Inf…

200 papers

Examining task-free functional connectivity (FC) in the human brain offers insights on how spontaneous integration and segregation of information relate to human cognition, and how this organization may be altered in different conditions,…

Integrating and processing information from various sources or modalities are critical for obtaining a comprehensive and accurate perception of the real world in autonomous systems and cyber-physical systems. Drawing inspiration from…

Machine Learning · Computer Science 2024-04-24 Xiongye Xiao , Gengshuo Liu , Gaurav Gupta , Defu Cao , Shixuan Li , Yaxing Li , Tianqing Fang , Mingxi Cheng , Paul Bogdan

How much information do large brain networks integrate as a whole over the sum of their parts? Can the dynamical complexity of such networks be globally quantified in an information-theoretic way and be meaningfully coupled to brain…

Neurons and Cognition · Quantitative Biology 2016-12-22 Xerxes D. Arsiwalla , Paul Verschure

One of the most fundamental problems in science is to define {\it quantitatively} the complexity of organized matters, i.e., {\it organized complexity}. Although many measures have been proposed toward this aim in previous decades, there is…

Information Theory · Computer Science 2016-08-03 Tatsuaki Okamoto

We introduce a new information theoretic measure that we call Public Information Complexity (PIC), as a tool for the study of multi-party computation protocols, and of quantities such as their communication complexity, or the amount of…

Computational Complexity · Computer Science 2018-12-18 Iordanis Kerenidis , Adi Rosén , Florent Urrutia

What does the informational complexity of dynamical networked systems tell us about intrinsic mechanisms and functions of these complex systems? Recent complexity measures such as integrated information have sought to operationalize this…

Neural and Evolutionary Computing · Computer Science 2017-07-06 Xerxes D. Arsiwalla , Pedro A. M. Mediano , Paul F. M. J. Verschure

From a traditional point of view, the value of information does not change during transmission. The Shannon information theory considers information transmission as a statistical phenomenon for measuring the communication channel capacity.…

Networking and Internet Architecture · Computer Science 2019-07-04 Min Chen , Yixue Hao , Hamid Gharavi , Victor C. M. Leung

Research on Cognitive Personal Informatics (CPI) is steadily growing as new wearable cognitive tracking technologies emerge on the consumer market, claiming to measure stress, focus, and other cognitive factors. At the same time, with…

Human-Computer Interaction · Computer Science 2026-01-22 Christina Schneegass , Francesco Chiossi , Anna L. Cox , Dimitra Dritsa , Teodora Mitrevska , Stephen Rainey , Max L. Wilson

Integrated information theory (IIT) starts from the existence of consciousness and characterizes its essential properties: every experience is intrinsic, specific, unitary, definite, and structured. IIT then formulates existence and its…

Neurons and Cognition · Quantitative Biology 2026-04-20 William G. P. Mayner , William Marshall , Giulio Tononi

Our understanding of complex systems rests on our ability to characterise how they perform distributed computation and integrate information. Advances in information theory have introduced several quantities to describe complex information…

Information Theory · Computer Science 2026-04-13 Alberto Liardi , George Blackburne , Hardik Rajpal , Fernando E. Rosas , Pedro A. M. Mediano

Integrative Complexity (IC) is a psychometric that measures the ability of a person to recognize multiple perspectives and connect them, thus identifying paths for conflict resolution. IC has been linked to a wide variety of political,…

Computers and Society · Computer Science 2019-06-06 Alexander Robertson , Luca Maria Aiello , Daniele Quercia

Cognition, information processing in form of inference, communication, and memorization, is the central activity of any intelligence. Its physical realization in a brain, computer, or in any other intelligent system requires resources like…

Information Theory · Computer Science 2025-06-11 Torsten Enßlin

Conceptually, partial information decomposition (PID) is concerned with separating the information contributions several sources hold about a certain target by decomposing the corresponding joint mutual information into contributions such…

Information Theory · Computer Science 2021-06-25 Kyle Schick-Poland , Abdullah Makkeh , Aaron J. Gutknecht , Patricia Wollstadt , Anja Sturm , Michael Wibral

Information theory is widely accepted as a powerful tool for analyzing complex systems and it has been applied in many disciplines. Recently, some central components of information theory - multivariate information measures - have found…

Information Theory · Computer Science 2012-08-30 Nicholas Timme , Wesley Alford , Benjamin Flecker , John M. Beggs

While mutual information effectively quantifies dependence between two variables, it does not by itself reveal the complex, fine-grained interactions among variables, i.e., how multiple sources contribute redundantly, uniquely, or…

Information Theory · Computer Science 2026-05-05 Aobo Lyu , Andrew Clark , Netanel Raviv

Assessing where and how information is stored in biological networks (such as neuronal and genetic networks) is a central task both in neuroscience and in molecular genetics, but most available tools focus on the network's structure as…

Information Theory · Computer Science 2023-02-24 Clifford Bohm , Douglas Kirkpatrick , Victoria Cao , Christoph Adami

Brain connectomics is a developing field in neurosciences which strives to understand cognitive processes and psychiatric diseases through the analysis of interactions between brain regions. However, in the high-dimensional, low-sample, and…

Applications · Statistics 2019-11-15 Claire Donnat , Leonardo Tozzi , Susan Holmes

Partial information decomposition (PID) of the multivariate mutual information describes the distinct ways in which a set of source variables contains information about a target variable. The groundbreaking work of Williams and Beer has…

Information Theory · Computer Science 2021-03-31 Abdullah Makkeh , Aaron J. Gutknecht , Michael Wibral

One of the fundamental tasks in machine learning is image classification, which serves as a key benchmark for validating algorithm performance and practical potential. However, effectively processing high-dimensional, detail-rich images, a…

Quantum Physics · Physics 2025-09-09 Chenghua Duan , Xiuxing Li , Wending Zhao , Lin Yao , Qing Li , Ziyu Li , Fukang Li , Junhao Ma , Xia Wu

Entropy governs molecular self-assembly, phase transitions, and material stability, yet remains challenging to quantify and directly control in molecular systems. Here, we demonstrate that the computable information density (CID), a data…

Statistical Mechanics · Physics 2026-02-27 Ashley Z. Guo , Kaelyn Chang , Nicholas J. Corrente