English
Related papers

Related papers: Efficient Algorithms for Searching the Minimum Inf…

200 papers

The Free Energy Principle (FEP) is a leading framework for mathematically modeling self-organization and learning, while Integrated Information Theory (IIT) is a computational ontology of consciousness oriented around irreducible cause and…

Neurons and Cognition · Quantitative Biology 2026-05-14 Alexander Kearney

Cognition, information processing in form of inference, communication, and memorization, is the central activity of any intelligence. Its physical realization in a brain, computer, or in any other intelligent system requires resources like…

Information Theory · Computer Science 2025-06-11 Torsten Enßlin

Researchers in many disciplines have previously used a variety of mathematical techniques for analyzing group interactions. Here we use a new metric for this purpose, called 'integrated information' or 'phi.' Phi was originally developed by…

Social and Information Networks · Computer Science 2018-11-21 David Engel , Thomas W. Malone

The apparent dichotomy between information-processing and dynamical approaches to complexity science forces researchers to choose between two diverging sets of tools and explanations, creating conflict and often hindering scientific…

Neurons and Cognition · Quantitative Biology 2022-01-26 Pedro A. M. Mediano , Fernando E. Rosas , Juan Carlos Farah , Murray Shanahan , Daniel Bor , Adam B. Barrett

We introduce a quantum integrated-information measure $\Phi$ for multipartite states within the Relational Quantum Dynamics (RQD) framework. $\Phi(\rho)$ is defined as the minimum quantum Jensen-Shannon distance between an n-partite density…

Quantum Physics · Physics 2025-10-31 Arash Zaghi

The relationship between Integrated Information Theory (IIT) and the Free-Energy Principle (FEP) remains unresolved, particularly with respect to how integrated information, proposed as the intrinsic substrate of consciousness, behaves…

Neurons and Cognition · Quantitative Biology 2025-10-07 Teruki Mayama , Sota Shimizu , Yuki Takano , Dai Akita , Hirokazu Takahashi

The science of consciousness has made great strides by focusing on the behavioral and neuronal correlates of experience. However, correlates are not enough if we are to understand even basic neurological fact; nor are they of much help in…

Neurons and Cognition · Quantitative Biology 2023-10-15 Giulio Tononi , Christof Koch

The maximal information coefficient (MIC), which measures the amount of dependence between two variables, is able to detect both linear and non-linear associations. However, computational cost grows rapidly as a function of the dataset…

Information Theory · Computer Science 2015-08-18 Ali Mousavi , Richard G. Baraniuk

The concept of information has emerged as a language in its own right, bridging several disciplines that analyze natural phenomena and man-made systems. Integrated information has been introduced as a metric to quantify the amount of…

Neurons and Cognition · Quantitative Biology 2019-06-10 Alberto Hernández-Espinosa , Héctor Zenil , Narsis A. Kiani , Jesper Tegnér

Complex systems, from the human brain to the global economy, are made of multiple elements that interact in such ways that the behaviour of the `whole' often seems to be more than what is readily explainable in terms of the `sum of the…

Neurons and Cognition · Quantitative Biology 2021-09-28 Pedro A. M. Mediano , Fernando E. Rosas , Andrea I Luppi , Robin L. Carhart-Harris , Daniel Bor , Anil K. Seth , Adam B. Barrett

Set partitioning is a key component of many algorithms in machine learning, signal processing, and communications. In general, the problem of finding a partition that minimizes a given impurity (loss function) is NP-hard. As such, there…

Information Theory · Computer Science 2020-01-01 Thuan Nguyen , Thinh Nguyen

This paper introduces the MIP Platform architecture model, a novel AI-based cognitive computing platform architecture. The goal of the proposed application of MIP is to reduce the implementation burden for the usage of AI algorithms applied…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-31 Pasquale Giampa , Massimiliano Dibitonto

In many neural systems anatomical motifs are present repeatedly, but despite their structural similarity they can serve very different tasks. A prime example for such a motif is the canonical microcircuit of six-layered neo-cortex, which is…

Neurons and Cognition · Quantitative Biology 2015-10-07 Michael Wibral , Viola Priesemann , Jim W. Kay , Joseph T. Lizier , William A. Phillips

Brain activity differs vastly between sleep, cognitive tasks, and action. Information theory is an appropriate concept to analytically quantify these brain states. Based on neurophysiological recordings, this concept can handle complex data…

Neurons and Cognition · Quantitative Biology 2022-05-04 Julian Fuhrer , Alejandro Blenkmann , Tor Endestad , Anne-Kristin Solbakk , Kyrre Glette

We proposed a Least Information theory (LIT) to quantify meaning of information in probability distribution changes, from which a new information retrieval model was developed. We observed several important characteristics of the proposed…

Information Retrieval · Computer Science 2012-05-03 Weimao Ke

Machine learning interatomic potentials (MLIPs) balance high accuracy and lower costs compared to density functional theory calculations, but their performance often depends on the size and diversity of training datasets. Large datasets…

Machine Learning · Computer Science 2025-11-14 Benjamin Yu , Vincenzo Lordi , Daniel Schwalbe-Koda

Integrated Information Theory is one of the leading models of consciousness. It aims to describe both the quality and quantity of the conscious experience of a physical system, such as the brain, in a particular state. In this contribution,…

Neurons and Cognition · Quantitative Biology 2020-02-19 Johannes Kleiner , Sean Tull

A physical field has an infinite number of degrees of freedom since it has a field value at each location of a continuous space. Therefore, it is impossible to know a field from finite measurements alone and prior information on the field…

Cosmology and Nongalactic Astrophysics · Physics 2021-01-12 Torsten A. Enßlin

There has been increasing interest in the integrated information theory (IIT) ofconsciousness, which hypothesizes that consciousness is integrated information withinneuronal dynamics. However, the current formulation of IIT poses both…

Neurons and Cognition · Quantitative Biology 2017-07-04 Satohiro Tajima , Ryota Kanai

The concept of Shannon entropy of random variables was generalized to measurable functions in general, and to simple functions with finite values in particular. It is shown that the information measure of a function is related to the time…

Information Theory · Computer Science 2017-01-25 Guo Zhao