English
Related papers

Related papers: Partial entropy decomposition reveals higher-order…

200 papers

Recent advances in signal processing and information theory are boosting the development of new approaches for the data-driven modelling of complex network systems. In the fields of Network Physiology and Network Neuroscience where the…

Methodology · Statistics 2024-01-23 Laura Sparacino , Yuri Antonacci , Gorana Mijatovic , Luca Faes

The time-dependent fields obtained by solving partial differential equations in two and more dimensions quickly overwhelm the analytical capabilities of the human brain. A meaningful insight into the temporal behaviour can be obtained by…

Numerical Analysis · Mathematics 2024-04-04 Miha Rot , Martin Horvat , Gregor Kosec

Interactions between elements, which are usually represented by networks, have to delineate potentially unequal relationships in terms of their relative importance or direction. The intrinsic unequal relationships of such kind, however, are…

Physics and Society · Physics 2021-12-01 Mi Jin Lee , Eun Lee , Byunghwee Lee , Hawoong Jeong , Deok-Sun Lee , Sang Hoon Lee

The creation of social ties is largely determined by the entangled effects of people's similarities in terms of individual characters and friends. However, feature and structural characters of people usually appear to be correlated, making…

Machine Learning · Computer Science 2019-10-30 Sébastien Lerique , Jacob Levy Abitbol , Márton Karsai

In this paper, we present a new nonintrusive reduced basis method when a cheap low-fidelity model and expensive high-fidelity model are available. The method relies on proper orthogonal decomposition (POD) to generate the high-fidelity…

Machine Learning · Statistics 2019-02-06 Chuan Lu , Xueyu Zhu

We seek general principles of the structure of the cellular collective activity associated with conscious awareness. Can we obtain evidence for features of the optimal brain organization that allows for adequate processing of stimuli and…

Neurons and Cognition · Quantitative Biology 2017-12-27 D. M. Mateos , R. Wennberg , R. Guevara , J. L. Perez Velazquez

Many existing interpretation methods are based on Partial Dependence (PD) functions that, for a pre-trained machine learning model, capture how a subset of the features affects the predictions by averaging over the remaining features.…

Machine Learning · Computer Science 2025-06-05 Jinyang Liu , Tessa Steensgaard , Marvin N. Wright , Niklas Pfister , Munir Hiabu

Recent studies have shown that novel collective behaviors emerge in complex systems due to the presence of higher-order interactions. However, how the collective behavior of a system is influenced by the microscopic organization of its…

Physics and Society · Physics 2025-07-01 Federico Malizia , Santiago Lamata-Otín , Mattia Frasca , Vito Latora , Jesús Gómez-Gardeñes

Brains construct not only "first-order" representations of the environment but also "higher-order" representations about those representations -- including higher-order uncertainty estimates that guide learning and adaptive behavior.…

Machine Learning · Computer Science 2026-04-15 Hojjat Azimi Asrari , Megan A. K. Peters

The microscopic organization of dynamical systems coupled via higher-order interactions plays a pivotal role in understanding their collective behavior. In this paper, we introduce a framework for systematically investigating the impact of…

Physics and Society · Physics 2025-01-14 Santiago Lamata-Otín , Federico Malizia , Vito Latora , Mattia Frasca , Jesús Gómez-Gardeñes

The main goal of this study is to extract a set of brain networks in multiple time-resolutions to analyze the connectivity patterns among the anatomic regions for a given cognitive task. We suggest a deep architecture which learns the…

Machine Learning · Statistics 2017-08-16 Arash Rahnama , Abdullah Alchihabi , Vijay Gupta , Panos Antsaklis , Fatos T. Yarman Vural

The entropy of a pair of random variables is commonly depicted using a Venn diagram. This representation is potentially misleading, however, since the multivariate mutual information can be negative. This paper presents new measures of…

Information Theory · Computer Science 2020-04-22 Conor Finn , Joseph T. Lizier

We formulate the entropy of a quantized artificial neural network as a differentiable function that can be plugged as a regularization term into the cost function minimized by gradient descent. Our formulation scales efficiently beyond the…

Machine Learning · Computer Science 2021-07-13 Enzo Tartaglione , Stéphane Lathuilière , Attilio Fiandrotti , Marco Cagnazzo , Marco Grangetto

With the emerging of huge amount of unlabeled data, unsupervised out-of-distribution (OOD) detection is vital for ensuring the reliability of graph neural networks (GNNs) by identifying OOD samples from in-distribution (ID) ones during…

Machine Learning · Computer Science 2025-03-13 Yue Hou , He Zhu , Ruomei Liu , Yingke Su , Jinxiang Xia , Junran Wu , Ke Xu

Dementia poses a growing challenge in our aging society. Frontotemporal dementia (FTD) and Alzheimer disease (AD) are the leading causes of early-onset dementia. FTD and AD display unique traits in their onset, progression, and treatment…

Signal Processing · Electrical Eng. & Systems 2024-09-26 Shivani Ranjan , Lalan Kumar

Named entity recognition (NER), which focuses on the extraction of semantically meaningful named entities and their semantic classes from text, serves as an indispensable component for several down-stream natural language processing (NLP)…

Computation and Language · Computer Science 2018-10-23 Zhanming Jie , Aldrian Obaja Muis , Wei Lu

Graphs are a standard framework for describing dynamical processes shaped by pairwise interactions among agents. But many systems involve interactions in groups of three or more agents. Here, we develop a method of "$\ell$-hyperedge…

Physics and Society · Physics 2026-05-25 Anzhi Sheng , Alex McAvoy , Ye Tian , Silun Zhang , Angela Fontan , Joshua B. Plotkin

Functional subnetwork extraction is commonly used to explore the brain's modular structure. However, reliable subnetwork extraction from functional magnetic resonance imaging (fMRI) data remains challenging due to the pronounced noise in…

Neurons and Cognition · Quantitative Biology 2018-01-17 Chendi Wang , Rafeef Abugharbieh

Collective behavior, both in real biological systems as well as in theoretical models, often displays a rich combination of different kinds of order. A clear-cut and unique definition of "phase" based on the standard concept of order…

Statistical Mechanics · Physics 2021-06-30 Andrea Cavagna , Paul M. Chaikin , Dov Levine , Stefano Martiniani , Andrea Puglisi , Massimiliano Viale

Tensor decomposition is an important tool for multiway data analysis. In practice, the data is often sparse yet associated with rich temporal information. Existing methods, however, often under-use the time information and ignore the…

Machine Learning · Computer Science 2023-10-31 Zheng Wang , Shikai Fang , Shibo Li , Shandian Zhe