English
Related papers

Related papers: Quantifying Networks Complexity from Information G…

200 papers

We study the notion of approximate entropy within the framework of network theory. Approximate entropy is an uncertainty measure originally proposed in the context of dynamical systems and time series. We firstly define a purely structural…

Disordered Systems and Neural Networks · Physics 2013-05-30 James West , Lucas Lacasa , Simone Severini , Andrew Teschendorff

Quantifying the relations (e.g., similarity) between complex networks paves the way for studying the latent information shared across networks. However, fundamental relation metrics are not well-defined between networks. As a compromise,…

Social and Information Networks · Computer Science 2023-07-21 Yang Tian , Hedong Hou , Guangzheng Xu , Ziyang Zhang , Pei Sun

We characterize different cell states, related to cancer and ageing phenotypes, by a measure of entropy of network ensembles, integrating gene expression values and protein interaction networks. The entropy measure estimates the parameter…

Molecular Networks · Quantitative Biology 2013-05-24 G. Menichetti , G. Bianconi , E. Giampieri , G. Castellani , D. Remondini

This paper leverages linear systems theory to propose a principled measure of complexity for network systems. We focus on a network of first-order scalar linear systems interconnected through a directed graph. By locally filtering out the…

Systems and Control · Electrical Eng. & Systems 2025-07-10 Giacomo Baggio , Marco Fabris

We investigate the effect of different metrizations of probability spaces on the information geometric complexity of entropic motion on curved statistical manifolds. Specifically, we provide a comparative analysis based upon Riemannian…

Mathematical Physics · Physics 2019-07-24 Steven Gassner , Carlo Cafaro

It is known that statistical model selection as well as identification of dynamical equations from available data are both very challenging tasks. Physical systems behave according to their underlying dynamical equations which, in turn, can…

Mathematical Physics · Physics 2017-10-11 Sean Alan Ali , Carlo Cafaro

We study the family of network models derived by requiring the expected properties of a graph ensemble to match a given set of measurements of a real-world network, while maximizing the entropy of the ensemble. Models of this type play the…

Statistical Mechanics · Physics 2009-11-10 Juyong Park , M. E. J. Newman

In this paper we generalize the concept of random networks to describe networks with non trivial features by a statistical mechanics approach. This framework is able to describe ensembles of undirected, directed as well as weighted…

Disordered Systems and Neural Networks · Physics 2009-11-13 Ginestra Bianconi

The entropy of a hierarchical network topology in an ensemble of sparse random networks with "hidden variables" associated to its nodes, is the log-likelihood that a given network topology is present in the chosen ensemble.We obtain a…

Disordered Systems and Neural Networks · Physics 2009-11-13 Ginestra Bianconi , Anthony C. C. Coolen , Conrad J. Perez Vicente

We study the information geometry and the entropic dynamics of a 3D Gaussian statistical model. We then compare our analysis to that of a 2D Gaussian statistical model obtained from the higher-dimensional model via introduction of an…

Mathematical Physics · Physics 2012-05-01 Carlo Cafaro , Adom Giffin , Cosmo Lupo , Stefano Mancini

Using the generalized entropies which depend on two parameters we propose a set of quantitative characteristics derived from the Information Geometry based on these entropies. Our aim, at this stage, is modest, as we are first constructing…

Mathematical Physics · Physics 2018-02-14 Demetris P. K. Ghikas , Fotios Oikonomou

Information geometry and inductive inference methods can be used to model dynamical systems in terms of their probabilistic description on curved statistical manifolds. In this article, we present a formal conceptual reexamination of the…

Mathematical Physics · Physics 2010-11-29 C. Cafaro , A. Giffin , S. A. Ali , D. -H. Kim

Here we present the entropic dynamics formalism for networks. That is, a framework for the dynamics of graphs meant to represent a network derived from the principle of maximum entropy and the rate of transition is obtained taking into…

Physics and Society · Physics 2021-04-29 Felipe Xavier Costa , Pedro Pessoa

We define a notion of complexity, which quantifies the nonlinearity of the computation of a neural network, as well as a complementary measure of the effective dimension of feature representations. We investigate these observables both for…

Machine Learning · Computer Science 2021-03-18 Romuald A. Janik , Przemek Witaszczyk

Information geometric techniques and inductive inference methods hold great promise for solving computational problems of interest in classical and quantum physics, especially with regard to complexity characterization of dynamical systems…

Mathematical Physics · Physics 2015-06-04 S. A. Ali , C. Cafaro , A. Giffin , D. -H. Kim

The entropy of network ensembles characterizes the amount of information encoded in the network structure, and can be used to quantify network complexity, and the relevance of given structural properties observed in real network datasets…

Disordered Systems and Neural Networks · Physics 2014-06-18 Kartik Anand , Dimitri Krioukov , Ginestra Bianconi

We introduce a mapping between graphs and pure quantum bipartite states and show that the associated entanglement entropy conveys non-trivial information about the structure of the graph. Our primary goal is to investigate the family of…

Quantum Physics · Physics 2012-02-24 Silvano Garnerone , Paolo Giorda , Paolo Zanardi

Systems which consist of many localized constituents interacting with each other can be represented by complex networks. Consistently, network science has become highly popular in vast fields focusing on natural, artificial and social…

Statistical Mechanics · Physics 2022-06-29 Rute Oliveira , Samuraí Brito , Luciano R. da Silva , Constantino Tsallis

The need to build a link between the structure of a complex network and the dynamical properties of the corresponding complex system (comprised of multiple low dimensional systems) has recently become apparent. Several attempts to tackle…

Chaotic Dynamics · Physics 2012-06-18 Michael Small , Kevin Judd , Thomas Stemler

Symmetry -- invariance to certain operators -- is a fundamental concept in many branches of physics. We propose ways to measure symmetric properties of vertices, and their surroundings, in networks. To be stable to the randomness inherent…

Disordered Systems and Neural Networks · Physics 2008-06-29 Petter Holme