English
Related papers

Related papers: Structure-aware divergences for comparing probabil…

200 papers

Community structures have been identified in various complex real-world networks, for example, communication, information, internet and shareholder networks. The scaling of community size distribution indicates the heterogeneity in the…

Physics and Society · Physics 2022-07-11 Qing Yao , Bingsheng Chen , Tim S. Evans , Kim Christensen

Information divergence that measures the difference between two nonnegative matrices or tensors has found its use in a variety of machine learning problems. Examples are Nonnegative Matrix/Tensor Factorization, Stochastic Neighbor…

Machine Learning · Computer Science 2014-06-06 Onur Dikmen , Zhirong Yang , Erkki Oja

Precisely quantifying the heterogeneity or disorder of a network system is very important and desired in studies of behavior and function of the network system. Although many degree-based entropies have been proposed to measure the…

Physics and Society · Physics 2008-10-09 Yanghua Xiao , Wentao Wu , Hui Wang , Momiao Xiong , Wei Wang

To comprehend the multipartite organization of large-scale biological and social systems, we introduce a new information theoretic approach that reveals community structure in weighted and directed networks. The method decomposes a network…

Physics and Society · Physics 2008-02-13 M. Rosvall , C. T. Bergstrom

This paper designs and implements an explainable recommendation model that integrates knowledge graphs with structure-aware attention mechanisms. The model is built on graph neural networks and incorporates a multi-hop neighbor aggregation…

Information Retrieval · Computer Science 2025-10-14 Shuangquan Lyu , Ming Wang , Huajun Zhang , Jiasen Zheng , Junjiang Lin , Xiaoxuan Sun

This book deals with functions allowing to express the dissimilarity (discrepancy) between two data fields or ''divergence functions'' with the aim of applications to linear inverse problems. Most of the divergences found in the litterature…

Optimization and Control · Mathematics 2020-03-04 Henri Lantéri

The task of sampling efficiently the Gibbs-Boltzmann distribution of disordered systems is important both for the theoretical understanding of these models and for the solution of practical optimization problems. Unfortunately, this task is…

Disordered Systems and Neural Networks · Physics 2025-04-30 Luca Maria Del Bono , Federico Ricci-Tersenghi , Francesco Zamponi

Easy and intuitive navigability is of central importance in cities. The actual scale-free networking of urban street networks in their topological space, where navigation information is encoded by mapping roads to nodes and junctions to…

Physics and Society · Physics 2019-10-03 Jerome Benoit , Saif Eddin Jabari

Complex networks are usually characterized in terms of their topological, spatial, or information-theoretic properties and combinations of the associated metrics are used to discriminate networks into different classes or categories.…

Data Analysis, Statistics and Probability · Physics 2017-10-25 Marc Wiedermann , Jonathan F. Donges , Jürgen Kurths , Reik V. Donner

Divergence functions are measures of distance or dissimilarity between probability distributions that serve various purposes in statistics and applications. We propose decompositions of Wasserstein and Cram\'er distances$-$which compare two…

Methodology · Statistics 2025-08-08 Johannes Resin , Daniel Wolffram , Johannes Bracher , Timo Dimitriadis

We consider the analysis of probability distributions through their associated covariance operators from reproducing kernel Hilbert spaces. We show that the von Neumann entropy and relative entropy of these operators are intimately related…

Information Theory · Computer Science 2022-08-29 Francis Bach

Meta-analytic methods tend to take all-or-nothing approaches to study-level heterogeneity, assuming all studies are heterogeneous or homogeneous, leading to inefficiency and/or bias in estimation and inference. In this paper, we develop a…

Methodology · Statistics 2026-03-12 Elizabeth M. Davis , Emily C. Hector

Bayesian structure learning allows inferring Bayesian network structure from data while reasoning about the epistemic uncertainty -- a key element towards enabling active causal discovery and designing interventions in real world systems.…

Machine Learning · Computer Science 2021-12-17 Lars Lorch , Jonas Rothfuss , Bernhard Schölkopf , Andreas Krause

In this paper entropy based methods are compared and used to measure structural diversity of an ensemble of 21 classifiers. This measure is mostly applied in ecology, whereby species counts are used as a measure of diversity. The measures…

Machine Learning · Computer Science 2008-10-21 L. Masisi , V. Nelwamondo , T. Marwala

In increasingly many settings, data sets consist of multiple samples from a population of networks, with vertices aligned across these networks. For example, brain connectivity networks in neuroscience consist of measures of interaction…

Statistics Theory · Mathematics 2021-05-11 Keith Levin , Asad Lodhia , Elizaveta Levina

Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…

Statistics Theory · Mathematics 2026-02-16 Nicholas G. Polson , Daniel Zantedeschi

Predicting the fate of ecologies is a daunting, albeit extremely important, task. As part of this task one needs to develop an understanding of the organization, hierarchies, and correlations among the species forming the ecology. Focusing…

Populations and Evolution · Quantitative Biology 2016-08-31 Ahmed Roman , Debanjan Dasgupta , Michel Pleimling

Cities create potential for individuals from different backgrounds to interact with one another. It is often the case, however, that urban infrastructure obfuscates this potential, creating dense pockets of affluence and poverty throughout…

Physics and Society · Physics 2023-04-21 Nandini Iyer , Ronaldo Menezes , Hugo Barbosa

Empirical studies of graphs have contributed enormously to our understanding of complex systems. Known today as network science, what was originally a theoretical study of graphs has grown into a more scientific exploration of communities…

Quantitative Methods · Quantitative Biology 2020-01-01 Ryan E. Langendorf , Debra S. Goldberg

The inverse problem of designing component interactions to target emergent structure is fundamental to numerous applications in biotechnology, materials science, and statistical physics. Equally important is the inverse problem of designing…

Computational Physics · Physics 2020-11-20 Carl P. Goodrich , Ella M. King , Samuel S. Schoenholz , Ekin D. Cubuk , Michael Brenner