English
Related papers

Related papers: Closely estimating the entropy of sparse graph mod…

200 papers

Graph signal processing (GSP) provides a powerful framework for analyzing signals arising in a variety of domains. In many applications of GSP, multiple network structures are available, each of which captures different aspects of the same…

Machine Learning · Statistics 2021-11-03 Michael Weylandt , George Michailidis , T. Mitchell Roddenberry

Network (or graph) sparsification compresses a graph by removing inessential edges. By reducing the data volume, it accelerates or even facilitates many downstream analyses. Still, the accuracy of many sparsification methods, with…

Social and Information Networks · Computer Science 2023-09-28 Zhen Su , Jürgen Kurths , Henning Meyerhenke

Data-driven modelling and computational predictions based on maximum entropy principle (MaxEnt-principle) aim at finding as-simple-as-possible - but not simpler then necessary - models that allow to avoid the data overfitting problem. We…

Computation · Statistics 2020-11-25 Horenko Illia , Marchenko Ganna , Gagliardini Patrick

Bayesian estimation of Gaussian graphical models has proven to be challenging because the conjugate prior distribution on the Gaussian precision matrix, the G-Wishart distribution, has a doubly intractable partition function. Recent…

Neurons and Cognition · Quantitative Biology 2014-09-10 Max Hinne , Alex Lenkoski , Tom Heskes , Marcel van Gerven

This paper proposes a new method of bandwidth selection in kernel estimation of density and distribution functions motivated by the connection between maximisation of the entropy of probability integral transforms and maximum likelihood in…

Methodology · Statistics 2016-07-14 Vitaliy Oryshchenko

We consider the problem of estimating a sparse precision matrix of a multivariate Gaussian distribution, including the case where the dimension $p$ is large. Gaussian graphical models provide an important tool in describing conditional…

Statistics Theory · Mathematics 2014-04-08 Sayantan Banerjee , Subhashis Ghosal

In this paper we develop a methodology that we call split sampling methods to estimate high dimensional expectations and rare event probabilities. Split sampling uses an auxiliary variable MCMC simulation and expresses the expectation of…

Computation · Statistics 2013-11-04 John R. Birge , Changgee Chang , Nicholas G. Polson

We consider the problem of estimating overlapping community memberships in a network, where each node can belong to multiple communities. More than a few communities per node are difficult to both estimate and interpret, so we focus on…

Social and Information Networks · Computer Science 2021-06-23 Jesús Arroyo , Elizaveta Levina

We derive rigorous bounds for well-defined community structure in complex networks for a stochastic block model (SBM) benchmark. In particular, we analyze the effect of inter-community "noise" (inter-community edges) on any "community…

Statistical Mechanics · Physics 2014-07-14 Richard K. Darst , David R. Reichman , Peter Ronhovde , Zohar Nussinov

Reconstructing the structural connectivity between interacting units from observed activity is a challenge across many different disciplines. The fundamental first step is to establish whether or to what extent the interactions between the…

Neurons and Cognition · Quantitative Biology 2016-11-02 Elliot A. Martin , Jaroslav Hlinka , Jörn Davidsen

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

We present a simple and flexible method to prove consistency of semidefinite optimization problems on random graphs. The method is based on Grothendieck's inequality. Unlike the previous uses of this inequality that lead to constant…

Statistics Theory · Mathematics 2016-12-23 Olivier Guédon , Roman Vershynin

Graph matching is a challenging problem with very important applications in a wide range of fields, from image and video analysis to biological and biomedical problems. We propose a robust graph matching algorithm inspired in…

Optimization and Control · Mathematics 2013-11-26 Marcelo Fiori , Pablo Sprechmann , Joshua Vogelstein , Pablo Musé , Guillermo Sapiro

Whether a system is to be considered complex or not depends on how one searches for correlations. We propose a general scheme for calculation of entropies in lattice systems that has high flexibility in how correlations are successively…

Statistical Mechanics · Physics 2015-06-18 Torbjørn Helvik , Kristian Lindgren

A large number of applications such as querying sensor networks, and analyzing protein-protein interaction (PPI) networks, rely on mining uncertain graph and hypergraph databases. In this work we study the following problem: given an…

Data Structures and Algorithms · Computer Science 2018-01-11 Charalampos E. Tsourakakis , Shreyas Sekar , Johnson Lam , Liu Yang

Analysis of a probabilistic system often requires to learn the joint probability distribution of its random variables. The computation of the exact distribution is usually an exhaustive precise analysis on all executions of the system. To…

Information Theory · Computer Science 2023-07-19 Fabrizio Biondi , Yusuke Kawamoto , Axel Legay , Louis-Marie Traonouez

We consider fitting a bivariate spline regression model to data using a weighted least-squares cost function, with weights that sum to one to form a discrete probability distribution. By applying the principle of maximum entropy, the weight…

Methodology · Statistics 2025-08-05 Pierluigi Amodio , Luigi Brugnano , Felice Iavernaro

In complex networks, especially social networks, networks could be divided into disjoint partitions that the ratio between the number of internal edges (the edges between the vertices within same partition) to the number of outer edges…

Social and Information Networks · Computer Science 2019-02-07 Hamid Shahrivari Joghan , Alireza Bagheri , Meysam Azad

We introduce a nonparametric approach for estimating drift and diffusion functions in systems of stochastic differential equations from observations of the state vector. Gaussian processes are used as flexible models for these functions and…

Data Analysis, Statistics and Probability · Physics 2018-08-15 Philipp Batz , Andreas Ruttor , Manfred Opper