English
Related papers

Related papers: Maximum entropy based testing in network models: E…

200 papers

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

Machine Learning · Statistics 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

We propose a family of statistical models for social network evolution over time, which represents an extension of Exponential Random Graph Models (ERGMs). Many of the methods for ERGMs are readily adapted for these models, including…

Machine Learning · Statistics 2009-08-11 Steve Hanneke , Wenjie Fu , Eric Xing

This article introduces a new class of models for multiple networks. The core idea is to parametrize a distribution on labelled graphs in terms of a Fr\'{e}chet mean graph (which depends on a user-specified choice of metric or graph…

Methodology · Statistics 2020-03-09 Simón Lunagómez , Sofia C. Olhede , Patrick J. Wolfe

I propose an estimation algorithm for Exponential Random Graph Models (ERGM), a popular statistical network model for estimating the structural parameters of strategic network formation in economics and finance. Existing methods often…

Econometrics · Economics 2025-12-09 Yoon Choi

Random graphs, where the connections between nodes are considered random variables, have wide applicability in the social sciences. Exponential-family Random Graph Models (ERGM) have shown themselves to be a useful class of models for…

Methodology · Statistics 2012-08-02 Ian Fellows , Mark S. Handcock

Mechanistic network models specify the mechanisms by which networks grow and change, allowing researchers to investigate complex systems using both simulation and analytical techniques. Unfortunately, it is difficult to write likelihoods…

Methodology · Statistics 2023-07-19 Jonathan Larson , Jukka-Pekka Onnela

Molecular dynamics (MD) simulations allow investigating the structural dynamics of biomolecular systems with unrivaled time and space resolution. However, in order to compensate for the inaccuracies of the utilized empirical force fields,…

Computational Physics · Physics 2018-02-12 Andrea Cesari , Sabine Reißer , Giovanni Bussi

We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel…

Optimization and Control · Mathematics 2019-10-22 Tobias Sutter , David Sutter , Peyman Mohajerin Esfahani , John Lygeros

Finding parameters that minimise a loss function is at the core of many machine learning methods. The Stochastic Gradient Descent algorithm is widely used and delivers state of the art results for many problems. Nonetheless, Stochastic…

Machine Learning · Computer Science 2018-09-26 Yao Zhang , Andrew M. Saxe , Madhu S. Advani , Alpha A. Lee

We describe a method to computationally estimate the probability density function of a univariate random variable by applying the maximum entropy principle with some local conditions given by Gaussian functions. The estimation errors and…

Statistics Theory · Mathematics 2012-06-21 Mihail-Ioan Pop

A broad set of sufficient conditions that guarantees the existence of the maximum entropy (maxent) distribution consistent with specified bounds on certain generalized moments is derived. Most results in the literature are either focused on…

Information Theory · Computer Science 2009-09-29 Prakash Ishwar , Pierre Moulin

Probabilistic reasoning systems combine different probabilistic rules and probabilistic facts to arrive at the desired probability values of consequences. In this paper we describe the MESA-algorithm (Maximum Entropy by Simulated Annealing)…

Artificial Intelligence · Computer Science 2013-03-25 Gerhard Paaß

Dynamic processes on networks are fundamental to understanding modern-day phenomena such as information diffusion and opinion polarization on the internet or epidemics spreading through society. However, such processes are notoriously…

Physics and Society · Physics 2025-07-15 Noam Abadi , Franco Ruzzenenti

New entropy measures have been recently introduced for the quantification of the complexity of networks. Most of these entropy measures apply to static networks or to dynamical processes defined on static complex networks. In this paper we…

Disordered Systems and Neural Networks · Physics 2015-05-30 Kun Zhao , Arda Halu , Simone Severini , Ginestra Bianconi

This letter considers optimizing user association in a heterogeneous network via utility maximization, which is a combinatorial optimization problem due to integer constraints. Different from existing solutions based on convex optimization,…

Information Theory · Computer Science 2018-06-12 Xietian Huang , Wei Xu , Guo Xie , Shi Jin , Xiaohu You

We present a statistical mechanics approach for the description of complex networks. We first define an energy and an entropy associated to a degree distribution which have a geometrical interpretation. Next we evaluate the distribution…

Disordered Systems and Neural Networks · Physics 2009-11-13 Ginestra Bianconi

Some of the most used sampling mechanisms that implicitly leverage a social network depend on tuning parameters; for instance, Respondent-Driven Sampling (RDS) is specified by the number of seeds and maximum number of referrals. We are…

Methodology · Statistics 2019-12-06 Simón Lunagómez , Marios Papamichalis , Patrick J. Wolfe , Edoardo M. Airoldi

We use an entropy based method to study two graph maximization problems. We upper bound the number of matchings of fixed size $\ell$ in a $d$-regular graph on $N$ vertices. For $\frac{2\ell}{N}$ bounded away from 0 and 1, the logarithm of…

Combinatorics · Mathematics 2012-06-15 Teena Carroll , David Galvin , Prasad Tetali

Markov networks are frequently used in sciences to represent conditional independence relationships underlying observed variables arising from a complex system. It is often of interest to understand how an underlying network differs between…

Methodology · Statistics 2021-04-26 Byol Kim , Song Liu , Mladen Kolar

Network theory has often disregarded many-body relationships, solely focusing on pairwise interactions: neglecting them, however, can lead to misleading representations of complex systems. Hypergraphs represent a suitable framework for…

Social and Information Networks · Computer Science 2025-07-16 Fabio Saracco , Giovanni Petri , Renaud Lambiotte , Tiziano Squartini