English
Related papers

Related papers: Nonparametric graphon estimation

200 papers

Estimating the matrix of connections probabilities is one of the key questions when studying sparse networks. In this work, we consider networks generated under the sparse graphon model and the in-homogeneous random graph model with missing…

Statistics Theory · Mathematics 2021-04-28 Solenne Gaucher , Olga Klopp

We present a framework to define a large class of neural networks for which, by construction, training by gradient flow provably reaches arbitrarily low loss when the number of parameters grows. Distinct from the fixed-space global…

Optimization and Control · Mathematics 2025-01-13 David A. R. Robin , Kevin Scaman , Marc Lelarge

In this work we propose a random graph model that can produce graphs at different levels of sparsity. We analyze how sparsity affects the graph spectra, and thus the performance of graph neural networks (GNNs) in node classification on…

Social and Information Networks · Computer Science 2023-09-14 Luana Ruiz , Ningyuan Huang , Soledad Villar

Recent work has introduced sparse exchangeable graphs and the associated graphex framework, as a generalization of dense exchangeable graphs and the associated graphon framework. The development of this subject involves the interplay…

Probability · Mathematics 2020-02-12 Christian Borgs , Jennifer T. Chayes , Henry Cohn , Victor Veitch

This paper studies the problem of estimating the grahpon model - the underlying generating mechanism of a network. Graphon estimation arises in many applications such as predicting missing links in networks and learning user preferences in…

Machine Learning · Statistics 2017-09-12 Jiaming Xu

We propose a class of methods for graphon estimation based on exploiting connections with nonparametric regression. The idea is to construct an ordering of the nodes in the network, similar in spirit to Chan and Airoldi (2014). However,…

Methodology · Statistics 2019-06-20 Oscar Hernan Madrid Padilla

We establish a general theory for subsampling network data generated by the sparse graphon model. In contrast to previous work for networks, we demonstrate validity under minimal assumptions; the main requirement is weak convergence of the…

Statistics Theory · Mathematics 2019-08-27 Robert Lunde , Purnamrita Sarkar

Graphs are ubiquitous in modelling relational structures. Recent endeavours in machine learning for graph-structured data have led to many architectures and learning algorithms. However, the graph used by these algorithms is often…

Machine Learning · Statistics 2020-06-25 Soumyasundar Pal , Saber Malekmohammadi , Florence Regol , Yingxue Zhang , Yishi Xu , Mark Coates

Pruning at Initialisation methods discover sparse, trainable subnetworks before training, but their theoretical mechanisms remain elusive. Existing analyses are often limited to finite-width statistics, lacking a rigorous characterisation…

Machine Learning · Computer Science 2026-02-09 Hoang Pham , The-Anh Ta , Long Tran-Thanh

Sparse neural networks promise efficiency, yet training them effectively remains a fundamental challenge. Despite advances in pruning methods that create sparse architectures, understanding why some sparse structures are better trainable…

Machine Learning · Computer Science 2025-10-21 Hoang Pham , The-Anh Ta , Tom Jacobs , Rebekka Burkholz , Long Tran-Thanh

Graphical models have been popularly used for capturing conditional independence structure in multivariate data, which are often built upon independent and identically distributed observations, limiting their applicability to complex…

Methodology · Statistics 2025-07-03 Yuwen Wang , Changyu Liu , Xin He , Junhui Wang

Graph neural networks (GNNs) are learning architectures that rely on knowledge of the graph structure to generate meaningful representations of large-scale network data. GNN stability is thus important as in real-world scenarios there are…

Machine Learning · Computer Science 2021-04-27 Luana Ruiz , Zhiyang Wang , Alejandro Ribeiro

In a recent paper, Caron and Fox suggest a probabilistic model for sparse graphs which are exchangeable when associating each vertex with a time parameter in $\mathbb{R}_+$. Here we show that by generalizing the classical definition of…

Probability · Mathematics 2018-06-21 Christian Borgs , Jennifer T. Chayes , Henry Cohn , Nina Holden

In this manuscript a unified framework for conducting inference on complex aggregated data in high dimensional settings is proposed. The data are assumed to be a collection of multiple non-Gaussian realizations with underlying undirected…

Applications · Statistics 2013-10-14 Fang Han , Han Liu , Brian Caffo

We consider the problem of estimating graph limits, known as graphons, from observations of sequences of sparse finite graphs. In this paper we show a simple method that can shed light on a subset of sparse graphs. The method involves…

Machine Learning · Statistics 2025-07-08 Sevvandi Kandanaarachchi , Cheng Soon Ong

Block graphons (also called stochastic block models) are an important and widely-studied class of models for random networks. We provide a lower bound on the accuracy of estimators for block graphons with a large number of blocks. We show…

Statistics Theory · Mathematics 2016-04-08 Audra McMillan , Adam Smith

In this paper we introduce a general framework for the study of limits of relational structures in general and graphs in particular, which is based on a combination of model theory and (functional) analysis. We show how the various…

Combinatorics · Mathematics 2021-04-23 Jaroslav Nesetril , Patrice Ossona De Mendez

This paper is concerned with nonparametric estimation of the weighted stochastic block model. We first show that the model implies a set of multilinear restrictions on the joint distribution of edge weights of certain subgraphs involving…

Statistics Theory · Mathematics 2022-03-10 Koen Jochmans

Graphon is a nonparametric model that generates graphs with arbitrary sizes and can be induced from graphs easily. Based on this model, we propose a novel algorithmic framework called \textit{graphon autoencoder} to build an interpretable…

Machine Learning · Computer Science 2021-06-01 Hongteng Xu , Peilin Zhao , Junzhou Huang , Dixin Luo

Exchangeable random graphs, which include some of the most widely studied network models, have emerged as the mainstay of statistical network analysis in recent years. Graphons, which are the central objects in graph limit theory, provide a…

Statistics Theory · Mathematics 2024-09-17 Anirban Chatterjee , Soham Dan , Bhaswar B. Bhattacharya