English
Related papers

Related papers: Scalable Deep Generative Modeling for Sparse Graph…

200 papers

Graph-based computations are crucial in a wide range of applications, where graphs can scale to trillions of edges. To enable efficient training on such large graphs, mini-batch subgraph sampling is commonly used, which allows training…

Machine Learning · Computer Science 2025-04-04 Yue Jin , Yongchao Liu , Chuntao Hong

Graph generative models have broad applications in biology, chemistry and social science. However, modelling and understanding the generative process of graphs is challenging due to the discrete and high-dimensional nature of graphs, as…

Machine Learning · Computer Science 2022-12-06 Han Huang , Leilei Sun , Bowen Du , Yanjie Fu , Weifeng Lv

Diffusion-based generative graph models have been proven effective in generating high-quality small graphs. However, they need to be more scalable for generating large graphs containing thousands of nodes desiring graph statistics. In this…

Machine Learning · Computer Science 2023-06-01 Xiaohui Chen , Jiaxing He , Xu Han , Li-Ping Liu

Graph neural networks (GNNs) have achieved great success on various tasks and fields that require relational modeling. GNNs aggregate node features using the graph structure as inductive biases resulting in flexible and powerful models.…

Machine Learning · Computer Science 2021-06-25 Mandeep Rathee , Zijian Zhang , Thorben Funke , Megha Khosla , Avishek Anand

This paper proposes an autoregressive (AR) model for sequences of graphs, which generalises traditional AR models. A first novelty consists in formalising the AR model for a very general family of graphs, characterised by a variable…

Machine Learning · Computer Science 2019-03-19 Daniele Zambon , Daniele Grattarola , Lorenzo Livi , Cesare Alippi

The problem of labeled graph generation is gaining attention in the Deep Learning community. The task is challenging due to the sparse and discrete nature of graph spaces. Several approaches have been proposed in the literature, most of…

Machine Learning · Computer Science 2021-07-20 Marco Podda , Davide Bacciu

Deep generative models have achieved great success in areas such as image, speech, and natural language processing in the past few years. Thanks to the advances in graph-based deep learning, and in particular graph representation learning,…

Machine Learning · Computer Science 2021-01-01 Faezeh Faez , Yassaman Ommi , Mahdieh Soleymani Baghshah , Hamid R. Rabiee

Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem…

Machine Learning · Computer Science 2021-06-15 Marco Serafini , Hui Guan

Recent advancements in graph representation learning have shifted attention towards dynamic graphs, which exhibit evolving topologies and features over time. The increased use of such graphs creates a paramount need for generative models…

Machine Learning · Computer Science 2024-12-23 Ryien Hosseini , Filippo Simini , Venkatram Vishwanath , Henry Hoffmann

In the realm of generative models for graphs, extensive research has been conducted. However, most existing methods struggle with large graphs due to the complexity of representing the entire joint distribution across all node pairs and…

Social and Information Networks · Computer Science 2024-05-15 Andreas Bergmeister , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

Graph generation is a crucial task in many fields, including network science and bioinformatics, as it enables the creation of synthetic graphs that mimic the properties of real-world networks for various applications. Graph Generative…

Machine Learning · Computer Science 2026-01-21 Salvatore Romano , Marco Grassia , Giuseppe Mangioni

Due to the significant computational challenge of training large-scale graph neural networks (GNNs), various sparse learning techniques have been exploited to reduce memory and storage costs. Examples include \textit{graph sparsification}…

Machine Learning · Computer Science 2023-02-07 Shuai Zhang , Meng Wang , Pin-Yu Chen , Sijia Liu , Songtao Lu , Miao Liu

Learning distributions of graphs can be used for automatic drug discovery, molecular design, complex network analysis, and much more. We present an improved framework for learning generative models of graphs based on the idea of deep state…

Machine Learning · Computer Science 2021-12-07 Julian Stier , Michael Granitzer

Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful…

Machine Learning · Computer Science 2018-03-12 Yujia Li , Oriol Vinyals , Chris Dyer , Razvan Pascanu , Peter Battaglia

Recent years have witnessed the impressive progress in Neural Dependency Parsing. According to the different factorization approaches to the graph joint probabilities, existing parsers can be roughly divided into autoregressive and…

Computation and Language · Computer Science 2023-06-22 Ye Ma , Mingming Sun , Ping Li

Graph neural networks (GNNs) learn to represent nodes by aggregating information from their neighbors. As GNNs increase in depth, their receptive field grows exponentially, leading to high memory costs. Several existing methods address this…

Machine Learning · Computer Science 2025-07-16 Taraneh Younesian , Daniel Daza , Emile van Krieken , Thiviyan Thanapalasingam , Peter Bloem

Bayesian methods for learning Gaussian graphical models offer a principled framework for quantifying model uncertainty and incorporating prior knowledge. However, their scalability is constrained by the computational cost of jointly…

Methodology · Statistics 2025-08-28 Reza Mohammadi , Marit Schoonhoven , Lucas Vogels , S. Ilker Birbil

We propose to execute deep neural networks (DNNs) with dynamic and sparse graph (DSG) structure for compressive memory and accelerative execution during both training and inference. The great success of DNNs motivates the pursuing of…

Machine Learning · Computer Science 2019-05-08 Liu Liu , Lei Deng , Xing Hu , Maohua Zhu , Guoqi Li , Yufei Ding , Yuan Xie

This paper addresses the challenge of incremental learning in growing graphs with increasingly complex tasks. The goal is to continuously train a graph model to handle new tasks while retaining proficiency in previous tasks via memory…

Machine Learning · Computer Science 2025-03-04 Ziyue Qiao , Junren Xiao , Qingqiang Sun , Meng Xiao , Xiao Luo , Hui Xiong

Learning the structure of Directed Acyclic Graphs (DAGs) presents a significant challenge due to the vast combinatorial search space of possible graphs, which scales exponentially with the number of nodes. Recent advancements have redefined…

Machine Learning · Computer Science 2024-11-01 Klea Ziu , Slavomír Hanzely , Loka Li , Kun Zhang , Martin Takáč , Dmitry Kamzolov