English
Related papers

Related papers: Autoregressive Diffusion Model for Graph Generatio…

200 papers

Generative models such as diffusion models have achieved remarkable success in state-of-the-art image and text tasks. Recently, score-based diffusion models have extended their success beyond image generation, showing competitive…

Machine Learning · Computer Science 2024-11-27 Jia Jun Cheng Xian , Sadegh Mahdavi , Renjie Liao , Oliver Schulte

Learning generative models for graph-structured data is challenging because graphs are discrete, combinatorial, and the underlying data distribution is invariant to the ordering of nodes. However, most of the existing generative models for…

Machine Learning · Computer Science 2020-03-03 Chenhao Niu , Yang Song , Jiaming Song , Shengjia Zhao , Aditya Grover , Stefano Ermon

Diffusion models have become the de facto framework for generating new datasets. The core of these models lies in the ability to reverse a diffusion process in time. The goal of this manuscript is to explain, from a PDE perspective, how…

Probability · Mathematics 2025-01-29 Fei Cao , Kimball Johnston , Thomas Laurent , Justin Le , Sébastien Motsch

Learning to generate graphs is challenging as a graph is a set of pairwise connected, unordered nodes encoding complex combinatorial structures. Recently, several works have proposed graph generative models based on normalizing flows or…

Machine Learning · Computer Science 2023-06-21 Xiaohui Chen , Yukun Li , Aonan Zhang , Li-Ping Liu

In this paper, we propose Continuous Graph Flow, a generative continuous flow based method that aims to model complex distributions of graph-structured data. Once learned, the model can be applied to an arbitrary graph, defining a…

Machine Learning · Computer Science 2019-10-01 Zhiwei Deng , Megha Nawhal , Lili Meng , Greg Mori

Diffusion probabilistic models (DPMs), widely recognized for their potential to generate high-quality samples, tend to go unnoticed in representation learning. While recent progress has highlighted their potential for capturing visual…

Machine Learning · Computer Science 2025-05-09 Dingshuo Chen , Shuchen Xue , Liuji Chen , Yingheng Wang , Qiang Liu , Shu Wu , Zhi-Ming Ma , Liang Wang

Graph generative models are essential across diverse scientific domains by capturing complex distributions over relational data. Among them, graph diffusion models achieve superior performance but face inefficient sampling and limited…

Machine Learning · Computer Science 2025-06-17 Yiming Qin , Manuel Madeira , Dorina Thanou , Pascal Frossard

We propose in this paper an analytically new construct of a diffusion model whose drift and diffusion parameters yield an exponentially time-decaying Signal to Noise Ratio in the forward process. In reverse, the construct cleverly carries…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Tanmay Asthana , Yufang Bao , Hamid Krim

Adversarial evasion attacks pose significant threats to graph learning, with lines of studies that have improved the robustness of Graph Neural Networks (GNNs). However, existing works rely on priors about clean graphs or attacking…

Machine Learning · Computer Science 2025-02-10 Jiayi Luo , Qingyun Sun , Haonan Yuan , Xingcheng Fu , Jianxin Li

In the realm of generative models for graphs, extensive research has been conducted. However, most existing methods struggle with large graphs due to the complexity of representing the entire joint distribution across all node pairs and…

Social and Information Networks · Computer Science 2024-05-15 Andreas Bergmeister , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

Graph generation with Machine Learning is an open problem with applications in various research fields. In this work, we propose to cast the generative process of a graph into a sequential one, relying on a node ordering procedure. We use…

Machine Learning · Statistics 2020-04-24 Davide Bacciu , Alessio Micheli , Marco Podda

We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in…

Machine Learning · Statistics 2025-06-13 Justin Le

Deep generative models have emerged as promising tools for detecting arbitrary anomalies in data, dispensing with the necessity for manual labelling. Recently, autoregressive transformers have achieved state-of-the-art performance for…

In this paper, we present GGSD, a novel graph generative model based on 1) the spectral decomposition of the graph Laplacian matrix and 2) a diffusion process. Specifically, we propose to use a denoising model to sample eigenvectors and…

Machine Learning · Computer Science 2025-03-05 Giorgia Minello , Alessandro Bicciato , Luca Rossi , Andrea Torsello , Luca Cosmo

Cross-Modal learning tasks have picked up pace in recent times. With plethora of applications in diverse areas, generation of novel content using multiple modalities of data has remained a challenging problem. To address the same, various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Nikhil Verma

Creating graphic layouts is a fundamental step in graphic designs. In this work, we present a novel generative model named LayoutDiffusion for automatic layout generation. As layout is typically represented as a sequence of discrete tokens,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Junyi Zhang , Jiaqi Guo , Shizhao Sun , Jian-Guang Lou , Dongmei Zhang

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim

The scope of this paper is generative modeling through diffusion processes. An approach falling within this paradigm is the work of Song et al. (2021), which relies on a time-reversal argument to construct a diffusion process targeting the…

Machine Learning · Computer Science 2023-12-25 Stefano Peluchetti

Employing a forward diffusion chain to gradually map the data to a noise distribution, diffusion-based generative models learn how to generate the data by inferring a reverse diffusion chain. However, this approach is slow and costly…

Machine Learning · Statistics 2023-09-08 Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

Generating graph-structured data is crucial in applications such as molecular generation, knowledge graphs, and network analysis. However, their discrete, unordered nature makes them difficult for traditional generative models, leading to…

Machine Learning · Computer Science 2026-04-14 Ole Petersen , Marcel Kollovieh , Marten Lienen , Stephan Günnemann