English
Related papers

Related papers: Autoregressive Diffusion Model for Graph Generatio…

200 papers

Generative diffusion models, famous for their performance in image generation, are popular in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling…

Networking and Internet Architecture · Computer Science 2025-03-11 Ruihuai Liang , Bo Yang , Zhiwen Yu , Bin Guo , Xuelin Cao , Mérouane Debbah , H. Vincent Poor , Chau Yuen

Diffusion-based generative models are extremely effective in generating high-quality images, with generated samples often surpassing the quality of those produced by other models under several metrics. One distinguishing feature of these…

Machine Learning · Computer Science 2022-10-25 Ashwini Pokle , Zhengyang Geng , Zico Kolter

Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful…

Machine Learning · Computer Science 2018-03-12 Yujia Li , Oriol Vinyals , Chris Dyer , Razvan Pascanu , Peter Battaglia

Diffusion-based generative models learn to iteratively transfer unstructured noise to a complex target distribution as opposed to Generative Adversarial Networks (GANs) or the decoder of Variational Autoencoders (VAEs) which produce samples…

Machine Learning · Computer Science 2022-10-26 Sarthak Mittal , Guillaume Lajoie , Stefan Bauer , Arash Mehrjou

Iterative denoising-based generation, also known as denoising diffusion models, has recently been shown to be comparable in quality to other classes of generative models, and even surpass them. Including, in particular, Generative…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Yaniv Benny , Lior Wolf

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

Machine Learning · Computer Science 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

We propose GraphNVP, the first invertible, normalizing flow-based molecular graph generation model. We decompose the generation of a graph into two steps: generation of (i) an adjacency tensor and (ii) node attributes. This decomposition…

Machine Learning · Statistics 2019-05-29 Kaushalya Madhawa , Katushiko Ishiguro , Kosuke Nakago , Motoki Abe

Most existing graph diffusion models have significant bias problems. We observe that the forward diffusion's maximum perturbation distribution in most models deviates from the standard Gaussian distribution, while reverse sampling…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Meng Yu , Kun Zhan

We present significant extensions to diffusion-based sequence generation models, blurring the line with autoregressive language models. We introduce hyperschedules, which assign distinct noise schedules to individual token positions,…

Machine Learning · Computer Science 2025-10-08 Nima Fathi , Torsten Scholak , Pierre-André Noël

Graph generation is an extremely important task, as graphs are found throughout different areas of science and engineering. In this work, we focus on the modern equivalent of the Erdos-Renyi random graph model: the graph variational…

Machine Learning · Computer Science 2020-02-19 Daniel Flam-Shepherd , Tony Wu , Alan Aspuru-Guzik

Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving, but they face challenges of inefficient inference steps and high computational demands. To tackle these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yixiao Wang , Chen Tang , Lingfeng Sun , Simone Rossi , Yichen Xie , Chensheng Peng , Thomas Hannagan , Stefano Sabatini , Nicola Poerio , Masayoshi Tomizuka , Wei Zhan

Diffusion models generate samples through an iterative denoising process, guided by a neural network. While training the denoiser on real-world data is computationally demanding, the sampling procedure itself is more flexible. This…

Machine Learning · Computer Science 2026-02-10 Constant Bourdrez , Alexandre Vérine , Olivier Cappé

Diffusion models have recently attained significant interest within the community owing to their strong performance as generative models. Furthermore, its application to inverse problems have demonstrated state-of-the-art performance.…

Image and Video Processing · Electrical Eng. & Systems 2022-03-22 Hyungjin Chung , Byeongsu Sim , Jong Chul Ye

Recent research has made significant progress in optimizing diffusion models for downstream objectives, which is an important pursuit in fields such as graph generation for drug design. However, directly applying these models to graph…

Machine Learning · Computer Science 2024-10-28 Yijing Liu , Chao Du , Tianyu Pang , Chongxuan Li , Min Lin , Wei Chen

Most graph-network-based meta-learning approaches model instance-level relation of examples. We extend this idea further to explicitly model the distribution-level relation of one example to all other examples in a 1-vs-N manner. We propose…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Ling Yang , Liangliang Li , Zilun Zhang , Xinyu Zhou , Erjin Zhou , Yu Liu

Physical systems with complex unsteady dynamics, such as fluid flows, are often poorly represented by a single mean solution. For many practical applications, it is crucial to access the full distribution of possible states, from which…

Computational Physics · Physics 2025-04-07 Mario Lino , Tobias Pfaff , Nils Thuerey

Continuous-time long-term event prediction plays an important role in many application scenarios. Most existing works rely on autoregressive frameworks to predict event sequences, which suffer from error accumulation, thus compromising…

Machine Learning · Computer Science 2023-11-03 Wang-Tao Zhou , Zhao Kang , Ling Tian

Diffusion models generate new samples by progressively decreasing the noise from the initially provided random distribution. This inference procedure generally utilizes a trained neural network numerous times to obtain the final output,…

Graph neural networks (GNNs) have shown promising results across various graph learning tasks, but they often assume homophily, which can result in poor performance on heterophilic graphs. The connected nodes are likely to be from different…

Machine Learning · Computer Science 2023-05-31 Kai Zhao , Qiyu Kang , Yang Song , Rui She , Sijie Wang , Wee Peng Tay

Graph learning is often a necessary step in processing or representing structured data, when the underlying graph is not given explicitly. Graph learning is generally performed centrally with a full knowledge of the graph signals, namely…

Signal Processing · Electrical Eng. & Systems 2021-12-14 Isabela Cunha Maia Nobre , Mireille El Gheche , Pascal Frossard