English
Related papers

Related papers: Encoding Robust Representation for Graph Generatio…

200 papers

Generative models have made significant progress in the tasks of modeling complex data distributions such as natural images. The introduction of Generative Adversarial Networks (GANs) and auto-encoders lead to the possibility of training on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Hinz , Stefan Wermter

Learning low-dimensional representations on graphs has proved to be effective in various downstream tasks. However, noises prevail in real-world networks, which compromise networks to a large extent in that edges in networks propagate…

Social and Information Networks · Computer Science 2020-12-07 Junshan Wang , Ziyao Li , Qingqing Long , Weiyu Zhang , Guojie Song , Chuan Shi

Graph generation is a critical task in numerous domains, including molecular design and social network analysis, due to its ability to model complex relationships and structured data. While most modern graph generative models utilize…

Machine Learning · Computer Science 2025-06-04 Xiaohui Chen , Yinkai Wang , Jiaxing He , Yuanqi Du , Soha Hassoun , Xiaolin Xu , Li-Ping Liu

Generating text from structured inputs, such as meaning representations or RDF triples, has often involved the use of specialized graph-encoding neural networks. However, recent applications of pretrained transformers to linearizations of…

Computation and Language · Computer Science 2021-01-01 Alexander Hoyle , Ana Marasović , Noah Smith

The (variational) graph auto-encoder is widely used to learn representations for graph-structured data. However, the formation of real-world graphs is a complicated and heterogeneous process influenced by latent factors. Existing encoders…

Machine Learning · Computer Science 2024-07-17 Di Fan , Chuanhou Gao

Modeling generative process of growing graphs has wide applications in social networks and recommendation systems, where cold start problem leads to new nodes isolated from existing graph. Despite the emerging literature in learning graph…

Machine Learning · Computer Science 2019-06-03 Da Xu , Chuanwei Ruan , Kamiya Motwani , Evren Korpeoglu , Sushant Kumar , Kannan Achan

We show that viewing graphs as sets of node features and incorporating structural and positional information into a transformer architecture is able to outperform representations learned with classical graph neural networks (GNNs). Our…

Machine Learning · Computer Science 2021-06-11 Grégoire Mialon , Dexiong Chen , Margot Selosse , Julien Mairal

Most previous work on neural text generation from graph-structured data relies on standard sequence-to-sequence methods. These approaches linearise the input graph to be fed to a recurrent neural network. In this paper, we propose an…

Computation and Language · Computer Science 2018-10-24 Diego Marcheggiani , Laura Perez-Beltrachini

Transformers have demonstrated success in graph learning, particularly for node-level tasks. However, existing methods encounter an information bottleneck when generating graph-level representations. The prevalent single token paradigm…

Machine Learning · Computer Science 2026-02-11 Ruixiang Wang , Yuyang Hong , Shiming Xiang , Chunhong Pan

This paper introduces a novel method for image colorization that utilizes a color transformer and generative adversarial networks (GANs) to address the challenge of generating visually appealing colorized images. Conventional approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Hamza Shafiq , Bumshik Lee

Transformers have become widely used in various tasks, such as natural language processing and machine vision. This paper proposes Gransformer, an algorithm based on Transformer for generating graphs. We modify the Transformer encoder to…

Machine Learning · Computer Science 2024-06-03 Ahmad Khajenezhad , Seyed Ali Osia , Mahmood Karimian , Hamid Beigy

Graphs arise naturally in many real-world applications including social networks, recommender systems, ontologies, biology, and computational finance. Traditionally, machine learning models for graphs have been mostly designed for static…

Machine Learning · Computer Science 2020-04-28 Seyed Mehran Kazemi , Rishab Goel , Kshitij Jain , Ivan Kobyzev , Akshay Sethi , Peter Forsyth , Pascal Poupart

Dynamic graphs provide a flexible data abstraction for modelling many sorts of real-world systems, such as transport, trade, and social networks. Graph neural networks (GNNs) are powerful tools allowing for different kinds of prediction and…

Machine Learning · Statistics 2025-03-27 Ed Davis , Ian Gallagher , Daniel John Lawson , Patrick Rubin-Delanchy

We present Graformer, a novel Transformer-based encoder-decoder architecture for graph-to-text generation. With our novel graph self-attention, the encoding of a node relies on all nodes in the input graph - not only direct neighbors -…

Computation and Language · Computer Science 2021-04-28 Martin Schmitt , Leonardo F. R. Ribeiro , Philipp Dufter , Iryna Gurevych , Hinrich Schütze

This paper introduces a novel generative encoder (GE) model for generative imaging and image processing with applications in compressed sensing and imaging, image compression, denoising, inpainting, deblurring, and super-resolution. The GE…

Image and Video Processing · Electrical Eng. & Systems 2019-06-03 Lin Chen , Haizhao Yang

Generative Adversarial Nets (GANs) and Variational Auto-Encoders (VAEs) provide impressive image generations from Gaussian white noise, but the underlying mathematics are not well understood. We compute deep convolutional network generators…

Machine Learning · Computer Science 2018-05-18 Tomás Angles , Stéphane Mallat

Transformer, based on the encoder-decoder framework, has achieved state-of-the-art performance on several natural language generation tasks. The encoder maps the words in the input sentence into a sequence of hidden states, which are then…

Computation and Language · Computer Science 2020-02-25 Rongxiang Weng , Haoran Wei , Shujian Huang , Heng Yu , Lidong Bing , Weihua Luo , Jiajun Chen

In the realm of generative models for graphs, extensive research has been conducted. However, most existing methods struggle with large graphs due to the complexity of representing the entire joint distribution across all node pairs and…

Social and Information Networks · Computer Science 2024-05-15 Andreas Bergmeister , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

Graph learning algorithms have attained state-of-the-art performance on many graph analysis tasks such as node classification, link prediction, and clustering. It has, however, become hard to track the field's burgeoning progress. One…

Machine Learning · Computer Science 2022-04-05 Anton Tsitsulin , Benedek Rozemberczki , John Palowitch , Bryan Perozzi

Generating realistic graph-structured data is challenging due to discrete structures, variable sizes, and class-specific connectivity patterns that resist conventional generative modelling. While recent graph generation methods employ…

Machine Learning · Computer Science 2026-02-02 Seyedeh Ava Razi Razavi , James Sargant , Sheridan Houghten , Renata Dividino