English
Related papers

Related papers: Promoting Graph Awareness in Linearized Graph-to-T…

200 papers

General graphs are difficult for learning due to their irregular structures. Existing works employ message passing along graph edges to extract local patterns using customized graph kernels, but few of them are effective for the integration…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Yecheng Lyu , Ming Li , Xinming Huang , Ulkuhan Guler , Patrick Schaumont , Ziming Zhang

Graphon is a nonparametric model that generates graphs with arbitrary sizes and can be induced from graphs easily. Based on this model, we propose a novel algorithmic framework called \textit{graphon autoencoder} to build an interpretable…

Machine Learning · Computer Science 2021-06-01 Hongteng Xu , Peilin Zhao , Junzhou Huang , Dixin Luo

Deep learning on graphs has become a popular research topic with many applications. However, past work has concentrated on learning graph embedding tasks, which is in contrast with advances in generative models for images and text. Is it…

Machine Learning · Computer Science 2018-02-13 Martin Simonovsky , Nikos Komodakis

Graph learning algorithms have attained state-of-the-art performance on many graph analysis tasks such as node classification, link prediction, and clustering. It has, however, become hard to track the field's burgeoning progress. One…

Machine Learning · Computer Science 2022-04-05 Anton Tsitsulin , Benedek Rozemberczki , John Palowitch , Bryan Perozzi

The inductive bias of a graph neural network (GNN) is largely encoded in its specified graph. Latent graph inference relies on latent geometric representations to dynamically rewire or infer a GNN's graph to maximize the GNN's predictive…

Machine Learning · Computer Science 2025-03-11 Haitz Sáez de Ocáriz Borde , Anastasis Kratsios

The application of large language models (LLMs) to graph data has attracted a lot of attention recently. LLMs allow us to use deep contextual embeddings from pretrained models in text-attributed graphs, where shallow embeddings are often…

Artificial Intelligence · Computer Science 2025-02-19 Shima Khoshraftar , Niaz Abedini , Amir Hajian

Complex node interactions are common in knowledge graphs, and these interactions also contain rich knowledge information. However, traditional methods usually treat a triple as a training unit during the knowledge representation learning…

Computation and Language · Computer Science 2021-10-01 Bin He , Di Zhou , Jinghui Xiao , Xin jiang , Qun Liu , Nicholas Jing Yuan , Tong Xu

A foundation model like GPT elicits many emergent abilities, owing to the pre-training with broad inclusion of data and the use of the powerful Transformer architecture. While foundation models in natural languages are prevalent, can we…

Machine Learning · Computer Science 2025-06-18 Ziyuan Tang , Jie Chen

Graph Neural Networks usually rely on the assumption that the graph topology is available to the network as well as optimal for the downstream task. Latent graph inference allows models to dynamically learn the intrinsic graph structure of…

Machine Learning · Computer Science 2023-06-28 Haitz Sáez de Ocáriz Borde , Anees Kazi , Federico Barbero , Pietro Liò

Graph representation learning is a fast-growing field where one of the main objectives is to generate meaningful representations of graphs in lower-dimensional spaces. The learned embeddings have been successfully applied to perform various…

Machine Learning · Computer Science 2021-12-21 Md. Khaledur Rahman , Ariful Azad

Graph transformer has been proven as an effective graph learning method for its adoption of attention mechanism that is capable of capturing expressive representations from complex topological and feature information of graphs. Graph…

Machine Learning · Computer Science 2024-03-26 Dongqi Fu , Zhigang Hua , Yan Xie , Jin Fang , Si Zhang , Kaan Sancak , Hao Wu , Andrey Malevich , Jingrui He , Bo Long

Information visualizations such as bar charts and line charts are very popular for exploring data and communicating insights. Interpreting and making sense of such visualizations can be challenging for some people, such as those who are…

Computation and Language · Computer Science 2020-12-01 Jason Obeid , Enamul Hoque

The application of deep learning to symbolic domains remains an active research endeavour. Graph neural networks (GNN), consisting of trained neural modules which can be arranged in different topologies at run time, are sound alternatives…

Social and Information Networks · Computer Science 2019-12-02 Pedro H. C. Avelar , Henrique Lemos , Marcelo O. R. Prates , Luis Lamb

We show that viewing graphs as sets of node features and incorporating structural and positional information into a transformer architecture is able to outperform representations learned with classical graph neural networks (GNNs). Our…

Machine Learning · Computer Science 2021-06-11 Grégoire Mialon , Dexiong Chen , Margot Selosse , Julien Mairal

Graph Convolutional Networks (GCNs) have shown strong performance in learning text representations for various tasks such as text classification, due to its expressive power in modeling graph structure data (e.g., a literature citation…

Computation and Language · Computer Science 2023-05-12 Zhibin Lu , Qianqian Xie , Benyou Wang , Jian-yun Nie

In recent years, graph representation learning has gained significant popularity, which aims to generate node embeddings that capture features of graphs. One of the methods to achieve this is employing a technique called random walks that…

Machine Learning · Computer Science 2022-10-13 Deniz Gurevin , Mohsin Shan , Tong Geng , Weiwen Jiang , Caiwen Ding , Omer Khan

How to properly model graphs is a long-existing and important problem in NLP area, where several popular types of graphs are knowledge graphs, semantic graphs and dependency graphs. Comparing with other data structures, such as sequences…

Computation and Language · Computer Science 2019-07-16 Linfeng Song

The necessary integration of renewable energy sources, combined with the expanding scale of power networks, presents significant challenges in controlling modern power grids. Traditional control systems, which are human and…

Machine Learning · Computer Science 2025-09-04 Carlo Fabrizio , Gianvito Losapio , Marco Mussi , Alberto Maria Metelli , Marcello Restelli

Graph Neural Networks (GNNs) are susceptible to distribution shifts, creating vulnerability and security issues in critical domains. There is a pressing need to enhance the generalizability of GNNs on out-of-distribution (OOD) test data.…

Machine Learning · Computer Science 2024-10-29 Xiaoxue Han , Huzefa Rangwala , Yue Ning

Enabling large language models (LLMs) to effectively process and reason with graph-structured data remains a significant challenge despite their remarkable success in natural language tasks. Current approaches either convert graph…

Artificial Intelligence · Computer Science 2025-09-03 Yanbiao Ji , Chang Liu , Xin Chen , Dan Luo , Mei Li , Yue Ding , Wenqing Lin , Hongtao Lu