English
Related papers

Related papers: Differentiable Reasoning over Long Stories -- Asse…

200 papers

We present Graph Neural Diffusion (GRAND) that approaches deep learning on graphs as a continuous diffusion process and treats Graph Neural Networks (GNNs) as discretisations of an underlying PDE. In our model, the layer structure and…

Graph neural networks (GNNs) are the most widely adopted model in graph-structured data oriented learning and representation. Despite their extraordinary success in real-world applications, understanding their working mechanism by theory is…

Machine Learning · Computer Science 2023-05-16 Huayi Tang , Yong Liu

Graph Neural Networks (GNNs) have achieved impressive performance in graph-related tasks. However, they suffer from poor generalization on out-of-distribution (OOD) data, as they tend to learn spurious correlations. Such correlations…

Machine Learning · Statistics 2026-03-26 Bowen Lu , Liangqiang Yang , Teng Li

This paper introduces Graph Convolutional Recurrent Network (GCRN), a deep learning model able to predict structured sequences of data. Precisely, GCRN is a generalization of classical recurrent neural networks (RNN) to data structured by…

Machine Learning · Statistics 2016-12-23 Youngjoo Seo , Michaël Defferrard , Pierre Vandergheynst , Xavier Bresson

Graph Neural Networks (GNNs) show promising results for graph tasks. However, existing GNNs' generalization ability will degrade when there exist distribution shifts between testing and training graph data. The cardinal impetus underlying…

Machine Learning · Computer Science 2023-12-21 Zhengyu Chen , Teng Xiao , Kun Kuang , Zheqi Lv , Min Zhang , Jinluan Yang , Chengqiang Lu , Hongxia Yang , Fei Wu

The era of data deluge has sparked the interest in graph-based learning methods in a number of disciplines such as sociology, biology, neuroscience, or engineering. In this paper, we introduce a graph recurrent neural network (GRNN) for…

Machine Learning · Computer Science 2019-02-19 Vassilis N. Ioannidis , Antonio G. Marques , Georgios B. Giannakis

We investigate response selection for multi-turn conversation in retrieval-based chatbots. Existing studies pay more attention to the matching between utterances and responses by calculating the matching score based on learned features,…

Computation and Language · Computer Science 2021-01-18 Yongkang Liu , Shi Feng , Daling Wang , Kaisong Song , Feiliang Ren , Yifei Zhang

Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are…

Machine Learning · Computer Science 2021-11-09 Debmalya Mandal , Sourav Medya , Brian Uzzi , Charu Aggarwal

Effective decision-making on networks often relies on learning from graph-structured data, where Graph Neural Networks (GNNs) play a central role, but they take efforts to configure and tune. In this demo, we propose LLMNet, showing how to…

Machine Learning · Computer Science 2025-06-18 Xiaohan Zheng , Lanning Wei , Yong Li , Quanming Yao

Recently Graph Neural Network (GNN) has been applied successfully to various NLP tasks that require reasoning, such as multi-hop machine reading comprehension. In this paper, we consider a novel case where reasoning is needed over graphs…

Computation and Language · Computer Science 2020-04-13 Ming Tu , Jing Huang , Xiaodong He , Bowen Zhou

Recurrent Neural Networks (RNNs) are very successful at solving challenging problems with sequential data. However, this observed efficiency is not yet entirely explained by theory. It is known that a certain class of multiplicative RNNs…

Machine Learning · Computer Science 2019-01-31 Valentin Khrulkov , Oleksii Hrinchuk , Ivan Oseledets

Graph Neural Networks (GNNs) are proposed without considering the agnostic distribution shifts between training and testing graphs, inducing the degeneration of the generalization ability of GNNs on Out-Of-Distribution (OOD) settings. The…

Machine Learning · Computer Science 2024-03-12 Shaohua Fan , Xiao Wang , Chuan Shi , Peng Cui , Bai Wang

Recent research on integrating Large Language Models (LLMs) with Graph Neural Networks (GNNs) typically follows two approaches: LLM-centered models, which convert graph data into tokens for LLM processing, and GNN-centered models, which use…

Machine Learning · Computer Science 2024-12-11 Haotong Yang , Xiyuan Wang , Qian Tao , Shuxian Hu , Zhouchen Lin , Muhan Zhang

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

This study aims to optimize the existing retrieval-augmented generation model (RAG) by introducing a graph structure to improve the performance of the model in dealing with complex knowledge reasoning tasks. The traditional RAG model has…

Information Retrieval · Computer Science 2024-11-07 Yuxin Dong , Shuo Wang , Hongye Zheng , Jiajing Chen , Zhenhong Zhang , Chihang Wang

Graph structure learning is a well-established problem that aims at optimizing graph structures adaptive to specific graph datasets to help message passing neural networks (i.e., GNNs) to yield effective and robust node embeddings. However,…

Machine Learning · Computer Science 2023-06-21 Wentao Zhao , Qitian Wu , Chenxiao Yang , Junchi Yan

Graphical models capture relations between entities in a wide range of applications including social networks, biology, and natural language processing, among others. Graph neural networks (GNN) are neural models that operate over graphs,…

Machine Learning · Computer Science 2024-02-08 Xu Zheng , Farhad Shirani , Tianchun Wang , Shouwei Gao , Wenqian Dong , Wei Cheng , Dongsheng Luo

Large Language Models (LLMs) have achieved impressive results in processing text data, which has sparked interest in applying these models beyond textual data, such as graphs. In the field of graph learning, there is a growing interest in…

Artificial Intelligence · Computer Science 2024-10-10 Sheng Ouyang , Yulan Hu , Ge Chen , Yong Liu

Large language models (LLMs) demonstrate great potential for problems with implicit graphical structures, while recent works seek to enhance the graph reasoning capabilities of LLMs through specialized instruction tuning. The resulting…

Computation and Language · Computer Science 2024-10-14 Yizhuo Zhang , Heng Wang , Shangbin Feng , Zhaoxuan Tan , Xiaochuang Han , Tianxing He , Yulia Tsvetkov

Graph neural networks (GNNs) learn representations from network data with naturally distributed architectures, rendering them well-suited candidates for decentralized learning. Oftentimes, this decentralized graph support changes with time…

Machine Learning · Computer Science 2020-10-27 Zhan Gao , Fernando Gama , Alejandro Ribeiro