English
Related papers

Related papers: TeKo: Text-Rich Graph Neural Networks with Externa…

200 papers

Deep learning has become the dominant approach in coping with various tasks in Natural LanguageProcessing (NLP). Although text inputs are typically represented as a sequence of tokens, there isa rich variety of NLP problems that can be best…

Computation and Language · Computer Science 2022-10-21 Lingfei Wu , Yu Chen , Kai Shen , Xiaojie Guo , Hanning Gao , Shucheng Li , Jian Pei , Bo Long

Graph-based recommendation has achieved great success in recent years. The classical graph recommendation model utilizes ID embedding to store essential collaborative information. However, this ID-based paradigm faces challenges in…

Information Retrieval · Computer Science 2026-05-12 Yiwen Chen , Yiqing Wu , Huishi Luo , Fuzhen Zhuang , Deqing Wang , Zhao Zhang

Graph Neural Networks (GNNs) have become a prominent approach to machine learning with graphs and have been increasingly applied in a multitude of domains. Nevertheless, since most existing GNN models are based on flat message-passing…

Machine Learning · Computer Science 2022-10-27 Zhiqiang Zhong , Cheng-Te Li , Jun Pang

Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. While extensive research has been done on developing GNN models with superior performance according to a…

Knowledge graph (KG) link prediction aims to infer new facts based on existing facts in the KG. Recent studies have shown that using the graph neighborhood of a node via graph neural networks (GNNs) provides more useful information compared…

Computation and Language · Computer Science 2024-02-15 Vardaan Pahuja , Boshi Wang , Hugo Latapie , Jayanth Srinivasa , Yu Su

Hypergraphs, with their capacity to depict high-order relationships, have emerged as a significant extension of traditional graphs. Although Graph Neural Networks (GNNs) have remarkable performance in graph representation learning, their…

Machine Learning · Computer Science 2024-11-07 Khaled Mohammed Saifuddin , Mehmet Emin Aktas , Esra Akbas

Graph neural networks (GNNs) are a powerful architecture for tackling graph learning tasks, yet have been shown to be oblivious to eminent substructures such as cycles. We present TOGL, a novel layer that incorporates global topological…

Machine Learning · Computer Science 2022-03-18 Max Horn , Edward De Brouwer , Michael Moor , Yves Moreau , Bastian Rieck , Karsten Borgwardt

Graph neural networks (GNNs) have been widely used in representation learning on graphs and achieved state-of-the-art performance in tasks such as node classification and link prediction. However, most existing GNNs are designed to learn…

Machine Learning · Computer Science 2020-02-06 Seongjun Yun , Minbyul Jeong , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Textual Attributed Graphs (TAGs) are crucial for modeling complex real-world systems, yet leveraging large language models (LLMs) for TAGs presents unique challenges due to the gap between sequential text processing and graph-structured…

Machine Learning · Computer Science 2025-05-09 Zhengyu Hu , Yichuan Li , Zhengyu Chen , Jingang Wang , Han Liu , Kyumin Lee , Kaize Ding

Graph Nerual Networks (GNNs) are effective models in graph embedding. It extracts shallow features and neighborhood information by aggregating neighbor information to learn the embedding representation of different nodes. However, the local…

Social and Information Networks · Computer Science 2023-12-14 Kejia Zhang

Human-curated knowledge graphs provide critical supportive information to various natural language processing tasks, but these graphs are usually incomplete, urging auto-completion of them. Prevalent graph embedding approaches, e.g.,…

Computation and Language · Computer Science 2021-02-25 Bo Wang , Tao Shen , Guodong Long , Tianyi Zhou , Yi Chang

Graph neural networks (GNNs) have emerged as a powerful tool for effectively mining and learning from graph-structured data, with applications spanning numerous domains. However, most research focuses on static graphs, neglecting the…

Machine Learning · Computer Science 2024-04-30 Yanping Zheng , Lu Yi , Zhewei Wei

Heterogeneous graph is a kind of data structure widely existing in real life. Nowadays, the research of graph neural network on heterogeneous graph has become more and more popular. The existing heterogeneous graph neural network algorithms…

Artificial Intelligence · Computer Science 2021-06-28 Xinliang Wu , Mengying Jiang , Guizhong Liu

Knowledge graphs suffer from sparsity which degrades the quality of representations generated by various methods. While there is an abundance of textual information throughout the web and many existing knowledge bases, aligning information…

Computation and Language · Computer Science 2021-04-13 Saed Rezayi , Handong Zhao , Sungchul Kim , Ryan A. Rossi , Nedim Lipka , Sheng Li

Traditional approaches to semantic communication tasks rely on the knowledge of the signal-to-noise ratio (SNR) to mitigate channel noise. Moreover, these methods necessitate training under specific SNR conditions, entailing considerable…

Machine Learning · Computer Science 2024-09-24 Chunhang Zheng , Kechao Cai

Graph neural networks (GNNs), as a group of powerful tools for representation learning on irregular data, have manifested superiority in various downstream tasks. With unstructured texts represented as concept maps, GNNs can be exploited…

Information Retrieval · Computer Science 2022-01-14 Hejie Cui , Jiaying Lu , Yao Ge , Carl Yang

In this work we propose a novel end-to-end multi-stage Knowledge Graph (KG) generation system from textual inputs, separating the overall process into two stages. The graph nodes are generated first using pretrained language model, followed…

Computation and Language · Computer Science 2022-11-22 Igor Melnyk , Pierre Dognin , Payel Das

Time, cost, and energy efficiency are critical considerations in Deep-Learning (DL), particularly when processing long texts. Transformers, which represent the current state of the art, exhibit quadratic computational complexity relative to…

Computation and Language · Computer Science 2025-07-11 Fardin Rastakhiz

Graph Neural Networks (GNNs) are routinely used in molecular physics, social sciences, and economics to model many-body interactions in graph-like systems. However, GNNs are inherently local and can suffer from information flow bottlenecks.…

Computational Physics · Physics 2025-02-21 Alessandro Caruso , Jacopo Venturin , Lorenzo Giambagli , Edoardo Rolando , Frank Noé , Cecilia Clementi

The era of data deluge has sparked the interest in graph-based learning methods in a number of disciplines such as sociology, biology, neuroscience, or engineering. In this paper, we introduce a graph recurrent neural network (GRNN) for…

Machine Learning · Computer Science 2019-02-19 Vassilis N. Ioannidis , Antonio G. Marques , Georgios B. Giannakis