English
Related papers

Related papers: Learning Universal Graph Neural Network Embeddings…

200 papers

Graph neural networks (GNNs) integrate deep architectures and topological structure modeling in an effective way. However, the performance of existing GNNs would decrease significantly when they stack many layers, because of the…

Machine Learning · Computer Science 2021-07-07 Kaixiong Zhou , Xiao Huang , Daochen Zha , Rui Chen , Li Li , Soo-Hyun Choi , Xia Hu

Graph Neural Networks (GNNs) have been extensively used for mining graph-structured data with impressive performance. However, because these traditional GNNs do not distinguish among various downstream tasks, embeddings embedded by them are…

Machine Learning · Computer Science 2024-09-20 Jianpeng Chen , Yujing Wang , Ming Zeng , Zongyi Xiang , Bitan Hou , Yunhai Tong , Ole J. Mengshoel , Yazhou Ren

Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model in broad application fields for their effectiveness in learning over graphs. To scale GNN training up for large-scale and ever-growing graphs, the most…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Haiyang Lin , Mingyu Yan , Xiaochun Ye , Dongrui Fan , Shirui Pan , Wenguang Chen , Yuan Xie

Graph embedding, aiming to learn low-dimensional representations (aka. embeddings) of nodes, has received significant attention recently. Recent years have witnessed a surge of efforts made on static graphs, among which Graph Convolutional…

Machine Learning · Computer Science 2021-04-08 Zeyu Cui , Zekun Li , Shu Wu , Xiaoyu Zhang , Qiang Liu , Liang Wang , Mengmeng Ai

We study the problem of embedding edgeless nodes such as users who newly enter the underlying network, while using graph neural networks (GNNs) widely studied for effective representation learning of graphs. Our study is motivated by the…

Social and Information Networks · Computer Science 2022-11-01 Yong-Min Shin , Cong Tran , Won-Yong Shin , Xin Cao

The pre-training on the graph neural network model can learn the general features of large-scale networks or networks of the same type by self-supervised methods, which allows the model to work even when node labels are missing. However,…

Machine Learning · Computer Science 2022-04-19 Ke-jia Chen , Jiajun Zhang , Linpu Jiang , Yunyun Wang , Yuxuan Dai

Graph Neural Networks (GNNs) are the first choice methods for graph machine learning problems thanks to their ability to learn state-of-the-art level representations from graph-structured data. However, centralizing a massive amount of…

Machine Learning · Computer Science 2021-06-08 Chaoyang He , Emir Ceyani , Keshav Balasubramanian , Murali Annavaram , Salman Avestimehr

The recent proliferation of publicly available graph-structured data has sparked an interest in machine learning algorithms for graph data. Since most traditional machine learning algorithms assume data to be tabular, embedding algorithms…

Machine Learning · Computer Science 2019-08-09 Sourav Mukherjee , Tim Oates , Ryan Wright

Graph neural networks (GNNs) are deep learning models designed specifically for graph data, and they typically rely on node features as the input to the first layer. When applying such a type of network on the graph without node features,…

Graph structure learning is a well-established problem that aims at optimizing graph structures adaptive to specific graph datasets to help message passing neural networks (i.e., GNNs) to yield effective and robust node embeddings. However,…

Machine Learning · Computer Science 2023-06-21 Wentao Zhao , Qitian Wu , Chenxiao Yang , Junchi Yan

Graph Neural Networks (GNNs) are widely used deep learning models that learn meaningful representations from graph-structured data. Due to the finite nature of the underlying recurrent structure, current GNN methods may struggle to capture…

Machine Learning · Computer Science 2021-06-02 Fangda Gu , Heng Chang , Wenwu Zhu , Somayeh Sojoudi , Laurent El Ghaoui

Deep neural networks (DNNs) have recently achieved impressive success across a wide range of real-world vision and language processing tasks, spanning from image classification to many other downstream vision tasks, such as object…

Machine Learning · Computer Science 2025-12-23 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Guochu Xiong , Weichen Liu

It has been observed that message-passing graph neural networks (GNN) sometimes struggle to maintain a healthy balance between the efficient/scalable modeling of long-range dependencies across nodes while avoiding unintended consequences…

Machine Learning · Computer Science 2025-05-21 Yongyi Yang , Tang Liu , Yangkun Wang , Zengfeng Huang , David Wipf

Dynamic graph learning (DGL) aims to learn informative and temporally-evolving node embeddings to support downstream tasks such as link prediction. A fundamental challenge in DGL lies in effectively modeling both the temporal dynamics and…

Social and Information Networks · Computer Science 2025-06-10 Ling Wang

Entity alignment typically suffers from the issues of structural heterogeneity and limited seed alignments. In this paper, we propose a novel Multi-channel Graph Neural Network model (MuGNN) to learn alignment-oriented knowledge graph (KG)…

Computation and Language · Computer Science 2019-08-28 Yixin Cao , Zhiyuan Liu , Chengjiang Li , Zhiyuan Liu , Juanzi Li , Tat-Seng Chua

Graph neural networks (GNNs) are powerful tools for developing scalable, decentralized artificial intelligence in large-scale networked systems, such as wireless networks, power grids, and transportation networks. Currently, GNNs in…

Machine Learning · Computer Science 2024-12-10 Rostyslav Olshevskyi , Zhongyuan Zhao , Kevin Chan , Gunjan Verma , Ananthram Swami , Santiago Segarra

Graph deep learning has recently emerged as a powerful ML concept allowing to generalize successful deep neural architectures to non-Euclidean structured data. Such methods have shown promising results on a broad spectrum of applications…

Machine Learning · Computer Science 2022-05-16 Anees Kazi , Luca Cosmo , Seyed-Ahmad Ahmadi , Nassir Navab , Michael Bronstein

Many machine learning techniques have been proposed in the last few years to process data represented in graph-structured form. Graphs can be used to model several scenarios, from molecules and materials to RNA secondary structures. Several…

Machine Learning · Computer Science 2018-11-19 Nicolò Navarin , Dinh V. Tran , Alessandro Sperduti

Graph neural networks (GNNs) excel in graph representation learning by integrating graph structure and node features. Existing GNNs, unfortunately, fail to account for the uncertainty of class probabilities that vary with the depth of the…

Machine Learning · Computer Science 2025-06-17 Qingfeng Chen , Shiyuan Li , Yixin Liu , Shirui Pan , Geoffrey I. Webb , Shichao Zhang

Graph structured data, specifically text-attributed graphs (TAG), effectively represent relationships among varied entities. Such graphs are essential for semi-supervised node classification tasks. Graph Neural Networks (GNNs) have emerged…

Machine Learning · Computer Science 2024-04-18 Kaiwen Dong , Zhichun Guo , Nitesh V. Chawla