English
Related papers

Related papers: When Do Graph Foundation Models Transfer? A Data-C…

200 papers

Graph foundation models (GFMs) have recently gained significant attention. However, the unique data processing and evaluation setups employed by different studies hinder a deeper understanding of their progress. Additionally, current…

Graph neural networks (GNNs) are composed of layers consisting of graph convolutions and pointwise nonlinearities. Due to their invariance and stability properties, GNNs are provably successful at learning representations from data…

Machine Learning · Computer Science 2023-08-09 Luana Ruiz , Luiz F. O. Chamon , Alejandro Ribeiro

In Graph Signal Processing (GSP), data dependencies are represented by a graph whose nodes label the data and the edges capture dependencies among nodes. The graph is represented by a weighted adjacency matrix $A$ that, in GSP, generalizes…

Signal Processing · Electrical Eng. & Systems 2020-12-02 João Domingos , José M. F. Moura

Multi-domain graph pre-training integrates knowledge from diverse domains to enhance performance in the target domains, which is crucial for building graph foundation models. Despite initial success, existing solutions often fall short of…

Machine Learning · Computer Science 2026-03-03 Li Sun , Zhenhao Huang , Silei Chen , Lanxu Yang , Junda Ye , Sen Su , Philip S. Yu

The focus of Part I of this monograph has been on both the fundamental properties, graph topologies, and spectral representations of graphs. Part II embarks on these concepts to address the algorithmic and practical issues centered round…

Information Theory · Computer Science 2019-09-24 Ljubisa Stankovic , Danilo Mandic , Milos Dakovic , Milos Brajovic , Bruno Scalzo , Anthony G. Constantinides

Foundation Models (FMs) serve as a general class for the development of artificial intelligence systems, offering broad potential for generalization across a spectrum of downstream tasks. Despite extensive research into self-supervised…

Machine Learning · Computer Science 2024-06-17 Yuhao Xu , Xinqi Liu , Keyu Duan , Yi Fang , Yu-Neng Chuang , Daochen Zha , Qiaoyu Tan

Graphs provide a powerful means for representing complex interactions between entities. Recently, deep learning approaches are emerging for representing and modeling graph-structured data, although the conventional deep learning methods…

Neural and Evolutionary Computing · Computer Science 2016-12-06 Jaekoo Lee , Hyunjae Kim , Jongsun Lee , Sungroh Yoon

The growing complexity of wireless systems has accelerated the move from traditional methods to learning-based solutions. Graph Neural Networks (GNNs) are especially well-suited here, since wireless networks can be naturally represented as…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Romina Garcia Camargo , Zhiyang Wang , Alejandro Ribeiro

Learning universal graph representations across heterogeneous domains is difficult because graph datasets differ in topology, node-attribute semantics, feature dimensions, and even attribute availability. We propose GraphVec, a…

Machine Learning · Computer Science 2026-05-08 Qi Feng , Jicong Fan

Continuous-depth graph neural networks, also known as Graph Neural Differential Equations (GNDEs), combine the structural inductive bias of Graph Neural Networks (GNNs) with the continuous-depth architecture of Neural ODEs, offering a…

Machine Learning · Computer Science 2026-04-21 Mingsong Yan , Charles Kulick , Sui Tang

Graph neural networks (GNNs) have been widely used in representation learning on graphs and achieved state-of-the-art performance in tasks such as node classification and link prediction. However, most existing GNNs are designed to learn…

Machine Learning · Computer Science 2020-02-06 Seongjun Yun , Minbyul Jeong , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Graph neural networks (GNN) suffer from severe inefficiency. It is mainly caused by the exponential growth of node dependency with the increase of layers. It extremely limits the application of stochastic optimization algorithms so that the…

Machine Learning · Computer Science 2024-04-23 Hongyuan Zhang , Yanan Zhu , Xuelong Li

Spectral graph convolutional networks are generalizations of standard convolutional networks for graph-structured data using the Laplacian operator. A common misconception is the instability of spectral filters, i.e. the impossibility to…

Machine Learning · Computer Science 2020-12-21 Axel Nilsson , Xavier Bresson

Graph Neural Networks (GNNs) have emerged as a powerful tool to capture intricate network patterns, achieving success across different domains. However, existing GNNs require careful domain-specific architecture designs and training from…

Machine Learning · Computer Science 2025-05-30 Jingzhe Liu , Haitao Mao , Zhikai Chen , Bingheng Li , Wenqi Fan , Mingxuan Ju , Tong Zhao , Neil Shah , Jiliang Tang

Graph convolutional networks (GCNs) are a widely used method for graph representation learning. To elucidate the capabilities and limitations of GCNs, we investigate their power, as a function of their number of layers, to distinguish…

Machine Learning · Statistics 2020-05-14 Abram Magner , Mayank Baranwal , Alfred O. Hero

Graph-structured data is ubiquitous in the world which models complex relationships between objects, enabling various Web applications. Daily influxes of unlabeled graph data on the Web offer immense potential for these applications. Graph…

Machine Learning · Computer Science 2024-03-12 Yun Zhu , Yaoke Wang , Haizhou Shi , Zhenshuo Zhang , Dian Jiao , Siliang Tang

The graph fractional Fourier transform (GFRFT) applies a single global fractional order to all graph frequencies, which restricts its adaptability to diverse signal characteristics across the spectral domain. To address this limitation, in…

Signal Processing · Electrical Eng. & Systems 2025-08-01 Manjun Cui , Zhichao Zhang , Wei Yao

In this paper we consider the problem of constructing graph Fourier transforms (GFTs) for directed graphs (digraphs), with a focus on developing multiple GFT designs that can capture different types of variation over the digraph…

Signal Processing · Electrical Eng. & Systems 2023-04-11 Laura Shimabukuro , Antonio Ortega

Graph convolutional networks (GCNs) are a widely used method for graph representation learning. We investigate the power of GCNs, as a function of their number of layers, to distinguish between different random graph models on the basis of…

Machine Learning · Statistics 2020-02-14 Abram Magner , Mayank Baranwal , Alfred O. Hero

Graph neural networks (GNNs) have recently been demonstrated to perform well on a variety of network-based tasks such as decentralized control and resource allocation, and provide computationally efficient methods for these tasks which have…

Machine Learning · Computer Science 2021-12-15 Raghu Arghal , Eric Lei , Shirin Saeedi Bidokhti