English
Related papers

Related papers: Boosting Graph Foundation Model from Structural Pe…

200 papers

Advanced graph neural networks have shown great potentials in graph classification tasks recently. Different from node classification where node embeddings aggregated from local neighbors can be directly used to learn node labels, graph…

Machine Learning · Computer Science 2022-03-16 Hao Jia , Junzhong Ji , Minglong Lei

We present Graph Foundation Models (GFMs) which have made significant progress in various tasks, but their robustness against domain noise, structural perturbations, and adversarial attacks remains underexplored. A key limitation is the…

Machine Learning · Computer Science 2026-03-11 Junhua Shi , Qingyun Sun , Haonan Yuan , Xingcheng Fu

Data augmentation has been widely used to improve generalizability of machine learning models. However, comparatively little work studies data augmentation for graphs. This is largely due to the complex, non-Euclidean structure of graphs,…

Machine Learning · Computer Science 2020-12-03 Tong Zhao , Yozen Liu , Leonardo Neves , Oliver Woodford , Meng Jiang , Neil Shah

In recent years, Massive Open Online Courses (MOOCs) have gained significant traction as a rapidly growing phenomenon in online learning. Unlike traditional classrooms, MOOCs offer a unique opportunity to cater to a diverse audience from…

Machine Learning · Computer Science 2023-10-20 Soheila Farokhi , Aswani Yaramala , Jiangtao Huang , Muhammad F. A. Khan , Xiaojun Qi , Hamid Karimi

Under circumstances of heterophily, where nodes with different labels tend to be connected based on semantic meanings, Graph Neural Networks (GNNs) often exhibit suboptimal performance. Current studies on graph heterophily mainly focus on…

Machine Learning · Computer Science 2024-11-13 Yilun Zheng , Jiahao Xu , Lihui Chen

Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful…

Machine Learning · Computer Science 2018-03-12 Yujia Li , Oriol Vinyals , Chris Dyer , Razvan Pascanu , Peter Battaglia

Recent advancements in graph learning have revolutionized the way to understand and analyze data with complex structures. Notably, Graph Neural Networks (GNNs), i.e. neural network architectures designed for learning graph representations,…

Machine Learning · Computer Science 2024-07-09 Yu Huang , Min Zhou , Menglin Yang , Zhen Wang , Muhan Zhang , Jie Wang , Hong Xie , Hao Wang , Defu Lian , Enhong Chen

A foundation model like GPT elicits many emergent abilities, owing to the pre-training with broad inclusion of data and the use of the powerful Transformer architecture. While foundation models in natural languages are prevalent, can we…

Machine Learning · Computer Science 2025-06-18 Ziyuan Tang , Jie Chen

Graphs are ubiquitous for modeling complex relationships between objects across various fields. Graph neural networks (GNNs) have become a mainstream technique for graph-based applications, but their performance heavily relies on abundant…

Machine Learning · Computer Science 2025-02-27 Xingtong Yu , Jie Zhang , Yuan Fang , Renhe Jiang

In many Natural Language Processing applications, neural networks have been found to fail to generalize on out-of-distribution examples. In particular, several recent semantic parsing datasets have put forward important limitations of…

Computation and Language · Computer Science 2023-10-24 Alban Petit , Caio Corro , François Yvon

The growing ubiquity of relational data structured as graphs has underscored the need for graph learning models with exceptional generalization capabilities. However, current approaches often struggle to effectively extract generalizable…

Machine Learning · Computer Science 2024-08-21 Lianghao Xia , Chao Huang

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

Machine Learning · Computer Science 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song

This work presents a novel approach to tabular data prediction leveraging graph structure learning and graph neural networks. Despite the prevalence of tabular data in real-world applications, traditional deep learning methods often…

Machine Learning · Computer Science 2023-05-26 Jay Chiehen Liao , Cheng-Te Li

Large scale pretrained models have revolutionized Natural Language Processing (NLP) and Computer Vision (CV), showcasing remarkable cross domain generalization abilities. However, in graph learning, models are typically trained on…

Computation and Language · Computer Science 2025-10-03 Ruyue Liu , Rong Yin , Xiangzhen Bo , Xiaoshuai Hao , Yong Liu , Jinwen Zhong , Can Ma , Weiping Wang

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

Subgraph recognition aims at discovering a compressed substructure of a graph that is most informative to the graph property. It can be formulated by optimizing Graph Information Bottleneck (GIB) with a mutual information estimator.…

Machine Learning · Computer Science 2022-04-05 Junchi Yu , Jie Cao , Ran He

Graphs provide a powerful means for representing complex interactions between entities. Recently, deep learning approaches are emerging for representing and modeling graph-structured data, although the conventional deep learning methods…

Neural and Evolutionary Computing · Computer Science 2016-12-06 Jaekoo Lee , Hyunjae Kim , Jongsun Lee , Sungroh Yoon

Foundation models have achieved great success in natural language processing (NLP) and computer vision (CV). Their success largely stems from the ability to integrate multi-domain knowledge in pre-training and transfer it to target domains.…

Computation and Language · Computer Science 2025-07-01 Zihao Zhao , Xinlong Zhai , Jinyu Yang , Chuan Shi

Learning the right graph representation from noisy, multisource data has garnered significant interest in recent years. A central tenet of this problem is relational learning. Here the objective is to incorporate the partial information…

Machine Learning · Computer Science 2014-01-15 Rajmonda Caceres , Kevin Carter , Jeremy Kun

Graph Neural Networks (GNNs) have achieved great success among various domains. Nevertheless, most GNN methods are sensitive to the quality of graph structures. To tackle this problem, some studies exploit different graph structure learning…

Machine Learning · Computer Science 2021-08-11 Liping Wang , Fenyu Hu , Shu Wu , Liang Wang