English
Related papers

Related papers: Out-of-Distribution Generalization in Graph Founda…

200 papers

Graph Neural Networks (GNNs) are susceptible to distribution shifts, creating vulnerability and security issues in critical domains. There is a pressing need to enhance the generalizability of GNNs on out-of-distribution (OOD) test data.…

Machine Learning · Computer Science 2024-10-29 Xiaoxue Han , Huzefa Rangwala , Yue Ning

The mismatch between training and target data is one major challenge for current machine learning systems. When training data is collected from multiple domains and the target domains include all training domains and other new domains, we…

Machine Learning · Computer Science 2021-01-22 Haotian Ye , Chuanlong Xie , Yue Liu , Zhenguo Li

The problem of out-of-distribution detection for graph classification is far from being solved. The existing models tend to be overconfident about OOD examples or completely ignore the detection task. In this work, we consider this problem…

Machine Learning · Computer Science 2022-06-23 Gleb Bazhenov , Sergei Ivanov , Maxim Panov , Alexey Zaytsev , Evgeny Burnaev

Neural networks, while effective for tackling many challenging scientific tasks, are not known to perform well out-of-distribution (OOD), i.e., within domains which differ from their training data. Understanding neural network OOD…

Machine Learning · Computer Science 2025-12-11 Luis Rangel DaCosta , Mary C. Scott

Out-of-distribution (OOD) generalization in the graph domain is challenging due to complex distribution shifts and a lack of environmental contexts. Recent methods attempt to enhance graph OOD generalization by generating flat environments.…

Machine Learning · Computer Science 2024-06-04 Yinhua Piao , Sangseon Lee , Yijingxiu Lu , Sun Kim

In general, graph representation learning methods assume that the train and test data come from the same distribution. In this work we consider an underexplored area of an otherwise rapidly developing field of graph representation learning:…

Machine Learning · Computer Science 2021-12-08 Beatrice Bevilacqua , Yangze Zhou , Bruno Ribeiro

Graph neural networks (GNNs) have been demonstrated to perform well in graph representation learning, but always lacking in generalization capability when tackling out-of-distribution (OOD) data. Graph invariant learning methods, backed by…

Machine Learning · Computer Science 2023-12-19 Tianrui Jia , Haoyang Li , Cheng Yang , Tao Tao , Chuan Shi

Graph neural networks (GNNs) have found widespread application in modeling graph data across diverse domains. While GNNs excel in scenarios where the testing data shares the distribution of their training counterparts (in distribution, ID),…

Machine Learning · Computer Science 2024-01-15 Luzhi Wang , Dongxiao He , He Zhang , Yixin Liu , Wenjie Wang , Shirui Pan , Di Jin , Tat-Seng Chua

With recent advancements in artificial intelligence, its applications can be seen in every aspect of humans' daily life. From voice assistants to mobile healthcare and autonomous driving, we rely on the performance of AI methods for many…

Machine Learning · Computer Science 2022-09-28 Navid Ghassemi , Ehsan Fazl-Ersi

Out-of-distribution (OOD) generalization in Graph Neural Networks (GNNs) has gained significant attention due to its critical importance in graph-based predictions in real-world scenarios. Existing methods primarily focus on extracting a…

Machine Learning · Computer Science 2025-04-21 Bowen Liu , Haoyang Li , Shuning Wang , Shuo Nie , Shanghang Zhang

In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, with the idea resting…

Machine Learning · Statistics 2022-03-25 Ruoyu Wang , Mingyang Yi , Zhitang Chen , Shengyu Zhu

This paper focuses on out-of-distribution generalization on graphs where performance drops due to the unseen distribution shift. Previous graph domain generalization works always resort to learning an invariant predictor among different…

Machine Learning · Computer Science 2022-06-22 Junchi Yu , Jian Liang , Ran He

As foundation models gain prominence, Federated Foundation Models (FedFM) have emerged as a privacy-preserving approach to collaboratively fine-tune models in federated learning (FL) frameworks using distributed datasets across clients. A…

Machine Learning · Computer Science 2025-05-05 Yiyuan Yang , Guodong Long , Tianyi Zhou , Qinghua Lu , Shanshan Ye , Jing Jiang

Dynamic graph neural networks (DGNNs) are increasingly pervasive in exploiting spatio-temporal patterns on dynamic graphs. However, existing works fail to generalize under distribution shifts, which are common in real-world scenarios. As…

Machine Learning · Computer Science 2023-11-21 Haonan Yuan , Qingyun Sun , Xingcheng Fu , Ziwei Zhang , Cheng Ji , Hao Peng , Jianxin Li

Graph neural networks (GNNs) are often trained on individual datasets, requiring specialized models and significant hyperparameter tuning due to the unique structures and features of each dataset. This approach limits the scalability and…

Machine Learning · Computer Science 2026-02-17 Divyansha Lachi , Mehdi Azabou , Vinam Arora , Eva Dyer

Out-of-distribution (OOD) generalization is a favorable yet challenging property for deep neural networks. The core challenges lie in the limited availability of source domains that help models learn an invariant representation from the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yijiang Li , Sucheng Ren , Weipeng Deng , Yuzhi Xu , Ying Gao , Edith Ngai , Haohan Wang

Learning robust vision models that perform well in out-of-distribution (OOD) situations is an important task for model deployment in real-world settings. Despite extensive research in this field, many proposed methods have only shown minor…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Gyuseong Lee , Wooseok Jang , Jinhyeon Kim , Jaewoo Jung , Seungryong Kim

Out-of-distribution (OOD) generalization has emerged as a significant challenge in graph recommender systems. Traditional graph neural network algorithms often fail because they learn spurious environmental correlations instead of stable…

Information Retrieval · Computer Science 2025-11-25 Jiahao Liang , Haoran Yang , Xiangyu Zhao , Zhiwen Yu , Mianjie Li , Chuan Shi , Kaixiang Yang

Graph transformation that predicts graph transition from one mode to another is an important and common problem. Despite much progress in developing advanced graph transformation techniques in recent years, the fundamental assumption…

Machine Learning · Computer Science 2023-05-25 Shiyu Wang , Guangji Bai , Qingyang Zhu , Zhaohui Qin , Liang Zhao

Graph Neural Networks (GNNs) show promising results for graph tasks. However, existing GNNs' generalization ability will degrade when there exist distribution shifts between testing and training graph data. The cardinal impetus underlying…

Machine Learning · Computer Science 2023-12-21 Zhengyu Chen , Teng Xiao , Kun Kuang , Zheqi Lv , Min Zhang , Jinluan Yang , Chengqiang Lu , Hongxia Yang , Fei Wu