English
Related papers

Related papers: Investigating Out-of-Distribution Generalization o…

200 papers

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Haoyue Bai

Graph Neural Network (GNN) has demonstrated extraordinary performance in classifying graph properties. However, due to the selection bias of training and testing data (e.g., training on small graphs and testing on large graphs, or training…

Machine Learning · Computer Science 2023-08-17 Bin Lu , Xiaoying Gan , Ze Zhao , Shiyu Liang , Luoyi Fu , Xinbing Wang , Chenghu Zhou

Out-of-distribution (OOD) generalization in Graph Neural Networks (GNNs) has gained significant attention due to its critical importance in graph-based predictions in real-world scenarios. Existing methods primarily focus on extracting a…

Machine Learning · Computer Science 2025-04-21 Bowen Liu , Haoyang Li , Shuning Wang , Shuo Nie , Shanghang Zhang

In the context of modern machine learning, models deployed in real-world scenarios often encounter diverse data shifts like covariate and semantic shifts, leading to challenges in both out-of-distribution (OOD) generalization and detection.…

Machine Learning · Computer Science 2024-09-30 Han Wang , Yixuan Li

Neural networks (NNs), despite their success and wide adoption, still struggle to extrapolate out-of-distribution (OOD), i.e., to inputs that are not well-represented by their training dataset. Addressing the OOD generalization gap is…

Machine Learning · Computer Science 2025-04-01 Robert R. Nerem , Samantha Chen , Sanjoy Dasgupta , Yusu Wang

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

Machine Learning · Computer Science 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

Out-of-distribution (OOD) learning deals with scenarios in which training and test data follow different distributions. Although general OOD problems have been intensively studied in machine learning, graph OOD is only an emerging area of…

Machine Learning · Computer Science 2022-09-28 Shurui Gui , Xiner Li , Limei Wang , Shuiwang Ji

In real-world material research, machine learning (ML) models are usually expected to predict and discover novel exceptional materials that deviate from the known materials. It is thus a pressing question to provide an objective evaluation…

Materials Science · Physics 2024-01-17 Sadman Sadeed Omee , Nihang Fu , Rongzhi Dong , Ming Hu , Jianjun Hu

Out-Of-Distribution (OOD) generalization has gained increasing attentions for machine learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation under distribution shifts. Existing graph OOD methods tend to…

Machine Learning · Computer Science 2025-05-12 Henan Sun , Xunkai Li , Lei Zhu , Junyi Han , Guang Zeng , Ronghua Li , Guoren Wang

Despite graph neural networks' (GNNs) great success in modelling graph-structured data, out-of-distribution (OOD) test instances still pose a great challenge for current GNNs. One of the most effective techniques to detect OOD nodes is to…

Machine Learning · Computer Science 2025-04-11 Danny Wang , Ruihong Qiu , Guangdong Bai , Zi Huang

Dynamic graph neural networks (DGNNs) are increasingly pervasive in exploiting spatio-temporal patterns on dynamic graphs. However, existing works fail to generalize under distribution shifts, which are common in real-world scenarios. As…

Machine Learning · Computer Science 2023-11-21 Haonan Yuan , Qingyun Sun , Xingcheng Fu , Ziwei Zhang , Cheng Ji , Hao Peng , Jianxin Li

When testing data and training data come from different distributions, deep neural networks (DNNs) will face significant safety risks in practical applications. Therefore, out-of-distribution (OOD) detection techniques, which can identify…

Machine Learning · Computer Science 2026-04-01 Cheng Yang , Yu Hao , Qi Zhang , Chuan Shi

Graph neural networks have shown remarkable success in exploiting the spatial and temporal patterns on dynamic graphs. However, existing GNNs exhibit poor generalization ability under distribution shifts, which is inevitable in dynamic…

Machine Learning · Computer Science 2025-11-25 Qingyun Sun , Jiayi Luo , Haonan Yuan , Xingcheng Fu , Hao Peng , Jianxin Li , Philip S. Yu

Systematic, compositional generalization beyond the training distribution remains a core challenge in machine learning -- and a critical bottleneck for the emergent reasoning abilities of modern language models. This work investigates…

Machine Learning · Computer Science 2025-10-17 Awni Altabaa , Siyu Chen , John Lafferty , Zhuoran Yang

Graph neural networks (GNNs) have become compelling models designed to perform learning and inference on graph-structured data. However, little work has been done to understand the fundamental limitations of GNNs for scaling to larger…

Machine Learning · Computer Science 2023-10-27 Hyungeun Lee , Kijung Yoon

Graph machine learning has witnessed rapid growth, driving advancements across diverse domains. However, the in-distribution assumption, where training and testing data share the same distribution, often breaks in real-world scenarios,…

Machine Learning · Computer Science 2025-02-13 Tingyi Cai , Yunliang Jiang , Yixin Liu , Ming Li , Changqin Huang , Shirui Pan

Graph-level representation learning is important in a wide range of applications. Existing graph-level models are generally built on i.i.d. assumption for both training and testing graphs. However, in an open world, models can encounter…

Machine Learning · Computer Science 2024-07-19 Zhihao Ding , Jieming Shi , Shiqi Shen , Xuequn Shang , Jiannong Cao , Zhipeng Wang , Zhi Gong

Recent studies have revealed that GNNs are highly susceptible to multiple adversarial attacks. Among these, graph backdoor attacks pose one of the most prominent threats, where attackers cause models to misclassify by learning the…

Cryptography and Security · Computer Science 2024-10-21 Hao Sui , Bing Chen , Jiale Zhang , Chengcheng Zhu , Di Wu , Qinghua Lu , Guodong Long

Graph neural networks (GNNs) are naturally distributed architectures for learning representations from network data. This renders them suitable candidates for decentralized tasks. In these scenarios, the underlying graph often changes with…

Machine Learning · Computer Science 2022-08-31 Zhan Gao , Fernando Gama , Alejandro Ribeiro

Graph neural networks (GNNs) learn representations from network data with naturally distributed architectures, rendering them well-suited candidates for decentralized learning. Oftentimes, this decentralized graph support changes with time…

Machine Learning · Computer Science 2020-10-27 Zhan Gao , Fernando Gama , Alejandro Ribeiro