English
Related papers

Related papers: Handling Distribution Shifts on Graphs: An Invaria…

200 papers

In the context of modern machine learning, models deployed in real-world scenarios often encounter diverse data shifts like covariate and semantic shifts, leading to challenges in both out-of-distribution (OOD) generalization and detection.…

Machine Learning · Computer Science 2024-09-30 Han Wang , Yixuan Li

Out-of-distribution (OOD) generalization in Graph Neural Networks (GNNs) has gained significant attention due to its critical importance in graph-based predictions in real-world scenarios. Existing methods primarily focus on extracting a…

Machine Learning · Computer Science 2025-04-21 Bowen Liu , Haoyang Li , Shuning Wang , Shuo Nie , Shanghang Zhang

Despite extensive research efforts focused on OOD detection on images, OOD detection on nodes in graph learning remains underexplored. The dependence among graph nodes hinders the trivial adaptation of existing approaches on images that…

Machine Learning · Computer Science 2025-03-18 Yuhan Chen , Yihong Luo , Yifan Song , Pengwen Dai , Jing Tang , Xiaochun Cao

Graph Transformers (GTs) have demonstrated great effectiveness across various graph analytical tasks. However, the existing GTs focus on training and testing graph data originated from the same distribution, but fail to generalize under…

Machine Learning · Computer Science 2026-03-16 Tianyin Liao , Ziwei Zhang , Yufei Sun , Chunyu Hu , Jianxin Li

Deep neural networks have found widespread adoption in solving complex tasks ranging from image recognition to natural language processing. However, these networks make confident mispredictions when presented with data that does not belong…

Machine Learning · Computer Science 2020-12-16 Deepak Ravikumar , Sangamesh Kodge , Isha Garg , Kaushik Roy

Graph Neural Networks (GNNs)-based recommendation algorithms typically assume that training and testing data are drawn from independent and identically distributed (IID) spaces. However, this assumption often fails in the presence of…

Machine Learning · Computer Science 2025-04-03 Chu Zhao , Enneng Yang , Yuliang Liang , Pengxiang Lan , Yuting Liu , Jianzhe Zhao , Guibing Guo , Xingwei Wang

In reliable decision-making systems based on machine learning, models have to be robust to distributional shifts or provide the uncertainty of their predictions. In node-level problems of graph learning, distributional shifts can be…

Machine Learning · Computer Science 2023-11-02 Gleb Bazhenov , Denis Kuznedelev , Andrey Malinin , Artem Babenko , Liudmila Prokhorenkova

This work considers the out-of-distribution (OOD) prediction problem where (1)~the training data are from multiple domains and (2)~the test domain is unseen in the training. DNNs fail in OOD prediction because they are prone to pick up…

Machine Learning · Computer Science 2021-02-24 Ruocheng Guo , Pengchuan Zhang , Hao Liu , Emre Kiciman

Deep learning models excel in computer vision tasks but often fail to generalize to out-of-distribution (OOD) domains. Invariant Risk Minimization (IRM) aims to address OOD generalization by learning domain-invariant features. However, IRM…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Yaoyao Zhu , Xiuding Cai , Yingkai Wang , Dong Miao , Zhongliang Fu , Xu Luo

Invariant learning demonstrates substantial potential for enhancing the generalization of graph neural networks (GNNs) with out-of-distribution (OOD) data. It aims to recognize stable features in graph data for classification, based on the…

Machine Learning · Computer Science 2025-01-23 Yongduo Sui , Jie Sun , Shuyao Wang , Zemin Liu , Qing Cui , Longfei Li , Xiang Wang

Distributionally robust optimization (DRO) and invariant risk minimization (IRM) are two popular methods proposed to improve out-of-distribution (OOD) generalization performance of machine learning models. While effective for small models,…

Machine Learning · Computer Science 2023-01-25 Xiao Zhou , Yong Lin , Renjie Pi , Weizhong Zhang , Renzhe Xu , Peng Cui , Tong Zhang

A popular assumption for out-of-distribution generalization is that the training data comprises sub-datasets, each drawn from a distinct distribution; the goal is then to "interpolate" these distributions and "extrapolate" beyond them --…

Machine Learning · Computer Science 2021-11-19 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Haoyue Bai

Out-of-distribution (OOD) detection is essential to handle the distribution shifts between training and test scenarios. For a new in-distribution (ID) dataset, existing methods require retraining to capture the dataset-specific feature…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Meng Xing , Zhiyong Feng , Yong Su , Changjae Oh

One of the challenges for neural networks in real-life applications is the overconfident errors these models make when the data is not from the original training distribution. Addressing this issue is known as Out-of-Distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sina Sharifi , Taha Entesari , Bardia Safaei , Vishal M. Patel , Mahyar Fazlyab

Graph Neural Networks (GNNs) are widely used for node classification tasks but often fail to generalize when training and test nodes come from different distributions, limiting their practicality. To overcome this, recent approaches adopt…

Machine Learning · Computer Science 2024-06-04 Weihuang Zheng , Jiashuo Liu , Jiaxing Li , Jiayun Wu , Peng Cui , Youyong Kong

Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has considerable real-world applications. One of the most mainstream methods is to extract the invariant subgraph by aligning…

Machine Learning · Computer Science 2024-07-23 Xuexin Chen , Ruichu Cai , Kaitao Zheng , Zhifan Jiang , Zhengting Huang , Zhifeng Hao , Zijian Li

We study the problem of lifelong graph learning in an open-world scenario, where a model needs to deal with new tasks and potentially unknown classes. We utilize Out-of-Distribution (OOD) detection methods to recognize new classes and adapt…

Machine Learning · Computer Science 2023-10-20 Marcel Hoffmann , Lukas Galke , Ansgar Scherp

Empirical risk minimization (ERM) is not robust to changes in the distribution of data. When the distribution of test data is different from that of training data, the problem is known as out-of-distribution generalization. Recently, two…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Shijian Xu

Deep learning on graphs has shown remarkable success across numerous applications, including social networks, bio-physics, traffic networks, and recommendation systems. Regardless of their successes, current methods frequently depend on the…

Machine Learning · Computer Science 2025-09-25 Itay Niv , Neta Rabin