English
Related papers

Related papers: Generative Risk Minimization for Out-of-Distributi…

200 papers

Recently, invariant risk minimization (IRM) was proposed as a promising solution to address out-of-distribution (OOD) generalization. However, it is unclear when IRM should be preferred over the widely-employed empirical risk minimization…

Machine Learning · Computer Science 2022-08-22 Kartik Ahuja , Jun Wang , Amit Dhurandhar , Karthikeyan Shanmugam , Kush R. Varshney

To build safe and reliable graph machine learning systems, unsupervised graph-level anomaly detection (GLAD) and unsupervised graph-level out-of-distribution (OOD) detection (GLOD) have received significant attention in recent years. Though…

Machine Learning · Computer Science 2025-04-07 Yili Wang , Yixin Liu , Xu Shen , Chenyu Li , Kaize Ding , Rui Miao , Ying Wang , Shirui Pan , Xin Wang

Existing methods for graph out-of-distribution (OOD) generalization primarily rely on empirical studies on synthetic datasets. Such approaches tend to overemphasize the causal relationships between invariant sub-graphs and labels, thereby…

Machine Learning · Computer Science 2025-07-08 Can Xu , Yao Cheng , Jianxiang Yu , Haosen Wang , Jingsong Lv , Yao Liu , Xiang Li

Out-of-distribution (OOD) generalization in the graph domain is challenging due to complex distribution shifts and a lack of environmental contexts. Recent methods attempt to enhance graph OOD generalization by generating flat environments.…

Machine Learning · Computer Science 2024-06-04 Yinhua Piao , Sangseon Lee , Yijingxiu Lu , Sun Kim

Graph machine learning has witnessed rapid growth, driving advancements across diverse domains. However, the in-distribution assumption, where training and testing data share the same distribution, often breaks in real-world scenarios,…

Machine Learning · Computer Science 2025-02-13 Tingyi Cai , Yunliang Jiang , Yixin Liu , Ming Li , Changqin Huang , Shirui Pan

Deep learning on graphs has shown remarkable success across numerous applications, including social networks, bio-physics, traffic networks, and recommendation systems. Regardless of their successes, current methods frequently depend on the…

Machine Learning · Computer Science 2025-09-25 Itay Niv , Neta Rabin

When testing data and training data come from different distributions, deep neural networks (DNNs) will face significant safety risks in practical applications. Therefore, out-of-distribution (OOD) detection techniques, which can identify…

Machine Learning · Computer Science 2026-04-01 Cheng Yang , Yu Hao , Qi Zhang , Chuan Shi

The open-world test dataset is often mixed with out-of-distribution (OOD) samples, where the deployed models will struggle to make accurate predictions. Traditional detection methods need to trade off OOD detection and in-distribution (ID)…

Machine Learning · Computer Science 2024-04-25 Xu Shen , Yili Wang , Kaixiong Zhou , Shirui Pan , Xin Wang

Although dynamic graph neural networks (DyGNNs) have demonstrated promising capabilities, most existing methods ignore out-of-distribution (OOD) shifts that commonly exist in dynamic graphs. Dynamic graph OOD generalization is non-trivial…

Machine Learning · Computer Science 2026-03-03 Xinxun Zhang , Pengfei Jiao , Mengzhou Gao , Tianpeng Li , Xuan Guo

Out-of-distribution detection is a common issue in deploying vision models in practice and solving it is an essential building block in safety critical applications. Most of the existing OOD detection solutions focus on improving the OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Tomas Vojir , Jan Sochman , Rahaf Aljundi , Jiri Matas

Enhancing the stability of machine learning algorithms under distributional shifts is at the heart of the Out-of-Distribution (OOD) Generalization problem. Derived from causal learning, recent works of invariant learning pursue strict…

Machine Learning · Computer Science 2024-02-15 Jiashuo Liu , Jiayun Wu , Jie Peng , Xiaoyu Wu , Yang Zheng , Bo Li , Peng Cui

Graph machine learning (GML) has been successfully applied across a wide range of tasks. Nonetheless, GML faces significant challenges in generalizing over out-of-distribution (OOD) data, which raises concerns about its wider applicability.…

Machine Learning · Computer Science 2024-10-17 Jing Ma

The Invariant Risk Minimization (IRM) framework aims to learn invariant features from a set of environments for solving the out-of-distribution (OOD) generalization problem. The underlying assumption is that the causal components of the…

Machine Learning · Computer Science 2021-12-28 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

Neural networks (NNs), despite their success and wide adoption, still struggle to extrapolate out-of-distribution (OOD), i.e., to inputs that are not well-represented by their training dataset. Addressing the OOD generalization gap is…

Machine Learning · Computer Science 2025-04-01 Robert R. Nerem , Samantha Chen , Sanjoy Dasgupta , Yusu Wang

With the progressive advancements in deep graph learning, out-of-distribution (OOD) detection for graph data has emerged as a critical challenge. While the efficacy of auxiliary datasets in enhancing OOD detection has been extensively…

Machine Learning · Computer Science 2024-08-01 Junwei He , Qianqian Xu , Yangbangyan Jiang , Zitai Wang , Yuchen Sun , Qingming Huang

In neuroscience, identifying distinct patterns linked to neurological disorders, such as Alzheimer's and Autism, is critical for early diagnosis and effective intervention. Graph Neural Networks (GNNs) have shown promising in analyzing…

Machine Learning · Computer Science 2025-02-05 Jiaxing Xu , Yongqiang Chen , Xia Dong , Mengcheng Lan , Tiancheng Huang , Qingtian Bian , James Cheng , Yiping Ke

Graph Out-of-Distribution (OOD) detection aims to identify whether a test graph deviates from the distribution of graphs observed during training, which is critical for ensuring the reliability of Graph Neural Networks (GNNs) when deployed…

Machine Learning · Computer Science 2026-02-20 Luzhi Wang , Xuanshuo Fu , He Zhang , Chuang Liu , Xiaobao Wang , Hongbo Liu

Dynamic graph neural networks (DGNNs) are increasingly pervasive in exploiting spatio-temporal patterns on dynamic graphs. However, existing works fail to generalize under distribution shifts, which are common in real-world scenarios. As…

Machine Learning · Computer Science 2023-11-21 Haonan Yuan , Qingyun Sun , Xingcheng Fu , Ziwei Zhang , Cheng Ji , Hao Peng , Jianxin Li

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

Graph Neural Networks (GNNs) are state-of-the-art models for performing prediction tasks on graphs. While existing GNNs have shown great performance on various tasks related to graphs, little attention has been paid to the scenario where…

Machine Learning · Computer Science 2023-08-15 Yu Song , Donglin Wang