中文
相关论文

相关论文: Dissecting the Failure of Invariant Learning on Gr…

200 篇论文

Out-of-distribution (OoD) generalization occurs when representation learning encounters a distribution shift. This occurs frequently in practice when training and testing data come from different environments. Covariate shift is a type of…

机器学习 · 计算机科学 2026-04-22 Simon Zhang , Ryan P. DeMilt , Kun Jin , Cathy H. Xia

We tackle the challenge of predicting models' Out-of-Distribution (OOD) performance using in-distribution (ID) measurements without requiring OOD data. Existing evaluations with "Effective Robustness", which use ID accuracy as an indicator…

机器学习 · 计算机科学 2024-07-24 Jia Shi , Gautam Gare , Jinjin Tian , Siqi Chai , Zhiqiu Lin , Arun Vasudevan , Di Feng , Francesco Ferroni , Shu Kong

The invariance principle from causality is at the heart of notable approaches such as invariant risk minimization (IRM) that seek to address out-of-distribution (OOD) generalization failures. Despite the promising theory, invariance…

Out-of-distribution (OOD) generalization has emerged as a critical challenge in graph learning, as real-world graph data often exhibit diverse and shifting environments that traditional models fail to generalize across. A promising solution…

机器学习 · 计算机科学 2025-08-05 Xu Shen , Yixin Liu , Yili Wang , Rui Miao , Yiwei Dai , Shirui Pan , Yi Chang , Xin Wang

Learning invariant graph representations for out-of-distribution (OOD) generalization remains challenging because the learned representations often retain spurious components. To address this challenge, this work introduces a new tool from…

机器学习 · 计算机科学 2025-12-09 Barproda Halder , Pasan Dissanayake , Sanghamitra Dutta

Machine learning can benefit from causal discovery for interpretation and from causal inference for generalization. In this line of research, a few invariant learning algorithms for out-of-distribution (OOD) generalization have been…

机器学习 · 计算机科学 2023-04-06 Borja Guerrero Santillan

Learning invariant (causal) features for out-of-distribution (OOD) generalization has attracted extensive attention recently, and among the proposals invariant risk minimization (IRM) is a notable solution. In spite of its theoretical…

机器学习 · 计算机科学 2023-02-01 Bin Deng , Kui Jia

Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on…

机器学习 · 计算机科学 2024-08-19 Qitian Wu , Fan Nie , Chenxiao Yang , Tianyi Bao , Junchi Yan

Invariant learning demonstrates substantial potential for enhancing the generalization of graph neural networks (GNNs) with out-of-distribution (OOD) data. It aims to recognize stable features in graph data for classification, based on the…

机器学习 · 计算机科学 2025-01-23 Yongduo Sui , Jie Sun , Shuyao Wang , Zemin Liu , Qing Cui , Longfei Li , Xiang Wang

Graph Neural Networks (GNNs) have achieved impressive performance in graph-related tasks. However, they suffer from poor generalization on out-of-distribution (OOD) data, as they tend to learn spurious correlations. Such correlations…

机器学习 · 统计学 2026-03-26 Bowen Lu , Liangqiang Yang , Teng Li

Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain…

机器学习 · 计算机科学 2021-03-30 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Without loss of generality, existing machine learning techniques may learn spurious correlation dependent on the domain, which exacerbates the generalization of models in out-of-distribution (OOD) scenarios. To address this issue, recent…

机器学习 · 计算机科学 2024-06-18 Bin Qin , Jiangmeng Li , Yi Li , Xuesong Wu , Yupeng Wang , Wenwen Qiang , Jianwen Cao

Graph out-of-distribution (OOD) generalization remains a major challenge in graph learning since graph neural networks (GNNs) often suffer from severe performance degradation under distribution shifts. Invariant learning, aiming to extract…

机器学习 · 计算机科学 2025-02-14 Wenyu Mao , Jiancan Wu , Haoyang Liu , Yongduo Sui , Xiang Wang

Due to the performance degradation of graph neural networks (GNNs) under distribution shifts, the work on out-of-distribution (OOD) generalization on graphs has received widespread attention. A novel perspective involves distinguishing…

机器学习 · 计算机科学 2024-06-04 Haoran Yang , Xiaobing Pei , Kai Yuan

Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has considerable real-world applications. One of the most mainstream methods is to extract the invariant subgraph by aligning…

机器学习 · 计算机科学 2024-07-23 Xuexin Chen , Ruichu Cai , Kaitao Zheng , Zhifan Jiang , Zhengting Huang , Zhifeng Hao , Zijian Li

Graph neural networks (GNNs) have been demonstrated to perform well in graph representation learning, but always lacking in generalization capability when tackling out-of-distribution (OOD) data. Graph invariant learning methods, backed by…

机器学习 · 计算机科学 2023-12-19 Tianrui Jia , Haoyang Li , Cheng Yang , Tao Tao , Chuan Shi

The Invariant Risk Minimization (IRM) framework aims to learn invariant features from a set of environments for solving the out-of-distribution (OOD) generalization problem. The underlying assumption is that the causal components of the…

机器学习 · 计算机科学 2021-12-28 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

We tackle the problem of graph out-of-distribution (OOD) generalization. Existing graph OOD algorithms either rely on restricted assumptions or fail to exploit environment information in training data. In this work, we propose to…

机器学习 · 计算机科学 2023-11-02 Shurui Gui , Meng Liu , Xiner Li , Youzhi Luo , Shuiwang Ji

Existing methods for graph out-of-distribution (OOD) generalization primarily rely on empirical studies on synthetic datasets. Such approaches tend to overemphasize the causal relationships between invariant sub-graphs and labels, thereby…

机器学习 · 计算机科学 2025-07-08 Can Xu , Yao Cheng , Jianxiang Yu , Haosen Wang , Jingsong Lv , Yao Liu , Xiang Li

Although dynamic graph neural networks (DyGNNs) have demonstrated promising capabilities, most existing methods ignore out-of-distribution (OOD) shifts that commonly exist in dynamic graphs. Dynamic graph OOD generalization is non-trivial…

机器学习 · 计算机科学 2026-03-03 Xinxun Zhang , Pengfei Jiao , Mengzhou Gao , Tianpeng Li , Xuan Guo