中文
相关论文

相关论文: Dissecting the Failure of Invariant Learning on Gr…

200 篇论文

Traditional machine learning methods heavily rely on the independent and identically distribution assumption, which imposes limitations when the test distribution deviates from the training distribution. To address this crucial issue,…

机器学习 · 计算机科学 2024-03-26 Qin Tian , Wenjun Wang , Chen Zhao , Minglai Shao , Wang Zhang , Dong Li

Out-of-distribution (OOD) generalization is an important issue for Graph Neural Networks (GNNs). Recent works employ different graph editions to generate augmented environments and learn an invariant GNN for generalization. However, the…

机器学习 · 计算机科学 2023-03-28 Junchi Yu , Jian Liang , Ran He

Out-of-distribution generalization under distributional shifts remains a critical challenge for graph neural networks. Existing methods generally adopt the Invariant Risk Minimization (IRM) framework, requiring costly environment…

机器学习 · 计算机科学 2025-10-24 Yang Qiu , Yixiong Zou , Jun Wang , Wei Liu , Xiangyu Fu , Ruixuan Li

In the past decades, machine learning with Empirical Risk Minimization (ERM) has demonstrated great capability in learning and exploiting the statistical patterns from data, or even surpassing humans. Despite the success, ERM avoids the…

机器学习 · 计算机科学 2025-06-17 Yongqiang Chen

Learning on molecule graphs has become an increasingly important topic in AI for science, which takes full advantage of AI to facilitate scientific discovery. Existing solutions on modeling molecules utilize Graph Neural Networks (GNNs) to…

机器学习 · 计算机科学 2025-05-13 Limin Li , Kuo Yang , Wenjie Du , Pengkun Wang , Zhengyang Zhou , Yang Wang

Through recognizing causal subgraphs, causal graph learning (CGL) has risen to be a promising approach for improving the generalizability of graph neural networks under out-of-distribution (OOD) scenarios. However, the empirical successes…

机器学习 · 计算机科学 2025-07-02 Yujia Yin , Tianyi Qu , Zihao Wang , Yifan Chen

Out-of-Distribution (OOD) generalization has become a primary metric for evaluating image analysis systems. Since deep learning models tend to capture domain-specific context, they often develop shortcut dependencies on these non-causal…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Haoran Pei , Yuguang Yang , Kexin Liu , Juan Zhang , Baochang Zhang

Invariant graph representation learning aims to learn the invariance among data from different environments for out-of-distribution generalization on graphs. As the graph environment partitions are usually expensive to obtain, augmenting…

机器学习 · 计算机科学 2023-10-31 Yongqiang Chen , Yatao Bian , Kaiwen Zhou , Binghui Xie , Bo Han , James Cheng

This paper addresses the challenge of out-of-distribution (OOD) generalization in graph machine learning, a field rapidly advancing yet grappling with the discrepancy between source and target data distributions. Traditional graph learning…

机器学习 · 计算机科学 2024-08-09 Xin Sun , Liang Wang , Qiang Liu , Shu Wu , Zilei Wang , Liang Wang

Out-of-distribution (OOD) generalization remains a fundamental challenge in real-world classification, where test distributions often differ substantially from training data. Most existing approaches pursue domain-invariant representations,…

机器学习 · 计算机科学 2026-01-30 Chen Cheng , Ang Li

Recently, generalization on out-of-distribution (OOD) data with correlation shift has attracted great attentions. The correlation shift is caused by the spurious attributes that correlate to the class label, as the correlation between them…

机器学习 · 计算机科学 2023-02-27 Mingyang Yi , Ruoyu Wang , Jiachen Sun , Zhenguo Li , Zhi-Ming Ma

Out-of-distribution (OOD) generalization remains challenging when models simultaneously encounter correlation shifts across environments and diversity shifts driven by rare or hard samples. Existing invariant risk minimization (IRM) methods…

机器学习 · 计算机科学 2026-02-03 Yuanchao Wang , Zhao-Rong Lai , Tianqi Zhong , Fengnan Li

In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, with the idea resting…

机器学习 · 统计学 2022-03-25 Ruoyu Wang , Mingyang Yi , Zhitang Chen , Shengyu Zhu

Out-Of-Distribution (OOD) generalization has gained increasing attentions for machine learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation under distribution shifts. Existing graph OOD methods tend to…

机器学习 · 计算机科学 2025-05-12 Henan Sun , Xunkai Li , Lei Zhu , Junyi Han , Guang Zeng , Ronghua Li , Guoren Wang

In general, graph representation learning methods assume that the train and test data come from the same distribution. In this work we consider an underexplored area of an otherwise rapidly developing field of graph representation learning:…

机器学习 · 计算机科学 2021-12-08 Beatrice Bevilacqua , Yangze Zhou , Bruno Ribeiro

Invariant risk minimization (IRM) aims to enable out-of-distribution (OOD) generalization in deep learning by learning invariant representations. As IRM poses an inherently challenging bi-level optimization problem, most existing approaches…

机器学习 · 计算机科学 2025-05-26 Kotaro Yoshida , Konstantinos Slavakis

We introduce Invariant Risk Minimization (IRM), a learning paradigm to estimate invariant correlations across multiple training distributions. To achieve this goal, IRM learns a data representation such that the optimal classifier, on top…

机器学习 · 统计学 2020-03-31 Martin Arjovsky , Léon Bottou , Ishaan Gulrajani , David Lopez-Paz

Recently, invariant risk minimization (IRM) was proposed as a promising solution to address out-of-distribution (OOD) generalization. However, it is unclear when IRM should be preferred over the widely-employed empirical risk minimization…

机器学习 · 计算机科学 2022-08-22 Kartik Ahuja , Jun Wang , Amit Dhurandhar , Karthikeyan Shanmugam , Kush R. Varshney

Out-of-distribution (OOD) graph generalization are critical for many real-world applications. Existing methods neglect to discard spurious or noisy features of inputs, which are irrelevant to the label. Besides, they mainly conduct…

机器学习 · 计算机科学 2023-06-29 Ling Yang , Jiayi Zheng , Heyuan Wang , Zhongyi Liu , Zhilin Huang , Shenda Hong , Wentao Zhang , Bin Cui

Deep Neural Networks often inherit spurious correlations embedded in training data and hence may fail to generalize to unseen domains, which have different distributions from the domain to provide training data. M. Arjovsky et al. (2019)…

机器学习 · 统计学 2024-10-30 Shoji Toyota , Kenji Fukumizu