中文
相关论文

相关论文: Handling Distribution Shifts on Graphs: An Invaria…

200 篇论文

Distribution shifts introduce uncertainty that undermines the robustness and generalization capabilities of machine learning models. While conventional wisdom suggests that learning causal-invariant representations enhances robustness to…

机器学习 · 计算机科学 2025-05-28 Abbavaram Gowtham Reddy , Celia Rubio-Madrigal , Rebekka Burkholz , Krikamol Muandet

Out-of-distribution (OOD) generalization is a favorable yet challenging property for deep neural networks. The core challenges lie in the limited availability of source domains that help models learn an invariant representation from the…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Yijiang Li , Sucheng Ren , Weipeng Deng , Yuzhi Xu , Ying Gao , Edith Ngai , Haohan Wang

An interesting phenomenon arises: Empirical Risk Minimization (ERM) sometimes outperforms methods specifically designed for out-of-distribution tasks. This motivates an investigation into the reasons behind such behavior beyond algorithmic…

机器学习 · 计算机科学 2026-01-21 Hong Zheng , Fei Teng

Although dynamic graph neural networks (DyGNNs) have demonstrated promising capabilities, most existing methods ignore out-of-distribution (OOD) shifts that commonly exist in dynamic graphs. Dynamic graph OOD generalization is non-trivial…

机器学习 · 计算机科学 2026-03-03 Xinxun Zhang , Pengfei Jiao , Mengzhou Gao , Tianpeng Li , Xuan Guo

Out-of-distribution generalization under distributional shifts remains a critical challenge for graph neural networks. Existing methods generally adopt the Invariant Risk Minimization (IRM) framework, requiring costly environment…

机器学习 · 计算机科学 2025-10-24 Yang Qiu , Yixiong Zou , Jun Wang , Wei Liu , Xiangyu Fu , Ruixuan Li

Out-of-distribution (OOD) detection poses a significant challenge for Graph Neural Networks (GNNs), particularly in open-world scenarios with varying distribution shifts. Most existing OOD detection methods on graphs primarily focus on…

机器学习 · 计算机科学 2024-10-24 Zhixia He , Chen Zhao , Minglai Shao , Yujie Lin , Dong Li , Qin Tian

Graph learning plays a pivotal role and has gained significant attention in various application scenarios, from social network analysis to recommendation systems, for its effectiveness in modeling complex data relations represented by graph…

机器学习 · 计算机科学 2024-03-08 Man Wu , Xin Zheng , Qin Zhang , Xiao Shen , Xiong Luo , Xingquan Zhu , Shirui Pan

In this work, we investigate the problem of out-of-distribution (OOD) generalization for unsupervised learning methods on graph data. This scenario is particularly challenging because graph neural networks (GNNs) have been shown to be…

机器学习 · 计算机科学 2023-08-03 Yun Zhu , Haizhou Shi , Zhenshuo Zhang , Siliang Tang

Machine learning algorithms with empirical risk minimization usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts.…

机器学习 · 计算机科学 2021-06-18 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

Out-of-distribution (OOD) generalization has emerged as a significant challenge in graph recommender systems. Traditional graph neural network algorithms often fail because they learn spurious environmental correlations instead of stable…

信息检索 · 计算机科学 2025-11-25 Jiahao Liang , Haoran Yang , Xiangyu Zhao , Zhiwen Yu , Mianjie Li , Chuan Shi , Kaixiang Yang

The Invariant Risk Minimization (IRM) framework aims to learn invariant features from a set of environments for solving the out-of-distribution (OOD) generalization problem. The underlying assumption is that the causal components of the…

机器学习 · 计算机科学 2021-12-28 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

The existing methods learn geographic network representations through deep graph neural networks (GNNs) based on the i.i.d. assumption. However, the spatial heterogeneity and temporal dynamics of geographic data make the out-of-distribution…

机器学习 · 计算机科学 2025-03-26 Yuhan Wang , Silu He , Qinyao Luo , Hongyuan Yuan , Ling Zhao , Jiawei Zhu , Haifeng Li

Learning on graphs, where instance nodes are inter-connected, has become one of the central problems for deep learning, as relational structures are pervasive and induce data inter-dependence which hinders trivial adaptation of existing…

机器学习 · 计算机科学 2023-03-10 Qitian Wu , Yiting Chen , Chenxiao Yang , Junchi Yan

Learning with identical train and test distributions has been extensively investigated both practically and theoretically. Much remains to be understood, however, in statistical learning under distribution shifts. This paper focuses on a…

机器学习 · 计算机科学 2024-11-01 Omar Montasser , Han Shao , Emmanuel Abbe

Out-of-distribution (OOD) learning deals with scenarios in which training and test data follow different distributions. Although general OOD problems have been intensively studied in machine learning, graph OOD is only an emerging area of…

机器学习 · 计算机科学 2022-09-28 Shurui Gui , Xiner Li , Limei Wang , Shuiwang Ji

Machine learning models traditionally assume that training and test data are independently and identically distributed. However, in real-world applications, the test distribution often differs from training. This problem, known as…

机器学习 · 计算机科学 2024-06-19 Kotaro Yoshida , Hiroki Naganuma

Out-of-distribution (OOD) generalization remains challenging when models simultaneously encounter correlation shifts across environments and diversity shifts driven by rare or hard samples. Existing invariant risk minimization (IRM) methods…

机器学习 · 计算机科学 2026-02-03 Yuanchao Wang , Zhao-Rong Lai , Tianqi Zhong , Fengnan Li

Most existing deep learning models are trained based on the closed-world assumption, where the test data is assumed to be drawn i.i.d. from the same distribution as the training data, known as in-distribution (ID). However, when models are…

机器学习 · 计算机科学 2022-11-09 Yixin Liu , Kaize Ding , Huan Liu , Shirui Pan

The problem of out-of-distribution detection for graph classification is far from being solved. The existing models tend to be overconfident about OOD examples or completely ignore the detection task. In this work, we consider this problem…

机器学习 · 计算机科学 2022-06-23 Gleb Bazhenov , Sergei Ivanov , Maxim Panov , Alexey Zaytsev , Evgeny Burnaev

Out-of-distribution (OoD) generalization occurs when representation learning encounters a distribution shift. This occurs frequently in practice when training and testing data come from different environments. Covariate shift is a type of…

机器学习 · 计算机科学 2026-04-22 Simon Zhang , Ryan P. DeMilt , Kun Jin , Cathy H. Xia