中文
相关论文

相关论文: Dissecting the Failure of Invariant Learning on Gr…

200 篇论文

Out-of-distribution (OOD) generalization deals with the prevalent learning scenario where test distribution shifts from training distribution. With rising application demands and inherent complexity, graph OOD problems call for specialized…

机器学习 · 计算机科学 2024-06-06 Xiner Li , Shurui Gui , Youzhi Luo , Shuiwang Ji

Real-world deployment of computer vision systems, including in the discovery processes of biomedical research, requires causal representations that are invariant to contextual nuisances and generalize to new data. Leveraging the internal…

计算机视觉与模式识别 · 计算机科学 2023-06-22 Wolfgang M. Pernice , Michael Doron , Alex Quach , Aditya Pratapa , Sultan Kenjeyev , Nicholas De Veaux , Michio Hirano , Juan C. Caicedo

Unsupervised Domain Adaptation (UDA) approaches address the covariate shift problem by minimizing the distribution discrepancy between the source and target domains, assuming that the label distribution is invariant across domains. However,…

机器学习 · 计算机科学 2023-08-22 Xiaona Sun , Zhenyu Wu , Yichen Liu , Saier Hu , Zhiqiang Zhan , Yang Ji

Multimodal affective computing aims to predict humans' sentiment, emotion, intention, and opinion using language, acoustic, and visual modalities. However, current models often learn spurious correlations that harm generalization under…

机器学习 · 计算机科学 2026-04-21 Sijie Mai , Shiqin Han

Out-of-distribution generalization is a common problem that expects the model to perform well in the different distributions even far from the train data. A popular approach to addressing this issue is invariant learning (IL), in which the…

机器学习 · 计算机科学 2025-05-23 Jiaqi Wang , Yuhang Zhou , Zhixiong Zhang , Qiguang Chen , Yongqiang Chen , James Cheng

In the literature, most existing graph-based semi-supervised learning (SSL) methods only use the label information of observed samples in the label propagation stage, while ignoring such valuable information when learning the graph. In this…

计算机视觉与模式识别 · 计算机科学 2017-02-14 Liansheng Zhuang , Zihan Zhou , Jingwen Yin , Shenghua Gao , Zhouchen Lin , Yi Ma , Nenghai Yu

Graph Neural Networks (GNNs) are susceptible to distribution shifts, creating vulnerability and security issues in critical domains. There is a pressing need to enhance the generalizability of GNNs on out-of-distribution (OOD) test data.…

机器学习 · 计算机科学 2024-10-29 Xiaoxue Han , Huzefa Rangwala , Yue Ning

We propose a risk-averse statistical learning framework wherein the performance of a learning algorithm is evaluated by the conditional value-at-risk (CVaR) of losses rather than the expected loss. We devise algorithms based on stochastic…

机器学习 · 计算机科学 2020-02-17 Tasuku Soma , Yuichi Yoshida

Graph neural networks have shown remarkable success in exploiting the spatial and temporal patterns on dynamic graphs. However, existing GNNs exhibit poor generalization ability under distribution shifts, which is inevitable in dynamic…

机器学习 · 计算机科学 2025-11-25 Qingyun Sun , Jiayi Luo , Haonan Yuan , Xingcheng Fu , Hao Peng , Jianxin Li , Philip S. Yu

Pretrained large generative language models have shown great performance on many tasks, but exhibit low compositional generalization abilities. Scaling such models has been shown to improve their performance on various NLP tasks even just…

计算与语言 · 计算机科学 2022-11-17 Arian Hosseini , Ankit Vani , Dzmitry Bahdanau , Alessandro Sordoni , Aaron Courville

The application of machine learning models can be significantly impeded by the occurrence of distributional shifts, as the assumption of homogeneity between the population of training and testing samples in machine learning and statistics…

机器学习 · 统计学 2023-06-06 Wenlu Tang , Zicheng Liu

Out-of-distribution detection (OOD) is a pivotal task for real-world applications that trains models to identify samples that are distributionally different from the in-distribution (ID) data during testing. Recent advances in AI,…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Chaohua Li , Enhao Zhang , Chuanxing Geng , Songcan Chen

Graph-level representation learning is important in a wide range of applications. Existing graph-level models are generally built on i.i.d. assumption for both training and testing graphs. However, in an open world, models can encounter…

机器学习 · 计算机科学 2024-07-19 Zhihao Ding , Jieming Shi , Shiqi Shen , Xuequn Shang , Jiannong Cao , Zhipeng Wang , Zhi Gong

Recently, there has been a surge of interest in developing graph neural networks that utilize the invariance principle on graphs to generalize the out-of-distribution (OOD) data. Due to the limited knowledge about OOD data, existing…

机器学习 · 计算机科学 2024-07-17 Tianjun Yao , Yongqiang Chen , Zhenhao Chen , Kai Hu , Zhiqiang Shen , Kun Zhang

Domain generalization asks for models trained over a set of training environments to generalize well in unseen test environments. Recently, a series of algorithms such as Invariant Risk Minimization (IRM) have been proposed for domain…

机器学习 · 计算机科学 2023-11-03 Haoxiang Wang , Gargi Balasubramaniam , Haozhe Si , Bo Li , Han Zhao

Robust prediction of molecular properties under extreme out-of-distribution (OOD) scenarios is a pivotal bottleneck in AI-driven drug discovery. Current scaffold-splitting protocols fail to obstruct microscopic semantic overlap,…

机器学习 · 计算机科学 2026-05-15 Zhuohao Lin , Kun Li , Jiameng Chen , Jiajun Yu , Duanhua Cao , Yizhen Zheng , Wenbin Hu

Value Decomposition (VD) aims to deduce the contributions of agents for decentralized policies in the presence of only global rewards, and has recently emerged as a powerful credit assignment paradigm for tackling cooperative Multi-Agent…

机器学习 · 计算机科学 2023-03-15 Shunyu Liu , Yihe Zhou , Jie Song , Tongya Zheng , Kaixuan Chen , Tongtian Zhu , Zunlei Feng , Mingli Song

Aiming to generalize the label knowledge from a source domain with continuous outputs to an unlabeled target domain, Domain Adaptation Regression (DAR) is developed for complex practical learning problems. However, due to the continuity…

机器学习 · 计算机科学 2024-08-14 Hao-Ran Yang , Chuan-Xian Ren , You-Wei Luo

Recent advances in large pre-trained models showed promising results in few-shot learning. However, their generalization ability on two-dimensional Out-of-Distribution (OoD) data, i.e., correlation shift and diversity shift, has not been…

计算机视觉与模式识别 · 计算机科学 2025-04-23 Lin Zhu , Xinbing Wang , Chenghu Zhou , Nanyang Ye

We study the problem of lifelong graph learning in an open-world scenario, where a model needs to deal with new tasks and potentially unknown classes. We utilize Out-of-Distribution (OOD) detection methods to recognize new classes and adapt…

机器学习 · 计算机科学 2023-10-20 Marcel Hoffmann , Lukas Galke , Ansgar Scherp