中文
相关论文

相关论文: Dissecting the Failure of Invariant Learning on Gr…

200 篇论文

While deep neural networks have made remarkable progress in various vision tasks, their performance typically deteriorates when tested in out-of-distribution (OOD) scenarios. Many OOD methods focus on extracting domain-invariant features…

计算机视觉与模式识别 · 计算机科学 2024-09-16 Qiaowei Miao , Yawei Luo , Yi Yang

Out-of-distribution (OOD) generalization in Graph Neural Networks (GNNs) has gained significant attention due to its critical importance in graph-based predictions in real-world scenarios. Existing methods primarily focus on extracting a…

机器学习 · 计算机科学 2025-04-21 Bowen Liu , Haoyang Li , Shuning Wang , Shuo Nie , Shanghang Zhang

A brain can detect outlier just by using only normal samples. Similarly, one-class classification (OCC) also uses only normal samples to train the model and trained model can be used for outlier detection. In this paper, a multi-layer…

机器学习 · 计算机科学 2019-04-16 Chandan Gautam , Aruna Tiwari , M. Tanveer

The performance of machine learning models can be impacted by changes in data over time. A promising approach to address this challenge is invariant learning, with a particular focus on a method known as invariant risk minimization (IRM).…

机器学习 · 计算机科学 2024-04-09 Wenlu Tang , Zicheng Liu

In the era of foundation models, Out-of- Distribution (OOD) problems, i.e., the data discrepancy between the training environments and testing environments, hinder AI generalization. Further, relational data like graphs disobeying the…

机器学习 · 计算机科学 2025-06-02 Katherine Tieu , Dongqi Fu , Jun Wu , Jingrui He

Invariance-principle-based methods such as Invariant Risk Minimization (IRM), have recently emerged as promising approaches for Domain Generalization (DG). Despite promising theory, such approaches fail in common classification tasks due to…

机器学习 · 计算机科学 2022-07-12 Thuan Nguyen , Boyang Lyu , Prakash Ishwar , Matthias Scheutz , Shuchin Aeron

Representation learning for images has been advanced by recent progress in more complex neural models such as the Vision Transformers and new learning theories such as the structural causal models. However, these models mainly rely on the…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Zitan Chen , Zhuang Qi , Xiao Cao , Xiangxian Li , Xiangxu Meng , Lei Meng

Learning models whose predictions are invariant under multiple environments is a promising approach for out-of-distribution generalization. Such models are trained to extract features $X_{\text{inv}}$ where the conditional distribution $Y…

机器学习 · 计算机科学 2024-07-29 Gina Wong , Joshua Gleason , Rama Chellappa , Yoav Wald , Anqi Liu

Detecting out-of-distribution (OOD) examples is crucial to guarantee the reliability and safety of deep neural networks in real-world settings. In this paper, we offer an innovative perspective on quantifying the disparities between…

机器学习 · 计算机科学 2024-01-17 Jinggang Chen , Junjie Li , Xiaoyang Qu , Jianzong Wang , Jiguang Wan , Jing Xiao

Invariant learning methods, aimed at identifying a consistent predictor across multiple environments, are gaining prominence in out-of-distribution (OOD) generalization. Yet, when environments aren't inherent in the data, practitioners must…

机器学习 · 计算机科学 2024-05-24 Yufan Liao , Qi Wu , Zhaodi Wu , Xing Yan

Many existing unsupervised domain adaptation (UDA) methods primarily focus on covariate shift, limiting their effectiveness in imbalanced domain adaptation (IDA) where both covariate shift and label shift coexist. Recent IDA methods have…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Xiaona Sun , Zhenyu Wu , Zhiqiang Zhan , Yang Ji

Deep learning has introduced significant improvements in many software analysis tasks. Although the Large Language Models (LLMs) based neural code models demonstrate commendable performance when trained and tested within the intra-project…

人工智能 · 计算机科学 2024-03-12 Zhiming Li , Yanzhou Li , Tianlin Li , Mengnan Du , Bozhi Wu , Yushi Cao , Junzhe Jiang , Yang Liu

Covariate distribution shift occurs when certain structural features present in the test set are absent from the training set. It is a common type of out-of-distribution (OOD) problem, frequently encountered in real-world graph data with…

机器学习 · 计算机科学 2026-04-22 Fanlong Zeng , Wensheng Gan

For decades, researchers in fields, such as the natural and social sciences, have been verifying causal relationships and investigating hypotheses that are now well-established or understood as truth. These causal mechanisms are properties…

机器学习 · 计算机科学 2019-12-02 Trent Kyono , Mihaela van der Schaar

Offline Reinforcement Learning (RL) enables policy optimization from static datasets but is inherently vulnerable to backdoor attacks. Existing attack strategies typically struggle against safety-constrained algorithms (e.g., CQL) due to…

机器学习 · 计算机科学 2026-01-16 Yuanjie Zhao , Junnan Qiu , Yue Ding , Jie Li

A common explanation for the failure of out-of-distribution (OOD) generalization is that the model trained with empirical risk minimization (ERM) learns spurious features instead of invariant features. However, several recent studies…

机器学习 · 计算机科学 2023-10-31 Yongqiang Chen , Wei Huang , Kaiwen Zhou , Yatao Bian , Bo Han , James Cheng

Graph Neural Network-based methods face privacy leakage risks due to the introduction of topological structures about the targets, which allows attackers to bypass the target's prior knowledge of the sensitive attributes and realize…

机器学习 · 计算机科学 2025-05-27 Jinyan Wang , Liu Yang , Yuecen Wei , Jiaxuan Si , Chenhao Guo , Qingyun Sun , Xianxian Li , Xingcheng Fu

Previous OOD detection systems only focus on the semantic gap between ID and OOD samples. Besides the semantic gap, we are faced with two additional gaps: the domain gap between source and target domains, and the class-imbalance gap between…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Xiang Fang , Arvind Easwaran , Blaise Genest , Ponnuthurai Nagaratnam Suganthan

Out-of-Distribution (OOD) Generalization aims to learn robust models that generalize well to various environments without fitting to distribution-specific features. Recent studies based on Lottery Ticket Hypothesis (LTH) address this…

机器学习 · 计算机科学 2023-10-26 Zhuo Huang , Muyang Li , Li Shen , Jun Yu , Chen Gong , Bo Han , Tongliang Liu

Graph contrastive learning (GCL), learning the node representation by contrasting two augmented graphs in a self-supervised way, has attracted considerable attention. GCL is usually believed to learn the invariant representation. However,…

机器学习 · 计算机科学 2024-03-08 Yanhu Mo , Xiao Wang , Shaohua Fan , Chuan Shi