中文
相关论文

相关论文: Out-of-distribution Prediction with Invariant Risk…

200 篇论文

Deep Neural Networks often inherit spurious correlations embedded in training data and hence may fail to generalize to unseen domains, which have different distributions from the domain to provide training data. M. Arjovsky et al. (2019)…

机器学习 · 统计学 2024-10-30 Shoji Toyota , Kenji Fukumizu

Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain…

机器学习 · 计算机科学 2021-03-30 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Empirical Risk Minimization (ERM) based machine learning algorithms have suffered from weak generalization performance on data obtained from out-of-distribution (OOD). To address this problem, Invariant Risk Minimization (IRM) objective was…

机器学习 · 计算机科学 2021-03-25 Jun-Hyun Bae , Inchul Choi , Minho Lee

Machine learning models often generalize poorly to out-of-distribution (OOD) data as a result of relying on features that are spuriously correlated with the label during training. Recently, the technique of Invariant Risk Minimization (IRM)…

机器学习 · 计算机科学 2023-01-18 Dongsung Huh , Avinash Baidya

Invariant risk minimization (IRM) (Arjovsky et al., 2019) is a recently proposed framework designed for learning predictors that are invariant to spurious correlations across different training environments. Yet, despite its theoretical…

机器学习 · 统计学 2020-07-07 Yo Joong Choe , Jiyeon Ham , Kyubyong Park

Despite impressive success in many tasks, deep learning models are shown to rely on spurious features, which will catastrophically fail when generalized to out-of-distribution (OOD) data. Invariant Risk Minimization (IRM) is proposed to…

机器学习 · 计算机科学 2022-12-20 Shiji Xin , Yifei Wang , Jingtong Su , Yisen Wang

This paper considers the out-of-distribution (OOD) generalization problem under the setting that both style distribution shift and spurious features exist and domain labels are missing. This setting frequently arises in real-world…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Ruimeng Li , Yuanhao Pu , Zhaoyi Li , Hong Xie , Defu Lian

Machine learning models traditionally assume that training and test data are independently and identically distributed. However, in real-world applications, the test distribution often differs from training. This problem, known as…

机器学习 · 计算机科学 2024-06-19 Kotaro Yoshida , Hiroki Naganuma

This paper proposes deception as a mechanism for out-of-distribution (OOD) generalization: by learning data representations that make training data appear independent and identically distributed (iid) to an observer, we can identify stable…

机器学习 · 计算机科学 2025-09-16 Anirudha Majumdar

Recently, invariant risk minimization (IRM) was proposed as a promising solution to address out-of-distribution (OOD) generalization. However, it is unclear when IRM should be preferred over the widely-employed empirical risk minimization…

机器学习 · 计算机科学 2022-08-22 Kartik Ahuja , Jun Wang , Amit Dhurandhar , Karthikeyan Shanmugam , Kush R. Varshney

Deep learning models excel in computer vision tasks but often fail to generalize to out-of-distribution (OOD) domains. Invariant Risk Minimization (IRM) aims to address OOD generalization by learning domain-invariant features. However, IRM…

计算机视觉与模式识别 · 计算机科学 2025-01-24 Yaoyao Zhu , Xiuding Cai , Yingkai Wang , Dong Miao , Zhongliang Fu , Xu Luo

The Invariant Risk Minimization (IRM) framework aims to learn invariant features from a set of environments for solving the out-of-distribution (OOD) generalization problem. The underlying assumption is that the causal components of the…

机器学习 · 计算机科学 2021-12-28 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

Out-of-distribution (OOD) generalization on graphs aims at dealing with scenarios where the test graph distribution differs from the training graph distributions. Compared to i.i.d. data like images, the OOD generalization problem on…

机器学习 · 计算机科学 2025-02-13 Song Wang , Zhen Tan , Yaochen Zhu , Chuxu Zhang , Jundong Li

Invariant risk minimization (IRM) aims to enable out-of-distribution (OOD) generalization in deep learning by learning invariant representations. As IRM poses an inherently challenging bi-level optimization problem, most existing approaches…

机器学习 · 计算机科学 2025-05-26 Kotaro Yoshida , Konstantinos Slavakis

The invariance principle from causality is at the heart of notable approaches such as invariant risk minimization (IRM) that seek to address out-of-distribution (OOD) generalization failures. Despite the promising theory, invariance…

Invariant representation learning (IRL) encourages the prediction from invariant causal features to labels de-confounded from the environments, advancing the technical roadmap of out-of-distribution (OOD) generalization. Despite spotlights…

机器学习 · 计算机科学 2023-12-18 Ziliang Chen , Yongsen Zheng , Zhao-Rong Lai , Quanlong Guan , Liang Lin

Methods which utilize the outputs or feature representations of predictive models have emerged as promising approaches for out-of-distribution (OOD) detection of image inputs. However, these methods struggle to detect OOD inputs that share…

机器学习 · 计算机科学 2023-02-09 Lily H. Zhang , Rajesh Ranganath

Enhancing the stability of machine learning algorithms under distributional shifts is at the heart of the Out-of-Distribution (OOD) Generalization problem. Derived from causal learning, recent works of invariant learning pursue strict…

机器学习 · 计算机科学 2024-02-15 Jiashuo Liu , Jiayun Wu , Jie Peng , Xiaoyu Wu , Yang Zheng , Bo Li , Peng Cui

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

机器学习 · 计算机科学 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

We introduce Invariant Risk Minimization (IRM), a learning paradigm to estimate invariant correlations across multiple training distributions. To achieve this goal, IRM learns a data representation such that the optimal classifier, on top…

机器学习 · 统计学 2020-03-31 Martin Arjovsky , Léon Bottou , Ishaan Gulrajani , David Lopez-Paz
‹ 上一页 1 2 3 10 下一页 ›