English
Related papers

Related papers: Out-of-distribution Generalization for Total Varia…

200 papers

Invariant risk minimization (IRM) is an arising approach to generalize invariant features to different environments in machine learning. While most related works focus on new IRM settings or new application scenarios, the mathematical…

Machine Learning · Computer Science 2024-05-20 Zhao-Rong Lai , Weiwen Wang

Deep Neural Networks often inherit spurious correlations embedded in training data and hence may fail to generalize to unseen domains, which have different distributions from the domain to provide training data. M. Arjovsky et al. (2019)…

Machine Learning · Statistics 2024-10-30 Shoji Toyota , Kenji Fukumizu

This paper introduces a novel approach to securing machine learning model deployments against potential distribution shifts in practical applications, the Total Variation Out-of-Distribution (TV-OOD) detection method. Existing methods have…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Dabiao Ma , Zhiba Su , Jian Yang , Haojun Fei

Invariant risk minimization (IRM) aims to enable out-of-distribution (OOD) generalization in deep learning by learning invariant representations. As IRM poses an inherently challenging bi-level optimization problem, most existing approaches…

Machine Learning · Computer Science 2025-05-26 Kotaro Yoshida , Konstantinos Slavakis

This work considers the out-of-distribution (OOD) prediction problem where (1)~the training data are from multiple domains and (2)~the test domain is unseen in the training. DNNs fail in OOD prediction because they are prone to pick up…

Machine Learning · Computer Science 2021-02-24 Ruocheng Guo , Pengchuan Zhang , Hao Liu , Emre Kiciman

Empirical Risk Minimization (ERM) based machine learning algorithms have suffered from weak generalization performance on data obtained from out-of-distribution (OOD). To address this problem, Invariant Risk Minimization (IRM) objective was…

Machine Learning · Computer Science 2021-03-25 Jun-Hyun Bae , Inchul Choi , Minho Lee

Machine learning models often generalize poorly to out-of-distribution (OOD) data as a result of relying on features that are spuriously correlated with the label during training. Recently, the technique of Invariant Risk Minimization (IRM)…

Machine Learning · Computer Science 2023-01-18 Dongsung Huh , Avinash Baidya

Machine learning models traditionally assume that training and test data are independently and identically distributed. However, in real-world applications, the test distribution often differs from training. This problem, known as…

Machine Learning · Computer Science 2024-06-19 Kotaro Yoshida , Hiroki Naganuma

Deep learning models excel in computer vision tasks but often fail to generalize to out-of-distribution (OOD) domains. Invariant Risk Minimization (IRM) aims to address OOD generalization by learning domain-invariant features. However, IRM…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Yaoyao Zhu , Xiuding Cai , Yingkai Wang , Dong Miao , Zhongliang Fu , Xu Luo

Out-of-distribution (OOD) generalization remains challenging when models simultaneously encounter correlation shifts across environments and diversity shifts driven by rare or hard samples. Existing invariant risk minimization (IRM) methods…

Machine Learning · Computer Science 2026-02-03 Yuanchao Wang , Zhao-Rong Lai , Tianqi Zhong , Fengnan Li

Recently, there has been a growing surge of interest in enabling machine learning systems to generalize well to Out-of-Distribution (OOD) data. Most efforts are devoted to advancing optimization objectives that regularize models to capture…

Machine Learning · Computer Science 2023-03-03 Yongqiang Chen , Kaiwen Zhou , Yatao Bian , Binghui Xie , Bingzhe Wu , Yonggang Zhang , Kaili Ma , Han Yang , Peilin Zhao , Bo Han , James Cheng

The Invariant Risk Minimization (IRM) framework aims to learn invariant features from a set of environments for solving the out-of-distribution (OOD) generalization problem. The underlying assumption is that the causal components of the…

Machine Learning · Computer Science 2021-12-28 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain…

Machine Learning · Computer Science 2021-03-30 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

This paper proposes deception as a mechanism for out-of-distribution (OOD) generalization: by learning data representations that make training data appear independent and identically distributed (iid) to an observer, we can identify stable…

Machine Learning · Computer Science 2025-09-16 Anirudha Majumdar

Out-of-distribution (OOD) generalization on graphs aims at dealing with scenarios where the test graph distribution differs from the training graph distributions. Compared to i.i.d. data like images, the OOD generalization problem on…

Machine Learning · Computer Science 2025-02-13 Song Wang , Zhen Tan , Yaochen Zhu , Chuxu Zhang , Jundong Li

Out-of-Distribution (OOD) Generalization aims to learn robust models that generalize well to various environments without fitting to distribution-specific features. Recent studies based on Lottery Ticket Hypothesis (LTH) address this…

Machine Learning · Computer Science 2023-10-26 Zhuo Huang , Muyang Li , Li Shen , Jun Yu , Chen Gong , Bo Han , Tongliang Liu

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

Machine Learning · Computer Science 2023-12-05 Sergey Kolesnikov

Despite impressive success in many tasks, deep learning models are shown to rely on spurious features, which will catastrophically fail when generalized to out-of-distribution (OOD) data. Invariant Risk Minimization (IRM) is proposed to…

Machine Learning · Computer Science 2022-12-20 Shiji Xin , Yifei Wang , Jingtong Su , Yisen Wang

Recently, invariant risk minimization (IRM) was proposed as a promising solution to address out-of-distribution (OOD) generalization. However, it is unclear when IRM should be preferred over the widely-employed empirical risk minimization…

Machine Learning · Computer Science 2022-08-22 Kartik Ahuja , Jun Wang , Amit Dhurandhar , Karthikeyan Shanmugam , Kush R. Varshney

We introduce Invariant Risk Minimization (IRM), a learning paradigm to estimate invariant correlations across multiple training distributions. To achieve this goal, IRM learns a data representation such that the optimal classifier, on top…

Machine Learning · Statistics 2020-03-31 Martin Arjovsky , Léon Bottou , Ishaan Gulrajani , David Lopez-Paz
‹ Prev 1 2 3 10 Next ›