English
Related papers

Related papers: IMO: Greedy Layer-Wise Sparse Representation Learn…

200 papers

This paper considers the out-of-distribution (OOD) generalization problem under the setting that both style distribution shift and spurious features exist and domain labels are missing. This setting frequently arises in real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ruimeng Li , Yuanhao Pu , Zhaoyi Li , Hong Xie , Defu Lian

Out-of-distribution (OOD) detection aims to discern outliers from the intended data distribution, which is crucial to maintaining high reliability and a good user experience. Most recent studies in OOD detection utilize the information from…

Computation and Language · Computer Science 2022-10-21 Hyunsoo Cho , Choonghyun Park , Jaewook Kang , Kang Min Yoo , Taeuk Kim , Sang-goo Lee

Out-of-distribution generalization is a common problem that expects the model to perform well in the different distributions even far from the train data. A popular approach to addressing this issue is invariant learning (IL), in which the…

Machine Learning · Computer Science 2025-05-23 Jiaqi Wang , Yuhang Zhou , Zhixiong Zhang , Qiguang Chen , Yongqiang Chen , James Cheng

We introduce Domain-specific Masks for Generalization, a model for improving both in-domain and out-of-domain generalization performance. For domain generalization, the goal is to learn from a set of source domains to produce a single model…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Prithvijit Chattopadhyay , Yogesh Balaji , Judy Hoffman

Out-of-Distribution (OOD) generalization in machine learning is a burgeoning area of study. Its primary goal is to enhance the adaptability and resilience of machine learning models when faced with new, unseen, and potentially adversarial…

Machine Learning · Computer Science 2024-11-05 Chengtao Jian , Kai Yang , Yang Jiao

The crux of effective out-of-distribution (OOD) detection lies in acquiring a robust in-distribution (ID) representation, distinct from OOD samples. While previous methods predominantly leaned on recognition-based techniques for this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Jingyao Li , Pengguang Chen , Shaozuo Yu , Shu Liu , Jiaya Jia

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

Computation and Language · Computer Science 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

Often, deep network models are purely inductive during training and while performing inference on unseen data. Thus, when such models are used for predictions, it is well known that they often fail to capture the semantic information and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Zhu Wang , Sourav Medya , Sathya N. Ravi

Out-of-distribution detection (OOD) is a pivotal task for real-world applications that trains models to identify samples that are distributionally different from the in-distribution (ID) data during testing. Recent advances in AI,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Chaohua Li , Enhao Zhang , Chuanxing Geng , Songcan Chen

The core of out-of-distribution (OOD) detection is to learn the in-distribution (ID) representation, which is distinguishable from OOD samples. Previous work applied recognition-based methods to learn the ID features, which tend to learn…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jingyao Li , Pengguang Chen , Shaozuo Yu , Zexin He , Shu Liu , Jiaya Jia

Machine learning (ML) systems in natural language processing (NLP) face significant challenges in generalizing to out-of-distribution (OOD) data, where the test distribution differs from the training data distribution. This poses important…

Computation and Language · Computer Science 2023-05-24 Linyi Yang , Yaoxiao Song , Xuan Ren , Chenyang Lyu , Yidong Wang , Lingqiao Liu , Jindong Wang , Jennifer Foster , Yue Zhang

Machine learning models often generalize poorly to out-of-distribution (OOD) data as a result of relying on features that are spuriously correlated with the label during training. Recently, the technique of Invariant Risk Minimization (IRM)…

Machine Learning · Computer Science 2023-01-18 Dongsung Huh , Avinash Baidya

The inability of deep learning models to handle data drawn from unseen distributions has sparked much interest in unsupervised out-of-distribution (U-OOD) detection, as it is crucial for reliable deep learning models. Despite considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Lars Doorenbos , Raphael Sznitman , Pablo Márquez-Neila

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Time series remains one of the most challenging modalities in machine learning research. The out-of-distribution (OOD) detection and generalization on time series tend to suffer due to its non-stationary property, i.e., the distribution…

Machine Learning · Computer Science 2023-08-07 Wang Lu , Jindong Wang , Xinwei Sun , Yiqiang Chen , Xiangyang Ji , Qiang Yang , Xing Xie

Recent object detectors have achieved impressive accuracy in identifying objects seen during training. However, real-world deployment often introduces novel and unexpected objects, referred to as out-of-distribution (OOD) objects, posing…

Machine Learning · Computer Science 2025-11-20 Quang-Huy Nguyen , Jin Peng Zhou , Zhenzhen Liu , Khanh-Huyen Bui , Kilian Q. Weinberger , Wei-Lun Chao , Dung D. Le

Out-of-distribution (OOD) detection plays a crucial role in ensuring the safety and reliability of deep neural networks in various applications. While there has been a growing focus on OOD detection in visual data, the field of textual OOD…

Computation and Language · Computer Science 2024-04-10 Li-Ming Zhan , Bo Liu , Xiao-Ming Wu

Text-to-image diffusion models (DMs) are frequently abused to produce harmful or copyrighted content, violating public interests. Concept erasure (unlearning) is a promising paradigm to alleviate this issue. However, there exists a peculiar…

Machine Learning · Computer Science 2026-05-08 Manyi Li , Yufan Liu , Lai Jiang , Bing Li , Yuming Li , Weiming Hu

Out-of-Distribution (OOD) Generalization aims to learn robust models that generalize well to various environments without fitting to distribution-specific features. Recent studies based on Lottery Ticket Hypothesis (LTH) address this…

Machine Learning · Computer Science 2023-10-26 Zhuo Huang , Muyang Li , Li Shen , Jun Yu , Chen Gong , Bo Han , Tongliang Liu

In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, with the idea resting…

Machine Learning · Statistics 2022-03-25 Ruoyu Wang , Mingyang Yi , Zhitang Chen , Shengyu Zhu