English
Related papers

Related papers: SimSCOOD: Systematic Analysis of Out-of-Distributi…

200 papers

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

Machine Learning · Computer Science 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

Pre-trained vision-language models have exhibited remarkable abilities in detecting out-of-distribution (OOD) samples. However, some challenging OOD samples, which lie close to in-distribution (InD) data in image feature space, can still…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Jinglun Li , Kaixun Jiang , Zhaoyu Chen , Bo Lin , Yao Tang , Weifeng Ge , Wenqiang Zhang

Modern deep generative models can assign high likelihood to inputs drawn from outside the training distribution, posing threats to models in open-world deployments. While much research attention has been placed on defining new test-time…

Machine Learning · Computer Science 2022-08-22 Mu Cai , Yixuan Li

Out-of-Domain (OOD) generalization is the ability of a model trained on one or more domains to generalize to unseen domains. In the ImageNet era of computer vision, evaluation sets for measuring a model's OOD performance were designed to be…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Prasanna Mayilvahanan , Roland S. Zimmermann , Thaddäus Wiedemer , Evgenia Rusak , Attila Juhos , Matthias Bethge , Wieland Brendel

A large language model's (LLM's) out-of-distribution (OOD) generalisation ability is crucial to its deployment. Previous work assessing LLMs' generalisation performance, however, typically focuses on a single out-of-distribution dataset.…

Computation and Language · Computer Science 2025-12-09 Matteo Boglioni , Andrea Sgobbi , Gabriel Tavernini , Francesco Rita , Marius Mosbach , Tiago Pimentel

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

In recent years, machine learning models have achieved success based on the independently and identically distributed assumption. However, this assumption can be easily violated in real-world applications, leading to the Out-of-Distribution…

Machine Learning · Computer Science 2024-03-27 Yifan Hao , Yong Lin , Difan Zou , Tong Zhang

Recent semi-supervised learning algorithms have demonstrated greater success with higher overall performance due to better-unlabeled data representations. Nonetheless, recent research suggests that the performance of the SSL algorithm can…

Machine Learning · Computer Science 2023-02-02 Xujiang Zhao , Killamsetty Krishnateja , Rishabh Iyer , Feng Chen

Distribution shifts on graphs -- the discrepancies in data distribution between training and employing a graph machine learning model -- are ubiquitous and often unavoidable in real-world scenarios. These shifts may severely deteriorate…

Machine Learning · Computer Science 2025-03-31 Kexin Zhang , Shuhan Liu , Song Wang , Weili Shi , Chen Chen , Pan Li , Sheng Li , Jundong Li , Kaize Ding

Recent advancements have explored text-to-image diffusion models for synthesizing out-of-distribution (OOD) samples, substantially enhancing the performance of OOD detection. However, existing approaches typically rely on perturbing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Xin Gao , Jiyao Liu , Guanghao Li , Yueming Lyu , Jianxiong Gao , Weichen Yu , Ningsheng Xu , Liang Wang , Caifeng Shan , Ziwei Liu , Chenyang Si

Out-of-distribution (OOD) generalization is a challenging machine learning problem yet highly desirable in many high-stake applications. Existing methods suffer from overly pessimistic modeling with low generalization confidence. As…

Machine Learning · Computer Science 2024-06-10 Fengchun Qiao , Xi Peng

Few-shot Out-of-Distribution (OOD) detection has emerged as a critical research direction in machine learning for practical deployment. Most existing Few-shot OOD detection methods suffer from insufficient generalization capability for the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Pinxuan Li , Bing Cao , Changqing Zhang , Qinghua Hu

Time series frequently manifest distribution shifts, diverse latent features, and non-stationary learning dynamics, particularly in open and evolving environments. These characteristics pose significant challenges for out-of-distribution…

Machine Learning · Computer Science 2026-05-20 Xin Wu , Fei Teng , Xingwang Li , Ji Zhang , Tianrui Li , Qiang Duan

Out-of-distribution (OOD) detection is crucial for ensuring the reliability and safety of machine learning models in real-world applications, where they frequently face data distributions unseen during training. Despite progress, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Reihaneh Zohrabi , Hosein Hasani , Mahdieh Soleymani Baghshah , Anna Rohrbach , Marcus Rohrbach , Mohammad Hossein Rohban

In this paper, we study the OOD generalization of neural algorithmic reasoning tasks, where the goal is to learn an algorithm (e.g., sorting, breadth-first search, and depth-first search) from input-output pairs using deep neural networks.…

Machine Learning · Computer Science 2023-03-21 Sadegh Mahdavi , Kevin Swersky , Thomas Kipf , Milad Hashemi , Christos Thrampoulidis , Renjie Liao

Integrating reasoning in large language models and large vision-language models has recently led to significant improvement of their capabilities. However, the generalization of reasoning models is still vaguely defined and poorly…

Machine Learning · Computer Science 2026-02-18 Yannic Neuhaus , Nicolas Flammarion , Matthias Hein , Francesco Croce

Out-of-distribution (OOD) detection is crucial for deploying robust and reliable machine-learning systems in open-world settings. Despite steady advances in OOD detectors, their interplay with modern training pipelines that maximize…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Gerhard Krumpl , Henning Avenhaus , Horst Possegger

Systematic, compositional generalization beyond the training distribution remains a core challenge in machine learning -- and a critical bottleneck for the emergent reasoning abilities of modern language models. This work investigates…

Machine Learning · Computer Science 2025-10-17 Awni Altabaa , Siyu Chen , John Lafferty , Zhuoran Yang

Out-of-distribution (OOD) detection has emerged as a popular technique to enhance the reliability of machine learning models by identifying unexpected inputs from unknown classes. Recent progress in pre-trained vision-language models (VLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yuanwei Hu , Bo Peng , Yadan Luo , Zhen Fang , Ling Chen , Jie Lu

Existing vision-language models exhibit strong generalization on a variety of visual domains and tasks. However, such models mainly perform zero-shot recognition in a closed-set manner, and thus struggle to handle open-domain visual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Yuhang Zang , Hanlin Goh , Josh Susskind , Chen Huang