English
Related papers

Related papers: A Meta-Analysis of Distributionally-Robust Models

200 papers

Systematic, compositional generalization beyond the training distribution remains a core challenge in machine learning -- and a critical bottleneck for the emergent reasoning abilities of modern language models. This work investigates…

Machine Learning · Computer Science 2025-10-17 Awni Altabaa , Siyu Chen , John Lafferty , Zhuoran Yang

Out-of-Distribution (OOD) detection is critical for safe deployment; however, existing detectors often struggle to generalize across datasets of varying scales and model architectures, and some can incur high computational costs in…

Machine Learning · Computer Science 2025-04-04 Litian Liu , Yao Qin

Out-of-distribution (OOD) detection is critical for safety-sensitive machine learning applications and has been extensively studied, yielding a plethora of methods developed in the literature. However, most studies for OOD detection did not…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Discriminatively trained neural classifiers can be trusted, only when the input data comes from the training distribution (in-distribution). Therefore, detecting out-of-distribution (OOD) samples is very important to avoid classification…

Machine Learning · Computer Science 2019-04-30 Sachin Vernekar , Ashish Gaurav , Taylor Denouden , Buu Phan , Vahdat Abdelzad , Rick Salay , Krzysztof Czarnecki

A fundamental challenge in physics-informed machine learning (PIML) is the design of robust PIML methods for out-of-distribution (OOD) forecasting tasks. These OOD tasks require learning-to-learn from observations of the same (ODE)…

Machine Learning · Computer Science 2023-03-07 S Chandra Mouli , Muhammad Ashraful Alam , Bruno Ribeiro

Image classification in the open-world must handle out-of-distribution (OOD) images. Systems should ideally reject OOD images, or they will map atop of known classes and reduce reliability. Using open-set classifiers that can reject OOD…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Mohsen Jafarzadeh , Touqeer Ahmad , Akshay Raj Dhamija , Chunchun Li , Steve Cruz , Terrance E. Boult

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

Machine Learning · Computer Science 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Image classification plays a pivotal role across diverse applications, yet challenges persist when models are deployed in real-world scenarios. Notably, these models falter in detecting unfamiliar classes that were not incorporated during…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Butian Xiong , Liguang Zhou , Tin Lun Lam , Yangsheng Xu

The core of out-of-distribution (OOD) detection is to learn the in-distribution (ID) representation, which is distinguishable from OOD samples. Previous work applied recognition-based methods to learn the ID features, which tend to learn…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jingyao Li , Pengguang Chen , Shaozuo Yu , Zexin He , Shu Liu , Jiaya Jia

Although prior work in computer vision has shown strong correlations between in-distribution (ID) and out-of-distribution (OOD) accuracies, such relationships remain underexplored in audio-based models. In this study, we investigate how…

Machine Learning · Computer Science 2025-08-01 Anaïs Baranger , Lucas Maison

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

Machine Learning · Computer Science 2023-12-05 Sergey Kolesnikov

Learning robust vision models that perform well in out-of-distribution (OOD) situations is an important task for model deployment in real-world settings. Despite extensive research in this field, many proposed methods have only shown minor…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Gyuseong Lee , Wooseok Jang , Jinhyeon Kim , Jaewoo Jung , Seungryong Kim

The reliability of artificial intelligence (AI) systems in open-world settings depends heavily on their ability to flag out-of-distribution (OOD) inputs unseen during training. Recent advances in large-scale vision-language models (VLMs)…

Machine Learning · Computer Science 2025-10-14 Faizul Rakib Sayem , Shahana Ibrahim

The ability to detect unfamiliar or unexpected images is essential for safe deployment of computer vision systems. In the context of classification, the task of detecting images outside of a model's training domain is known as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Galadrielle Humblot-Renaux , Sergio Escalera , Thomas B. Moeslund

Out-of-distribution (OOD) detection empowers the model trained on the closed image set to identify unknown data in the open world. Though many prior techniques have yielded considerable improvements in this research direction, two crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Sen Pei

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

Machine Learning · Computer Science 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

How can we automatically select an out-of-distribution (OOD) detection model for various underlying tasks? This is crucial for maintaining the reliability of open-world applications by identifying data distribution shifts, particularly in…

Machine Learning · Computer Science 2025-03-03 Yuehan Qin , Yichi Zhang , Yi Nian , Xueying Ding , Yue Zhao

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

Machine Learning · Computer Science 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

Modern deep learning techniques have illustrated their excellent capabilities in many areas, but relies on large training data. Optimization-based meta-learning train a model on a variety tasks, such that it can solve new learning tasks…

Machine Learning · Computer Science 2023-02-23 Penghao Jiang , Ke Xin , Zifeng Wang , Chunxi Li

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

Machine Learning · Computer Science 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen