English
Related papers

Related papers: Contrastive Training for Improved Out-of-Distribut…

200 papers

Near out-of-distribution detection (OOD) is a major challenge for deep neural networks. We demonstrate that large-scale pre-trained transformers can significantly improve the state-of-the-art (SOTA) on a range of near OOD tasks across…

Machine Learning · Computer Science 2021-07-30 Stanislav Fort , Jie Ren , Balaji Lakshminarayanan

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Machine Learning · Computer Science 2025-07-03 Yucen Lily Li , Daohan Lu , Polina Kirichenko , Shikai Qiu , Tim G. J. Rudner , C. Bayan Bruss , Andrew Gordon Wilson

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

Machine Learning · Computer Science 2023-10-11 Yiyou Sun

Out-of-distribution (OOD) detection is a task that detects OOD samples during inference to ensure the safety of deployed models. However, conventional benchmarks have reached performance saturation, making it difficult to compare recent OOD…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Shiho Noda , Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

The safe deployment of machine learning and AI models in open-world settings hinges critically on the ability to detect out-of-distribution (OOD) data accurately, data samples that contrast vastly from what the model was trained with.…

Machine Learning · Computer Science 2025-05-23 Andrija Djurisic , Rosanne Liu , Mladen Nikolic

Out-of-distribution (OOD) detection has emerged as a popular technique to enhance the reliability of machine learning models by identifying unexpected inputs from unknown classes. Recent progress in pre-trained vision-language models (VLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yuanwei Hu , Bo Peng , Yadan Luo , Zhen Fang , Ling Chen , Jie Lu

Machine learning algorithms typically assume independent and identically distributed samples in training and at test time. Much work has shown that high-performing ML classifiers can degrade significantly and provide overly-confident, wrong…

Computation and Language · Computer Science 2023-03-09 Jie Ren , Jiaming Luo , Yao Zhao , Kundan Krishna , Mohammad Saleh , Balaji Lakshminarayanan , Peter J. Liu

Effective out-of-distribution (OOD) detection is crucial for reliable machine learning models, yet most current methods are limited in practical use due to requirements like access to training data or intervention in training. We present a…

Machine Learning · Computer Science 2024-03-13 Fran Jelenić , Josip Jukić , Martin Tutek , Mate Puljiz , Jan Šnajder

Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typically lack a…

Machine Learning · Statistics 2022-06-09 Mingtian Zhang , Andi Zhang , Tim Z. Xiao , Yitong Sun , Steven McDonagh

In recent years, multi-view outlier detection (MVOD) methods have advanced significantly, aiming to identify outliers within multi-view datasets. A key point is to better detect class outliers and class-attribute outliers, which only exist…

Multimedia · Computer Science 2024-08-16 Yijia Wang , Qianqian Xu , Yangbangyan Jiang , Siran Dai , Qingming Huang

LiDAR-based 3D object detection has become an essential part of automated driving due to its ability to localize and classify objects precisely in 3D. However, object detectors face a critical challenge when dealing with unknown foreground…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Michael Kösel , Marcel Schreiber , Michael Ulrich , Claudius Gläser , Klaus Dietmayer

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

Machine Learning · Computer Science 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

Out-of-distribution (OOD) detection is crucial for model reliability, as it identifies samples from unknown classes and reduces errors due to unexpected inputs. Vision-Language Models (VLMs) such as CLIP are emerging as powerful tools for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Yabin Zhang , Wenjie Zhu , Chenhang He , Lei Zhang

Outlier exposure (OE) is powerful in out-of-distribution (OOD) detection, enhancing detection capability via model fine-tuning with surrogate OOD data. However, surrogate data typically deviate from test OOD data. Thus, the performance of…

Machine Learning · Computer Science 2023-03-10 Qizhou Wang , Junjie Ye , Feng Liu , Quanyu Dai , Marcus Kalander , Tongliang Liu , Jianye Hao , Bo Han

Computer-aided diagnostics has benefited from the development of deep learning-based computer vision techniques in these years. Traditional supervised deep learning methods assume that the test sample is drawn from the identical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zesheng Hong , Yubiao Yue , Yubin Chen , Lele Cong , Huanjie Lin , Yuanmei Luo , Mini Han Wang , Weidong Wang , Jialong Xu , Xiaoqi Yang , Hechang Chen , Zhenzhang Li , Sihong Xie

Modern deep neural network models are known to erroneously classify out-of-distribution (OOD) test data into one of the in-distribution (ID) training classes with high confidence. This can have disastrous consequences for safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Ramya S. Hebbalaguppe , Soumya Suvra Goshal , Jatin Prakash , Harshad Khadilkar , Chetan Arora

Recent object detectors have achieved impressive accuracy in identifying objects seen during training. However, real-world deployment often introduces novel and unexpected objects, referred to as out-of-distribution (OOD) objects, posing…

Machine Learning · Computer Science 2025-11-20 Quang-Huy Nguyen , Jin Peng Zhou , Zhenzhen Liu , Khanh-Huyen Bui , Kilian Q. Weinberger , Wei-Lun Chao , Dung D. Le

We study the problem of few-shot out-of-distribution (OOD) detection, which aims to detect OOD samples from unseen categories during inference time with only a few labeled in-domain (ID) samples. Existing methods mainly focus on training…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xinyi Chen , Yaohui Li , Haoxing Chen

Detecting deepfakes has become a critical challenge in Computer Vision and Artificial Intelligence. Despite significant progress in detection techniques, generalizing them to open-set scenarios continues to be a persistent difficulty.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Luca Maiano , Fabrizio Casadei , Irene Amerini

Detecting whether examples belong to a given in-distribution or are Out-Of-Distribution (OOD) requires identifying features specific to the in-distribution. In the absence of labels, these features can be learned by self-supervised…

Artificial Intelligence · Computer Science 2022-01-19 Nima Rafiee , Rahil Gholamipoorfard , Nikolas Adaloglou , Simon Jaxy , Julius Ramakers , Markus Kollmann