English
Related papers

Related papers: Fine-Tuning Deteriorates General Textual Out-of-Di…

200 papers

Existing out-of-distribution (OOD) detection literature clearly defines semantic shift as a sign of OOD but does not have a consensus over covariate shift. Samples experiencing covariate shift but not semantic shift are either excluded from…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Jingkang Yang , Kaiyang Zhou , Ziwei Liu

The task of out-of-distribution (OOD) detection is notoriously ill-defined. Earlier works focused on new-class detection, aiming to identify label-altering data distribution shifts, also known as "semantic shift." However, recent works…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 William Yang , Byron Zhang , Olga Russakovsky

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

Detecting out-of-distribution (OOD) instances is significant for the safe deployment of NLP models. Among recent textual OOD detection works based on pretrained language models (PLMs), distance-based methods have shown superior performance.…

Computation and Language · Computer Science 2022-10-17 Sishuo Chen , Xiaohan Bi , Rundong Gao , Xu Sun

Detecting out-of-distribution (OOD) inputs is a central challenge for safely deploying machine learning models in the real world. Existing solutions are mainly driven by small datasets, with low resolution and very few class labels (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Rui Huang , Yixuan Li

Most existing out-of-distribution (OOD) detection benchmarks classify samples with novel labels as the OOD data. However, some marginal OOD samples actually have close semantic contents to the in-distribution (ID) sample, which makes…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Xingming Long , Jie Zhang , Shiguang Shan , Xilin Chen

We propose a generalized method for boosting the generalization ability of pre-trained vision-language models (VLMs) while fine-tuning on downstream few-shot tasks. The idea is realized by exploiting out-of-distribution (OOD) detection to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Kun Ding , Haojian Zhang , Qiang Yu , Ying Wang , Shiming Xiang , Chunhong Pan

Recognizing out-of-distribution (OOD) samples is critical for machine learning systems deployed in the open world. The vast majority of OOD detection methods are driven by a single modality (e.g., either vision or language), leaving the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Yifei Ming , Ziyang Cai , Jiuxiang Gu , Yiyou Sun , Wei Li , Yixuan Li

Out-of-distribution (OOD) detection poses a significant challenge for Graph Neural Networks (GNNs), particularly in open-world scenarios with varying distribution shifts. Most existing OOD detection methods on graphs primarily focus on…

Machine Learning · Computer Science 2024-10-24 Zhixia He , Chen Zhao , Minglai Shao , Yujie Lin , Dong Li , Qin Tian

Text-attributed graphs (TAGs) associate nodes with textual attributes and graph structure, enabling GNNs to jointly model semantic and structural information. While effective on in-distribution (ID) data, GNNs often encounter…

Machine Learning · Computer Science 2026-02-13 Yinlin Zhu , Di Wu , Xu Wang , Guocong Quan , Miao Hu

In addition to accurate scene understanding through precise semantic segmentation of LiDAR point clouds, detecting out-of-distribution (OOD) objects, instances not encountered during training, is essential to prevent the incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Hanieh Shojaei Miandashti , Claus Brenner

Out-of-distribution (OOD) detection is a critical task to ensure the reliability and security of machine learning models deployed in real-world applications. Conventional methods for OOD detection that rely on single-modal information,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 K Huang , G Song , Hanwen Su , Jiyan Wang

Recent advances in deep learning have led to breakthroughs in the development of automated skin disease classification. As we observe an increasing interest in these models in the dermatology space, it is crucial to address aspects such as…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 Hannah Kim , Girmaw Abebe Tadesse , Celia Cintas , Skyler Speakman , Kush Varshney

Existing vision-language model (VLM)-based methods for out-of-distribution (OOD) detection typically rely on similarity scores between input images and in-distribution (ID) text prototypes. However, the modality gap between image and text…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yimu Wang , Evelien Riddell , Adrian Chow , Sean Sedwards , Krzysztof Czarnecki

Existing prompt learning methods have shown certain capabilities in Out-of-Distribution (OOD) detection, but the lack of OOD images in the target dataset in their training can lead to mismatches between OOD images and In-Distribution (ID)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Tianqi Li , Guansong Pang , Xiao Bai , Wenjun Miao , Jin Zheng

Methods for out-of-distribution (OOD) detection that scale to 3D data are crucial components of any real-world clinical deep learning system. Classic denoising diffusion probabilistic models (DDPMs) have been recently proposed as a robust…

Identifying unexpected domain-shifted instances in natural language processing is crucial in real-world applications. Previous works identify the out-of-distribution (OOD) instance by leveraging a single global feature embedding to…

Computation and Language · Computer Science 2024-03-20 Jinan Zou , Maihao Guo , Yu Tian , Yuhao Lin , Haiyao Cao , Lingqiao Liu , Ehsan Abbasnejad , Javen Qinfeng Shi

The detection of out of distribution samples for image classification has been widely researched. Safety critical applications, such as autonomous driving, would benefit from the ability to localise the unusual objects causing the image to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Matt Angus , Krzysztof Czarnecki , Rick Salay

A key feature of out-of-distribution (OOD) detection is to exploit a trained neural network by extracting statistical patterns and relationships through the multi-layer classifier to detect shifts in the expected input data distribution.…

Machine Learning · Computer Science 2023-06-07 Eduardo Dadalto , Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

Recent advances in medical vision-language models (VLMs) demonstrate impressive performance in image classification tasks, driven by their strong zero-shot generalization capabilities. However, given the high variability and complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Lie Ju , Sijin Zhou , Yukun Zhou , Huimin Lu , Zhuoting Zhu , Pearse A. Keane , Zongyuan Ge