中文
相关论文

相关论文: Domain Feature Collapse: Implications for Out-of-D…

200 篇论文

Deep generative models (DGMs) seem a natural fit for detecting out-of-distribution (OOD) inputs, but such models have been shown to assign higher probabilities or densities to OOD images than images from the training distribution. In this…

机器学习 · 计算机科学 2021-07-20 Lily H. Zhang , Mark Goldstein , Rajesh Ranganath

Out-of-distribution (OOD) detection is critical for deploying image classifiers in safety-sensitive environments, yet existing detectors often struggle when OOD samples are semantically similar to the in-distribution (ID) classes. We…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Yuanchao Wang , Tian Qin , Eduardo Valle , Bruno Abrahao

Most classification and segmentation datasets assume a closed-world scenario in which predictions are expressed as distribution over a predetermined set of visual classes. However, such assumption implies unavoidable and often unnoticeable…

计算机视觉与模式识别 · 计算机科学 2018-10-02 Petra Bevandić , Ivan Krešo , Marin Oršić , Siniša Šegvić

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

机器学习 · 计算机科学 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

The reliability of artificial intelligence (AI) systems in open-world settings depends heavily on their ability to flag out-of-distribution (OOD) inputs unseen during training. Recent advances in large-scale vision-language models (VLMs)…

机器学习 · 计算机科学 2025-10-14 Faizul Rakib Sayem , Shahana Ibrahim

Out-of-Distribution (OOD) detection is critical for safe deployment; however, existing detectors often struggle to generalize across datasets of varying scales and model architectures, and some can incur high computational costs in…

机器学习 · 计算机科学 2025-04-04 Litian Liu , Yao Qin

We expect the generalization error to improve with more samples from a similar task, and to deteriorate with more samples from an out-of-distribution (OOD) task. In this work, we show a counter-intuitive phenomenon: the generalization error…

机器学习 · 计算机科学 2023-07-20 Ashwin De Silva , Rahul Ramesh , Carey E. Priebe , Pratik Chaudhari , Joshua T. Vogelstein

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

机器学习 · 计算机科学 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

The task of out-of-distribution (OOD) detection is crucial for deploying machine learning models in real-world settings. In this paper, we observe that the singular value distributions of the in-distribution (ID) and OOD features are quite…

机器学习 · 计算机科学 2022-09-20 Yue Song , Nicu Sebe , Wei Wang

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

机器学习 · 计算机科学 2024-04-09 Zhen Fang , Yixuan Li , Feng Liu , Bo Han , Jie Lu

A recent popular approach to out-of-distribution (OOD) detection is based on a self-supervised learning technique referred to as contrastive learning. There are two main variants of contrastive learning, namely instance and class…

机器学习 · 计算机科学 2022-11-08 Nawid Keshtmand , Raul Santos-Rodriguez , Jonathan Lawry

Despite machine learning models' success in Natural Language Processing (NLP) tasks, predictions from these models frequently fail on out-of-distribution (OOD) samples. Prior works have focused on developing state-of-the-art methods for…

计算与语言 · 计算机科学 2021-11-30 Dyah Adila , Dongyeop Kang

Recent studies have addressed the concern of detecting and rejecting the out-of-distribution (OOD) samples as a major challenge in the safe deployment of deep learning (DL) models. It is desired that the DL model should only be confident…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Umar Khalid , Ashkan Esmaeili , Nazmul Karim , Nazanin Rahnavard

This paper identifies the flaws in existing open-world learning approaches and attempts to provide a complete picture in the form of \textbf{True Open-World Learning}. We accomplish this by proposing a comprehensive generalize-able…

计算机视觉与模式识别 · 计算机科学 2021-04-30 Akshay Raj Dhamija , Touqeer Ahmad , Jonathan Schwan , Mohsen Jafarzadeh , Chunchun Li , Terrance E. Boult

Out-of-distribution (OOD) detection, crucial for reliable pattern classification, discerns whether a sample originates outside the training distribution. This paper concentrates on the high-dimensional features output by the final…

计算机视觉与模式识别 · 计算机科学 2024-05-06 Qiuyu Zhu , Yiwei He

Despite much progress being made in the field of object recognition with the advances of deep learning, there are still several factors negatively affecting the performance of deep learning models. Domain shift is one of these factors and…

计算机视觉与模式识别 · 计算机科学 2023-03-03 Kaiyu Guo , Brian Lovell

Successful deep neural networks discover salient features of data. We show when and why they fail to learn out-of-distribution (OOD)-relevant representations from an in-distribution (ID) training window. This requires decoupling feature…

机器学习 · 计算机科学 2026-05-14 Leonel Aguilar , Jan Nagler , Christoph Hoelscher , Nino Antulov-Fantulin

A key feature of out-of-distribution (OOD) detection is to exploit a trained neural network by extracting statistical patterns and relationships through the multi-layer classifier to detect shifts in the expected input data distribution.…

机器学习 · 计算机科学 2023-06-07 Eduardo Dadalto , Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

Deep Learning models perform unreliably when the data comes from a distribution different from the training one. In critical applications such as medical imaging, out-of-distribution (OOD) detection methods help to identify such data…

图像与视频处理 · 电气工程与系统科学 2023-06-26 Anton Vasiliuk , Daria Frolova , Mikhail Belyaev , Boris Shirokikh

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

计算与语言 · 计算机科学 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu