中文
相关论文

相关论文: Out-of-Distribution Detection using Synthetic Data…

200 篇论文

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

机器学习 · 计算机科学 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry

Detecting Out-of-Distribution (OOD) samples in real world visual applications like classification or object detection has become a necessary precondition in today's deployment of Deep Learning systems. Many techniques have been proposed, of…

计算机视觉与模式识别 · 计算机科学 2022-08-24 Abhishek Joshi , Sathish Chalasani , Kiran Nanjunda Iyer

This study demonstrates that the modern generation of Large Language Models (LLMs, such as GPT-4) suffers from the same out-of-domain (OOD) performance gap observed in prior research on pre-trained Language Models (PLMs, such as BERT). We…

计算与语言 · 计算机科学 2024-12-31 Dmitri Roussinov , Serge Sharoff , Nadezhda Puchnina

Out-of-distribution (OOD) detection, crucial for reliable pattern classification, discerns whether a sample originates outside the training distribution. This paper concentrates on the high-dimensional features output by the final…

计算机视觉与模式识别 · 计算机科学 2024-05-06 Qiuyu Zhu , Yiwei He

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

机器学习 · 计算机科学 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

One of the challenges for neural networks in real-life applications is the overconfident errors these models make when the data is not from the original training distribution. Addressing this issue is known as Out-of-Distribution (OOD)…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Sina Sharifi , Taha Entesari , Bardia Safaei , Vishal M. Patel , Mahyar Fazlyab

Detecting out-of-distribution (OOD) inputs is a central challenge for safely deploying machine learning models in the real world. Existing solutions are mainly driven by small datasets, with low resolution and very few class labels (e.g.,…

计算机视觉与模式识别 · 计算机科学 2021-05-06 Rui Huang , Yixuan Li

Out-of-distribution (OOD) detection is indispensable for safely deploying machine learning models in the wild. One of the key challenges is that models lack supervision signals from unknown data, and as a result, can produce overconfident…

机器学习 · 计算机科学 2023-03-07 Leitian Tao , Xuefeng Du , Xiaojin Zhu , Yixuan Li

Deep neural networks have demonstrated great generalization capabilities for tasks whose training and test sets are drawn from the same distribution. Nevertheless, out-of-distribution (OOD) detection remains a challenging task that has…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Brian K. S. Isaac-Medina , Toby P. Breckon

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

机器学习 · 计算机科学 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Standard recognition approaches are unable to deal with novel categories at test time. Their overconfidence on the known classes makes the predictions unreliable for safety-critical applications such as healthcare or autonomous driving.…

计算机视觉与模式识别 · 计算机科学 2023-07-13 Lorenzo Li Lu , Giulia D'Ascenzi , Francesco Cappio Borlino , Tatiana Tommasi

We present a new methodology for detecting out-of-distribution (OOD) images by utilizing norms of the score estimates at multiple noise scales. A score is defined to be the gradient of the log density with respect to the input data. Our…

机器学习 · 计算机科学 2021-03-24 Ahsan Mahmood , Junier Oliva , Martin Styner

The task of identifying out-of-domain (OOD) input examples directly at test-time has seen renewed interest recently due to increased real world deployment of models. In this work, we focus on OOD detection for natural language sentence…

计算与语言 · 计算机科学 2020-01-01 Varun Gangal , Abhinav Arora , Arash Einolghozati , Sonal Gupta

An intuitive way to detect out-of-distribution (OOD) data is via the density function of a fitted probabilistic generative model: points with low density may be classed as OOD. But this approach has been found to fail, in deep learning…

机器学习 · 统计学 2022-11-02 Andi Zhang , Damon Wischik

Deep Learning (DL) models tend to perform poorly when the data comes from a distribution different from the training one. In critical applications such as medical imaging, out-of-distribution (OOD) detection helps to identify such data…

图像与视频处理 · 电气工程与系统科学 2023-06-26 Daria Frolova , Anton Vasiliuk , Mikhail Belyaev , Boris Shirokikh

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

机器学习 · 统计学 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

In real-world applications, machine learning models must reliably detect Out-of-Distribution (OoD) samples to prevent unsafe decisions. Current OoD detection methods often rely on analyzing the logits or the embeddings of the penultimate…

机器学习 · 计算机科学 2025-02-19 Gianluca Guglielmo , Marc Masana

Out-Of-Distribution (OOD) detection has received broad attention over the years, aiming to ensure the reliability and safety of deep neural networks (DNNs) in real-world scenarios by rejecting incorrect predictions. However, we notice a…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , Rongxin Jiang , Bolun Zheng , Yaowu Chen

Despite machine learning models' success in Natural Language Processing (NLP) tasks, predictions from these models frequently fail on out-of-distribution (OOD) samples. Prior works have focused on developing state-of-the-art methods for…

计算与语言 · 计算机科学 2021-11-30 Dyah Adila , Dongyeop Kang

Robust out-of-distribution (OOD) detection is an indispensable component of modern artificial intelligence (AI) systems, especially in safety-critical applications where models must identify inputs from unfamiliar classes not seen during…

机器学习 · 计算机科学 2025-09-09 Tarhib Al Azad , Shahana Ibrahim