中文
相关论文

相关论文: Why Should we Combine Training and Post-Training M…

200 篇论文

Out-of-distribution (OOD) detection is a critical task for reliable predictions over text. Fine-tuning with pre-trained language models has been a de facto procedure to derive OOD detectors with respect to in-distribution (ID) data. Despite…

计算与语言 · 计算机科学 2023-05-23 Rheeya Uppaal , Junjie Hu , Yixuan Li

Deep Neural Networks are powerful models that attained remarkable results on a variety of tasks. These models are shown to be extremely efficient when training and test data are drawn from the same distribution. However, it is not clear how…

机器学习 · 统计学 2019-01-11 Gabi Shalev , Yossi Adi , Joseph Keshet

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

机器学习 · 计算机科学 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

In satellite image analysis, distributional mismatch between the training and test data may arise due to several reasons, including unseen classes in the test data and differences in the geographic area. Deep learning based models may…

机器学习 · 计算机科学 2021-04-13 Jakob Gawlikowski , Sudipan Saha , Anna Kruspe , Xiao Xiang Zhu

Deep Learning models possess two key traits that, in combination, make their use in the real world a risky prospect. One, they do not typically generalize well outside of the distribution for which they were trained, and two, they tend to…

机器学习 · 计算机科学 2021-09-29 Jonathan S. Kent , Bo Li

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

机器学习 · 计算机科学 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability…

机器学习 · 统计学 2019-09-27 Nilesh A. Ahuja , Ibrahima Ndiour , Trushant Kalyanpur , Omesh Tickoo

Improving the reliability of deployed machine learning systems often involves developing methods to detect out-of-distribution (OOD) inputs. However, existing research often narrowly focuses on samples from classes that are absent from the…

机器学习 · 计算机科学 2024-12-11 Charles Guille-Escuret , Pierre-André Noël , Ioannis Mitliagkas , David Vazquez , Joao Monteiro

Deep Learning models are easily disturbed by variations in the input images that were not observed during the training stage, resulting in unpredictable predictions. Detecting such Out-of-Distribution (OOD) images is particularly crucial in…

计算机视觉与模式识别 · 计算机科学 2023-07-31 Benjamin Lambert , Florence Forbes , Senan Doyle , Michel Dojat

Reinforcement Learning (RL) based solutions are being adopted in a variety of domains including robotics, health care and industrial automation. Most focus is given to when these solutions work well, but they fail when presented with out of…

机器学习 · 计算机科学 2021-12-07 Aaqib Parvez Mohammed , Matias Valdenegro-Toro

Out-of-distribution (OOD) detection is essential for building reliable AI systems, as models that produce outputs for invalid inputs cannot be trusted. Although deep learning (DL) is often assumed to outperform traditional machine learning…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Jihyeon Baek , Seunghoon Lee , Gitaek Kwon , Doohyun Park

Convolutional Neural Networks (CNNs) have shown to be powerful medical image segmentation models. In this study, we address some of the main unresolved issues regarding these models. Specifically, training of these models on small medical…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Davood Karimi , Ali Gholipour

Out-of-distribution detection (OOD) is a pivotal task for real-world applications that trains models to identify samples that are distributionally different from the in-distribution (ID) data during testing. Recent advances in AI,…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Chaohua Li , Enhao Zhang , Chuanxing Geng , Songcan Chen

Standard recognition approaches are unable to deal with novel categories at test time. Their overconfidence on the known classes makes the predictions unreliable for safety-critical applications such as healthcare or autonomous driving.…

计算机视觉与模式识别 · 计算机科学 2023-07-13 Lorenzo Li Lu , Giulia D'Ascenzi , Francesco Cappio Borlino , Tatiana Tommasi

Existing out-of-distribution (OOD) detectors are often tuned by a separate dataset deemed OOD with respect to the training distribution of a neural network (NN). OOD detectors process the activations of NN layers and score the output, where…

机器学习 · 计算机科学 2026-02-06 Sudeepta Mondal , Xinyi Mary Xie , Ruxiao Duan , Alex Wong , Ganesh Sundaramoorthi

In this paper, we present a novel approach that combines deep metric learning and synthetic data generation using diffusion models for out-of-distribution (OOD) detection. One popular approach for OOD detection is outlier exposure, where…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Assefa Seyoum Wahd

Being able to successfully determine whether the testing samples has similar distribution as the training samples is a fundamental question to address before we can safely deploy most of the machine learning models into practice. In this…

机器学习 · 计算机科学 2024-05-07 Zhaiming Shen , Menglun Wang , Guang Cheng , Ming-Jun Lai , Lin Mu , Ruihao Huang , Qi Liu , Hao Zhu

Adoption of deep learning in safety-critical systems raise the need for understanding what deep neural networks do not understand after models have been deployed. The behaviour of deep neural networks is undefined for so called…

机器学习 · 计算机科学 2021-08-25 Rickard Sjögren , Johan Trygg

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

Deep neural networks (DNNs) deployed in real-world applications can encounter out-of-distribution (OOD) data and adversarial examples. These represent distinct forms of distributional shifts that can significantly impact DNNs' reliability…

机器学习 · 计算机科学 2024-04-09 Naveen Karunanayake , Ravin Gunawardena , Suranga Seneviratne , Sanjay Chawla