中文
相关论文

相关论文: Norm-Scaling for Out-of-Distribution Detection

200 篇论文

Soft labeling becomes a common output regularization for generalization and model compression of deep neural networks. However, the effect of soft labeling on out-of-distribution (OOD) detection, which is an important topic of machine…

机器学习 · 计算机科学 2020-07-08 Doyup Lee , Yeongjae Cheon

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

机器学习 · 计算机科学 2023-10-11 Yiyou Sun

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Machine Learning (ML) models are trained on in-distribution (ID) data but often encounter out-of-distribution (OOD) inputs during deployment -- posing serious risks in safety-critical domains. Recent works have focused on designing scoring…

机器学习 · 计算机科学 2025-05-06 Daisuke Yamada , Harit Vishwakarma , Ramya Korlakai Vinayak

In order to safely deploy Deep Neural Networks (DNNs) within the perception pipelines of real-time decision making systems, there is a need for safeguards that can detect out-of-training-distribution (OoD) inputs both efficiently and…

机器学习 · 计算机科学 2021-02-26 Apoorva Sharma , Navid Azizan , Marco Pavone

The safe deployment of machine learning and AI models in open-world settings hinges critically on the ability to detect out-of-distribution (OOD) data accurately, data samples that contrast vastly from what the model was trained with.…

机器学习 · 计算机科学 2025-05-23 Andrija Djurisic , Rosanne Liu , Mladen Nikolic

Out-of-Distribution (OoD) detection is important for building safe artificial intelligence systems. However, current OoD detection methods still cannot meet the performance requirements for practical deployment. In this paper, we propose a…

机器学习 · 统计学 2020-12-18 Haiwen Huang , Zhihan Li , Lulu Wang , Sishuo Chen , Bin Dong , Xinyu Zhou

Neural networks often make overconfident predictions from out-of-distribution (OOD) samples. Detection of OOD data is therefore crucial to improve the safety of machine learning. The simplest and most powerful method for OOD detection is…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Hikaru Shijo , Yutaka Yoshihama , Kenichi Yadani , Norifumi Murata

We propose a simple modification to standard ResNet architectures--L2 normalization over feature space--that substantially improves out-of-distribution (OoD) performance on the previously proposed Deep Deterministic Uncertainty (DDU)…

机器学习 · 计算机科学 2023-01-13 Jarrod Haas , William Yolland , Bernhard Rabus

Applying machine learning to increasingly high-dimensional problems with sparse or biased training data increases the risk that a model is used on inputs outside its training domain. For such out-of-distribution (OOD) inputs, the model can…

机器学习 · 计算机科学 2025-03-10 Juniper Tyree , Andreas Rupp , Petri S. Clusius , Michael H. Boy

Detecting out-of-distribution (OOD) inputs is a central challenge for safely deploying machine learning models in the real world. Existing solutions are mainly driven by small datasets, with low resolution and very few class labels (e.g.,…

计算机视觉与模式识别 · 计算机科学 2021-05-06 Rui Huang , Yixuan Li

Modern deep generative models can assign high likelihood to inputs drawn from outside the training distribution, posing threats to models in open-world deployments. While much research attention has been placed on defining new test-time…

机器学习 · 计算机科学 2022-08-22 Mu Cai , Yixuan Li

We consider the two related problems of detecting if an example is misclassified or out-of-distribution. We present a simple baseline that utilizes probabilities from softmax distributions. Correctly classified examples tend to have greater…

神经与进化计算 · 计算机科学 2018-10-04 Dan Hendrycks , Kevin Gimpel

Detecting deepfakes has become a critical challenge in Computer Vision and Artificial Intelligence. Despite significant progress in detection techniques, generalizing them to open-set scenarios continues to be a persistent difficulty.…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Luca Maiano , Fabrizio Casadei , Irene Amerini

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

机器学习 · 统计学 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

Neural networks are notorious for being overconfident predictors, posing a significant challenge to their safe deployment in real-world applications. While feature normalization has garnered considerable attention within the deep learning…

计算机视觉与模式识别 · 计算机科学 2023-06-09 Sudarshan Regmi , Bibek Panthi , Sakar Dotel , Prashnna K. Gyawali , Danail Stoyanov , Binod Bhattarai

The ability of a deep learning network to distinguish between in-distribution (ID) and out-of-distribution (OOD) inputs is crucial for ensuring the reliability and trustworthiness of AI systems. Existing OOD detection methods often involve…

机器学习 · 计算机科学 2024-12-25 Gagandeep Singh , Ishan Mishra , Deepak Mishra

Deep learning models are increasingly deployed in safety-critical applications, where reliable out-of-distribution (OOD) detection is essential to ensure robustness. Existing methods predominantly rely on the penultimate-layer activations…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Shreen Gul , Mohamed Elmahallawy , Ardhendu Tripathy , Sanjay Madria

This paper introduces a universal approach to seamlessly combine out-of-distribution (OOD) detection scores. These scores encompass a wide range of techniques that leverage the self-confidence of deep learning models and the anomalous…

机器学习 · 统计学 2024-06-25 Eduardo Dadalto , Florence Alberge , Pierre Duhamel , Pablo Piantanida

Out-of-distribution (OOD) detection has seen significant advancements with zero-shot approaches by leveraging the powerful Vision-Language Models (VLMs) such as CLIP. However, prior research works have predominantly focused on enhancing…

计算机视觉与模式识别 · 计算机科学 2025-01-10 Pei-Kang Lee , Jun-Cheng Chen , Ja-Ling Wu