中文
相关论文

相关论文: On Out-of-distribution Detection with Energy-based…

200 篇论文

We consider the problem of detecting out-of-distribution (OOD) samples in deep reinforcement learning. In a value based reinforcement learning setting, we propose to use uncertainty estimation techniques directly on the agent's value…

机器学习 · 计算机科学 2019-01-09 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

Recent advances in medical vision-language models (VLMs) demonstrate impressive performance in image classification tasks, driven by their strong zero-shot generalization capabilities. However, given the high variability and complexity…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Lie Ju , Sijin Zhou , Yukun Zhou , Huimin Lu , Zhuoting Zhu , Pearse A. Keane , Zongyuan Ge

Energy-based models (EBMs) offer a flexible framework for parameterizing probability distributions using neural networks. However, learning EBMs by exact maximum likelihood estimation (MLE) is generally intractable, due to the need to…

机器学习 · 计算机科学 2025-08-20 Michael E. Sander , Vincent Roulet , Tianlin Liu , Mathieu Blondel

Out-of-distribution (OOD) detection is committed to delineating the classification boundaries between in-distribution (ID) and OOD images. Recent advances in vision-language models (VLMs) have demonstrated remarkable OOD detection…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Zhixia He , Chen Zhao , Minglai Shao , Xintao Wu , Xujiang Zhao , Dong Li , Qin Tian , Linlin Yu

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

机器学习 · 计算机科学 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

Effective out-of-distribution (OOD) detection is crucial for reliable machine learning models, yet most current methods are limited in practical use due to requirements like access to training data or intervention in training. We present a…

机器学习 · 计算机科学 2024-03-13 Fran Jelenić , Josip Jukić , Martin Tutek , Mate Puljiz , Jan Šnajder

We offer a study that connects robust discriminative classifiers trained with adversarial training (AT) with generative modeling in the form of Energy-based Models (EBM). We do so by decomposing the loss of a discriminative classifier and…

机器学习 · 计算机科学 2023-06-06 Senad Beadini , Iacopo Masi

Out-of-Distribution (OOD) detection is critical to AI reliability and safety, yet in many practical settings, only a limited amount of training data is available. Bayesian Neural Networks (BNNs) are a promising class of model on which to…

机器学习 · 计算机科学 2026-02-12 Kevin Raina , Tanya Schmah

Earth Observation imagery can capture rare and unusual events, such as disasters and major landscape changes, whose visual appearance contrasts with the usual observations. Deep models trained on common remote sensing data will output…

计算机视觉与模式识别 · 计算机科学 2024-04-22 Georges Le Bellier , Nicolas Audebert

In this paper, we tackle the detection of out-of-distribution (OOD) objects in semantic segmentation. By analyzing the literature, we found that current methods are either accurate or fast but not both which limits their usability in real…

计算机视觉与模式识别 · 计算机科学 2021-08-04 Victor Besnier , Andrei Bursuc , David Picard , Alexandre Briot

Adoption of deep learning in safety-critical systems raise the need for understanding what deep neural networks do not understand after models have been deployed. The behaviour of deep neural networks is undefined for so called…

机器学习 · 计算机科学 2021-08-25 Rickard Sjögren , Johan Trygg

In domains with interdependent data, such as graphs, quantifying the epistemic uncertainty of a Graph Neural Network (GNN) is challenging as uncertainty can arise at different structural scales. Existing techniques neglect this issue or…

机器学习 · 计算机科学 2025-02-28 Dominik Fuchsgruber , Tom Wollschläger , Stephan Günnemann

Improving the reliability of deployed machine learning systems often involves developing methods to detect out-of-distribution (OOD) inputs. However, existing research often narrowly focuses on samples from classes that are absent from the…

机器学习 · 计算机科学 2024-12-11 Charles Guille-Escuret , Pierre-André Noël , Ioannis Mitliagkas , David Vazquez , Joao Monteiro

Modern machine learning models, that excel on computer vision tasks such as classification and object detection, are often overconfident in their predictions for Out-of-Distribution (OOD) examples, resulting in unpredictable behaviour for…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Brian K. S. Isaac-Medina , Mauricio Che , Yona F. A. Gaus , Samet Akcay , Toby P. Breckon

Deep neural networks (DNNs), especially convolutional neural networks, have achieved superior performance on image classification tasks. However, such performance is only guaranteed if the input to a trained model is similar to the training…

计算机视觉与模式识别 · 计算机科学 2021-01-28 Liang Liang , Linhai Ma , Linchen Qian , Jiasong Chen

Out-of-distribution (OOD) detection is essential to handle the distribution shifts between training and test scenarios. For a new in-distribution (ID) dataset, existing methods require retraining to capture the dataset-specific feature…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Meng Xing , Zhiyong Feng , Yong Su , Changjae Oh

Energy-based models (EBM) have become increasingly popular within computer vision. EBMs bring a probabilistic approach to training deep neural networks (DNN) and have been shown to enhance performance in areas such as calibration,…

机器学习 · 计算机科学 2023-04-05 Jacob Piland , Christopher Sweet , Priscila Saboia , Charles Vardeman , Adam Czajka

Deep generative models have been demonstrated as state-of-the-art density estimators. Yet, recent work has found that they often assign a higher likelihood to data from outside the training distribution. This seemingly paradoxical behavior…

机器学习 · 计算机科学 2022-01-19 Jakob D. Havtorn , Jes Frellsen , Søren Hauberg , Lars Maaløe

Consider learning a policy purely on the basis of demonstrated behavior -- that is, with no access to reinforcement signals, no knowledge of transition dynamics, and no further interaction with the environment. This *strictly batch…

机器学习 · 统计学 2021-01-15 Daniel Jarrett , Ioana Bica , Mihaela van der Schaar

As deep neural networks become adopted in high-stakes domains, it is crucial to identify when inference inputs are Out-of-Distribution (OOD) so that users can be alerted of likely drops in performance and calibration despite high confidence…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Will LeVine , Benjamin Pikus , Jacob Phillips , Berk Norman , Fernando Amat Gil , Sean Hendryx