中文
相关论文

相关论文: On Out-of-distribution Detection with Energy-based…

200 篇论文

In this work, we study the out-of-distribution (OOD) detection problem through the use of the feature space of a pre-trained deep classifier. We show that learning the density of in-distribution (ID) features with an energy-based models…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Marc Lafon , Clément Rambour , Nicolas Thome

Today, deep learning is increasingly applied in security-critical situations such as autonomous driving and medical diagnosis. Despite its success, the behavior and robustness of deep networks are not fully understood yet, posing a…

机器学习 · 计算机科学 2023-03-27 Sven Elflein

Out-of-distribution (OOD) detection is an essential approach to robustifying deep learning models, enabling them to identify inputs that fall outside of their trained distribution. Existing OOD detection methods usually depend on crafted…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Yifan Wu , Xichen Ye , Songmin Dai , Dengye Pan , Xiaoqiang Li , Weizhong Zhang , Yifan Chen

Out-of-distribution (OOD) detection is a critical requirement for the deployment of deep neural networks. This paper introduces the HEAT model, a new post-hoc OOD detection method estimating the density of in-distribution (ID) samples using…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Marc Lafon , Elias Ramzi , Clément Rambour , Nicolas Thome

Detecting Out-of-Distribution (OOD) samples in real world visual applications like classification or object detection has become a necessary precondition in today's deployment of Deep Learning systems. Many techniques have been proposed, of…

计算机视觉与模式识别 · 计算机科学 2022-08-24 Abhishek Joshi , Sathish Chalasani , Kiran Nanjunda Iyer

Despite extensive research efforts focused on OOD detection on images, OOD detection on nodes in graph learning remains underexplored. The dependence among graph nodes hinders the trivial adaptation of existing approaches on images that…

机器学习 · 计算机科学 2025-03-18 Yuhan Chen , Yihong Luo , Yifan Song , Pengwen Dai , Jing Tang , Xiaochun Cao

Maximum likelihood (ML) learning for energy-based models (EBMs) is challenging, partly due to non-convergence of Markov chain Monte Carlo.Several variations of ML learning have been proposed, but existing methods all fail to achieve both…

机器学习 · 统计学 2023-04-24 Xinwei Zhang , Zhiqiang Tan , Zhijian Ou

Out-of-distribution (OOD) detection is a critical task for safe deployment of learning systems in the open world setting. In this work, we investigate the use of feature density estimation via normalizing flows for OOD detection and present…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Evan D. Cook , Marc-Antoine Lavoie , Steven L. Waslander

Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typically lack a…

机器学习 · 统计学 2022-06-09 Mingtian Zhang , Andi Zhang , Tim Z. Xiao , Yitong Sun , Steven McDonagh

Deep energy-based models (EBMs), which use deep neural networks (DNNs) as energy functions, are receiving increasing attention due to their ability to learn complex distributions. To train deep EBMs, the maximum likelihood estimation (MLE)…

机器学习 · 计算机科学 2022-05-31 Beomsu Kim , Jong Chul Ye

Detecting out-of-distribution (OOD) data is crucial for robust machine learning systems. Normalizing flows are flexible deep generative models that often surprisingly fail to distinguish between in- and out-of-distribution data: a flow…

机器学习 · 统计学 2020-06-16 Polina Kirichenko , Pavel Izmailov , Andrew Gordon Wilson

The diverse nature of dialects presents challenges for models trained on specific linguistic patterns, rendering them susceptible to errors when confronted with unseen or out-of-distribution (OOD) data. This study introduces a novel…

计算与语言 · 计算机科学 2024-06-27 Yaqian Hao , Chenguang Hu , Yingying Gao , Shilei Zhang , Junlan Feng

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

机器学习 · 计算机科学 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

A common explanation for the failure of out-of-distribution (OOD) generalization is that the model trained with empirical risk minimization (ERM) learns spurious features instead of invariant features. However, several recent studies…

机器学习 · 计算机科学 2023-10-31 Yongqiang Chen , Wei Huang , Kaiwen Zhou , Yatao Bian , Bo Han , James Cheng

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

机器学习 · 计算机科学 2023-11-07 Reza Averly , Wei-Lun Chao

Energy-based models (EBMs) are versatile density estimation models that directly parameterize an unnormalized log density. Although very flexible, EBMs lack a specified normalization constant of the model, making the likelihood of the model…

机器学习 · 计算机科学 2024-02-20 Louis Grenioux , Éric Moulines , Marylou Gabrié

As machine learning models continue to achieve impressive performance across different tasks, the importance of effective anomaly detection for such models has increased as well. It is common knowledge that even well-trained models lose…

机器学习 · 计算机科学 2023-02-23 Ramneet Kaur , Xiayan Ji , Souradeep Dutta , Michele Caprio , Yahan Yang , Elena Bernardis , Oleg Sokolsky , Insup Lee

Energy-based models (EBMs) offer a flexible framework for probabilistic modelling across various data domains. However, training EBMs on data in discrete or mixed state spaces poses significant challenges due to the lack of robust and fast…

机器学习 · 统计学 2024-12-03 Tobias Schröder , Zijing Ou , Yingzhen Li , Andrew B. Duncan

Energy-based models (EBMs) provide a powerful and flexible way of learning a joint probability distribution over data by constructing an energy surface. This energy surface enables insight extraction and conditional sampling. We apply EBMs…

等离子体物理 · 物理学 2026-05-12 Phil Travis , Troy Carter

Deep neural networks (DNNs) often exhibit overconfidence when encountering out-of-distribution (OOD) samples, posing significant challenges for deployment. Since DNNs are trained on in-distribution (ID) datasets, the information flow of ID…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Guide Yang , Chao Hou , Weilong Peng , Xiang Fang , Yongwei Nie , Peican Zhu , Keke Tang
‹ 上一页 1 2 3 10 下一页 ›