中文
相关论文

相关论文: Out-of-Distribution Detection using Maximum Entrop…

200 篇论文

Recently proposed generative models for discrete data, such as Masked Diffusion Models (MDMs), exploit conditional independence approximations to reduce the computational cost of popular Auto-Regressive Models (ARMs), at the price of some…

机器学习 · 统计学 2025-12-18 Hugo Lavenant , Giacomo Zanella

Out-of-distribution (OOD) detection is a well-known challenge due to deep models often producing overconfident. In this paper, we reveal a key insight that trained classifiers tend to rely on sparse parameter contribution patterns, meaning…

机器学习 · 计算机科学 2026-03-10 Haonan Xu , Yang Yang

Previously referred to as `miraculous' in the scientific literature because of its powerful properties and its wide application as optimal solution to the problem of induction/inference, (approximations to) Algorithmic Probability (AP) and…

Commonly used AI networks are very self-confident in their predictions, even when the evidence for a certain decision is dubious. The investigation of a deep learning model output is pivotal for understanding its decision processes and…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Damian Matuszewski , Ida-Maria Sintorn

A crucial requirement for machine learning algorithms is not only to perform well, but also to show robustness and adaptability when encountering novel scenarios. One way to achieve these characteristics is to endow the deep learning models…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Eduardo Aguilar , Bogdan Raducanu , Petia Radeva

Distinguishing in- and out-of-distribution (OOD) inputs is crucial for reliable deployment of classification systems. However, OOD data is typically unavailable or difficult to collect, posing a significant challenge for accurate OOD…

计算与语言 · 计算机科学 2025-10-03 Momin Abbas , Muneeza Azmat , Raya Horesh , Mikhail Yurochkin

In monocular depth estimation, uncertainty estimation approaches mainly target the data uncertainty introduced by image noise. In contrast to prior work, we address the uncertainty due to lack of knowledge, which is relevant for the…

计算机视觉与模式识别 · 计算机科学 2023-08-14 Julia Hornauer , Adrian Holzbock , Vasileios Belagiannis

Cyber-physical systems (CPS) greatly benefit by using machine learning components that can handle the uncertainty and variability of the real-world. Typical components such as deep neural networks, however, introduce new types of hazards…

机器学习 · 计算机科学 2020-01-29 Feiyang Cai , Xenofon Koutsoukos

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…

机器学习 · 统计学 2024-12-04 Wuyue Yang , Liangrong Peng , Guojie Li , Liu Hong

We present an analysis of predictive uncertainty based out-of-distribution detection for different approaches to estimate various models' epistemic uncertainty and contrast it with extreme value theory based open set recognition. While the…

机器学习 · 计算机科学 2019-08-27 Martin Mundt , Iuliia Pliushch , Sagnik Majumder , Visvanathan Ramesh

In this work, we propose CODE, an extension of existing work from the field of explainable AI that identifies class-specific recurring patterns to build a robust Out-of-Distribution (OoD) detection method for visual classifiers. CODE does…

计算机视觉与模式识别 · 计算机科学 2023-11-23 Romain Xu-Darme , Julien Girard-Satabin , Darryl Hond , Gabriele Incorvaia , Zakaria Chihani

Deep neural networks for image classification only learn to map in-distribution inputs to their corresponding ground truth labels in training without differentiating out-of-distribution samples from in-distribution ones. This results from…

机器学习 · 计算机科学 2023-08-29 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

Out-of-Distribution (OoD) inputs are examples that do not belong to the true underlying distribution of the dataset. Research has shown that deep neural nets make confident mispredictions on OoD inputs. Therefore, it is critical to identify…

机器学习 · 计算机科学 2022-05-10 Deepak Ravikumar , Kaushik Roy

Anomalies are strange data points; they usually represent an unusual occurrence. Anomaly detection is presented from the perspective of Wireless sensor networks. Different approaches have been taken in the past, as we will see, not only to…

机器学习 · 计算机科学 2017-08-30 Pelumi Oluwasanya

We consider nonparametric or universal sequential hypothesis testing problem when the distribution under the null hypothesis is fully known but the alternate hypothesis corresponds to some other unknown distribution. These algorithms are…

信息论 · 计算机科学 2013-08-30 Jithin K. Sreedharan , Vinod Sharma

Deep neural networks (DNNs) often exhibit overconfidence when encountering out-of-distribution (OOD) samples, posing significant challenges for deployment. Since DNNs are trained on in-distribution (ID) datasets, the information flow of ID…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Guide Yang , Chao Hou , Weilong Peng , Xiang Fang , Yongwei Nie , Peican Zhu , Keke Tang

Deep neural networks are known to be overconfident when applied to out-of-distribution (OOD) inputs which clearly do not belong to any class. This is a problem in safety-critical applications since a reliable assessment of the uncertainty…

机器学习 · 计算机科学 2021-03-11 Julian Bitterwolf , Alexander Meinke , Matthias Hein

It is well known that computer vision can be unreliable when faced with previously unseen imaging conditions. This paper proposes a method to adapt camera parameters according to a normalizing flow-based out-of-distibution detector. A…

计算机视觉与模式识别 · 计算机科学 2023-05-17 Simon Kristoffersson Lind , Rudolph Triebel , Luigi Nardi , Volker Krueger

Out-of-distribution (OOD) detection is a critical task to ensure the reliability and security of machine learning models deployed in real-world applications. Conventional methods for OOD detection that rely on single-modal information,…

计算机视觉与模式识别 · 计算机科学 2024-03-21 K Huang , G Song , Hanwen Su , Jiyan Wang

A new method for outlier detection and generation is introduced by lifting data into the space of probability distributions which are not analytically expressible, but from which samples can be drawn using a neural generator. Given a…

机器学习 · 计算机科学 2020-12-24 Stefano Giovanni Rizzo , Linsey Pang , Yixian Chen , Sanjay Chawla