中文
相关论文

相关论文: Out-of-Distribution Detection using Maximum Entrop…

200 篇论文

When presented with Out-of-Distribution (OOD) examples, deep neural networks yield confident, incorrect predictions. Detecting OOD examples is challenging, and the potential risks are high. In this paper, we propose to detect OOD examples…

机器学习 · 计算机科学 2020-01-10 Chandramouli Shama Sastry , Sageev Oore

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

We present simple methods for out-of-distribution detection using a trained generative model. These techniques, based on classical statistical tests, are model-agnostic in the sense that they can be applied to any differentiable generative…

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

机器学习 · 计算机科学 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has considerable real-world applications. One of the most mainstream methods is to extract the invariant subgraph by aligning…

机器学习 · 计算机科学 2024-07-23 Xuexin Chen , Ruichu Cai , Kaitao Zheng , Zhifan Jiang , Zhengting Huang , Zhifeng Hao , Zijian Li

How to find unknown distributions is questioned in many pieces of research. There are several ways to figure them out, but the main question is which acts more reasonably than others. In this paper, we focus on the maximum entropy principle…

其他统计学 · 统计学 2023-07-26 Seyedeh Azadeh Fallah Mortezanejad

Out-of-distribution (OOD) detection is a critical task for ensuring the reliability and safety of deep neural networks in real-world scenarios. Different from most previous OOD detection methods that focus on designing OOD scores or…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Yao Zhu , YueFeng Chen , Chuanlong Xie , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , bolun zheng , Yaowu Chen

We consider the two related problems of detecting if an example is misclassified or out-of-distribution. We present a simple baseline that utilizes probabilities from softmax distributions. Correctly classified examples tend to have greater…

神经与进化计算 · 计算机科学 2018-10-04 Dan Hendrycks , Kevin Gimpel

Consider the set of source distributions within a fixed maximum relative entropy with respect to a given nominal distribution. Lossless source coding over this relative entropy ball can be approached in more than one way. A problem…

信息论 · 计算机科学 2011-05-03 Michael B. Baer , Farzad Rezaei , Charalambos D. Charalambous

Despite the significant research efforts on trajectory prediction for automated driving, limited work exists on assessing the prediction reliability. To address this limitation we propose an approach that covers two sources of error, namely…

机器人学 · 计算机科学 2023-08-07 Julian Wiederer , Julian Schmidt , Ulrich Kressel , Klaus Dietmayer , Vasileios Belagiannis

This paper proposes a new method of bandwidth selection in kernel estimation of density and distribution functions motivated by the connection between maximisation of the entropy of probability integral transforms and maximum likelihood in…

统计方法学 · 统计学 2016-07-14 Vitaliy Oryshchenko

To facilitate reliable deployments of autonomous robots in the real world, Out-of-Distribution (OOD) detection capabilities are often required. A powerful approach for OOD detection is based on density estimation with Normalizing Flows…

机器人学 · 计算机科学 2023-11-14 Jianxiang Feng , Jongseok Lee , Simon Geisler , Stephan Gunnemann , Rudolph Triebel

In recent years, deep neural networks have defined the state-of-the-art in semantic segmentation where their predictions are constrained to a predefined set of semantic classes. They are to be deployed in applications such as automated…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Kira Maag , Tobias Riedlinger

The following detection problem is studied, in which there are $M$ sequences of samples out of which one outlier sequence needs to be detected. Each typical sequence contains $n$ independent and identically distributed (i.i.d.) continuous…

信息论 · 计算机科学 2015-10-08 Yuheng Bu , Shaofeng Zou , Yingbin Liang , Venugopal V. Veeravalli

This paper introduces a novel approach to securing machine learning model deployments against potential distribution shifts in practical applications, the Total Variation Out-of-Distribution (TV-OOD) detection method. Existing methods have…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Dabiao Ma , Zhiba Su , Jian Yang , Haojun Fei

We consider the topic of universal decoding with a decoder that does not have direct access to the codebook, but only to noisy versions of the various randomly generated codewords, a problem motivated by biometrical identification systems.…

信息论 · 计算机科学 2016-09-05 Neri Merhav

Out-of-Distribution (OOD) detection, i.e., identifying whether an input is sampled from a novel distribution other than the training distribution, is a critical task for safely deploying machine learning systems in the open world. Recently,…

机器学习 · 计算机科学 2023-01-13 Feng Xue , Zi He , Chuanlong Xie , Falong Tan , Zhenguo Li

Out-of-distribution (OOD) data poses serious challenges in deployed machine learning models as even subtle changes could incur significant performance drops. Being able to estimate a model's performance on test data is important in practice…

机器学习 · 计算机科学 2023-02-13 Yuzhe Lu , Zhenlin Wang , Runtian Zhai , Soheil Kolouri , Joseph Campbell , Katia Sycara

Consider a sequence $X^n$ of length $n$ emitted by a Discrete Memoryless Source (DMS) with unknown distribution $p_X$. The objective is to construct a lossless source code that maps $X^n$ to a sequence $\widehat{Y}^m$ of length $m$ that is…

信息论 · 计算机科学 2021-06-21 Remi A. Chou , Matthieu R. Bloch , Aylin Yener

Given two discrete random variables $X$ and $Y$, with probability distributions ${\bf p} =(p_1, \ldots , p_n)$ and ${\bf q}=(q_1, \ldots , q_m)$, respectively, denote by ${\cal C}({\bf p}, {\bf q})$ the set of all couplings of ${\bf p}$ and…

信息论 · 计算机科学 2017-03-29 Ferdinando Cicalese , Luisa Gargano , Ugo Vaccaro