中文
相关论文

相关论文: Out-of-Distribution Detection using Maximum Entrop…

200 篇论文

Discriminatively trained neural classifiers can be trusted, only when the input data comes from the training distribution (in-distribution). Therefore, detecting out-of-distribution (OOD) samples is very important to avoid classification…

This paper proposes a novel fast online methodology for outlier detection called the exception maximization outlier detection method(EMODM), which employs probabilistic models and statistical algorithms to detect abnormal patterns from the…

机器学习 · 统计学 2025-06-03 Zhikun Zhang , Yiting Duan , Xiangjun Wang , Mingyuan Zhang

Out-of-distribution data and anomalous inputs are vulnerabilities of machine learning systems today, often causing systems to make incorrect predictions. The diverse range of data on which these models are used makes detecting atypical…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Laura O'Mahony , David JP O'Sullivan , Nikola S. Nikolov

Despite rapid advances in AI, safety remains the main bottleneck to deploying machine-learning systems. A critical safety component is out-of-distribution detection: given an input, decide whether it comes from the same distribution as the…

机器学习 · 计算机科学 2025-11-06 Joonas Järve , Karl Kaspar Haavel , Meelis Kull

Deep neural network, despite its remarkable capability of discriminating targeted in-distribution samples, shows poor performance on detecting anomalous out-of-distribution data. To address this defect, state-of-the-art solutions choose to…

计算机视觉与模式识别 · 计算机科学 2022-08-30 Boxi Wu , Jie Jiang , Haidong Ren , Zifan Du , Wenxiao Wang , Zhifeng Li , Deng Cai , Xiaofei He , Binbin Lin , Wei Liu

Our work investigates out-of-distribution (OOD) detection as a neural network output explanation problem. We learn a heatmap representation for detecting OOD images while visualizing in- and out-of-distribution image regions at the same…

计算机视觉与模式识别 · 计算机科学 2023-08-14 Julia Hornauer , Vasileios Belagiannis

From the output produced by a memoryless deletion channel from a uniformly random input of known length $n$, one obtains a posterior distribution on the channel input. The difference between the Shannon entropy of this distribution and that…

信息论 · 计算机科学 2018-08-01 Arash Atashpendar , David Mestel , A. W. Roscoe , Peter Y. A. Ryan

Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typically lack a…

机器学习 · 统计学 2022-06-09 Mingtian Zhang , Andi Zhang , Tim Z. Xiao , Yitong Sun , Steven McDonagh

The Principle of Maximum Entropy is a rigorous technique for estimating an unknown distribution given partial information while simultaneously minimizing bias. However, an important requirement for applying the principle is that the…

信息论 · 计算机科学 2026-02-03 Kenneth Bogert , Matthew Kothe

Discriminative neural networks offer little or no performance guarantees when deployed on data not generated by the same process as the training distribution. On such out-of-distribution (OOD) inputs, the prediction may not only be…

Out-of-distribution (OOD) detection is crucial to safety-critical machine learning applications and has been extensively studied. While recent studies have predominantly focused on classifier-based methods, research on deep generative model…

机器学习 · 计算机科学 2024-02-19 Genki Osada , Tsubasa Takahashi , Takashi Nishide

Despite their successes, deep neural networks may make unreliable predictions when faced with test data drawn from a distribution different to that of the training data, constituting a major problem for AI safety. While this has recently…

机器学习 · 计算机科学 2020-07-16 Erik Daxberger , José Miguel Hernández-Lobato

A nonparametric anomalous hypothesis testing problem is investigated, in which there are totally n sequences with s anomalous sequences to be detected. Each typical sequence contains m independent and identically distributed (i.i.d.)…

机器学习 · 计算机科学 2016-12-15 Shaofeng Zou , Yingbin Liang , H. Vincent Poor , Xinghua Shi

Estimating uncertainty from deep neural networks is a widely used approach for detecting out-of-distribution (OoD) samples, which typically exhibit high predictive uncertainty. However, conventional methods such as Monte Carlo (MC) Dropout…

计算机视觉与模式识别 · 计算机科学 2025-07-25 JinYoung Kim , DaeUng Jo , Kimin Yun , Jeonghyo Song , Youngjoon Yoo

Detecting out-of-distribution (OOD) data at inference time is crucial for many applications of machine learning. We present XOOD: a novel extreme value-based OOD detection framework for image classification that consists of two algorithms.…

Deep generative models have been demonstrated as state-of-the-art density estimators. Yet, recent work has found that they often assign a higher likelihood to data from outside the training distribution. This seemingly paradoxical behavior…

机器学习 · 计算机科学 2022-01-19 Jakob D. Havtorn , Jes Frellsen , Søren Hauberg , Lars Maaløe

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

机器学习 · 统计学 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

Masked Diffusion Models (MDMs) offer flexible, non-autoregressive generation, but this freedom introduces a challenge: final output quality is highly sensitive to the decoding order. We are the first to formalize this issue, attributing the…

计算与语言 · 计算机科学 2025-12-25 Ziyu Chen , Xinbei Jiang , Peng Sun , Tao Lin

This work focuses on off-policy evaluation (OPE) with function approximation in infinite-horizon undiscounted Markov decision processes (MDPs). For MDPs that are ergodic and linear (i.e. where rewards and dynamics are linear in some known…

机器学习 · 计算机科学 2020-06-24 Nevena Lazic , Dong Yin , Mehrdad Farajtabar , Nir Levine , Dilan Gorur , Chris Harris , Dale Schuurmans

Unsupervised out-of-distribution (U-OOD) detection is to identify OOD data samples with a detector trained solely on unlabeled in-distribution (ID) data. The likelihood function estimated by a deep generative model (DGM) could be a natural…

机器学习 · 统计学 2024-09-09 Yewen Li , Chaojie Wang , Xiaobo Xia , Xu He , Ruyi An , Dong Li , Tongliang Liu , Bo An , Xinrun Wang