中文
相关论文

相关论文: Logit Disagreement: OoD Detection with Bayesian Ne…

200 篇论文

Quantifying predictive uncertainty of neural networks has recently attracted increasing attention. In this work, we focus on measuring uncertainty of graph neural networks (GNNs) for the task of node classification. Most existing GNNs model…

机器学习 · 计算机科学 2023-04-04 Zhao Xu , Carolin Lawrence , Ammar Shaker , Raman Siarheyeu

Estimating uncertainty from deep neural networks is a widely used approach for detecting out-of-distribution (OoD) samples, which typically exhibit high predictive uncertainty. However, conventional methods such as Monte Carlo (MC) Dropout…

计算机视觉与模式识别 · 计算机科学 2025-07-25 JinYoung Kim , DaeUng Jo , Kimin Yun , Jeonghyo Song , Youngjoon Yoo

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

机器学习 · 统计学 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

The superior performance of object detectors is often established under the condition that the test samples are in the same distribution as the training data. However, in many practical applications, out-of-distribution (OOD) instances are…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Tianhao Zhang , Shenglin Wang , Nidhal Bouaynaya , Radu Calinescu , Lyudmila Mihaylova

Predictive uncertainty estimation is an essential next step for the reliable deployment of deep object detectors in safety-critical tasks. In this work, we focus on estimating predictive distributions for bounding box regression output with…

计算机视觉与模式识别 · 计算机科学 2021-03-15 Ali Harakeh , Steven L. Waslander

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

机器学习 · 计算机科学 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause

Learning with noisy labels (LNL) is typically benchmarked by closed-set classification accuracy, yet deployment often requires classifiers to reject out-of-distribution (OOD) inputs. We present a learner-agnostic ACC-OOD benchmark that…

机器学习 · 计算机科学 2026-05-19 Ningkang Peng , Jingyang Mao , Runhan Zhou , Peirong Ma , Yanhui Gu

Uncertainty awareness is crucial to develop reliable machine learning models. In this work, we propose the Natural Posterior Network (NatPN) for fast and high-quality uncertainty estimation for any task where the target distribution belongs…

机器学习 · 计算机科学 2022-03-17 Bertrand Charpentier , Oliver Borchert , Daniel Zügner , Simon Geisler , Stephan Günnemann

Deep neural networks (DNNs) provide state-of-the-art results for a multitude of applications, but the approaches using DNNs for multimodal audiovisual applications do not consider predictive uncertainty associated with individual…

神经与进化计算 · 计算机科学 2019-09-23 Mahesh Subedar , Ranganath Krishnan , Paulo Lopez Meyer , Omesh Tickoo , Jonathan Huang

Deep Ensembles, as a type of Bayesian Neural Networks, can be used to estimate uncertainty on the prediction of multiple neural networks by collecting votes from each network and computing the difference in those predictions. In this paper,…

机器学习 · 计算机科学 2023-07-10 Illia Oleksiienko , Alexandros Iosifidis

Out-of-Domain (OOD) detection is a key component in a task-oriented dialog system, which aims to identify whether a query falls outside the predefined supported intent set. Previous softmax-based detection algorithms are proved to be…

计算与语言 · 计算机科学 2022-09-15 Yanan Wu , Zhiyuan Zeng , Keqing He , Yutao Mou , Pei Wang , Weiran Xu

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

机器学习 · 计算机科学 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

计算机视觉与模式识别 · 计算机科学 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

We introduce a probabilistic robustness measure for Bayesian Neural Networks (BNNs), defined as the probability that, given a test point, there exists a point within a bounded set such that the BNN prediction differs between the two. Such a…

机器学习 · 计算机科学 2019-03-06 Luca Cardelli , Marta Kwiatkowska , Luca Laurenti , Nicola Paoletti , Andrea Patane , Matthew Wicker

Neural network potentials (NNPs) combine the computational efficiency of classical interatomic potentials with the high accuracy and flexibility of the ab initio methods used to create the training set, but can also result in unphysical…

材料科学 · 物理学 2022-01-24 Leonid Kahle , Federico Zipoli

Ensemble learning is a standard approach to building machine learning systems that capture complex phenomena in real-world data. An important aspect of these systems is the complete and valid quantification of model uncertainty. We…

机器学习 · 计算机科学 2019-11-12 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent Coull

Uncertainty quantification and robustness to distribution shifts are important goals in machine learning and artificial intelligence. Although Bayesian Neural Networks (BNNs) allow for uncertainty in the predictions to be assessed,…

机器学习 · 计算机科学 2024-10-23 Michele Caprio , Souradeep Dutta , Kuk Jin Jang , Vivian Lin , Radoslav Ivanov , Oleg Sokolsky , Insup Lee

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

机器学习 · 计算机科学 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

Deep neural networks (DNNs) have received tremendous attention and achieved great success in various applications, such as image and video analysis, natural language processing, recommendation systems, and drug discovery. However, inherent…

机器学习 · 计算机科学 2023-04-21 Xujiang Zhao

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

图像与视频处理 · 电气工程与系统科学 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi