中文
相关论文

相关论文: Revisiting Neural Activation Coverage for Uncertai…

200 篇论文

Deep neural networks have become the gold-standard approach for the automated segmentation of 3D medical images. Their full acceptance by clinicians remains however hampered by the lack of intelligible uncertainty assessment of the provided…

图像与视频处理 · 电气工程与系统科学 2022-09-23 Benjamin Lambert , Florence Forbes , Senan Doyle , Alan Tucholka , Michel Dojat

Estimating uncertainty from deep neural networks is a widely used approach for detecting out-of-distribution (OoD) samples, which typically exhibit high predictive uncertainty. However, conventional methods such as Monte Carlo (MC) Dropout…

计算机视觉与模式识别 · 计算机科学 2025-07-25 JinYoung Kim , DaeUng Jo , Kimin Yun , Jeonghyo Song , Youngjoon Yoo

We present neural activation coding (NAC) as a novel approach for learning deep representations from unlabeled data for downstream applications. We argue that the deep encoder should maximize its nonlinear expressivity on the data for…

机器学习 · 计算机科学 2021-12-09 Yookoon Park , Sangho Lee , Gunhee Kim , David M. Blei

Predictive uncertainty estimation remains a challenging problem precluding the use of deep neural networks as subsystems within safety-critical applications. Aleatoric uncertainty is a component of predictive uncertainty that cannot be…

机器学习 · 计算机科学 2023-12-12 Angel Daruna , Yunye Gong , Abhinav Rajvanshi , Han-Pang Chiu , Yi Yao

Out-of-distribution detection (OOD) is a crucial technique for deploying machine learning models in the real world to handle the unseen scenarios. In this paper, we first propose a simple yet effective Neural Activation Prior (NAP) for OOD…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Weilin Wan , Weizhong Zhang , Quan Zhou , Fan Yi , Cheng Jin

Neural networks are often utilised in critical domain applications (e.g. self-driving cars, financial markets, and aerospace engineering), even though they exhibit overconfident predictions for ambiguous inputs. This deficiency demonstrates…

机器学习 · 计算机科学 2023-01-03 John Mitros , Brian Mac Namee

As deep learning-based computer vision algorithms continue to advance the state of the art, their robustness to real-world data continues to be an issue, making it difficult to bring an algorithm from the lab to the real world.…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Michael Smith , Frank Ferrie

Inspired by recent advances in coverage-guided analysis of neural networks, we propose a novel anomaly detection method. We show that the hidden activation values contain information useful to distinguish between normal and anomalous…

密码学与安全 · 计算机科学 2021-02-25 Philip Sperl , Jan-Philipp Schulze , Konstantin Böttinger

Deep learning provides a powerful tool for machine perception when the observations resemble the training data. However, real-world robotic systems must react intelligently to their observations even in unexpected circumstances. This…

机器学习 · 计算机科学 2018-12-31 Rowan McAllister , Gregory Kahn , Jeff Clune , Sergey Levine

Dropout has been commonly used to quantify prediction uncertainty, i.e, the variations of model predictions on a given input example. However, using dropout in practice can be expensive as it requires running dropout inferences many times.…

机器学习 · 计算机科学 2022-06-20 Haichao Yu , Zhe Chen , Dong Lin , Gil Shamir , Jie Han

Understanding decisions made by neural networks is key for the deployment of intelligent systems in real world applications. However, the opaque decision making process of these systems is a disadvantage where interpretability is essential.…

机器学习 · 计算机科学 2023-04-12 Kai Fischer , Jonas Schneider

We explore the utility of information contained within a dropout based Bayesian neural network (BNN) for the task of detecting out of distribution (OOD) data. We first show how previous attempts to leverage the randomized embeddings induced…

机器学习 · 计算机科学 2022-02-21 Andre T. Nguyen , Fred Lu , Gary Lopez Munoz , Edward Raff , Charles Nicholas , James Holt

A key to deciphering the inner workings of neural networks is understanding what a model has learned. Promising methods for discovering learned features are based on analyzing activation values, whereby current techniques focus on analyzing…

机器学习 · 计算机科学 2022-06-23 Alex Bäuerle , Daniel Jönsson , Timo Ropinski

Uncertainty Sampling is an Active Learning strategy that aims to improve the data efficiency of machine learning models by iteratively acquiring labels of data points with the highest uncertainty. While it has proven effective for…

Traditional neural networks provide deterministic predictions without inherent uncertainty estimates. While Bayesian Neural Networks (BNNs) offer a principled approach to uncertainty quantification, their computational complexity limits…

机器学习 · 统计学 2026-05-25 Rouaa Hoblos , Noura Dridi , Noureddine Zerhouni , Zeina Al Masry

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

机器学习 · 计算机科学 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis

Existing uncertainty modeling approaches try to detect an out-of-distribution point from the in-distribution dataset. We extend this argument to detect finer-grained uncertainty that distinguishes between (a). certain points, (b). uncertain…

机器学习 · 计算机科学 2020-02-12 Rahul Soni , Naresh Shah , Jimmy D. Moore

We present a new method for uncertainty estimation and out-of-distribution detection in neural networks with softmax output. We extend softmax layer with an additional constant input. The corresponding additional output is able to represent…

机器学习 · 计算机科学 2019-04-09 Marcin Możejko , Mateusz Susik , Rafał Karczewski

The examination of uncertainty in the predictions of machine learning (ML) models is receiving increasing attention. One uncertainty modeling technique used for this purpose is Monte-Carlo (MC)-Dropout, where repeated predictions are…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Florian Heidecker , Ahmad El-Khateeb , Bernhard Sick

Neural cellular automata (NCA) provide a lightweight alternative to encoder-decoder segmentation networks. However, it can be difficult to decide when a prediction should be trusted. Here, we study uncertainty estimation for NCA-based…

图像与视频处理 · 电气工程与系统科学 2026-05-27 Ario Sadafi , Michael Deutges , Nassir Navab , Carsten Marr