中文
相关论文

相关论文: Morse Neural Networks for Uncertainty Quantificati…

200 篇论文

When the cost of misclassifying a sample is high, it is useful to have an accurate estimate of uncertainty in the prediction for that sample. There are also multiple types of uncertainty which are best estimated in different ways, for…

机器学习 · 计算机科学 2019-03-18 Richard Harang , Ethan M. Rudd

We present a new methodology for detecting out-of-distribution (OOD) images by utilizing norms of the score estimates at multiple noise scales. A score is defined to be the gradient of the log density with respect to the input data. Our…

机器学习 · 计算机科学 2021-03-24 Ahsan Mahmood , Junier Oliva , Martin Styner

Providing accurate uncertainty estimations is essential for producing reliable machine learning models, especially in safety-critical applications such as accelerator systems. Gaussian process models are generally regarded as the gold…

The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data. This work investigates whether this distribution moreover correlates with a model's epistemic uncertainty,…

Memory units have been widely used to enrich the capabilities of deep networks on capturing long-term dependencies in reasoning and prediction tasks, but little investigation exists on deep generative models (DGMs) which are good at…

机器学习 · 计算机科学 2016-05-31 Chongxuan Li , Jun Zhu , Bo Zhang

Deep neural networks (NNs) are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in NNs is a challenging and yet unsolved problem. Bayesian NNs,…

机器学习 · 统计学 2017-11-07 Balaji Lakshminarayanan , Alexander Pritzel , Charles Blundell

The quantification of uncertainty is important for the adoption of machine learning, especially to reject out-of-distribution (OOD) data back to human experts for review. Yet progress has been slow, as a balance must be struck between…

机器学习 · 计算机科学 2022-09-12 Derek Everett , Andre T. Nguyen , Luke E. Richards , Edward Raff

Estimating uncertainty from deep neural networks is a widely used approach for detecting out-of-distribution (OoD) samples, which typically exhibit high predictive uncertainty. However, conventional methods such as Monte Carlo (MC) Dropout…

计算机视觉与模式识别 · 计算机科学 2025-07-25 JinYoung Kim , DaeUng Jo , Kimin Yun , Jeonghyo Song , Youngjoon Yoo

Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this problem by developing an…

机器学习 · 计算机科学 2023-05-19 Luigi Sbailò , Luca M. Ghiringhelli

Deep neural networks have seen enormous success in various real-world applications. Beyond their predictions as point estimates, increasing attention has been focused on quantifying the uncertainty of their predictions. In this review, we…

机器学习 · 计算机科学 2023-02-06 Chengyu Dong

Deep Learning research is advancing at a fantastic rate, and there is much to gain from transferring this knowledge to older fields like Computational Fluid Dynamics in practical engineering contexts. This work compares state-of-the-art…

计算物理 · 物理学 2020-10-01 Pierre Jacquier , Azzedine Abdedou , Vincent Delmas , Azzeddine Soulaimani

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Out-of-distribution (OOD) detection is essential for reliable and trustworthy machine learning. Recent multi-modal OOD detection leverages textual information from in-distribution (ID) class names for visual OOD detection, yet it currently…

计算与语言 · 计算机科学 2023-10-13 Yi Dai , Hao Lang , Kaisheng Zeng , Fei Huang , Yongbin Li

Morden deep ensembles technique achieves strong uncertainty estimation performance by going through multiple forward passes with different models. This is at the price of a high storage space and a slow speed in the inference (test) time.…

机器学习 · 计算机科学 2024-03-13 Ha Manh Bui , Anqi Liu

When neural networks process images which do not resemble the distribution seen during training, so called out-of-distribution images, they often make wrong predictions, and do so too confidently. The capability to detect…

计算机视觉与模式识别 · 计算机科学 2018-12-13 Marc Masana , Idoia Ruiz , Joan Serrat , Joost van de Weijer , Antonio M. Lopez

Deep neural networks have significantly contributed to the success in predictive accuracy for classification tasks. However, they tend to make over-confident predictions in real-world settings, where domain shifting and out-of-distribution…

人工智能 · 计算机科学 2021-07-16 Yibo Hu , Latifur Khan

Standard machine learning is unable to accommodate inputs which do not belong to the training distribution. The resulting models often give rise to confident incorrect predictions which may lead to devastating consequences. This problem is…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Matej Grcić , Petra Bevandić , Zoran Kalafatić , Siniša Šegvić

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

机器学习 · 计算机科学 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Quantifying uncertainty in a model's predictions is important as it enables the safety of an AI system to be increased by acting on the model's output in an informed manner. This is crucial for applications where the cost of an error is…

计算机视觉与模式识别 · 计算机科学 2021-05-31 Aria Khoshsirat

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for…

机器学习 · 统计学 2023-12-14 Tomoharu Iwata , Atsutoshi Kumagai