中文
相关论文

相关论文: Dropout Prediction Uncertainty Estimation Using Ne…

200 篇论文

Cognitive diagnosis models have been widely used in different areas, especially intelligent education, to measure users' proficiency levels on knowledge concepts, based on which users can get personalized instructions. As the measurement is…

计算机与社会 · 计算机科学 2024-03-25 Fei Wang , Qi Liu , Enhong Chen , Chuanren Liu , Zhenya Huang , Jinze Wu , Shijin Wang

We introduce a new, reliable, and agnostic uncertainty measure for classification tasks called logit uncertainty. It is based on logit outputs of neural networks. We in particular show that this new uncertainty measure yields a superior…

机器学习 · 计算机科学 2021-07-08 Huiyu Wu , Diego Klabjan

We present a sampling-free approach for computing the epistemic uncertainty of a neural network. Epistemic uncertainty is an important quantity for the deployment of deep neural networks in safety-critical applications, since it represents…

机器学习 · 计算机科学 2019-12-04 Janis Postels , Francesco Ferroni , Huseyin Coskun , Nassir Navab , Federico Tombari

The examination of uncertainty in the predictions of machine learning (ML) models is receiving increasing attention. One uncertainty modeling technique used for this purpose is Monte-Carlo (MC)-Dropout, where repeated predictions are…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Florian Heidecker , Ahmad El-Khateeb , Bernhard Sick

Reliable uncertainty quantification in deep neural networks is very crucial in safety-critical applications such as automated driving for trustworthy and informed decision-making. Assessing the quality of uncertainty estimates is…

计算机视觉与模式识别 · 计算机科学 2022-12-12 Neslihan Kose , Ranganath Krishnan , Akash Dhamasia , Omesh Tickoo , Michael Paulitsch

As deep neural networks (DNNs) are applied to increasingly challenging problems, they will need to be able to represent their own uncertainty. Modeling uncertainty is one of the key features of Bayesian methods. Using Bernoulli dropout with…

机器学习 · 计算机科学 2019-09-19 Patrick McClure , Nikolaus Kriegeskorte

We evaluate the uncertainty quality in neural networks using anomaly detection. We extract uncertainty measures (e.g. entropy) from the predictions of candidate models, use those measures as features for an anomaly detector, and gauge how…

机器学习 · 统计学 2016-12-26 Ramon Oliveira , Pedro Tabacof , Eduardo Valle

Recent work introduced the epinet as a new approach to uncertainty modeling in deep learning. An epinet is a small neural network added to traditional neural networks, which, together, can produce predictive distributions. In particular,…

Recurrent neural network based solutions are increasingly being used in the analysis of longitudinal Electronic Health Record data. However, most works focus on prediction accuracy and neglect prediction uncertainty. We propose Deep Kernel…

机器学习 · 计算机科学 2021-07-27 Zhiliang Wu , Yinchong Yang , Peter A. Fasching , Volker Tresp

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

机器学习 · 计算机科学 2024-01-17 Soyed Tuhin Ahmed

Supporting model interpretability for complex phenomena where annotators can legitimately disagree, such as emotion recognition, is a challenging machine learning task. In this work, we show that explicitly quantifying the uncertainty in…

机器学习 · 计算机科学 2019-10-08 Asma Ghandeharioun , Brian Eoff , Brendan Jou , Rosalind W. Picard

Predictive multiplicity refers to the phenomenon in which classification tasks may admit multiple competing models that achieve almost-equally-optimal performance, yet generate conflicting outputs for individual samples. This presents…

机器学习 · 计算机科学 2024-02-02 Hsiang Hsu , Guihong Li , Shaohan Hu , Chun-Fu , Chen

During training, the weights of a Deep Neural Network (DNN) are optimized from a random initialization towards a nearly optimum value minimizing a loss function. Only this final state of the weights is typically kept for testing, while the…

机器学习 · 计算机科学 2021-03-26 Gianni Franchi , Andrei Bursuc , Emanuel Aldea , Severine Dubuisson , Isabelle Bloch

Popular approaches for quantifying predictive uncertainty in deep neural networks often involve distributions over weights or multiple models, for instance via Markov Chain sampling, ensembling, or Monte Carlo dropout. These techniques…

机器学习 · 计算机科学 2023-03-08 Dennis Ulmer , Christian Hardmeier , Jes Frellsen

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

机器学习 · 统计学 2025-12-22 Yuli Slavutsky , David M. Blei

Deep neural networks (DNNs) have successfully learned useful data representations in various tasks. However, assessing the reliability of these representations remains a challenge. Deep Ensemble is widely considered the state-of-the-art…

机器学习 · 计算机科学 2021-10-29 Yufeng Xia , Jun Zhang , Zhiqiang Gong , Tingsong Jiang , Wen Yao

Optical flow estimation can be formulated as an end-to-end supervised learning problem, which yields estimates with a superior accuracy-runtime tradeoff compared to alternative methodology. In this paper, we make such networks estimate…

计算机视觉与模式识别 · 计算机科学 2018-12-21 Eddy Ilg , Özgün Çiçek , Silvio Galesso , Aaron Klein , Osama Makansi , Frank Hutter , Thomas Brox

As deep learning-based computer vision algorithms continue to advance the state of the art, their robustness to real-world data continues to be an issue, making it difficult to bring an algorithm from the lab to the real world.…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Michael Smith , Frank Ferrie

The inputs of deep neural network (DNN) from real-world data usually come with uncertainties. Yet, it is challenging to propagate the uncertainty in the input features to the DNN predictions at a low computational cost. This work employs a…

机器学习 · 统计学 2020-01-14 Weiqi Ji , Zhuyin Ren , Chung K. Law

The predictive power of neural networks often costs model interpretability. Several techniques have been developed for explaining model outputs in terms of input features; however, it is difficult to translate such interpretations into…

机器学习 · 计算机科学 2017-08-17 Benjamin J. Lengerich , Sandeep Konam , Eric P. Xing , Stephanie Rosenthal , Manuela Veloso