English
Related papers

Related papers: Density-Informed Pseudo-Counts for Calibrated Evid…

200 papers

There is a significant need for principled uncertainty reasoning in machine learning systems as they are increasingly deployed in safety-critical domains. A new approach with uncertainty-aware regression-based neural networks (NNs), based…

Machine Learning · Computer Science 2023-07-21 Nis Meinert , Jakob Gawlikowski , Alexander Lavin

Deterministic neural nets have been shown to learn effective predictors on a wide range of machine learning problems. However, as the standard approach is to train the network to minimize a prediction loss, the resultant model remains…

Machine Learning · Computer Science 2018-11-02 Murat Sensoy , Lance Kaplan , Melih Kandemir

Popular approaches for quantifying predictive uncertainty in deep neural networks often involve distributions over weights or multiple models, for instance via Markov Chain sampling, ensembling, or Monte Carlo dropout. These techniques…

Machine Learning · Computer Science 2023-03-08 Dennis Ulmer , Christian Hardmeier , Jes Frellsen

Semi-supervised classification based on active learning has made significant progress, but the existing methods often ignore the uncertainty estimation (or reliability) of the prediction results during the learning process, which makes it…

Machine Learning · Computer Science 2025-05-28 Shenkai Zhao , Xinao Zhang , Lipeng Pan , Xiaobin Xu , Danilo Pelusi

Current methods commonly used for uncertainty quantification (UQ) in deep learning (DL) models utilize Bayesian methods which are computationally expensive and time-consuming. In this paper, we provide a detailed study of UQ based on…

High Energy Physics - Experiment · Physics 2025-01-13 Ayush Khot , Xiwei Wang , Avik Roy , Volodymyr Kindratenko , Mark S. Neubauer

Most named entity recognition (NER) systems focus on improving model performance, ignoring the need to quantify model uncertainty, which is critical to the reliability of NER systems in open environments. Evidential deep learning (EDL) has…

Computation and Language · Computer Science 2023-05-30 Zhen Zhang , Mengting Hu , Shiwan Zhao , Minlie Huang , Haotian Wang , Lemao Liu , Zhirui Zhang , Zhe Liu , Bingzhe Wu

Trustworthy ML systems should not only return accurate predictions, but also a reliable representation of their uncertainty. Bayesian methods are commonly used to quantify both aleatoric and epistemic uncertainty, but alternative…

Artificial Intelligence · Computer Science 2024-09-11 Mira Jürgens , Nis Meinert , Viktor Bengs , Eyke Hüllermeier , Willem Waegeman

Accurate quantification of both aleatoric and epistemic uncertainties is essential when deploying Graph Neural Networks (GNNs) in high-stakes applications such as drug discovery and financial fraud detection, where reliable predictions are…

Machine Learning · Computer Science 2025-03-12 Linlin Yu , Kangshuo Li , Pritom Kumar Saha , Yifei Lou , Feng Chen

Deterministic neural networks (NNs) are increasingly being deployed in safety critical domains, where calibrated, robust, and efficient measures of uncertainty are crucial. In this paper, we propose a novel method for training non-Bayesian…

Machine Learning · Computer Science 2020-11-25 Alexander Amini , Wilko Schwarting , Ava Soleimany , Daniela Rus

Autonomous and semi-autonomous systems are using deep learning models to improve decision-making. However, deep classifiers can be overly confident in their incorrect predictions, a major issue especially in safety-critical domains. The…

Machine Learning · Computer Science 2024-12-05 Murat Sensoy , Lance M. Kaplan , Simon Julier , Maryam Saleki , Federico Cerutti

Pretrained models have become standard in both vision and language, yet they typically do not provide reliable measures of confidence. Existing uncertainty estimation methods, such as deep ensembles and MC dropout, are often too…

Machine Learning · Computer Science 2026-04-13 Yongchan Chun , Chanhee Park , Jeongho Yoon , Jaehyung Seo , Heuiseok Lim

Deep neural networks (DNNs) have been shown to perform well on exclusive, multi-class classification tasks. However, when different classes have similar visual features, it becomes challenging for human annotators to differentiate them.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Changbin Li , Kangshuo Li , Yuzhe Ou , Lance M. Kaplan , Audun Jøsang , Jin-Hee Cho , Dong Hyun Jeong , Feng Chen

Existing semi-supervised medical segmentation co-learning frameworks have realized that model performance can be diminished by the biases in model recognition caused by low-quality pseudo-labels. Due to the averaging nature of their…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Yuanpeng He , Yali Bi , Lijian Li , Chi-Man Pun , Wenpin Jiao , Zhi Jin

Although more layers and more parameters generally improve the accuracy of the models, such big models generally have high computational complexity and require big memory, which exceed the capacity of small devices for inference and incurs…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-15 Ji Liu , Daxiang Dong , Xi Wang , An Qin , Xingjian Li , Patrick Valduriez , Dejing Dou , Dianhai Yu

Deep neural networks have significantly contributed to the success in predictive accuracy for classification tasks. However, they tend to make over-confident predictions in real-world settings, where domain shifting and out-of-distribution…

Artificial Intelligence · Computer Science 2021-07-16 Yibo Hu , Latifur Khan

We propose a novel method for closed-form predictive distribution modeling with neural nets. In quantifying prediction uncertainty, we build on Evidential Deep Learning, which has been impactful as being both simple to implement and giving…

Machine Learning · Statistics 2021-01-22 Manuel Haussmann , Sebastian Gerwinn , Melih Kandemir

We propose Evolutionary Dynamic Loss (EDL), a framework that learns a transferable classification loss in the probability space using unlimited synthetic prediction-label pairs, without accessing real samples during the main loss…

Machine Learning · Computer Science 2026-05-06 Meng Xiang , Yan Pei

With the widespread success of deep neural networks in science and technology, it is becoming increasingly important to quantify the uncertainty of the predictions produced by deep learning. In this paper, we introduce a new method that…

Machine Learning · Computer Science 2019-08-15 Qingyang Wu , He Li , Lexin Li , Zhou Yu

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

Machine Learning · Computer Science 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

In this work, we examine the effectiveness of an uncertainty quantification framework known as Evidential Deep Learning applied in the context of biomedical image segmentation. This class of models involves assigning Dirichlet distributions…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Hai Siong Tan , Kuancheng Wang , Rafe Mcbeth