English
Related papers

Related papers: Nonlinear Amplification of Finite-Sample Uncertain…

200 papers

Effectively measuring and modeling the reliability of a trained model is essential to the real-world deployment of monocular depth estimation (MDE) models. However, the intrinsic ill-posedness and ordinal-sensitive nature of MDE pose major…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Mochu Xiang , Jing Zhang , Nick Barnes , Yuchao Dai

In a data-scarce field such as healthcare, where models often deliver predictions on patients with rare conditions, the ability to measure the uncertainty of a model's prediction could potentially lead to improved effectiveness of decision…

Machine Learning · Statistics 2020-05-26 Lotta Meijerink , Giovanni Cinà , Michele Tonutti

In the context of industrially mass-manufactured products, quality management is based on physically inspecting a small sample from a large batch and reasoning about the batch's quality conformance. When complementing physical inspections…

Applications · Statistics 2024-02-22 Simon Cramer , Tobias Müller , Robert H. Schmitt

This paper deals with nonlinear mechanics of an elevator brake system subjected to uncertainties. A deterministic model that relates the braking force with uncertain parameters is deduced from mechanical equilibrium conditions. In order to…

Computational Engineering, Finance, and Science · Computer Science 2024-09-30 Piotr Wolszczak , Pawel Lonkwic , Americo Cunha , Grzegorz Litak , Szymon Molski

We present a sampling-free approach for computing the epistemic uncertainty of a neural network. Epistemic uncertainty is an important quantity for the deployment of deep neural networks in safety-critical applications, since it represents…

Machine Learning · Computer Science 2019-12-04 Janis Postels , Francesco Ferroni , Huseyin Coskun , Nassir Navab , Federico Tombari

Computational models support high-stakes decisions across engineering and science, and practitioners increasingly seek probabilistic predictions to quantify uncertainty in such models. Existing approaches generate predictions either by…

Computational Engineering, Finance, and Science · Computer Science 2026-04-13 Rileigh Bandy , Enrico Camporeale , Andong Hu , Thomas Berger , Rebecca Morrison

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying…

Using Machine Learning systems in the real world can often be problematic, with inexplicable black-box models, the assumed certainty of imperfect measurements, or providing a single classification instead of a probability distribution. This…

Machine Learning · Computer Science 2023-07-11 Jonathan S. Kent , David H. Menager

While the accuracy of modern deep learning models has significantly improved in recent years, the ability of these models to generate uncertainty estimates has not progressed to the same degree. Uncertainty methods are designed to provide…

Machine Learning · Statistics 2020-06-17 Adam M. Oberman , Chris Finlay , Alexander Iannantuono , Tiago Salvador

Bayesian model comparison (BMC) offers a principled probabilistic approach to study and rank competing models. In standard BMC, we construct a discrete probability distribution over the set of possible models, conditional on the observed…

Machine Learning · Statistics 2023-02-22 Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

We present a method of parameter estimation for large class of nonlinear systems, namely those in which the state consists of output derivatives and the flow is linear in the parameter. The method, which solves for the unknown parameter by…

Systems and Control · Electrical Eng. & Systems 2024-07-16 Simon Kuang , Xinfan Lin

Accurately estimating semantic aleatoric and epistemic uncertainties in large language models (LLMs) is particularly challenging in free-form question answering (QA), where obtaining stable estimates often requires many expensive…

Computation and Language · Computer Science 2026-01-26 Ji Won Park , Kyunghyun Cho

Data-driven modeling is useful for reconstructing nonlinear dynamical systems when the underlying process is unknown or too expensive to compute. Having reliable uncertainty assessment of the forecast enables tools to be deployed to predict…

Methodology · Statistics 2023-11-01 Mengyang Gu , Yizi Lin , Victor Chang Lee , Diana Qiu

Nowadays, the use of machine learning models is becoming a utility in many applications. Companies deliver pre-trained models encapsulated as application programming interfaces (APIs) that developers combine with third party components and…

Machine Learning · Computer Science 2020-01-01 José Mena , Oriol Pujol , Jordi Vitrià

The consideration of predictive uncertainty in medical imaging with deep learning is of utmost importance. We apply estimation of both aleatoric and epistemic uncertainty by variational Bayesian inference with Monte Carlo dropout to…

Image and Video Processing · Electrical Eng. & Systems 2021-04-27 Max-Heinrich Laves , Sontje Ihler , Jacob F. Fast , Lüder A. Kahrs , Tobias Ortmaier

Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators. However, they are often overconfident in their predictions, which leads to inaccurate and miscalibrated…

Machine Learning · Computer Science 2021-02-23 Jeffrey Willette , Juho Lee , Sung Ju Hwang

Subjective judgements from experts provide essential information when assessing and modelling threats in respect to cyber-physical systems. For example, the vulnerability of individual system components can be described using multiple…

Cryptography and Security · Computer Science 2019-10-03 Zack Ellerby , Josie McCulloch , Melanie Wilson , Christian Wagner

Sublinear expectations for uncertain processes have received a lot of attention recently, particularly methods to extend a downward-continuous sublinear expectation on the bounded finitary functions to one on the non-finitary functions. In…

Probability · Mathematics 2023-05-05 Alexander Erreygers

As neural networks become more popular, the need for accompanying uncertainty estimates increases. There are currently two main approaches to test the quality of these estimates. Most methods output a density. They can be compared by…

Machine Learning · Statistics 2024-06-05 Laurens Sluijterman , Eric Cator , Tom Heskes

Predictive uncertainties in classification tasks are often a consequence of model inadequacy or insufficient training data. In popular applications, such as image processing, we are often required to scrutinise these uncertainties by…

Machine Learning · Computer Science 2022-11-10 Iker Perez , Piotr Skalski , Alec Barns-Graham , Jason Wong , David Sutton