English
Related papers

Related papers: Probabilistic Neighbourhood Component Analysis: Sa…

200 papers

Uncertainty quantification is an important part of many performance critical applications. This paper provides a simple alternative to existing approaches such as ensemble learning and bayesian neural networks. By directly modeling the loss…

Machine Learning · Computer Science 2024-08-28 Yi Hung Lim

Characterizing uncertainty is a common issue in nuclear measurement and has important implications for reliable physical discovery. Traditional methods are either insufficient to cope with the heterogeneous nature of uncertainty or…

Data Analysis, Statistics and Probability · Physics 2022-03-01 Pengcheng Ai , Zhi Deng , Yi Wang , Chendi Shen

Uncertainty Quantification aims to determine when the prediction from a Machine Learning model is likely to be wrong. Computer Vision research has explored methods for determining epistemic uncertainty (also known as model uncertainty),…

Machine Learning · Computer Science 2024-03-15 Prithviraj Manivannan , Ivo Pascal de Jong , Matias Valdenegro-Toro , Andreea Ioana Sburlea

Computational chemistry has come a long way over the course of several decades, enabling subatomic level calculations particularly with the development of Density Functional Theory (DFT). Recently, machine-learned potentials (MLP) have…

We develop a novel deep learning method for uncertainty quantification in stochastic partial differential equations based on Bayesian neural network (BNN) and Hamiltonian Monte Carlo (HMC). A BNN efficiently learns the posterior…

Machine Learning · Statistics 2022-10-24 Jeahan Jung , Minseok Choi

Neural network potentials (NNPs) combine the computational efficiency of classical interatomic potentials with the high accuracy and flexibility of the ab initio methods used to create the training set, but can also result in unphysical…

Materials Science · Physics 2022-01-24 Leonid Kahle , Federico Zipoli

Ensembles of neural networks (NNs) have long been used to estimate predictive uncertainty; a small number of NNs are trained from different initialisations and sometimes on differing versions of the dataset. The variance of the ensemble's…

Machine Learning · Computer Science 2018-11-30 Tim Pearce , Mohamed Zaki , Andy Neely

Probabilistic convolutional neural networks, which predict distributions of predictions instead of point estimates, led to recent advances in many areas of computer vision, from image reconstruction to semantic segmentation. Besides state…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Josef Lorenz Rumberger , Lisa Mais , Dagmar Kainmueller

When using the K-nearest neighbors method, one often ignores uncertainty in the choice of K. To account for such uncertainty, Holmes and Adams (2002) proposed a Bayesian framework for K-nearest neighbors (KNN). Their Bayesian KNN (BKNN)…

Machine Learning · Statistics 2008-04-09 Wanhua Su , Hugh Chipman , Mu Zhu

When employing deep neural networks (DNNs) for semantic segmentation in safety-critical applications like automotive perception or medical imaging, it is important to estimate their performance at runtime, e.g. via uncertainty estimates or…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Edgar Heinert , Stephan Tilgner , Timo Palm , Matthias Rottmann

Reliable uncertainty quantification on RUL prediction is crucial for informative decision-making in predictive maintenance. In this context, we assess some of the latest developments in the field of uncertainty quantification for…

Machine Learning · Computer Science 2023-02-10 Luis Basora , Arthur Viens , Manuel Arias Chao , Xavier Olive

Probabilistic k-nearest neighbour (PKNN) classification has been introduced to improve the performance of original k-nearest neighbour (KNN) classification algorithm by explicitly modelling uncertainty in the classification of each feature…

Machine Learning · Computer Science 2013-05-07 Ji Won Yoon , Nial Friel

Physics-informed neural networks (PINNs) have recently emerged as an alternative way of solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In…

Analysis of PDEs · Mathematics 2019-09-04 Dongkun Zhang , Lu Lu , Ling Guo , George Em Karniadakis

Deep Neural Networks (DNN) are increasingly used as components of larger software systems that need to process complex data, such as images, written texts, audio/video signals. DNN predictions cannot be assumed to be always correct for…

Software Engineering · Computer Science 2022-12-15 Michael Weiss , Paolo Tonella

Deep neural networks has been increasingly applied in fault diagnostics, where it uses historical data to capture systems behavior, bypassing the need for high-fidelity physical models. However, despite their competence in prediction tasks,…

Machine Learning · Computer Science 2025-09-24 Arman Mohammadi , Mattias Krysander , Daniel Jung , Erik Frisk

Recent studies have shown that ensemble approaches could not only improve accuracy and but also estimate model uncertainty in deep learning. However, it requires a large number of parameters according to the increase of ensemble models for…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Hong Joo Lee , Seong Tae Kim , Hakmin Lee , Nassir Navab , Yong Man Ro

Bayesian Neural Networks (BNNs) provide principled uncertainty quantification but suffer from substantial computational and memory overhead compared to deterministic networks. While quantization techniques have successfully reduced resource…

Machine Learning · Computer Science 2025-12-12 Hendrik Borras , Yong Wu , Bernhard Klein , Holger Fröning

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

Machine Learning · Statistics 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

Uncertainty estimation is pivotal in machine learning, especially for classification tasks, as it improves the robustness and reliability of models. We introduce a novel `Epistemic Wrapping' methodology aimed at improving uncertainty…

Ensemble forecasting is, so far, the most successful approach to produce relevant forecasts with an estimation of their uncertainty. The main limitations of ensemble forecasting are the high computational cost and the difficulty to capture…

Machine Learning · Computer Science 2022-12-21 Maximiliano A. Sacco , Juan J. Ruiz , Manuel Pulido , Pierre Tandeo